1
|
Khalafi P, Morsali S, Hamidi S, Ashayeri H, Sobhi N, Pedrammehr S, Jafarizadeh A. Artificial intelligence in stroke risk assessment and management via retinal imaging. Front Comput Neurosci 2025; 19:1490603. [PMID: 40034651 PMCID: PMC11872910 DOI: 10.3389/fncom.2025.1490603] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2024] [Accepted: 01/10/2025] [Indexed: 03/05/2025] Open
Abstract
Retinal imaging, used for assessing stroke-related retinal changes, is a non-invasive and cost-effective method that can be enhanced by machine learning and deep learning algorithms, showing promise in early disease detection, severity grading, and prognostic evaluation in stroke patients. This review explores the role of artificial intelligence (AI) in stroke patient care, focusing on retinal imaging integration into clinical workflows. Retinal imaging has revealed several microvascular changes, including a decrease in the central retinal artery diameter and an increase in the central retinal vein diameter, both of which are associated with lacunar stroke and intracranial hemorrhage. Additionally, microvascular changes, such as arteriovenous nicking, increased vessel tortuosity, enhanced arteriolar light reflex, decreased retinal fractals, and thinning of retinal nerve fiber layer are also reported to be associated with higher stroke risk. AI models, such as Xception and EfficientNet, have demonstrated accuracy comparable to traditional stroke risk scoring systems in predicting stroke risk. For stroke diagnosis, models like Inception, ResNet, and VGG, alongside machine learning classifiers, have shown high efficacy in distinguishing stroke patients from healthy individuals using retinal imaging. Moreover, a random forest model effectively distinguished between ischemic and hemorrhagic stroke subtypes based on retinal features, showing superior predictive performance compared to traditional clinical characteristics. Additionally, a support vector machine model has achieved high classification accuracy in assessing pial collateral status. Despite this advancements, challenges such as the lack of standardized protocols for imaging modalities, hesitance in trusting AI-generated predictions, insufficient integration of retinal imaging data with electronic health records, the need for validation across diverse populations, and ethical and regulatory concerns persist. Future efforts must focus on validating AI models across diverse populations, ensuring algorithm transparency, and addressing ethical and regulatory issues to enable broader implementation. Overcoming these barriers will be essential for translating this technology into personalized stroke care and improving patient outcomes.
Collapse
Affiliation(s)
- Parsa Khalafi
- School of Medicine, Tehran University of Medical Sciences, Tehran, Iran
| | - Soroush Morsali
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Tabriz USERN Office, Universal Scientific Education and Research Network (USERN), Tabriz, Iran
- Neuroscience Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Sana Hamidi
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Tabriz USERN Office, Universal Scientific Education and Research Network (USERN), Tabriz, Iran
| | - Hamidreza Ashayeri
- Student Research Committee, Tabriz University of Medical Sciences, Tabriz, Iran
- Neuroscience Research Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Navid Sobhi
- Nikookari Eye Center, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Siamak Pedrammehr
- Faculty of Design, Tabriz Islamic Art University, Tabriz, Iran
- Institute for Intelligent Systems Research and Innovation (IISRI), Deakin University, Geelong, VIC, Australia
| | - Ali Jafarizadeh
- Nikookari Eye Center, Tabriz University of Medical Sciences, Tabriz, Iran
| |
Collapse
|
2
|
Guo X, Cao X, Sun Q, Li H, Zhang Y, Sui Y. Prognostic Value of Apparent Diffusion Coefficient for Mechanical Thrombectomy in Patients with Acute Posterior Ischemic Stroke. World Neurosurg 2025; 194:123458. [PMID: 39577633 DOI: 10.1016/j.wneu.2024.11.041] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2024] [Accepted: 11/07/2024] [Indexed: 11/24/2024]
Abstract
BACKGROUND This study investigates the prognostic value of the apparent diffusion coefficient (ADC) in magnetic resonance imaging for patients with acute posterior circulation stroke (PCS) undergoing endovascular therapy (EVT). METHODS A retrospective analysis was conducted of patients with acute PCS from January 2017 to December 2021, confirmed by diffusion-weighted imaging (DWI)-ADC within 24 hours of onset. Patients were categorized based on their 3-month modified Rankin Scale score after EVT. Data on the National Institutes of Health Stroke Scale at admission, ADC value, and 3-month modified Rankin Scale score were collected. Multivariable logistic regression analyzed the impact of various factors on ADC values. The receiver operating characteristic curve assessed predictive indices. RESULTS Among 94 patients, 47 had a good prognosis and 47 had a poor prognosis. Univariate analysis showed that factors significantly associated with a good prognosis included lower National Institutes of Health Stroke Scale at admission, higher ADC values, smaller infarct areas, unilateral infarction, basilar artery occlusion, lower pons-midbrain-thalamus scores, intravenous thrombolysis, intra-arterial thrombolysis, and fewer perioperative complications (P < 0.05). Multivariable logistic regression identified high ADC values (P = 0.002) and unilateral infarction (P = 0.017) as independent predictive factors for prognosis. An ADC value >549 × 10-6 mm2/second was associated with a higher rate of good prognosis. Combining ADC values with unilateral infarction resulted in the highest area under the curve and Youden Index of 0.766, with sensitivity and specificity of 89.36% and 87.23%, respectively (P < 0.05). CONCLUSIONS High ADC values and unilateral infarction are independent predictive factors for the prognosis of patients with PCS after EVT. Combining these factors provides the highest predictive accuracy, aiding in clinical decision making for PCS treatment.
Collapse
Affiliation(s)
- Xinze Guo
- Department of Neurology, Shenyang First People's Hospital, Shenyang, China
| | - Xiaopan Cao
- Department of Neurology, Shenyang First People's Hospital, Shenyang, China
| | - Qian Sun
- Department of Neurology, Shenyang First People's Hospital, Shenyang, China
| | - Honghao Li
- Department of Neurology, Shenyang First People's Hospital, Shenyang, China
| | - Yang Zhang
- School of Public Health, China Medical University, Shenyang, China
| | - Yi Sui
- Department of Neurology, Shenyang First People's Hospital, Shenyang, China; Shenyang Medical College, Shenyang, China.
| |
Collapse
|
3
|
Wang Z, Yang W, Li Z, Rong Z, Wang X, Han J, Ma L. A 25-Year Retrospective of the Use of AI for Diagnosing Acute Stroke: Systematic Review. J Med Internet Res 2024; 26:e59711. [PMID: 39255472 PMCID: PMC11422733 DOI: 10.2196/59711] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/20/2024] [Revised: 06/25/2024] [Accepted: 07/15/2024] [Indexed: 09/12/2024] Open
Abstract
BACKGROUND Stroke is a leading cause of death and disability worldwide. Rapid and accurate diagnosis is crucial for minimizing brain damage and optimizing treatment plans. OBJECTIVE This review aims to summarize the methods of artificial intelligence (AI)-assisted stroke diagnosis over the past 25 years, providing an overview of performance metrics and algorithm development trends. It also delves into existing issues and future prospects, intending to offer a comprehensive reference for clinical practice. METHODS A total of 50 representative articles published between 1999 and 2024 on using AI technology for stroke prevention and diagnosis were systematically selected and analyzed in detail. RESULTS AI-assisted stroke diagnosis has made significant advances in stroke lesion segmentation and classification, stroke risk prediction, and stroke prognosis. Before 2012, research mainly focused on segmentation using traditional thresholding and heuristic techniques. From 2012 to 2016, the focus shifted to machine learning (ML)-based approaches. After 2016, the emphasis moved to deep learning (DL), which brought significant improvements in accuracy. In stroke lesion segmentation and classification as well as stroke risk prediction, DL has shown superiority over ML. In stroke prognosis, both DL and ML have shown good performance. CONCLUSIONS Over the past 25 years, AI technology has shown promising performance in stroke diagnosis.
Collapse
Affiliation(s)
| | | | | | - Ze Rong
- Nantong University, Nantong, China
| | | | | | - Lei Ma
- Nantong University, Nantong, China
| |
Collapse
|
4
|
Wang X, Zhang J, Xie SQ, Shi C, Li J, Zhang ZQ. Quantitative Upper Limb Impairment Assessment for Stroke Rehabilitation: A Review. IEEE SENSORS JOURNAL 2024; 24:7432-7447. [DOI: 10.1109/jsen.2024.3359811] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/03/2025]
Affiliation(s)
- Xin Wang
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| | - Jie Zhang
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| | - Sheng Quan Xie
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| | - Chaoyang Shi
- Key Laboratory of Mechanism Theory and Equipment Design of Ministry of Education, School of Mechanical Engineering, Tianjin University, Tianjin, China
| | - Jun Li
- College of Intelligent Systems Science and Engineering, Hubei Minzu University, Enshi, China
| | - Zhi-Qiang Zhang
- School of Electrical and Electronic Engineering, University of Leeds, Leeds, U.K
| |
Collapse
|
5
|
Mu S, Lu W, Yu G, Zheng L, Qiu J. Deep learning-based grading of white matter hyperintensities enables identification of potential markers in multi-sequence MRI data. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2024; 243:107904. [PMID: 37924768 DOI: 10.1016/j.cmpb.2023.107904] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 03/13/2023] [Revised: 10/06/2023] [Accepted: 10/27/2023] [Indexed: 11/06/2023]
Abstract
BACKGROUND White matter hyperintensities (WMHs) are widely-seen in the aging population, which are associated with cerebrovascular risk factors and age-related cognitive decline. At present, structural atrophy and functional alterations coexisted with WMHs lacks comprehensive investigation. This study developed a WMHs risk prediction model to evaluate WHMs according to Fazekas scales, and to locate potential regions with high risks across the entire brain. METHODS We developed a WMHs risk prediction model, which consisted of the following steps: T2 fluid attenuated inversion recovery (T2-FLAIR) image of each participant was firstly segmented into 1000 tiles with the size of 32 × 32 × 1, features from the tiles were extracted using the ResNet18-based feature extractor, and then a 1D convolutional neural network (CNN) was used to score all tiles based on the extracted features. Finally, a multi-layer perceptron (MLP) was constructed to predict the Fazekas scales based on the tile scores. The proposed model was trained using T2-FLAIR images, we selected tiles with abnormal scores in the test set after prediction, and evaluated their corresponding gray matter (GM) volume, white matter (WM) volume, fractional anisotropy (FA), mean diffusivity (MD), and cerebral blood flow (CBF) via longitudinal and multi-sequence Magnetic Resonance Imaging (MRI) data analysis. RESULTS The proposed WMHs risk prediction model could accurately predict the Fazekas ratings based on the tile scores from T2-FLAIR MRI images with accuracy of 0.656, 0.621 in training data set and test set, respectively. The longitudinal MRI validation revealed that most of the high-risk tiles predicted by the WMHs risk prediction model in the baseline images had WMHs in the corresponding positions in the longitudinal images. The validation on multi-sequence MRI demonstrated that WMHs were associated with GM and WM atrophies, WM micro-structural and perfusion alterations in high-risk tiles, and multi-modal MRI measures of most high-risk tiles showed significant associations with Mini Mental State Examination (MMSE) score. CONCLUSION Our proposed WMHs risk prediction model can not only accurately evaluate WMH severities according to Fazekas scales, but can also uncover potential markers of WMHs across modalities. The WMHs risk prediction model has the potential to be used for the early detection of WMH-related alterations in the entire brain and WMH-induced cognitive decline.
Collapse
Affiliation(s)
- Si Mu
- College of Mechanical and Electronic Engineering, Shandong Agricultural University, Tai'an, Shandong, 271000, China
| | - Weizhao Lu
- Department of Radiology, the Second Affiliated Hospital of Shandong First Medical University, Tai'an, Shandong, 271000, China
| | - Guanghui Yu
- Department of Radiology, the Second Affiliated Hospital of Shandong First Medical University, Tai'an, Shandong, 271000, China
| | - Lei Zheng
- Department of Radiology, Rushan Hospital of Chinese Medicine, Rushan, Shandong, 264500, China.
| | - Jianfeng Qiu
- School of Radiology, Shandong First Medical University & Shandong Academy of Medicine Sciences, Tai'an, Shandong, 271000, China; Science and Technology Innovation Center, Shandong First Medical University & Shandong Academy of Medical Sciences, Jinan, 250000, China.
| |
Collapse
|
6
|
Dang T, Fermin ASR, Machizawa MG. oFVSD: a Python package of optimized forward variable selection decoder for high-dimensional neuroimaging data. Front Neuroinform 2023; 17:1266713. [PMID: 37829329 PMCID: PMC10566623 DOI: 10.3389/fninf.2023.1266713] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 09/08/2023] [Indexed: 10/14/2023] Open
Abstract
The complexity and high dimensionality of neuroimaging data pose problems for decoding information with machine learning (ML) models because the number of features is often much larger than the number of observations. Feature selection is one of the crucial steps for determining meaningful target features in decoding; however, optimizing the feature selection from such high-dimensional neuroimaging data has been challenging using conventional ML models. Here, we introduce an efficient and high-performance decoding package incorporating a forward variable selection (FVS) algorithm and hyper-parameter optimization that automatically identifies the best feature pairs for both classification and regression models, where a total of 18 ML models are implemented by default. First, the FVS algorithm evaluates the goodness-of-fit across different models using the k-fold cross-validation step that identifies the best subset of features based on a predefined criterion for each model. Next, the hyperparameters of each ML model are optimized at each forward iteration. Final outputs highlight an optimized number of selected features (brain regions of interest) for each model with its accuracy. Furthermore, the toolbox can be executed in a parallel environment for efficient computation on a typical personal computer. With the optimized forward variable selection decoder (oFVSD) pipeline, we verified the effectiveness of decoding sex classification and age range regression on 1,113 structural magnetic resonance imaging (MRI) datasets. Compared to ML models without the FVS algorithm and with the Boruta algorithm as a variable selection counterpart, we demonstrate that the oFVSD significantly outperformed across all of the ML models over the counterpart models without FVS (approximately 0.20 increase in correlation coefficient, r, with regression models and 8% increase in classification models on average) and with Boruta variable selection algorithm (approximately 0.07 improvement in regression and 4% in classification models). Furthermore, we confirmed the use of parallel computation considerably reduced the computational burden for the high-dimensional MRI data. Altogether, the oFVSD toolbox efficiently and effectively improves the performance of both classification and regression ML models, providing a use case example on MRI datasets. With its flexibility, oFVSD has the potential for many other modalities in neuroimaging. This open-source and freely available Python package makes it a valuable toolbox for research communities seeking improved decoding accuracy.
Collapse
Affiliation(s)
- Tung Dang
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
- Graduate School of Agricultural and Life Sciences, The University of Tokyo, Tokyo, Japan
| | - Alan S. R. Fermin
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
| | - Maro G. Machizawa
- Center for Brain, Mind, and KANSEI Sciences Research, Hiroshima University, Hiroshima, Japan
| |
Collapse
|
7
|
Khezrpour S, Seyedarabi H, Razavi SN, Farhoudi M. Automatic segmentation of the brain stroke lesions from MR flair scans using improved U-net framework. Biomed Signal Process Control 2022. [DOI: 10.1016/j.bspc.2022.103978] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/25/2022]
|
8
|
Indirect Volume Estimation for Acute Ischemic Stroke from Diffusion Weighted Image Using Slice Image Segmentation. J Pers Med 2022; 12:jpm12040521. [PMID: 35455637 PMCID: PMC9031505 DOI: 10.3390/jpm12040521] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/20/2022] [Revised: 03/16/2022] [Accepted: 03/21/2022] [Indexed: 02/05/2023] Open
Abstract
The accurate estimation of acute ischemic stroke (AIS) using diffusion-weighted imaging (DWI) is crucial for assessing patients and guiding treatment options. This study aimed to propose a method that estimates AIS volume in DWI objectively, quickly, and accurately. We used a dataset of DWI with AIS, including 2159 participants (1179 for internal validation and 980 for external validation) with various types of AIS. We constructed algorithms using 3D segmentation (direct estimation) and 2D segmentation (indirect estimation) and compared their performances with those annotated by neurologists. The proposed pretrained indirect model demonstrated higher segmentation performance than the direct model, with a sensitivity, specificity, F1-score, and Jaccard index of 75.0%, 77.9%, 76.0, and 62.1%, respectively, for internal validation, and 72.8%, 84.3%, 77.2, and 63.8%, respectively, for external validation. Volume estimation was more reliable for the indirect model, with 93.3% volume similarity (VS), 0.797 mean absolute error (MAE) for internal validation, VS of 89.2% and a MAE of 2.5% for external validation. These results suggest that the indirect model using 2D segmentation developed in this study can provide an accurate estimation of volume from DWI of AIS and may serve as a supporting tool to help physicians make crucial clinical decisions.
Collapse
|
9
|
Bridge CP, Bizzo BC, Hillis JM, Chin JK, Comeau DS, Gauriau R, Macruz F, Pawar J, Noro FTC, Sharaf E, Straus Takahashi M, Wright B, Kalafut JF, Andriole KP, Pomerantz SR, Pedemonte S, González RG. Development and clinical application of a deep learning model to identify acute infarct on magnetic resonance imaging. Sci Rep 2022; 12:2154. [PMID: 35140277 PMCID: PMC8828773 DOI: 10.1038/s41598-022-06021-0] [Citation(s) in RCA: 10] [Impact Index Per Article: 3.3] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/22/2021] [Accepted: 01/18/2022] [Indexed: 11/09/2022] Open
Abstract
Stroke is a leading cause of death and disability. The ability to quickly identify the presence of acute infarct and quantify the volume on magnetic resonance imaging (MRI) has important treatment implications. We developed a machine learning model that used the apparent diffusion coefficient and diffusion weighted imaging series. It was trained on 6,657 MRI studies from Massachusetts General Hospital (MGH; Boston, USA). All studies were labelled positive or negative for infarct (classification annotation) with 377 having the region of interest outlined (segmentation annotation). The different annotation types facilitated training on more studies while not requiring the extensive time to manually segment every study. We initially validated the model on studies sequestered from the training set. We then tested the model on studies from three clinical scenarios: consecutive stroke team activations for 6-months at MGH, consecutive stroke team activations for 6-months at a hospital that did not provide training data (Brigham and Women’s Hospital [BWH]; Boston, USA), and an international site (Diagnósticos da América SA [DASA]; Brazil). The model results were compared to radiologist ground truth interpretations. The model performed better when trained on classification and segmentation annotations (area under the receiver operating curve [AUROC] 0.995 [95% CI 0.992–0.998] and median Dice coefficient for segmentation overlap of 0.797 [IQR 0.642–0.861]) compared to segmentation annotations alone (AUROC 0.982 [95% CI 0.972–0.990] and Dice coefficient 0.776 [IQR 0.584–0.857]). The model accurately identified infarcts for MGH stroke team activations (AUROC 0.964 [95% CI 0.943–0.982], 381 studies), BWH stroke team activations (AUROC 0.981 [95% CI 0.966–0.993], 247 studies), and at DASA (AUROC 0.998 [95% CI 0.993–1.000], 171 studies). The model accurately segmented infarcts with Pearson correlation comparing model output and ground truth volumes between 0.968 and 0.986 for the three scenarios. Acute infarct can be accurately detected and segmented on MRI in real-world clinical scenarios using a machine learning model.
Collapse
Affiliation(s)
- Christopher P Bridge
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA.,Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, USA.,Harvard Medical School, Boston, USA.,Department of Radiology, Massachusetts General Hospital, Boston, USA
| | - Bernardo C Bizzo
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA. .,Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, USA. .,Harvard Medical School, Boston, USA. .,Department of Radiology, Massachusetts General Hospital, Boston, USA. .,Diagnósticos da América SA, São Paulo, Brazil. .,MGH & BWH Center for Clinical Data Science, Mass General Brigham, Suite 1303, Floor 13, 100 Cambridge St, Boston, MA, 02114, USA.
| | - James M Hillis
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA.,Harvard Medical School, Boston, USA.,Department of Neurology, Massachusetts General Hospital, Boston, USA
| | - John K Chin
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | - Donnella S Comeau
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | - Romane Gauriau
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | - Fabiola Macruz
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | - Jayashri Pawar
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | - Flavia T C Noro
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | - Elshaimaa Sharaf
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | | | - Bradley Wright
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | | | - Katherine P Andriole
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA.,Harvard Medical School, Boston, USA.,Department of Radiology, Brigham and Women's Hospital, Boston, USA
| | - Stuart R Pomerantz
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA.,Harvard Medical School, Boston, USA.,Department of Radiology, Massachusetts General Hospital, Boston, USA
| | - Stefano Pedemonte
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA
| | - R Gilberto González
- MGH & BWH Center for Clinical Data Science, Mass General Brigham, Boston, USA.,Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General Hospital, Boston, USA.,Harvard Medical School, Boston, USA.,Department of Radiology, Massachusetts General Hospital, Boston, USA
| |
Collapse
|
10
|
Zhao Y, Chen Y, Chen Y, Zhang L, Wang X, He X. A Fully Convolutional Network (FCN) based Automated Ischemic Stroke Segment Method using Chemical Exchange Saturation Transfer Imaging. Med Phys 2022; 49:1635-1647. [PMID: 35083756 DOI: 10.1002/mp.15483] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/20/2021] [Revised: 12/26/2021] [Accepted: 01/02/2022] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND Chemical exchange saturation transfer (CEST) MRI is a promising imaging modality in ischemic stroke detection for its sensitivity in sensing post-ischemic pH alteration. However, the accurate segmentation of pH-altered regions remains difficult due to the complicated sources in water signal changes of CEST MRI. Meanwhile, manual localization and quantification of stroke lesions are laborious and time-consuming, which cannot meet the urgent need for timely therapeutic interventions. PURPOSE The goal of this study was to develop an automatic lesion segmentation approach of ischemic region based on CEST MR images. A novel segmentation framework based on fully convolutional neural network was investigated for our task. METHODS Z-spectra from 10 rats were manually labeled as ground truth and split into two datasets, where the training dataset including 3 rats was used to generate a segmentation model, and the remaining rats were used as test datasets to evaluate the model's performance. Then a 1-D fully convolutional neural network equipped with bottleneck structures was set up, and a Grad-CAM approach was used to produce a coarse localization map, which can reflect the relevancy to the 'ischemia' class of each pixel. RESULTS As compared with the ground truth, the proposed network model achieved satisfying segmentation results with high values of evaluation metrics including specificity (SPE), sensitivity (SEN), accuracy (ACC), and Dice similarity coefficient (DSC), especially in some intractable situations where conventional MRI modalities and CEST quantitative method failed to distinguish between ischemic and normal tissues, and the model with augmentation was robust to input perturbations. The Grad-CAM maps performed clear tissue change distributions and interpreted the segmentations, and showed a strong correlation with the quantitative method, gave extended thinking to the function of networks. CONCLUSIONS The proposed method can segment ischemia region from CEST images, with the Grad-CAM maps give access to interpretative information about the segmentations, which demonstrates great potential in clinical routines. This article is protected by copyright. All rights reserved.
Collapse
Affiliation(s)
- Yingcheng Zhao
- Xi'an Key Lab of Radiomics and Intelligent Perception, School of Information Sciences and Technology, Northwest University, Xi'an, Shaanxi, 710069, China
| | - Yibing Chen
- Xi'an Key Lab of Radiomics and Intelligent Perception, School of Information Sciences and Technology, Northwest University, Xi'an, Shaanxi, 710069, China
| | - Yanrong Chen
- Xi'an Key Lab of Radiomics and Intelligent Perception, School of Information Sciences and Technology, Northwest University, Xi'an, Shaanxi, 710069, China
| | - Lihong Zhang
- College of Computer Science and Technology (Software College), Henan Polytechnic University, Jiaozuo, Henan, 454003, China
| | - Xiaoli Wang
- Department of Medical Imaging, Weifang Medical University, Weifang, 261053, China
| | - Xiaowei He
- Xi'an Key Lab of Radiomics and Intelligent Perception, School of Information Sciences and Technology, Northwest University, Xi'an, Shaanxi, 710069, China
| |
Collapse
|
11
|
Automated Extraction of Cerebral Infarction Region in Head MR Image Using Pseudo Cerebral Infarction Image by CycleGAN. APPLIED SCIENCES-BASEL 2022. [DOI: 10.3390/app12010489] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 02/01/2023]
Abstract
Since recognizing the location and extent of infarction is essential for diagnosis and treatment, many methods using deep learning have been reported. Generally, deep learning requires a large amount of training data. To overcome this problem, we generated pseudo patient images using CycleGAN, which performed image transformation without paired images. Then, we aimed to improve the extraction accuracy by using the generated images for the extraction of cerebral infarction regions. First, we used CycleGAN for data augmentation. Pseudo-cerebral infarction images were generated from healthy images using CycleGAN. Finally, U-Net was used to segment the cerebral infarction region using CycleGAN-generated images. Regarding the extraction accuracy, the Dice index was 0.553 for U-Net with CycleGAN, which was an improvement over U-Net without CycleGAN. Furthermore, the number of false positives per case was 3.75 for U-Net without CycleGAN and 1.23 for U-Net with CycleGAN, respectively. The number of false positives was reduced by approximately 67% by introducing the CycleGAN-generated images to training cases. These results indicate that utilizing CycleGAN-generated images was effective and facilitated the accurate extraction of the infarcted regions while maintaining the detection rate.
Collapse
|
12
|
Werdiger F, Bivard A, Parsons M. Artificial Intelligence in Acute Ischemic Stroke. Artif Intell Med 2022. [DOI: 10.1007/978-3-030-64573-1_287] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
13
|
|
14
|
Yu H, Wang Z, Sun Y, Bo W, Duan K, Song C, Hu Y, Zhou J, Mu Z, Wu N. Prognosis of ischemic stroke predicted by machine learning based on multi-modal MRI radiomics. Front Psychiatry 2022; 13:1105496. [PMID: 36699499 PMCID: PMC9868394 DOI: 10.3389/fpsyt.2022.1105496] [Citation(s) in RCA: 16] [Impact Index Per Article: 5.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 11/22/2022] [Accepted: 12/12/2022] [Indexed: 01/10/2023] Open
Abstract
OBJECTIVE Increased risk of stroke is highly associated with psychiatric disorders. We aimed to conduct the machine learning model based on multi-modal magnetic resonance imaging (MRI) radiomics predicting the prognosis of ischemic stroke. METHODS This study retrospectively analyzed 148 patients with acute ischemic stroke due to anterior circulation artery occlusion. Based on the modified Rankin Scale (mRS) score, patients were divided into good (mRS ≤ 2) and poor (mRS > 2) outcome groups. Segmentation of the infarct region was performed by manually outlining a mask of the lesion on diffusion-weighted images (DWI) using MRIcron software. The apparent diffusion coefficient (ADC), fluid decay inversion recoverage (FLAIR), susceptibility weighted imaging (SWI) and T1-weighted (T1w) images were aligned to the DWI images and the radiomic features within the lesion area were extracted for each image modality. The calculations were done using pyradiomics software and a total of 4,744 stroke-related imaging features were automatically calculated. Next, feature selection based on recursive feature elimination was used for each modality and three radiomic features were extracted from each modality plus one feature from the lesion mask, for a total of 16 radiomic features. At last, five machine learning (ML) models were trained and tested to predict stroke prognosis, calculate the received operating characteristic (ROC) curves and other parameters, evaluate the performance of the models and validate their predictive efficacy by five-fold cross-validation. RESULTS Sixteen radiomic features were selected to construct the ML models for prognostic classification. By five-fold cross-validation, light gradient boosting machine (LightGBM) model-based muti-modal MRI radiomic features performed best in binary prognostic classification with accuracy of 0.831, sensitivity of 0.739, specificity of 0.902, F1-score of 0.788 and an area under the curve (AUC) of 0.902. CONCLUSION The ML models based on muti-modal MRI radiomics are of high value for predicting clinical outcomes in acute stroke patients.
Collapse
Affiliation(s)
- Huan Yu
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Zhenwei Wang
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Yiqing Sun
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Wenwei Bo
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Kai Duan
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Chunhua Song
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Yi Hu
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Jie Zhou
- Department of Radiology, Liangxiang Hospital, Beijing, China
| | - Zizhang Mu
- Department of Neurology, Liangxiang Hospital, Beijing, China
| | - Ning Wu
- Department of Medical Imaging, Yanjing Medical College, Capital Medical University, Beijing, China
| |
Collapse
|
15
|
Dey N, V. R. Magnetic resonance imaging: recording and reconstruction. Magn Reson Imaging 2022. [DOI: 10.1016/b978-0-12-823401-3.00003-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/19/2022]
|
16
|
Inamdar MA, Raghavendra U, Gudigar A, Chakole Y, Hegde A, Menon GR, Barua P, Palmer EE, Cheong KH, Chan WY, Ciaccio EJ, Acharya UR. A Review on Computer Aided Diagnosis of Acute Brain Stroke. SENSORS (BASEL, SWITZERLAND) 2021; 21:8507. [PMID: 34960599 PMCID: PMC8707263 DOI: 10.3390/s21248507] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 10/04/2021] [Revised: 12/05/2021] [Accepted: 12/09/2021] [Indexed: 01/01/2023]
Abstract
Amongst the most common causes of death globally, stroke is one of top three affecting over 100 million people worldwide annually. There are two classes of stroke, namely ischemic stroke (due to impairment of blood supply, accounting for ~70% of all strokes) and hemorrhagic stroke (due to bleeding), both of which can result, if untreated, in permanently damaged brain tissue. The discovery that the affected brain tissue (i.e., 'ischemic penumbra') can be salvaged from permanent damage and the bourgeoning growth in computer aided diagnosis has led to major advances in stroke management. Abiding to the Preferred Reporting Items for Systematic Review and Meta-Analyses (PRISMA) guidelines, we have surveyed a total of 177 research papers published between 2010 and 2021 to highlight the current status and challenges faced by computer aided diagnosis (CAD), machine learning (ML) and deep learning (DL) based techniques for CT and MRI as prime modalities for stroke detection and lesion region segmentation. This work concludes by showcasing the current requirement of this domain, the preferred modality, and prospective research areas.
Collapse
Affiliation(s)
- Mahesh Anil Inamdar
- Department of Mechatronics, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India;
| | - Udupi Raghavendra
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (Y.C.)
| | - Anjan Gudigar
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (Y.C.)
| | - Yashas Chakole
- Department of Instrumentation and Control Engineering, Manipal Institute of Technology, Manipal Academy of Higher Education, Manipal 576104, India; (A.G.); (Y.C.)
| | - Ajay Hegde
- Department of Neurosurgery, Kasturba Medical College, Manipal Academy of Higher Education, Manipal 576104, India; (A.H.); (G.R.M.)
| | - Girish R. Menon
- Department of Neurosurgery, Kasturba Medical College, Manipal Academy of Higher Education, Manipal 576104, India; (A.H.); (G.R.M.)
| | - Prabal Barua
- School of Management & Enterprise, University of Southern Queensland, Toowoomba, QLD 4350, Australia;
- Faculty of Engineering and Information Technology, University of Technology, Sydney, NSW 2007, Australia
- Cogninet Brain Team, Cogninet Australia, Sydney, NSW 2010, Australia
| | - Elizabeth Emma Palmer
- School of Women’s and Children’s Health, University of New South Wales, Sydney, NSW 2052, Australia;
| | - Kang Hao Cheong
- Science, Mathematics and Technology Cluster, Singapore University of Technology and Design, Singapore 487372, Singapore;
| | - Wai Yee Chan
- Department of Biomedical Imaging, Research Imaging Centre, University of Malaya, Kuala Lumpur 59100, Malaysia;
| | - Edward J. Ciaccio
- Department of Medicine, Columbia University, New York, NY 10032, USA;
| | - U. Rajendra Acharya
- Department of Biomedical Engineering, Faculty of Engineering, University of Malaya, Kuala Lumpur 50603, Malaysia;
- School of Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore
- Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore 599491, Singapore
- Department of Biomedical Informatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
| |
Collapse
|
17
|
An Q, Yang N, Yamakawa H, Kogami H, Yoshida K, Wang R, Yamashita A, Asama H, Ishiguro S, Shimoda S, Yamasaki H, Yokoyama M, Alnajjar F, Hattori N, Takahashi K, Fujii T, Otomune H, Miyai I, Kurazume R. Classification of Motor Impairments of Post-Stroke Patients Based on Force Applied to a Handrail. IEEE Trans Neural Syst Rehabil Eng 2021; 29:2399-2406. [PMID: 34762588 DOI: 10.1109/tnsre.2021.3127504] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Many patients suffer from declined motor abilities after a brain injury. To provide appropriate rehabilitation programs and encourage motor-impaired patients to participate further in rehabilitation, sufficient and easy evaluation methodologies are necessary. This study is focused on the sit-to-stand motion of post-stroke patients because it is an important daily activity. Our previous study utilized muscle synergies (synchronized muscle activation) to classify the degree of motor impairment in patients and proposed appropriate rehabilitation methodologies. However, in our previous study, the patient was required to attach electromyography sensors to his/her body; thus, it was difficult to evaluate motor ability in daily circumstances. Here, we developed a handrail-type sensor that can measure the force applied to it. Using temporal features of the force data, the relationship between the degree of motor impairment and temporal features was clarified, and a classification model was developed using a random forest model to determine the degree of motor impairment in hemiplegic patients. The results show that hemiplegic patients with severe motor impairments tend to apply greater force to the handrail and use the handrail for a longer period. It was also determined that patients with severe motor impairments did not move forward while standing up, but relied more on the handrail to pull their upper body upward as compared to patients with moderate impairments. Furthermore, based on the developed classification model, patients were successfully classified as having severe or moderate impairments. The developed classification model can also detect long-term patient recovery. The handrail-type sensor does not require additional sensors on the patient's body and provides an easy evaluation methodology.
Collapse
|
18
|
Ben Alaya I, Limam H, Kraiem T. Applications of artificial intelligence for DWI and PWI data processing in acute ischemic stroke: Current practices and future directions. Clin Imaging 2021; 81:79-86. [PMID: 34649081 DOI: 10.1016/j.clinimag.2021.09.015] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/10/2021] [Revised: 09/05/2021] [Accepted: 09/22/2021] [Indexed: 11/03/2022]
Abstract
Multimodal Magnetic Resonance Imaging (MRI) techniques of Perfusion-Weighted Imaging (PWI) and Diffusion-Weighted Imaging (DWI) data are integral parts of the diagnostic workup in the acute stroke setting. The visual interpretation of PWI/DWI data is the most likely procedure to triage Acute Ischemic Stroke (AIS) patients who will access reperfusion therapy, especially in those exceeding 6 h of stroke onset. In fact, this process defines two classes of tissue: the ischemic core, which is presumed to be irreversibly damaged, visualized on DWI data and the penumbra which is the reversibly injured brain tissue around the ischemic tissue, visualized on PWI data. AIS patients with a large ischemic penumbra and limited infarction core have a high probability of benefiting from endovascular treatment. However, it is a tedious and time-consuming procedure. Consequently, it is subject to high inter- and intra-observer variability. Thus, the assessment of the potential risks and benefits of endovascular treatment is uncertain. Fast, accurate and automatic post-processing of PWI and DWI data is important for clinical diagnosis and is necessary to help the decision making for therapy. Therefore, an automated procedure that identifies stroke slices, stroke hemisphere, segments stroke regions in DWI, and measures hypoperfused tissue in PWI enhances considerably the reproducibility and the accuracy of stroke assessment. In this work, we draw an overview of several applications of Artificial Intelligence (AI) for the automation processing and their potential contributions in clinical practices. We compare the current approaches among each other's with respect to some key requirements.
Collapse
Affiliation(s)
- Ines Ben Alaya
- Tunis El Manar University, Higher Institute of Medical Technology of Tunis, Laboratory of Biophysics and Medical Technology, 1006 Tunis, Tunisia.
| | - Hela Limam
- Université de Tunis El Manar, Institut Supérieur d'Informatique, Institut Supérieur de Gestion de Tunis, Laboratoire BestMod, 1002 Tunis, Tunisie.
| | - Tarek Kraiem
- Tunis El Manar University, Higher Institute of Medical Technology of Tunis, Laboratory of Biophysics and Medical Technology, 1006 Tunis, Tunisia.
| |
Collapse
|
19
|
MCA-DN: Multi-path convolution leveraged attention deep network for salvageable tissue detection in ischemic stroke from multi-parametric MRI. Comput Biol Med 2021; 136:104724. [PMID: 34388469 DOI: 10.1016/j.compbiomed.2021.104724] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 07/16/2021] [Accepted: 07/30/2021] [Indexed: 11/24/2022]
Abstract
BACKGROUND AND OBJECTIVE Accurate and timely treatment of ischemic stroke can restore the blood flow in the affected area and reduce the risk of disability and death. Identification and localisation of both direct and collateral blood flow restriction from MRI using computational intelligence play a crucial role in assisting manual diagnosis decisions in stroke treatment. METHOD A novel multi-path convolution leveraged attention based deep network (MCA-DN) is proposed to address this challenge. MCA-DN combines multi-path convolution derived attention making different weighted filters in each attention convolution sub-path, with interactions on the same level of abstraction. This facilitates the network to focus on voxels with enhanced weighted activations, directing to a plausible lesion. Such a proposition of acquiring attention by embedding multiple filter paths, also prioritizes the selective activation of multi-parametric MRI sequences. The multi-path convolution assisted attention block allows the network layers to gain more insights on the input tensor, enabling the expansion of hypothesis search space with a controlled parameter count. RESULTS The algorithm is evaluated on 139 patients of 3 datasets with 4 sub-datasets, including 2 benchmarked challenge datasets of ISLES-2015, 2017. MCA-DN achieved parametric measures of Dice similarity coefficient: 77.3 %, sensitivity: 82.8 %, and specificity: 98.8 %, for stroke segmentation, outperforming the five state-of-the-art methods in the field with encouraging success. CONCLUSION Competitive performance of the MCA-DN demonstrates immense potential to assist patient-specific stroke treatment planning by estimating the benefit of reperfusion.
Collapse
|
20
|
Faust O, En Wei Koh J, Jahmunah V, Sabut S, Ciaccio EJ, Majid A, Ali A, Lip GYH, Acharya UR. Fusion of Higher Order Spectra and Texture Extraction Methods for Automated Stroke Severity Classification with MRI Images. INTERNATIONAL JOURNAL OF ENVIRONMENTAL RESEARCH AND PUBLIC HEALTH 2021; 18:8059. [PMID: 34360349 PMCID: PMC8345794 DOI: 10.3390/ijerph18158059] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 05/18/2021] [Revised: 07/05/2021] [Accepted: 07/23/2021] [Indexed: 11/18/2022]
Abstract
This paper presents a scientific foundation for automated stroke severity classification. We have constructed and assessed a system which extracts diagnostically relevant information from Magnetic Resonance Imaging (MRI) images. The design was based on 267 images that show the brain from individual subjects after stroke. They were labeled as either Lacunar Syndrome (LACS), Partial Anterior Circulation Syndrome (PACS), or Total Anterior Circulation Stroke (TACS). The labels indicate different physiological processes which manifest themselves in distinct image texture. The processing system was tasked with extracting texture information that could be used to classify a brain MRI image from a stroke survivor into either LACS, PACS, or TACS. We analyzed 6475 features that were obtained with Gray-Level Run Length Matrix (GLRLM), Higher Order Spectra (HOS), as well as a combination of Discrete Wavelet Transform (DWT) and Gray-Level Co-occurrence Matrix (GLCM) methods. The resulting features were ranked based on the p-value extracted with the Analysis Of Variance (ANOVA) algorithm. The ranked features were used to train and test four types of Support Vector Machine (SVM) classification algorithms according to the rules of 10-fold cross-validation. We found that SVM with Radial Basis Function (RBF) kernel achieves: Accuracy (ACC) = 93.62%, Specificity (SPE) = 95.91%, Sensitivity (SEN) = 92.44%, and Dice-score = 0.95. These results indicate that computer aided stroke severity diagnosis support is possible. Such systems might lead to progress in stroke diagnosis by enabling healthcare professionals to improve diagnosis and management of stroke patients with the same resources.
Collapse
Affiliation(s)
- Oliver Faust
- Department of Engineering and Mathematics, Sheffield Hallam University, Sheffield S1 1WB, UK
| | - Joel En Wei Koh
- School of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore; (J.E.W.K.); (V.J.); (U.R.A.)
| | - Vicnesh Jahmunah
- School of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore; (J.E.W.K.); (V.J.); (U.R.A.)
| | - Sukant Sabut
- School of Electronics Engineering, Kalinga Institute of Industrial Technology, Bhubaneswar, Odisha 751024, India;
| | - Edward J. Ciaccio
- Department of Medicine-Cardiology, Columbia University, New York, NY 10027, USA;
| | - Arshad Majid
- Sheffield Institute for Translational Neuroscience, University of Sheffield, Sheffield S10 2HQ, UK;
| | - Ali Ali
- Sheffield Teaching Hospitals NIHR Biomedical Research Centre, Sheffield S10 2JF, UK;
| | - Gregory Y. H. Lip
- Liverpool Centre for Cardiovascular Science, University of Liverpool and Liverpool Heart & Chest Hospital, Liverpool L69 7TX, UK;
- Aalborg Thrombosis Research Unit, Department of Clinical Medicine, Aalborg University, 9000 Aalborg, Denmark
| | - U. Rajendra Acharya
- School of Electronics and Computer Engineering, Ngee Ann Polytechnic, Singapore 599489, Singapore; (J.E.W.K.); (V.J.); (U.R.A.)
- School of Science and Technology, Singapore University of Social Sciences, 463 Clementi Road, Singapore 599494, Singapore
- Department of Bioinformatics and Medical Engineering, Asia University, Taichung 41354, Taiwan
- International Research Organization for Advanced Science and Technology (IROAST), Kumamoto University, Kumamoto 860-8555, Japan
| |
Collapse
|
21
|
Multi-view iterative random walker for automated salvageable tissue delineation in ischemic stroke from multi-sequence MRI. J Neurosci Methods 2021; 360:109260. [PMID: 34146591 DOI: 10.1016/j.jneumeth.2021.109260] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2021] [Revised: 05/19/2021] [Accepted: 06/13/2021] [Indexed: 12/13/2022]
Abstract
BACKGROUND AND OBJECTIVE Non-invasive and robust identification of salvageable tissue (penumbra) is crucial for interventional stroke therapy. Besides identifying stroke injury as a whole, the ability to automatically differentiate core and penumbra tissues, using both diffusion and perfusion magnetic resonance imaging (MRI) sequences is essential for ischemic stroke treatment. METHOD A fully automated and novel one-shot multi-view iterative random walker (MIRW) method with an automated injury seed point detection is developed for lesion delineation. MIRW utilizes the heirarchical decomposition of multi-sequence MRI physical properties of the underlying tissue within the lesion to maximize the inter-class variations of the volumetric histogram to estimate the probable seed points. These estimates are further utilized to conglomerate the lesion estimations iteratively from axial, coronal and sagittal MRI volumes for a computationally efficient segmentation and quantification of salvageable and necrotic tissues from multi-sequence MRI. RESULTS Comprehensive experimental analysis of MIRW is performed on three challenging adult(sub-)acute ischemic stroke datasets using performance measures like precision, sensitivity, specificity and Dice similarity score (DSC), which are computed with respect to the manual ground-truth. COMPARISON WITH EXISTING METHODS MIRW method resulted in a high DSC of 83.5% in a very less computational time of 98.23 s/volume, which is a significant improvement on the ISLES benchmark dataset for penumbra detection, compared to the state-of-the-art techniques. CONCLUSION Quantitative measures demonstrate the promising potential of MIRW for computational analysis of adult stroke and quantifying penumbra in stroke patients which is essential for selecting the good candidates for recanalization.
Collapse
|
22
|
Fernandez-Lozano C, Hervella P, Mato-Abad V, Rodríguez-Yáñez M, Suárez-Garaboa S, López-Dequidt I, Estany-Gestal A, Sobrino T, Campos F, Castillo J, Rodríguez-Yáñez S, Iglesias-Rey R. Random forest-based prediction of stroke outcome. Sci Rep 2021; 11:10071. [PMID: 33980906 PMCID: PMC8115135 DOI: 10.1038/s41598-021-89434-7] [Citation(s) in RCA: 47] [Impact Index Per Article: 11.8] [Reference Citation Analysis] [Abstract] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2020] [Accepted: 04/26/2021] [Indexed: 11/09/2022] Open
Abstract
We research into the clinical, biochemical and neuroimaging factors associated with the outcome of stroke patients to generate a predictive model using machine learning techniques for prediction of mortality and morbidity 3-months after admission. The dataset consisted of patients with ischemic stroke (IS) and non-traumatic intracerebral hemorrhage (ICH) admitted to Stroke Unit of a European Tertiary Hospital prospectively registered. We identified the main variables for machine learning Random Forest (RF), generating a predictive model that can estimate patient mortality/morbidity according to the following groups: (1) IS + ICH, (2) IS, and (3) ICH. A total of 6022 patients were included: 4922 (mean age 71.9 ± 13.8 years) with IS and 1100 (mean age 73.3 ± 13.1 years) with ICH. NIHSS at 24, 48 h and axillary temperature at admission were the most important variables to consider for evolution of patients at 3-months. IS + ICH group was the most stable for mortality prediction [0.904 ± 0.025 of area under the receiver operating characteristics curve (AUC)]. IS group presented similar results, although variability between experiments was slightly higher (0.909 ± 0.032 of AUC). ICH group was the one in which RF had more problems to make adequate predictions (0.9837 vs. 0.7104 of AUC). There were no major differences between IS and IS + ICH groups according to morbidity prediction (0.738 and 0.755 of AUC) but, after checking normality with a Shapiro Wilk test with the null hypothesis that the data follow a normal distribution, it was rejected with W = 0.93546 (p-value < 2.2e-16). Conditions required for a parametric test do not hold, and we performed a paired Wilcoxon Test assuming the null hypothesis that all the groups have the same performance. The null hypothesis was rejected with a value < 2.2e-16, so there are statistical differences between IS and ICH groups. In conclusion, machine learning algorithms RF can be effectively used in stroke patients for long-term outcome prediction of mortality and morbidity.
Collapse
Affiliation(s)
- Carlos Fernandez-Lozano
- Department of Computer Science and Information Technologies, Faculty of Computer Science, CITIC-Research Center of Information and Communication Technologies, Universidade da Coruña, A Coruña, Spain.,Grupo de Redes de Neuronas Artificiales y Sistemas Adaptativos. Imagen Médica y Diagnóstico Radiológico (RNASA-IMEDIR). Instituto de Investigación Biomédica de A Coruña (INIBIC). Complexo Hospitalario Universitario de A Coruña (CHUAC), SERGAS, Universidade da Coruña, A Coruña, Spain
| | - Pablo Hervella
- Clinical Neurosciences Research Laboratory (LINC), Health Research Institute of Santiago de Compostela (IDIS), Santiago de Compostela, Spain
| | - Virginia Mato-Abad
- Software Engineering Laboratory, Department of Computer Science and Information Technologies, Faculty of Computer Science, University of A Coruña, Campus de Elviña, 15071, A Coruña, Spain
| | - Manuel Rodríguez-Yáñez
- Stroke Unit, Department of Neurology, Health Research Institute of Santiago de Compostela (IDIS), Hospital Clínico Universitario, Rúa Travesa da Choupana, s/n, 15706Santiago de Compostela, Spain
| | - Sonia Suárez-Garaboa
- Software Engineering Laboratory, Department of Computer Science and Information Technologies, Faculty of Computer Science, University of A Coruña, Campus de Elviña, 15071, A Coruña, Spain
| | - Iria López-Dequidt
- Stroke Unit, Department of Neurology, Health Research Institute of Santiago de Compostela (IDIS), Hospital Clínico Universitario, Rúa Travesa da Choupana, s/n, 15706Santiago de Compostela, Spain
| | - Ana Estany-Gestal
- Unit of Methodology of the Research, Health Research Institute of Santiago de Compostela (IDIS), Santiago de Compostela, Spain
| | - Tomás Sobrino
- Clinical Neurosciences Research Laboratory (LINC), Health Research Institute of Santiago de Compostela (IDIS), Santiago de Compostela, Spain
| | - Francisco Campos
- Clinical Neurosciences Research Laboratory (LINC), Health Research Institute of Santiago de Compostela (IDIS), Santiago de Compostela, Spain
| | - José Castillo
- Clinical Neurosciences Research Laboratory (LINC), Health Research Institute of Santiago de Compostela (IDIS), Santiago de Compostela, Spain
| | - Santiago Rodríguez-Yáñez
- Software Engineering Laboratory, Department of Computer Science and Information Technologies, Faculty of Computer Science, University of A Coruña, Campus de Elviña, 15071, A Coruña, Spain.
| | - Ramón Iglesias-Rey
- Clinical Neurosciences Research Laboratory (LINC), Health Research Institute of Santiago de Compostela (IDIS), Santiago de Compostela, Spain.
| |
Collapse
|
23
|
Automated Segmentation of Infarct Lesions in T1-Weighted MRI Scans Using Variational Mode Decomposition and Deep Learning. SENSORS 2021; 21:s21061952. [PMID: 33802223 PMCID: PMC7999810 DOI: 10.3390/s21061952] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/17/2021] [Revised: 03/07/2021] [Accepted: 03/08/2021] [Indexed: 11/22/2022]
Abstract
Automated segmentation methods are critical for early detection, prompt actions, and immediate treatments in reducing disability and death risks of brain infarction. This paper aims to develop a fully automated method to segment the infarct lesions from T1-weighted brain scans. As a key novelty, the proposed method combines variational mode decomposition and deep learning-based segmentation to take advantages of both methods and provide better results. There are three main technical contributions in this paper. First, variational mode decomposition is applied as a pre-processing to discriminate the infarct lesions from unwanted non-infarct tissues. Second, overlapped patches strategy is proposed to reduce the workload of the deep-learning-based segmentation task. Finally, a three-dimensional U-Net model is developed to perform patch-wise segmentation of infarct lesions. A total of 239 brain scans from a public dataset is utilized to develop and evaluate the proposed method. Empirical results reveal that the proposed automated segmentation can provide promising performances with an average dice similarity coefficient (DSC) of 0.6684, intersection over union (IoU) of 0.5022, and average symmetric surface distance (ASSD) of 0.3932, respectively.
Collapse
|
24
|
Thomas SM, Delanni E, Christophe B, Connolly ES. Systematic review of novel technology-based interventions for ischemic stroke. Neurol Sci 2021; 42:1705-1717. [PMID: 33604762 DOI: 10.1007/s10072-021-05126-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/13/2020] [Accepted: 02/09/2021] [Indexed: 10/22/2022]
Abstract
PURPOSE To identify novel technologies pertinent to the prevention, diagnosis, treatment, and rehabilitation of ischemic stroke, and recommend the technologies that show the most promise in advancing ischemic stroke care. METHOD A systematic literature search on PubMed and Medscape was performed. Articles were assessed based on pre-determined criteria. Included journal articles were evaluated for specific characteristics and reviewed according to a structured paradigm. A search on www.clinicaltrials.gov was performed to identify pre-clinical ischemic stroke technological interventions. All clinical trial results were included. An additional search on PubMed was conducted to identify studies on robotic neuroendovascular procedures. RESULTS Thirty journal articles and five clinical trials were analyzed. Articles were categorized as follows: six studies pertinent to pre-morbidity and prevention of ischemic stroke, three studies relevant to the diagnosis of ischemic stroke, 16 studies about post-ischemic stroke rehabilitation, and five studies on robotic neuroendovascular interventions. CONCLUSIONS Novel technologies across the spectrum of ischemic stroke care were identified, and the ones that appear to have the most clinical utility are recommended. Future investigation of the feasibility and long-term efficacy of the recommended technologies in clinical settings is warranted.
Collapse
Affiliation(s)
- Steven Mulackal Thomas
- Department of Neurological Surgery, Columbia University Irving Medical Center, 710 West 168th Street, New York, NY, 10032, USA.
| | - Ellie Delanni
- Department of Neurological Surgery, Columbia University Irving Medical Center, 710 West 168th Street, New York, NY, 10032, USA
| | - Brandon Christophe
- Department of Neurological Surgery, Columbia University Irving Medical Center, 710 West 168th Street, New York, NY, 10032, USA
| | - Edward Sander Connolly
- Department of Neurological Surgery, Columbia University Irving Medical Center, 710 West 168th Street, New York, NY, 10032, USA
| |
Collapse
|
25
|
Image fusion practice to improve the ischemic-stroke-lesion detection for efficient clinical decision making. EVOLUTIONARY INTELLIGENCE 2021. [DOI: 10.1007/s12065-020-00551-0] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/26/2022]
|
26
|
Kanber B, Vos SB, de Tisi J, Wood TC, Barker GJ, Rodionov R, Chowdhury FA, Thom M, Alexander DC, Duncan JS, Winston GP. Detection of covert lesions in focal epilepsy using computational analysis of multimodal magnetic resonance imaging data. Epilepsia 2021; 62:807-816. [PMID: 33567113 PMCID: PMC8436754 DOI: 10.1111/epi.16836] [Citation(s) in RCA: 8] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2020] [Revised: 12/24/2020] [Accepted: 01/21/2021] [Indexed: 02/01/2023]
Abstract
Objective To compare the location of suspect lesions detected by computational analysis of multimodal magnetic resonance imaging data with areas of seizure onset, early propagation, and interictal epileptiform discharges (IEDs) identified with stereoelectroencephalography (SEEG) in a cohort of patients with medically refractory focal epilepsy and radiologically normal magnetic resonance imaging (MRI) scans. Methods We developed a method of lesion detection using computational analysis of multimodal MRI data in a cohort of 62 control subjects, and 42 patients with focal epilepsy and MRI‐visible lesions. We then applied it to detect covert lesions in 27 focal epilepsy patients with radiologically normal MRI scans, comparing our findings with the areas of seizure onset, early propagation, and IEDs identified at SEEG. Results Seizure‐onset zones (SoZs) were identified at SEEG in 18 of the 27 patients (67%) with radiologically normal MRI scans. In 11 of these 18 cases (61%), concordant abnormalities were detected by our method. In the remaining seven cases, either early seizure propagation or IEDs were observed within the abnormalities detected, or there were additional areas of imaging abnormalities found by our method that were not sampled at SEEG. In one of the nine patients (11%) in whom SEEG was inconclusive, an abnormality, which may have been involved in seizures, was identified by our method and was not sampled at SEEG. Significance Computational analysis of multimodal MRI data revealed covert abnormalities in the majority of patients with refractory focal epilepsy and radiologically normal MRI that co‐located with SEEG defined zones of seizure onset. The method could help identify areas that should be targeted with SEEG when considering epilepsy surgery.
Collapse
Affiliation(s)
- Baris Kanber
- Centre for Medical Image Computing, University College London, London, UK.,Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK
| | - Sjoerd B Vos
- Centre for Medical Image Computing, University College London, London, UK.,Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK.,Neuroradiological Academic Unit, UCL Queen Square Institute of Neurology, London, UK
| | - Jane de Tisi
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK
| | - Tobias C Wood
- Department of Neuroimaging, King's College London, London, UK
| | - Gareth J Barker
- Department of Neuroimaging, King's College London, London, UK
| | - Roman Rodionov
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK
| | - Fahmida Amin Chowdhury
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK
| | - Maria Thom
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,Division of Neuropathology, The National Hospital for Neurology and Neurosurgery, London, UK
| | - Daniel C Alexander
- Centre for Medical Image Computing, University College London, London, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK
| | - John S Duncan
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,National Institute for Health Research Biomedical Research Centre at University College London and University College London NHS Foundation Trust, London, UK
| | - Gavin P Winston
- Department of Clinical and Experimental Epilepsy, UCL Queen Square Institute of Neurology, London, UK.,MRI Unit, Epilepsy Society, Chalfont St Peter, UK.,Department of Medicine, Division of Neurology, Queen's University, Kingston, Canada
| |
Collapse
|
27
|
Chen Q, Xia T, Zhang M, Xia N, Liu J, Yang Y. Radiomics in Stroke Neuroimaging: Techniques, Applications, and Challenges. Aging Dis 2021; 12:143-154. [PMID: 33532134 PMCID: PMC7801280 DOI: 10.14336/ad.2020.0421] [Citation(s) in RCA: 48] [Impact Index Per Article: 12.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2020] [Accepted: 04/21/2020] [Indexed: 12/11/2022] Open
Abstract
Stroke is a leading cause of disability and mortality worldwide, resulting in substantial economic costs for post-stroke care each year. Neuroimaging, such as cranial computed tomography or magnetic resonance imaging, is the backbone of stroke management strategies, which can guide treatment decision-making (thrombolysis or hemostasis) at an early stage. With advances in computational technologies, particularly in machine learning, visual image information can now be converted into numerous quantitative features in an objective, repeatable, and high-throughput manner, in a process known as radiomics. Radiomics is mainly used in the field of oncology, which remains an area of active research. Over the past few years, investigators have attempted to apply radiomics to stroke in the hope of gaining benefits similar to those obtained in cancer management, i.e., in promoting the development of personalized precision medicine. Currently, radiomic analysis has shown promise for a variety of applications in stroke, including the diagnosis of stroke lesions, early prediction of outcomes, and evaluation for long-term prognosis. In this article, we elaborate the contributions of radiomics to stroke, as well as the subprocesses and techniques involved in radiomics studies. We also discuss the potential challenges facing its widespread implementation in routine practice and the directions for future research.
Collapse
Affiliation(s)
- Qian Chen
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang, China
| | - Tianyi Xia
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang, China
| | - Mingyue Zhang
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang, China
| | - Nengzhi Xia
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang, China
| | - Jinjin Liu
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang, China
| | - Yunjun Yang
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Zhejiang, China
| |
Collapse
|
28
|
Gryska E, Schneiderman J, Björkman-Burtscher I, Heckemann RA. Automatic brain lesion segmentation on standard magnetic resonance images: a scoping review. BMJ Open 2021; 11:e042660. [PMID: 33514580 PMCID: PMC7849889 DOI: 10.1136/bmjopen-2020-042660] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 07/11/2020] [Revised: 01/09/2021] [Accepted: 01/12/2021] [Indexed: 12/11/2022] Open
Abstract
OBJECTIVES Medical image analysis practices face challenges that can potentially be addressed with algorithm-based segmentation tools. In this study, we map the field of automatic MR brain lesion segmentation to understand the clinical applicability of prevalent methods and study designs, as well as challenges and limitations in the field. DESIGN Scoping review. SETTING Three databases (PubMed, IEEE Xplore and Scopus) were searched with tailored queries. Studies were included based on predefined criteria. Emerging themes during consecutive title, abstract, methods and whole-text screening were identified. The full-text analysis focused on materials, preprocessing, performance evaluation and comparison. RESULTS Out of 2990 unique articles identified through the search, 441 articles met the eligibility criteria, with an estimated growth rate of 10% per year. We present a general overview and trends in the field with regard to publication sources, segmentation principles used and types of lesions. Algorithms are predominantly evaluated by measuring the agreement of segmentation results with a trusted reference. Few articles describe measures of clinical validity. CONCLUSIONS The observed reporting practices leave room for improvement with a view to studying replication, method comparison and clinical applicability. To promote this improvement, we propose a list of recommendations for future studies in the field.
Collapse
Affiliation(s)
- Emilia Gryska
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| | - Justin Schneiderman
- Sektionen för klinisk neurovetenskap, Goteborgs Universitet Institutionen for Neurovetenskap och fysiologi, Goteborg, Sweden
| | | | - Rolf A Heckemann
- Medical Radiation Sciences, Goteborgs universitet Institutionen for kliniska vetenskaper, Goteborg, Sweden
| |
Collapse
|
29
|
Deep Learning-Based Acute Ischemic Stroke Lesion Segmentation Method on Multimodal MR Images Using a Few Fully Labeled Subjects. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2021; 2021:3628179. [PMID: 33564322 PMCID: PMC7867461 DOI: 10.1155/2021/3628179] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/18/2020] [Revised: 12/17/2020] [Accepted: 01/10/2021] [Indexed: 12/21/2022]
Abstract
Acute ischemic stroke (AIS) has been a common threat to human health and may lead to severe outcomes without proper and prompt treatment. To precisely diagnose AIS, it is of paramount importance to quantitatively evaluate the AIS lesions. By adopting a convolutional neural network (CNN), many automatic methods for ischemic stroke lesion segmentation on magnetic resonance imaging (MRI) have been proposed. However, most CNN-based methods should be trained on a large amount of fully labeled subjects, and the label annotation is a labor-intensive and time-consuming task. Therefore, in this paper, we propose to use a mixture of many weakly labeled and a few fully labeled subjects to relieve the thirst of fully labeled subjects. In particular, a multifeature map fusion network (MFMF-Network) with two branches is proposed, where hundreds of weakly labeled subjects are used to train the classification branch, and several fully labeled subjects are adopted to tune the segmentation branch. By training on 398 weakly labeled and 5 fully labeled subjects, the proposed method is able to achieve a mean dice coefficient of 0.699 ± 0.128 on a test set with 179 subjects. The lesion-wise and subject-wise metrics are also evaluated, where a lesion-wise F1 score of 0.886 and a subject-wise detection rate of 1 are achieved.
Collapse
|
30
|
Artificial Intelligence in Acute Ischemic Stroke. Artif Intell Med 2021. [DOI: 10.1007/978-3-030-58080-3_287-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
31
|
Karthik R, Radhakrishnan M, Rajalakshmi R, Raymann J. Delineation of ischemic lesion from brain MRI using attention gated fully convolutional network. Biomed Eng Lett 2020; 11:3-13. [PMID: 33747599 DOI: 10.1007/s13534-020-00178-1] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/02/2020] [Revised: 10/16/2020] [Accepted: 10/24/2020] [Indexed: 11/30/2022] Open
Abstract
Precise delineation of the ischemic lesion from unimodal Magnetic Resonance Imaging (MRI) is a challenging task due to the subtle intensity difference between the lesion and normal tissues. Hence, multispectral MRI modalities are used for characterizing the properties of brain tissues. Traditional lesion detection methods rely on extracting significant hand-engineered features to differentiate normal and abnormal brain tissues. But the identification of those discriminating features is quite complex, as the degree of differentiation varies according to each modality. This can be addressed well by Convolutional Neural Networks (CNN) which supports automatic feature extraction. It is capable of learning the global features from images effectively for image classification. But it loses the context of local information among the pixels that need to be retained for segmentation. Also, it must provide more emphasis on the features of the lesion region for precise reconstruction. The major contribution of this work is the integration of attention mechanism with a Fully Convolutional Network (FCN) to segment ischemic lesion. This attention model is applied to learn and concentrate only on salient features of the lesion region by suppressing the details of other regions. Hence the proposed FCN with attention mechanism was able to segment ischemic lesion of varying size and shape. To study the effectiveness of attention mechanism, various experiments were carried out on ISLES 2015 dataset and a mean dice coefficient of 0.7535 was obtained. Experimental results indicate that there is an improvement of 5% compared to the existing works.
Collapse
Affiliation(s)
- R Karthik
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India
| | - Menaka Radhakrishnan
- Centre for Cyber Physical Systems, Vellore Institute of Technology, Chennai, India
| | - R Rajalakshmi
- School of Computing Sciences and Engineering, Vellore Institute of Technology, Chennai, Chennai, India
| | - Joel Raymann
- School of Computing Sciences and Engineering, Vellore Institute of Technology, Chennai, Chennai, India
| |
Collapse
|
32
|
Zhu G, Jiang B, Chen H, Tong E, Xie Y, Faizy TD, Heit JJ, Zaharchuk G, Wintermark M. Artificial Intelligence and Stroke Imaging. Neuroimaging Clin N Am 2020; 30:479-492. [DOI: 10.1016/j.nic.2020.07.001] [Citation(s) in RCA: 6] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022]
|
33
|
Wang G, Song T, Dong Q, Cui M, Huang N, Zhang S. Automatic ischemic stroke lesion segmentation from computed tomography perfusion images by image synthesis and attention-based deep neural networks. Med Image Anal 2020; 65:101787. [DOI: 10.1016/j.media.2020.101787] [Citation(s) in RCA: 18] [Impact Index Per Article: 3.6] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/08/2019] [Revised: 07/04/2020] [Accepted: 07/16/2020] [Indexed: 12/24/2022]
|
34
|
Yedavalli VS, Tong E, Martin D, Yeom KW, Forkert ND. Artificial intelligence in stroke imaging: Current and future perspectives. Clin Imaging 2020; 69:246-254. [PMID: 32980785 DOI: 10.1016/j.clinimag.2020.09.005] [Citation(s) in RCA: 42] [Impact Index Per Article: 8.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/22/2020] [Revised: 07/08/2020] [Accepted: 09/11/2020] [Indexed: 12/12/2022]
Abstract
Artificial intelligence (AI) is a fast-growing research area in computer science that aims to mimic cognitive processes through a number of techniques. Supervised machine learning, a subfield of AI, includes methods that can identify patterns in high-dimensional data using labeled 'ground truth' data and apply these learnt patterns to analyze, interpret, or make predictions on new datasets. Supervised machine learning has become a significant area of interest within the medical community. Radiology and neuroradiology in particular are especially well suited for application of machine learning due to the vast amount of data that is generated. One devastating disease for which neuroimaging plays a significant role in the clinical management is stroke. Within this context, AI techniques can play pivotal roles for image-based diagnosis and management of stroke. This overview focuses on the recent advances of artificial intelligence methods - particularly supervised machine learning and deep learning - with respect to workflow, image acquisition and reconstruction, and image interpretation in patients with acute stroke, while also discussing potential pitfalls and future applications.
Collapse
Affiliation(s)
- Vivek S Yedavalli
- Stanford University, Department of Radiology, Division of Neuroradiology and Neurointervention, 300 Pasteur Drive, Room S047, Stanford, CA 94305, United States of America; Johns Hopkins Hospital, Department of Radiological Sciences, 600 N. Wolfe St. B 112-D, Baltimore, MD 21287, United States of America.
| | - Elizabeth Tong
- Stanford University, Department of Radiology, Division of Neuroradiology and Neurointervention, 300 Pasteur Drive, Room S031, Stanford, CA 94305, United States of America.
| | - Dann Martin
- Stanford University, Department of Radiology, Division of Neuroradiology and Neurointervention, 300 Pasteur Drive, Room S047, Stanford, CA 94305, United States of America.
| | - Kristen W Yeom
- Stanford University, Department of Radiology, Divisions of Neuroradiology and Pediatric Neuroradiology, 725 Welch Rd. MC 5654, Stanford, CA 94304, United States of America.
| | - Nils D Forkert
- Department of Radiology, Alberta Children's Hospital Research Institute, Hotchkiss Brain Institute Cumming School of Medicine, University of Calgary, HSC Building, Room 2913, 3330 Hospital Drive NW, Calgary, AB T2N 4N1, Canada; Department Clinical Neurosciences, Alberta Children's Hospital Research Institute, Hotchkiss Brain Institute Cumming School of Medicine, University of Calgary, HSC Building, Room 2913, 3330 Hospital Drive NW, Calgary, AB T2N 4N1, Canada.
| |
Collapse
|
35
|
Liu L, Kurgan L, Wu FX, Wang J. Attention convolutional neural network for accurate segmentation and quantification of lesions in ischemic stroke disease. Med Image Anal 2020; 65:101791. [PMID: 32712525 DOI: 10.1016/j.media.2020.101791] [Citation(s) in RCA: 53] [Impact Index Per Article: 10.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2019] [Revised: 06/26/2020] [Accepted: 07/17/2020] [Indexed: 10/23/2022]
Abstract
Ischemic stroke lesion and white matter hyperintensity (WMH) lesion appear as regions of abnormally signal intensity on magnetic resonance image (MRI) sequences. Ischemic stroke is a frequent cause of death and disability, while WMH is a risk factor for stroke. Accurate segmentation and quantification of ischemic stroke and WMH lesions are important for diagnosis and prognosis. However, radiologists have a difficult time distinguishing these two types of similar lesions. A novel deep residual attention convolutional neural network (DRANet) is proposed to accurately and simultaneously segment and quantify ischemic stroke and WMH lesions in the MRI images. DRANet inherits the advantages of the U-net design and applies a novel attention module that extracts high-quality features from the input images. Moreover, the Dice loss function is used to train DRANet to address data imbalance in the training data set. DRANet is trained and evaluated on 742 2D MRI images which are produced from the sub-acute ischemic stroke lesion segmentation (SISS) challenge. Empirical tests demonstrate that DRANet outperforms several other state-of-the-art segmentation methods. It accurately segments and quantifies both ischemic stroke lesion and WMH. Ablation experiments reveal that attention modules improve the predictive performance of DRANet.
Collapse
Affiliation(s)
- Liangliang Liu
- School of Computer Science and Engineering, Central South University, Changsha, 410083, P.R. China; Hunan Provincial Key Lab on Bioinformatics, Central South University, Changsha, 410083, P.R. China; Department of Network Center, Pingdingshan University, Pingdingshan, 467000, P.R. China
| | - Lukasz Kurgan
- Department of Computer Science, Virginia Commonwealth University, Richmond, VA, 23284, USA
| | - Fang-Xiang Wu
- Department of Mechanical Engineering and Division of Biomedical Engineering, University of Saskatchewan, Saskatoon, SK S7N5A9, Canada
| | - Jianxin Wang
- School of Computer Science and Engineering, Central South University, Changsha, 410083, P.R. China; Hunan Provincial Key Lab on Bioinformatics, Central South University, Changsha, 410083, P.R. China.
| |
Collapse
|
36
|
Tomita N, Jiang S, Maeder ME, Hassanpour S. Automatic post-stroke lesion segmentation on MR images using 3D residual convolutional neural network. Neuroimage Clin 2020; 27:102276. [PMID: 32512401 PMCID: PMC7281812 DOI: 10.1016/j.nicl.2020.102276] [Citation(s) in RCA: 20] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2019] [Revised: 03/31/2020] [Accepted: 05/07/2020] [Indexed: 01/21/2023]
Abstract
In this paper, we demonstrate the feasibility and performance of deep residual neural networks for volumetric segmentation of irreversibly damaged brain tissue lesions on T1-weighted MRI scans for chronic stroke patients. A total of 239 T1-weighted MRI scans of chronic ischemic stroke patients from a public dataset were retrospectively analyzed by 3D deep convolutional segmentation models with residual learning, using a novel zoom-in&out strategy. Dice similarity coefficient (DSC), average symmetric surface distance (ASSD), and Hausdorff distance (HD) of the identified lesions were measured by using manual tracing of lesions as the reference standard. Bootstrapping was employed for all metrics to estimate 95% confidence intervals. The models were assessed on a test set of 31 scans. The average DSC was 0.64 (0.51-0.76) with a median of 0.78. ASSD and HD were 3.6 mm (1.7-6.2 mm) and 20.4 mm (10.0-33.3 mm), respectively. The latest deep learning architecture and techniques were applied with 3D segmentation on MRI scans and demonstrated effectiveness for volumetric segmentation of chronic ischemic stroke lesions.
Collapse
Affiliation(s)
- Naofumi Tomita
- Department of Biomedical Data Science, Geisel School of Medicine at Dartmouth, Hanover, NH 03755, USA
| | - Steven Jiang
- Department of Computer Science, Dartmouth College, Hanover, NH 03755, USA
| | - Matthew E Maeder
- Department of Radiology, Dartmouth-Hitchcock Medical Center, Lebanon, NH 03756, USA
| | - Saeed Hassanpour
- Department of Biomedical Data Science, Geisel School of Medicine at Dartmouth, Hanover, NH 03755, USA; Department of Computer Science, Dartmouth College, Hanover, NH 03755, USA; Department of Epidemiology, Geisel School of Medicine at Dartmouth, Hanover, NH 03755, USA.
| |
Collapse
|
37
|
Chen G, Li Q, Shi F, Rekik I, Pan Z. RFDCR: Automated brain lesion segmentation using cascaded random forests with dense conditional random fields. Neuroimage 2020; 211:116620. [DOI: 10.1016/j.neuroimage.2020.116620] [Citation(s) in RCA: 11] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/07/2019] [Revised: 01/11/2020] [Accepted: 02/06/2020] [Indexed: 10/25/2022] Open
|
38
|
Waddle SL, Juttukonda MR, Lants SK, Davis LT, Chitale R, Fusco MR, Jordan LC, Donahue MJ. Classifying intracranial stenosis disease severity from functional MRI data using machine learning. J Cereb Blood Flow Metab 2020; 40:705-719. [PMID: 31068081 PMCID: PMC7168799 DOI: 10.1177/0271678x19848098] [Citation(s) in RCA: 17] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Indexed: 02/05/2023]
Abstract
Translation of many non-invasive hemodynamic MRI methods to cerebrovascular disease patients has been hampered by well-known artifacts associated with delayed blood arrival times and reduced microvascular compliance. Using machine learning and support vector machine (SVM) algorithms, we investigated whether arrival time-related artifacts in these methods could be exploited as novel contrast sources to discriminate angiographically confirmed stenotic flow territories. Intracranial steno-occlusive moyamoya patients (n = 53; age = 45 ± 14.2 years; sex = 43 F) underwent (i) catheter angiography, (ii) anatomical MRI, (iii) cerebral blood flow (CBF)-weighted arterial spin labeling, and (iv) cerebrovascular reactivity (CVR)-weighted hypercapnic blood-oxygenation-level-dependent MRI. Mean, standard deviation (std), and 99th percentile of CBF, CVR, CVRDelay, and CVRMax were calculated in major anterior and posterior flow territories perfused by vessels with vs. without stenosis (≥70%) confirmed by catheter angiography. These and demographic variables were input into SVMs to evaluate discriminatory capacity for stenotic flow territories using k-fold cross-validation and receiver-operating-characteristic-area-under-the-curve to quantify variable combination relevance. Anterior circulation CBF-std, attributable to heterogeneous endovascular signal and prolonged arterial transit times, was the best performing single variable and CVRDelay-mean and CBF-std, both reflective of delayed vascular compliance, were a high-performing two-variable combination (specificity = 0.67; sensitivity = 0.75). Findings highlight the relevance of hemodynamic imaging and machine learning for identifying cerebrovascular impairment.
Collapse
Affiliation(s)
- Spencer L Waddle
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Meher R Juttukonda
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Sarah K Lants
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Larry T Davis
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Rohan Chitale
- Department of Neurosurgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Matthew R Fusco
- Department of Neurosurgery, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Lori C Jordan
- Department of Pediatrics, Division of Pediatric Neurology, Vanderbilt University Medical Center, Nashville, TN, USA
| | - Manus J Donahue
- Department of Radiology and Radiological Sciences, Vanderbilt University Medical Center, Nashville, TN, USA.,Department of Neurology, Vanderbilt University Medical Center, Nashville, TN, USA.,Department of Psychiatry, Vanderbilt University Medical Center, Nashville, TN, USA.,Department of Physics and Astronomy, Vanderbilt University, Nashville, TN, USA
| |
Collapse
|
39
|
Payabvash S, Aboian M, Tihan T, Cha S. Machine Learning Decision Tree Models for Differentiation of Posterior Fossa Tumors Using Diffusion Histogram Analysis and Structural MRI Findings. Front Oncol 2020; 10:71. [PMID: 32117728 PMCID: PMC7018938 DOI: 10.3389/fonc.2020.00071] [Citation(s) in RCA: 21] [Impact Index Per Article: 4.2] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2019] [Accepted: 01/15/2020] [Indexed: 12/16/2022] Open
Abstract
We applied machine learning algorithms for differentiation of posterior fossa tumors using apparent diffusion coefficient (ADC) histogram analysis and structural MRI findings. A total of 256 patients with intra-axial posterior fossa tumors were identified, of whom 248 were included in machine learning analysis, with at least 6 representative subjects per each tumor pathology. The ADC histograms of solid components of tumors, structural MRI findings, and patients' age were applied to construct decision models using Classification and Regression Tree analysis. We also compared different machine learning classification algorithms (i.e., naïve Bayes, random forest, neural networks, support vector machine with linear and polynomial kernel) for dichotomized differentiation of the 5 most common tumors in our cohort: metastasis (n = 65), hemangioblastoma (n = 44), pilocytic astrocytoma (n = 43), ependymoma (n = 27), and medulloblastoma (n = 26). The decision tree model could differentiate seven tumor histopathologies with terminal nodes yielding up to 90% accurate classification rates. In receiver operating characteristics (ROC) analysis, the decision tree model achieved greater area under the curve (AUC) for differentiation of pilocytic astrocytoma (p = 0.020); and atypical teratoid/rhabdoid tumor ATRT (p = 0.001) from other types of neoplasms compared to the official clinical report. However, neuroradiologists' interpretations had greater accuracy in differentiating metastases (p = 0.001). Among different machine learning algorithms, random forest models yielded the highest accuracy in dichotomized classification of the 5 most common tumor types; and in multiclass differentiation of all tumor types random forest yielded an averaged AUC of 0.961 in training datasets, and 0.873 in validation samples. Our study demonstrates the potential application of machine learning algorithms and decision trees for accurate differentiation of brain tumors based on pretreatment MRI. Using easy to apply and understandable imaging metrics, the proposed decision tree model can help radiologists with differentiation of posterior fossa tumors, especially in tumors with similar qualitative imaging characteristics. In particular, our decision tree model provided more accurate differentiation of pilocytic astrocytomas from ATRT than by neuroradiologists in clinical reads.
Collapse
Affiliation(s)
- Seyedmehdi Payabvash
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, United States.,Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| | - Mariam Aboian
- Department of Radiology and Biomedical Imaging, Yale School of Medicine, New Haven, CT, United States.,Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| | - Tarik Tihan
- Department of Pathology, University of California, San Francisco, San Francisco, CA, United States
| | - Soonmee Cha
- Department of Radiology and Biomedical Imaging, University of California, San Francisco, San Francisco, CA, United States
| |
Collapse
|
40
|
Multi-modal neuroimaging feature selection with consistent metric constraint for diagnosis of Alzheimer's disease. Med Image Anal 2020. [DOI: 10.1016/j.media.2019.101625 10.1016/j.media.2019.101625] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
41
|
Hao X, Bao Y, Guo Y, Yu M, Zhang D, Risacher SL, Saykin AJ, Yao X, Shen L. Multi-modal neuroimaging feature selection with consistent metric constraint for diagnosis of Alzheimer's disease. Med Image Anal 2020; 60:101625. [PMID: 31841947 PMCID: PMC6980345 DOI: 10.1016/j.media.2019.101625] [Citation(s) in RCA: 77] [Impact Index Per Article: 15.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/22/2019] [Revised: 11/25/2019] [Accepted: 11/25/2019] [Indexed: 12/12/2022]
Abstract
The accurate diagnosis of Alzheimer's disease (AD) and its early stage, e.g., mild cognitive impairment (MCI), is essential for timely treatment or possible intervention to slow down AD progression. Recent studies have demonstrated that multiple neuroimaging and biological measures contain complementary information for diagnosis and prognosis. Therefore, information fusion strategies with multi-modal neuroimaging data, such as voxel-based measures extracted from structural MRI (VBM-MRI) and fluorodeoxyglucose positron emission tomography (FDG-PET), have shown their effectiveness for AD diagnosis. However, most existing methods are proposed to simply integrate the multi-modal data, but do not make full use of structure information across the different modalities. In this paper, we propose a novel multi-modal neuroimaging feature selection method with consistent metric constraint (MFCC) for AD analysis. First, the similarity is calculated for each modality (i.e. VBM-MRI or FDG-PET) individually by random forest strategy, which can extract pairwise similarity measures for multiple modalities. Then the group sparsity regularization term and the sample similarity constraint regularization term are used to constrain the objective function to conduct feature selection from multiple modalities. Finally, the multi-kernel support vector machine (MK-SVM) is used to fuse the features selected from different models for final classification. The experimental results on the Alzheimer's Disease Neuroimaging Initiative (ADNI) show that the proposed method has better classification performance than the start-of-the-art multimodality-based methods. Specifically, we achieved higher accuracy and area under the curve (AUC) for AD versus normal controls (NC), MCI versus NC, and MCI converters (MCI-C) versus MCI non-converters (MCI-NC) on ADNI datasets. Therefore, the proposed model not only outperforms the traditional method in terms of AD/MCI classification, but also discovers the characteristics associated with the disease, demonstrating its promise for improving disease-related mechanistic understanding.
Collapse
Affiliation(s)
- Xiaoke Hao
- School of Artificial Intelligence, Hebei University of Technology, Tianjin 300401, China
| | - Yongjin Bao
- School of Artificial Intelligence, Hebei University of Technology, Tianjin 300401, China
| | - Yingchun Guo
- School of Artificial Intelligence, Hebei University of Technology, Tianjin 300401, China.
| | - Ming Yu
- School of Artificial Intelligence, Hebei University of Technology, Tianjin 300401, China
| | - Daoqiang Zhang
- School of Computer Science and Technology, Nanjing University of Aeronautics and Astronautics, Nanjing 211106, China.
| | - Shannon L Risacher
- Department of Radiology and Imaging Sciences, School of Medicine, Indiana University, Indianapolis 46202, USA
| | - Andrew J Saykin
- Department of Radiology and Imaging Sciences, School of Medicine, Indiana University, Indianapolis 46202, USA
| | - Xiaohui Yao
- Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia 19104, USA
| | - Li Shen
- Department of Biostatistics, Epidemiology and Informatics, Perelman School of Medicine, University of Pennsylvania, Philadelphia 19104, USA.
| |
Collapse
|
42
|
Melingi SB, Vijayalakshmi V. A Hybrid Approach for Sub-Acute Ischemic Stroke Lesion Segmentation Using Random Decision Forest and Gravitational Search Algorithm. Curr Med Imaging 2020; 15:170-183. [PMID: 31975663 DOI: 10.2174/1573405614666180209150338] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/01/2017] [Revised: 01/17/2018] [Accepted: 01/29/2018] [Indexed: 11/22/2022]
Abstract
BACKGROUND The sub-acute ischemic stroke is the most basic illnesses reason for death on the planet. We evaluate the impact of segmentation technique during the time of breaking down the capacities of the cerebrum. OBJECTIVE The main objective of this paper is to segment the ischemic stroke lesions in Magnetic Resonance (MR) images in the presence of other pathologies like neurological disorder, encephalopathy, brain damage, Multiple sclerosis (MS). METHODS In this paper, we utilize a hybrid way to deal with segment the ischemic stroke from alternate pathologies in magnetic resonance (MR) images utilizing Random Decision Forest (RDF) and Gravitational Search Algorithm (GSA). The RDF approach is an effective machine learning approach. RESULTS The RDF strategy joins two parameters; they are; the number of trees in the forest and the number of leaves per tree; it runs quickly and proficiently when dealing with vast data. The GSA algorithm is utilized to optimize the RDF data for choosing the best number of trees and the number of leaves per tree in the forest. CONCLUSION This paper provides a new hybrid GSA-RDF classifier technique to segment the ischemic stroke lesions in MR images. The experimental results demonstrate that the proposed technique has the Root Mean Square Error (RMSE), Mean Absolute Percentage Error (MAPE), and Mean Bias Error (MBE) ranges are 16.5485 %, 7.2654 %, and 2.4585 %individually. The proposed RDF-GSA algorithm has better precision and execution when compared with the existing ischemic stroke segmentation method.
Collapse
Affiliation(s)
- Sunil Babu Melingi
- Department of Electronics and Communication Engineering, Pondicherry Engineering College (PEC), Puducherry, India
| | - V Vijayalakshmi
- Department of Electronics and Communication Engineering, Pondicherry Engineering College (PEC), Puducherry, India
| |
Collapse
|
43
|
|
44
|
Automated segmentation and classification of brain stroke using expectation-maximization and random forest classifier. Biocybern Biomed Eng 2020. [DOI: 10.1016/j.bbe.2019.04.004] [Citation(s) in RCA: 71] [Impact Index Per Article: 14.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
|
45
|
Rajendra Acharya U, Meiburger KM, Faust O, En Wei Koh J, Lih Oh S, Ciaccio EJ, Subudhi A, Jahmunah V, Sabut S. Automatic detection of ischemic stroke using higher order spectra features in brain MRI images. COGN SYST RES 2019. [DOI: 10.1016/j.cogsys.2019.05.005] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/18/2022]
|
46
|
Zhang J, Liu M, Wang L, Chen S, Yuan P, Li J, Shen SGF, Tang Z, Chen KC, Xia JJ, Shen D. Context-guided fully convolutional networks for joint craniomaxillofacial bone segmentation and landmark digitization. Med Image Anal 2019; 60:101621. [PMID: 31816592 DOI: 10.1016/j.media.2019.101621] [Citation(s) in RCA: 60] [Impact Index Per Article: 10.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/26/2018] [Revised: 07/01/2019] [Accepted: 11/19/2019] [Indexed: 12/24/2022]
Abstract
Cone-beam computed tomography (CBCT) scans are commonly used in diagnosing and planning surgical or orthodontic treatment to correct craniomaxillofacial (CMF) deformities. Based on CBCT images, it is clinically essential to generate an accurate 3D model of CMF structures (e.g., midface, and mandible) and digitize anatomical landmarks. This process often involves two tasks, i.e., bone segmentation and anatomical landmark digitization. Because landmarks usually lie on the boundaries of segmented bone regions, the tasks of bone segmentation and landmark digitization could be highly associated. Also, the spatial context information (e.g., displacements from voxels to landmarks) in CBCT images is intuitively important for accurately indicating the spatial association between voxels and landmarks. However, most of the existing studies simply treat bone segmentation and landmark digitization as two standalone tasks without considering their inherent relationship, and rarely take advantage of the spatial context information contained in CBCT images. To address these issues, we propose a Joint bone Segmentation and landmark Digitization (JSD) framework via context-guided fully convolutional networks (FCNs). Specifically, we first utilize displacement maps to model the spatial context information in CBCT images, where each element in the displacement map denotes the displacement from a voxel to a particular landmark. An FCN is learned to construct the mapping from the input image to its corresponding displacement maps. Using the learned displacement maps as guidance, we further develop a multi-task FCN model to perform bone segmentation and landmark digitization jointly. We validate the proposed JSD method on 107 subjects, and the experimental results demonstrate that our method is superior to the state-of-the-art approaches in both tasks of bone segmentation and landmark digitization.
Collapse
Affiliation(s)
- Jun Zhang
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC 27599, USA.
| | - Mingxia Liu
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC 27599, USA.
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC 27599, USA.
| | - Si Chen
- Department of Orthodontics, Peking University School and Hospital of Stomatology, Beijing 100191, China
| | - Peng Yuan
- Surgical Planning Laboratory, Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, Houston, TX 77030, USA
| | - Jianfu Li
- Surgical Planning Laboratory, Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, Houston, TX 77030, USA
| | - Steve Guo-Fang Shen
- Surgical Planning Laboratory, Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, Houston, TX 77030, USA
| | - Zhen Tang
- Surgical Planning Laboratory, Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, Houston, TX 77030, USA
| | - Ken-Chung Chen
- Surgical Planning Laboratory, Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, Houston, TX 77030, USA
| | - James J Xia
- Surgical Planning Laboratory, Department of Oral and Maxillofacial Surgery, Houston Methodist Research Institute, Houston, TX 77030, USA.
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina, Chapel Hill, NC 27599, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea.
| |
Collapse
|
47
|
Sundaresan V, Zamboni G, Le Heron C, Rothwell PM, Husain M, Battaglini M, De Stefano N, Jenkinson M, Griffanti L. Automated lesion segmentation with BIANCA: Impact of population-level features, classification algorithm and locally adaptive thresholding. Neuroimage 2019; 202:116056. [PMID: 31376518 PMCID: PMC6996003 DOI: 10.1016/j.neuroimage.2019.116056] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/18/2019] [Revised: 06/19/2019] [Accepted: 07/24/2019] [Indexed: 11/24/2022] Open
Abstract
White matter hyperintensities (WMH) or white matter lesions exhibit high variability in their characteristics both at population- and subject-level, making their detection a challenging task. Population-level factors such as age, vascular risk factors and neurodegenerative diseases affect lesion load and spatial distribution. At the individual level, WMH vary in contrast, amount and distribution in different white matter regions. In this work, we aimed to improve BIANCA, the FSL tool for WMH segmentation, in order to better deal with these sources of variability. We worked on two stages of BIANCA by improving the lesion probability map estimation (classification stage) and making the lesion probability map thresholding stage automated and adaptive to local lesion probabilities. Firstly, in order to take into account the effect of population-level factors, we included population-level lesion probabilities, modelled with respect to a parametric factor (e.g. age), in the classification stage. Secondly, we tested BIANCA performance when using four alternative classifiers commonly used in the literature with respect to K-nearest neighbour algorithm (currently used for lesion probability map estimation in BIANCA). Finally, we propose LOCally Adaptive Threshold Estimation (LOCATE), a supervised method for determining optimal local thresholds to apply to the estimated lesion probability map, as an alternative option to global thresholding (i.e. applying the same threshold to the entire lesion probability map). For these experiments we used data from a neurodegenerative cohort, a vascular cohort and the cohorts available publicly as a part of a segmentation challenge. We observed that including population-level parametric lesion probabilities with respect to age and using alternative machine learning techniques provided negligible improvement. However, LOCATE provided a substantial improvement in the lesion segmentation performance, when compared to the global thresholding. It allowed to detect more deep lesions and provided better segmentation of periventricular lesion boundaries, despite the differences in the lesion spatial distribution and load across datasets. We further validated LOCATE on a cohort of CADASIL (Cerebral autosomal dominant arteriopathy with subcortical infarcts and leukoencephalopathy) patients, a genetic form of cerebral small vessel disease, and healthy controls, showing that LOCATE adapts well to wide variations in lesion load and spatial distribution.
Collapse
Affiliation(s)
- Vaanathi Sundaresan
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK; Oxford-Nottingham Centre for Doctoral Training in Biomedical Imaging, University of Oxford, UK; Oxford India Centre for Sustainable Development, Somerville College, University of Oxford, UK.
| | - Giovanna Zamboni
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK; Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Campbell Le Heron
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK; New Zealand Brain Research Institute, Christchurch 8011, New Zealand
| | - Peter M Rothwell
- Centre for Prevention of Stroke and Dementia, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Masud Husain
- Nuffield Department of Clinical Neurosciences, University of Oxford, Oxford, UK; Department of Experimental Psychology, University of Oxford, Oxford, UK; Wellcome Centre for Integrative NeuroImaging, University of Oxford, UK
| | - Marco Battaglini
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Nicola De Stefano
- Department of Medicine, Surgery and Neuroscience, University of Siena, Siena, Italy
| | - Mark Jenkinson
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| | - Ludovica Griffanti
- Wellcome Centre for Integrative Neuroimaging, Oxford Centre for Functional MRI of the Brain, Nuffield Department of Clinical Neurosciences, University of Oxford, UK
| |
Collapse
|
48
|
Vupputuri A, Ashwal S, Tsao B, Ghosh N. Ischemic stroke segmentation in multi-sequence MRI by symmetry determined superpixel based hierarchical clustering. Comput Biol Med 2019; 116:103536. [PMID: 31783255 DOI: 10.1016/j.compbiomed.2019.103536] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/17/2019] [Revised: 11/07/2019] [Accepted: 11/07/2019] [Indexed: 02/02/2023]
Abstract
Automated estimation of ischemic stroke evolution across different brain anatomical regions has immense potential to revolutionize stroke treatment. Multi-sequence Magnetic Resonance Imaging (MRI) techniques provide information to characterize abnormal tissues based on their anatomy and physical properties. Asymmetry of the right and left hemispheres of the brain is an important cue for abnormality estimation but using it alone is susceptible to occasional error due to self-asymmetry of the brain. A precise estimate of the symmetry axis is therefore essential for accurate asymmetry identification, which holds the key to the proposed method. The proposed symmetry determined superpixel based hierarchical clustering (SSHC) method initially estimates the lesion from inter-hemispheric asymmetry. This asymmetry further determines the thresholding parameter for hierarchically clustering the superpixels leading to an automated and accurate lesion delineation. A multi-sequence MRI based pipeline also combines the estimations from individual sequences. SSHC is evaluated on different sequences of the Loma Linda University (LLU) dataset with 26 patients and the Ischemic Stroke Lesion Segmentation (ISLES'15) dataset with 28 patients. SSHC eliminates the need for manual determination of threshold for combining the superpixel clusters and is more reliable as it derives the information from the quick estimation of asymmetry. SSHC outperforms the state-of-the-art resulting in a high Dice similarity score of 0.704±0.27 and a recall of 0.85±0.01 which are 6% and 35% respectively higher than the challenge winning method. SSHC thus demonstrates a promising potential in the automated detection of (sub-)acute adult ischemic stroke.
Collapse
Affiliation(s)
- Anusha Vupputuri
- Department of Electrical Engineering, Indian Institute of Technology, Kharagpur, 721302, India.
| | - Stephen Ashwal
- Department of Pediatrics, Loma Linda University, Loma Linda, CA, 92354, USA.
| | - Bryan Tsao
- Department of Neurology, Loma Linda University, Loma Linda, CA, 92354, USA.
| | - Nirmalya Ghosh
- Department of Electrical Engineering, Indian Institute of Technology, Kharagpur, 721302, India.
| |
Collapse
|
49
|
Subudhi A, Jena SS, Sabut S. Automated Detection of Brain Stroke in MRI with Hybrid Fuzzy C-Means Clustering and Random Forest Classifier. INTERNATIONAL JOURNAL OF COMPUTATIONAL INTELLIGENCE AND APPLICATIONS 2019. [DOI: 10.1142/s1469026819500184] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/18/2022]
Abstract
Neuroimaging investigation is an essential parameter to detect infarct lesion in stroke patients. Precise detection of brain lesions is an important task related to impaired behavior. In this paper, we aimed to develop an automatic method to segment and classify infarct lesion in diffusion-weighted imaging (DWI) of brain MRI. The method includes hybrid fuzzy [Formula: see text]-means (HFCM) clustering in which the structure of [Formula: see text]-means clustering is modified with rough sets and fuzzy sets to improve the segmentation performance with self-adjusted intensity thresholds. Quantitative evaluation was carried out on 128 MRI slices of brain image collected from ischemic stroke patients at the Department of Radiology, IMS and SUM Hospital, Bhubaneswar. The informative statistical features have been extracted using gray-level co-occurrence matrix (GLCM) and used to classify the types of stroke infarct according to the Oxfordshire Community Stroke Project (OCSP) classification. The parameters such as accuracy, Dice similarity index (DSI) and Jaccard index (JI) were utilized to evaluate the effectiveness of the proposed method in detecting the stroke lesions. The segmentation method achieved the average accuracy, DSI and JI of 96.8%, 95.8% and 92.2%, respectively, in support vector machine (SVM) classifier. The obtained results are higher in terms of random forest (RF) classification. With a high Dice coefficient of 0.958 and other evaluated parameters, the proposed method outperforms earlier published results.
Collapse
Affiliation(s)
- Asit Subudhi
- Department of Electronics and Communication Engineering, Faculty of Engineering and Technology, Institute of Technical Education and Research, SOA Deemed to be University, Khandagiri, Bhubaneswar 751030, Odisha, India
| | - Subhransu S. Jena
- Department of Neurology, All India Institute of Medical Sciences Bhubaneswar, Patrapada, Bhubaneswar 751019, Odisha, India
| | - Sukanta Sabut
- School of Electronics Engineering, KIIT Deemed to be University, Bhubaneswar 751024, Odisha, India
| |
Collapse
|
50
|
Yang N, An Q, Kogami H, Yamakawa H, Tamura Y, Takahashi K, Kinomoto M, Yamasaki H, Itkonen M, Shibata-Alnajjar F, Shimoda S, Hattori N, Fujii T, Otomune H, Miyai I, Yamashita A, Asama H. Temporal Features of Muscle Synergies in Sit-to-Stand Motion Reflect the Motor Impairment of Post-Stroke Patients. IEEE Trans Neural Syst Rehabil Eng 2019; 27:2118-2127. [PMID: 31494552 DOI: 10.1109/tnsre.2019.2939193] [Citation(s) in RCA: 30] [Impact Index Per Article: 5.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/07/2022]
Abstract
Sit-to-stand (STS) motion is an important daily activity, and many post-stroke patients have difficulty performing STS motion. Previous studies found that there are four muscle synergies (synchronized muscle activations) in the STS motion of healthy adults. However, for post-stroke patients, it is unclear whether muscle synergies change and which features primarily reflect motor impairment. Here, we use a machine learning method to demonstrate that temporal features in two muscle synergies that contribute to hip rising and balance maintenance motion reflect the motor impairment of post-stroke patients. Analyzing the muscle synergies of age-matched healthy elderly people ( n = 12 ) and post-stroke patients ( n = 33 ), we found that the same four muscle synergies could account for the muscle activity of post-stroke patients. Also, we were able to distinguish post-stroke patients from healthy people on the basis of the temporal features of these muscle synergies. Furthermore, these temporal features were found to correlate with motor impairment of post-stroke patients. We conclude that post-stroke patients can still utilize the same number of muscle synergies as healthy people, but the temporal structure of muscle synergies changes as a result of motor impairment. This could lead to a new rehabilitation strategy for post-stroke patients that focuses on activation timing of muscle synergies.
Collapse
|