1
|
Kim N, Ryu WS, Ha SY, Kim JY, Kang J, Baik SH, Jung C, Han MK, Bae HJ, Lin L, Parsons M, Kim BJ. Optimal Cerebral Blood Flow Thresholds for Ischemic Core Estimation Using Computed Tomography Perfusion and Diffusion-Weighted Imaging. Ann Neurol 2025; 97:919-929. [PMID: 39723650 DOI: 10.1002/ana.27169] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2024] [Revised: 11/21/2024] [Accepted: 12/09/2024] [Indexed: 12/28/2024]
Abstract
OBJECTIVE Computed tomography perfusion (CTP) imaging is crucial in quantifying cerebral blood flow (CBF) and thereby making an endovascular treatment (EVT) after large vessel occlusion. However, CTP is prone to overestimating the ischemic core. We sought to delineate the optimal regional CBF (rCBF) thresholds of pre-EVT CTP. METHODS We collected acute ischemic stroke patients due to large vessel occlusion who achieved successful recanalization with baseline CTP, immediate post-EVT diffusion-weighted image (DWI) within 3 hours, and delayed post-EVT DWI between 24 and 196 hours. Core volumes estimated by CTP at various rCBF thresholds were validated against immediate and delayed DWI lesion volumes. RESULTS A total of 175 acute large vessel occlusion patients were included. Baseline CTP was taken in a median of 24 minutes (interquartile range [IQR] 21-31 minutes) after arrival; after the CTP, groin puncture in a median of 37 minutes (IQR 28-52 minutes), immediate post-EVT DWI scans in a median of 1.6 hours (IQR 0.8-2.1 hours), and delayed DWI scans in a median of 89 hours (IQR 69-106 hours). The correlations between the rCBF thresholds were the best at rCBF <22% for immediate DWI (0.64; 95% CI 0.55-0.73) and at rCBF <30% for delayed DWI (0.69; 95% CI 0.61-0.76). The interval between CTP and recanalization was inversely correlated with the overestimation of ischemic core volume compared with the subsequent DWI. INTERPRETATION Optimal rCBF thresholds for estimating ischemic core using CTP depend significantly on the timing of DWI post-EVT and CTP to recanalization delay. The optimal rCBF thresholds for ischemic core estimation may vary depending on the clinical setting. ANN NEUROL 2025;97:919-929.
Collapse
Affiliation(s)
- Nakhoon Kim
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
| | - Wi-Sun Ryu
- Artificial Intelligence Research Center, JLK, Seoul, South Korea
| | - Sue Young Ha
- Artificial Intelligence Research Center, JLK, Seoul, South Korea
- Department of Neurology, Seoul National University Hospital, Seoul, South Korea
| | - Jun Yup Kim
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
| | - Jihoon Kang
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
| | - Sung Hyun Baik
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
| | - Cheolkyu Jung
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
| | - Moon-Ku Han
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
- Department of Neuroscience, Seoul National University College of Medicine, Seoul, South Korea
| | - Hee-Joon Bae
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
- Department of Neuroscience, Seoul National University College of Medicine, Seoul, South Korea
| | - Longting Lin
- Department of Neurology, South Western Sydney Clinical School, Ingham Institute of Applied Medical Research, Liverpool Hospital, University of New South Wales, Liverpool, New South Wales, Australia
| | - Mark Parsons
- Department of Neurology, South Western Sydney Clinical School, Ingham Institute of Applied Medical Research, Liverpool Hospital, University of New South Wales, Liverpool, New South Wales, Australia
| | - Beom Joon Kim
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam-si, South Korea
| |
Collapse
|
2
|
Lee SB, Roh HG, Lee TJ, Jeon YS, Ki HJ, Choi JW, Shin NI, Nam HH, Kwak JT, Lee JS, Park JJ, Kim HJ. Multiphase CTA vs. MRA collateral map for predicting functional outcomes after acute ischemic stroke. Neuroradiology 2025; 67:1191-1202. [PMID: 40019548 DOI: 10.1007/s00234-025-03570-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/16/2024] [Accepted: 02/16/2025] [Indexed: 03/01/2025]
Abstract
PURPOSE To compare the prognostic abilities of multiphase CT angiography (mCTA) and multiphase MR angiography (MRA) collateral map in acute anterior circulation ischemic stroke. METHODS This secondary analysis of a prospective observational study included data from participants with acute ischemic stroke due to steno-occlusion of the internal carotid artery and/or middle cerebral artery within 8 h of symptom onset between January 1, 2016, and March 31, 2021. The intermethod agreement of the collateral scores (CSs) from mCTA and the collateral perfusion scores (CPSs) from the MRA collateral map was analyzed. Multiple logistic regression analyses were conducted to determine the prognostic value of mCTA and MRA collateral maps. RESULTS 169 participants (106 men and 63 women, mean age 69 years ± 13) were included. The agreement between the CSs of mCTA and the CPSs of the MRA collateral map (weighted kappa = 0.44, 95% confidence interval [CI]: 0.37-0.52) of 168 participants was moderate. Younger age (Odds ratio [OR], 0.51; 95% CI, 0.34-0.76; p = 0.001), lower baseline NIHSS scores (OR, 0.89; 95% CI, 0.81-0.99; p = 0.024), CPS 4 (OR, 36.66; 95% CI, 1.79-750.29; p = 0.019) and CPS 5 (OR, 144.10; 95% CI, 1.11-18788.93; p = 0.046) on the MRA collateral map, and successful reperfusion (OR, 9.63; 95% CI, 3.00-30.94; p < 0.001) were independently associated with favorable functional outcomes. CONCLUSIONS Only the MRA collateral map demonstrated clinical prognostic value in acute anterior circulation ischemic stroke patients, demonstrating the superiority of the MRA collateral map over mCTA in collateral assessment.
Collapse
Affiliation(s)
- Sang Bong Lee
- Daejeon St. Mary'S Hospital, College of Medicine, the Catholic University of Korea, Seoul, Republic of Korea
| | - Hong Gee Roh
- Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
- DeepClue Inc., Daejeon, Republic of Korea
| | - Taek-Jun Lee
- Daejeon St. Mary'S Hospital, College of Medicine, the Catholic University of Korea, Seoul, Republic of Korea
| | - Yoo Sung Jeon
- Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
| | - Hee Jong Ki
- Daejeon St. Mary'S Hospital, College of Medicine, the Catholic University of Korea, Seoul, Republic of Korea
| | - Jin Woo Choi
- Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
| | - Na Il Shin
- Daejeon St. Mary'S Hospital, College of Medicine, the Catholic University of Korea, Seoul, Republic of Korea
| | - Ho Hyun Nam
- Daejeon St. Mary'S Hospital, College of Medicine, the Catholic University of Korea, Seoul, Republic of Korea
| | - Jin Tae Kwak
- DeepClue Inc., Daejeon, Republic of Korea
- School of Electrical Engineering, Korea University, Seoul, Republic of Korea
| | - Ji Sung Lee
- Clinical Research Center, Asan Institute for Life Science, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Jeong Jin Park
- Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea.
| | - Hyun Jeong Kim
- Daejeon St. Mary'S Hospital, College of Medicine, the Catholic University of Korea, Seoul, Republic of Korea.
- DeepClue Inc., Daejeon, Republic of Korea.
| |
Collapse
|
3
|
Lee JH. Letter to the Editor: Commentary on Using Artificial Intelligence in the Comprehensive Management of Spinal Cord Injury ( Korean J Neurotrauma 2024;20:215-224). Korean J Neurotrauma 2025; 21:161-162. [PMID: 40353284 PMCID: PMC12062822 DOI: 10.13004/kjnt.2025.21.e8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/26/2025] [Accepted: 02/11/2025] [Indexed: 05/14/2025] Open
Affiliation(s)
- Jung Hwan Lee
- Department of Neurosurgery, Yeouido St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Korea
| |
Collapse
|
4
|
Yum KS, Chung JW, Ha SY, Park KY, Shin DI, Park HK, Cho YJ, Hong KS, Kim JG, Lee SJ, Kim JT, Seo WK, Bang OY, Kim GM, Lee M, Kim D, Sunwoo L, Bae HJ, Ryu WS, Kim BJ. A multicenter validation and calibration of automated software package for detecting anterior circulation large vessel occlusion on CT angiography. BMC Neurol 2025; 25:100. [PMID: 40065263 PMCID: PMC11892136 DOI: 10.1186/s12883-025-04107-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2024] [Accepted: 02/25/2025] [Indexed: 03/14/2025] Open
Abstract
PURPOSE To validate JLK-LVO, a software detecting large vessel occlusion (LVO) on computed tomography angiography (CTA), within a multicenter dataset. METHODS From 2021 to 2023, we enrolled patients with ischemic stroke who underwent CTA within 24-hour of onset at six university hospitals for validation and calibration datasets and at another university hospital for an independent dataset for testing model calibration. The diagnostic performance was evaluated using area under the curve (AUC), sensitivity, and specificity across the entire study population and specifically in patients with isolated middle cerebral artery (MCA)-M2 occlusion. We calibrated LVO probabilities using logistic regression and by grouping LVO probabilities based on observed frequency. RESULTS After excluding 168 patients, 796 remained; the mean (SD) age was 68.9 (13.7) years, and 57.7% were men. LVO was present in 193 (24.3%) of patients, and the median interval from last-known-well to CTA was 5.7 h (IQR 2.5-12.1 h). The software achieved an AUC of 0.944 (95% CI 0.926-0.960), with a sensitivity of 89.6% (84.5-93.6%) and a specificity of 90.4% (87.7-92.6%). In isolated MCA-M2 occlusion, the AUROC was 0.880 (95% CI 0.824-0.921). Due to sparse data between 20 and 60% of LVO probabilities, recategorization into unlikely (0-20% LVO scores), less likely (20-60%), possible (60-90%), and suggestive (90-100%) provided a reliable estimation of LVO compared with mathematical calibration. The category of LVO probabilities was associated with follow-up infarct volumes and functional outcome. CONCLUSION In this multicenter study, we proved the clinical efficacy of the software in detecting LVO on CTA.
Collapse
Affiliation(s)
- Kyu Sun Yum
- Department of Neurology, College of Medicine, Chungbuk National University Hospital, Chungbuk National University, Cheongju, Republic of Korea
| | - Jong-Won Chung
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea
| | - Sue Young Ha
- Artificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea
- Department of Neurology, Seoul National University Hospital, Seoul National University College of Medicine, Seoul, Republic of Korea
| | - Kwang-Yeol Park
- Department of Neurology, Chung-Ang University College of Medicine, Chung-Ang University Hospital, Seoul, Republic of Korea
| | - Dong-Ick Shin
- Department of Neurology, College of Medicine, Chungbuk National University Hospital, Chungbuk National University, Cheongju, Republic of Korea
| | - Hong-Kyun Park
- Department of Neurology, Inje University Ilsan Paik Hospital, Inje University College of Medicine, Goyang, Republic of Korea
| | - Yong-Jin Cho
- Department of Neurology, Inje University Ilsan Paik Hospital, Inje University College of Medicine, Goyang, Republic of Korea
| | - Keun-Sik Hong
- Department of Neurology, Inje University Ilsan Paik Hospital, Inje University College of Medicine, Goyang, Republic of Korea
| | - Jae Guk Kim
- Department of Neurology, Daejeon Eulji Medical Center, Eulji University School of Medicine, Daejeon, Republic of Korea
| | - Soo Joo Lee
- Department of Neurology, Daejeon Eulji Medical Center, Eulji University School of Medicine, Daejeon, Republic of Korea
| | - Joon-Tae Kim
- Department of Neurology, Chonnam National University Hospital, Chonnam National University Medical School, Gwangju, Republic of Korea
| | - Woo-Keun Seo
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea
| | - Oh Young Bang
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea
| | - Gyeong-Moon Kim
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University College of Medicine, Seoul, Republic of Korea
| | - Myungjae Lee
- Artificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea
| | - Dongmin Kim
- Artificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea
| | - Leonard Sunwoo
- Department of Radiology, Seoul National University Bundang Hospital, Seoul National University College of Medicine, Seongnam, Republic of Korea
| | - Hee-Joon Bae
- Department of Neurology, Seoul National University College of Medicine, Seongnam, Republic of Korea
- Cerebrovascular Disease Center, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Wi-Sun Ryu
- Artificial Intelligence Research Center, JLK Inc, Seoul, Republic of Korea.
| | - Beom Joon Kim
- Department of Neurology, Seoul National University College of Medicine, Seongnam, Republic of Korea.
- Cerebrovascular Disease Center, Seoul National University Bundang Hospital, Seongnam, Republic of Korea.
| |
Collapse
|
5
|
Ki HJ, Roh HG, Kwak JT, Kim IS, Park JJ, Jeon YS, Yang H, Jung S, Lee JS, Kim HJ. The CT collateral map: collateral perfusion estimation and baseline lesion assessment after acute anterior circulation ischemic stroke. LA RADIOLOGIA MEDICA 2025; 130:235-247. [PMID: 39661247 PMCID: PMC11870971 DOI: 10.1007/s11547-024-01941-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/07/2024] [Accepted: 11/27/2024] [Indexed: 12/12/2024]
Abstract
PURPOSE To investigate the clinical feasibility of a CT collateral map compared with an MRA collateral map, focusing on collateral perfusion (CP) estimation and baseline lesion assessment in acute ischemic stroke (AIS). MATERIALS AND METHODS This retrospective analysis used selected data from a prospectively collected database. We generated CT collateral maps derived from CT perfusion, encompassing images of arterial, capillary, early venous (CMEV), late venous, and delay phases. Three raters assessed CP scores from MRA and CT collateral maps and CMEV lesion volumes. Lesion volumes of baseline diffusion-weighted imaging (bDWI) and cerebral blood flow rate (CBF) < 30% were automatically measured by the software. The agreement between MRA and CT collateral maps in CP estimation and the correlation between lesion volumes with a CBF < 30% and the CMEV for bDWI lesion volumes were analyzed. RESULTS One-hundred ten patients (mean age ± standard deviation, 71 ± 14; 60 women) with AIS due to steno-occlusion of the internal carotid and/or middle cerebral arteries were included. The agreement between the MRA and CT collateral maps in CP grading was excellent (weighted κ = 0.93; 95% CI, 0.90-0.97). The concordance correlation coefficients (CCCs) of the CBF < 30% and CMEV for bDWI lesion volumes were 0.76 (95% CI, 0.60-0.91) and 0.97 (0.95-0.98), respectively. CONCLUSION The clinical feasibility of the CT collateral map is demonstrated by its significant correlation with the MRA collateral map in CP estimation and baseline lesion assessment.
Collapse
Affiliation(s)
- Hee Jong Ki
- Department of Neurosurgery, Daejeon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Seoul, Republic of Korea
| | - Hong Gee Roh
- Department of Radiology, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
- DeepClue Inc., Daejeon, Republic of Korea
| | - Jin Tae Kwak
- DeepClue Inc., Daejeon, Republic of Korea
- School of Electrical Engineering, Korea University, Seoul, Republic of Korea
| | - In Seong Kim
- DeepClue Inc., Daejeon, Republic of Korea
- Siemens Healthineers Ltd, Seoul, Republic of Korea
| | - Jeong Jin Park
- Department of Neurology, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
| | - Yoo Sung Jeon
- Department of Neurosurgery, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
| | - Hyun Yang
- School of Electrical Engineering, Korea University, Seoul, Republic of Korea
| | - Sumin Jung
- School of Electrical Engineering, Korea University, Seoul, Republic of Korea
| | - Ji Sung Lee
- Clinical Research Center, Asan Institute for Life Science, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Hyun Jeong Kim
- DeepClue Inc., Daejeon, Republic of Korea.
- Department of Radiology, Daejeon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, 64 Daeheung-Ro, Jung-Gu, Daejeon Seoul, 34943, Republic of Korea.
| |
Collapse
|
6
|
Jeon YJ, Roh HG, Jung S, Yang H, Ki HJ, Park JJ, Lee TJ, Shin NI, Lee JS, Kwak JT, Kim HJ. Clinical feasibility of deep learning-driven magnetic resonance angiography collateral map in acute anterior circulation ischemic stroke. Sci Rep 2025; 15:2304. [PMID: 39825032 PMCID: PMC11742650 DOI: 10.1038/s41598-025-85731-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/02/2024] [Accepted: 01/06/2025] [Indexed: 01/20/2025] Open
Abstract
To validate the clinical feasibility of deep learning-driven magnetic resonance angiography (DL-driven MRA) collateral map in acute ischemic stroke. We employed a 3D multitask regression and ordinal regression deep neural network, called as 3D-MROD-Net, to generate DL-driven MRA collateral maps. Two raters graded the collateral perfusion scores of both conventional and DL-driven MRA collateral maps and measured the grading time. They also qualitatively assessed the image quality of both collateral maps. Interrater and inter-method agreements for collateral perfusion grading between the two collateral maps were analyzed, along with a comparison of grading time and image quality. In the analysis of the 296 acute ischemic stroke patients, the inter-method agreement for collateral perfusion grading was almost perfect (κ = 0.96, 95% CI: 0.95-0.98). Compared to conventional MRA collateral maps, the time taken for collateral perfusion grading on DL-driven MRA collateral maps was shorter (P < 0.001 for rater 1 and P = 0.003 for rater 2), and the image quality of the DL-driven MRA collateral maps was superior (P < 0.001 for rater 1 and P = 0.002 for rater 2). The DL-driven MRA collateral map demonstrates clinical feasibility for collateral perfusion grading in acute ischemic stroke, with the added benefits of reduced generation and interpretation time, along with improved image quality of the MRA collateral map.
Collapse
Affiliation(s)
- Ye Jin Jeon
- Department of Computer Science, University of California, La Jolla, San Diego, CA, USA
| | - Hong Gee Roh
- Department of Radiology, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
- DeepClue Inc., Deajeon, Republic of Korea
| | - Sumin Jung
- School of Electrical Engineering, Korea University, 145 Anam-ro, Seingbuk-gu, 02841, Seoul, Republic of Korea
| | - Hyun Yang
- School of Electrical Engineering, Korea University, 145 Anam-ro, Seingbuk-gu, 02841, Seoul, Republic of Korea
| | - Hee Jong Ki
- Department of Neurosurgery, Daejeon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Daejeon, Republic of Korea
| | - Jeong Jin Park
- Department of Neurology, Konkuk University Medical Center, Konkuk University School of Medicine, Seoul, Republic of Korea
| | - Taek-Jun Lee
- Department of Neurology, Daejeon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Daejeon, Republic of Korea
| | - Na Il Shin
- Department of Neurosurgery, Daejeon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, Daejeon, Republic of Korea
| | - Ji Sung Lee
- Clinical Research Center, Asan Institute for Life Science, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea
| | - Jin Tae Kwak
- DeepClue Inc., Deajeon, Republic of Korea.
- School of Electrical Engineering, Korea University, 145 Anam-ro, Seingbuk-gu, 02841, Seoul, Republic of Korea.
| | - Hyun Jeong Kim
- DeepClue Inc., Deajeon, Republic of Korea.
- Clinical Research Center, Asan Institute for Life Science, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Republic of Korea.
- Department of Radiology, Daejeon St. Mary's Hospital, College of Medicine, The Catholic University of Korea, 64 Daeheung-Ro, Jung-Gu, 34943, Daejeon, Republic of Korea.
| |
Collapse
|
7
|
Kim H, Ryu WS, Schellingerhout D, Park J, Chung J, Jeong SW, Gwak DS, Kim BJ, Kim JT, Hong KS, Lee KB, Park TH, Park JM, Kang K, Cho YJ, Lee BC, Yu KH, Oh MS, Lee SJ, Cha JK, Kim DH, Lee J, Park MS, Bae HJ, Kim DE. Automated Segmentation of MRI White Matter Hyperintensities in 8421 Patients with Acute Ischemic Stroke. AJNR Am J Neuroradiol 2024; 45:1885-1894. [PMID: 39013565 PMCID: PMC11630893 DOI: 10.3174/ajnr.a8418] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/28/2024] [Accepted: 07/09/2024] [Indexed: 07/18/2024]
Abstract
BACKGROUND AND PURPOSE To date, only a few small studies have attempted deep learning-based automatic segmentation of white matter hyperintensity (WMH) lesions in patients with cerebral infarction; this issue is complicated because stroke-related lesions can obscure WMH borders. We developed and validated deep learning algorithms to segment WMH lesions accurately in patients with cerebral infarction using multisite data sets involving 8421 patients with acute ischemic stroke. MATERIALS AND METHODS We included 8421 patients with stroke from 9 centers in Korea. 2D UNet and squeeze-and-excitation (SE)-UNet models were trained using 2408 FLAIR MRIs from 3 hospitals and validated using 6013 FLAIR MRIs from 6 hospitals. WMH segmentation performance was assessed by calculating the Dice similarity coefficient (DSC), the correlation coefficient, and the concordance correlation coefficient compared with a human-segmented criterion standard. In addition, we obtained an uncertainty index that represents overall ambiguity in the voxel classification for WMH segmentation in each patient based on the Kullback-Leibler divergence. RESULTS In the training data set, the mean age was 67.4 (SD, 13.0) years, and 60.4% were men. The mean (95% CI) DSCs for UNet in internal testing and external validation were, respectively, 0.659 (0.649-0.669) and 0.710 (0.707-0.714), which were slightly lower than the reliability between humans (DSC = 0.744; 95% CI, 0.738-0.751; P = .031). Compared with the UNet, the SE-UNet demonstrated better performance, achieving a mean DSC of 0.675 (95% CI, 0.666-0.685; P < .001) in the internal testing and 0.722 (95% CI, 0.719-0.726; P < .001) in the external validation; moreover, it achieved high DSC values (ranging from 0.672 to 0.744) across multiple validation data sets. We observed a significant correlation between WMH volumes that were segmented automatically and manually for the UNet (r = 0.917, P < .001), and it was even stronger for the SE-UNet (r = 0.933, P < .001). The SE-UNet also attained a high concordance correlation coefficient (ranging from 0.841 to 0.956) in the external test data sets. In addition, the uncertainty indices in most patients (86%) in the external data sets were <0.35, with an average DSC of 0.744 in these patients. CONCLUSIONS We developed and validated deep learning algorithms to segment WMH in patients with acute cerebral infarction using the largest-ever MRI data sets. In addition, we showed that the uncertainty index can be used to identify cases in which automatic WMH segmentation is less accurate and requires human review.
Collapse
Affiliation(s)
- Hosung Kim
- From the USC Stevens Neuroimaging and Informatics Institute (H.K.), Keck School of Medicine of USC, University of Southern California, Los Angeles, California
| | - Wi-Sun Ryu
- Artificial Intelligence Research Center (W.-S.R, J.P.), JLK Inc, Seoul, Republic of Korea
- National Priority Research Center for Stroke and Department of Neurology (W.-S.R, J.C., S.-W.J., D.-S.G., D.-E.K.), Dongguk University Ilsan Hospital, Goyang, Republic of Korea
| | - Dawid Schellingerhout
- Department of Neuroradiology and Imaging Physics (D.S.), The University of Texas M.D. Anderson Cancer Center, Houston, Texas
| | - Jonghyeok Park
- Artificial Intelligence Research Center (W.-S.R, J.P.), JLK Inc, Seoul, Republic of Korea
| | - Jinyong Chung
- National Priority Research Center for Stroke and Department of Neurology (W.-S.R, J.C., S.-W.J., D.-S.G., D.-E.K.), Dongguk University Ilsan Hospital, Goyang, Republic of Korea
- Bioimaging Data Curation Center (J.C., D.-S.G., D.-E.K.), KOREA-BioData Station, Daejeon, Republic of Korea
| | - Sang-Wuk Jeong
- National Priority Research Center for Stroke and Department of Neurology (W.-S.R, J.C., S.-W.J., D.-S.G., D.-E.K.), Dongguk University Ilsan Hospital, Goyang, Republic of Korea
| | - Dong-Seok Gwak
- National Priority Research Center for Stroke and Department of Neurology (W.-S.R, J.C., S.-W.J., D.-S.G., D.-E.K.), Dongguk University Ilsan Hospital, Goyang, Republic of Korea
- Bioimaging Data Curation Center (J.C., D.-S.G., D.-E.K.), KOREA-BioData Station, Daejeon, Republic of Korea
| | - Beom Joon Kim
- Department of Neurology (B.J.K., H.-J.B.), Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Joon-Tae Kim
- Department of Neurology (J.-T.K., M.S.P.,), Chonnam National University Hospital, Gwangju, Republic of Korea
| | - Keun-Sik Hong
- Department of Neurology (K.-S.H., Y,-J.C.), Inje University Ilsan Paik Hospital, Goyang, Republic of Korea
| | - Kyung Bok Lee
- Department of Neurology (K.B.L.), Soonchunhyang University Hospital, Seoul, Republic of Korea
| | - Tai Hwan Park
- Department of Neurology (T.H.P.), Seoul Medical Center, Seoul, Republic of Korea
| | - Jong-Moo Park
- Department of Neurology (J.-M.P.), Uijeongbu Eulji Medical Center, Uijeongbu, Republic of Korea
| | - Kyusik Kang
- Department of Neurology (K.K.), Nowon Eulji Medical Center, Eulji University School of Medicine, Seoul, Republic of Korea
| | - Yong-Jin Cho
- Department of Neurology (K.-S.H., Y,-J.C.), Inje University Ilsan Paik Hospital, Goyang, Republic of Korea
| | - Byung-Chul Lee
- Department of Neurology (B.-C.L., K.-H.Y., M.S.O.), Hallym University Sacred Heart Hospital, Anyang, Republic of Korea
| | - Kyung-Ho Yu
- Department of Neurology (B.-C.L., K.-H.Y., M.S.O.), Hallym University Sacred Heart Hospital, Anyang, Republic of Korea
| | - Mi Sun Oh
- Department of Neurology (B.-C.L., K.-H.Y., M.S.O.), Hallym University Sacred Heart Hospital, Anyang, Republic of Korea
| | - Soo Joo Lee
- Department of Neurology (S.J.L.), Eulji University Hospital, Daejeon, Republic of Korea
| | - Jae-Kwan Cha
- Department of Neurology (J.-K.C., D.-H.K.), Dong-A University Hospital, Busan, Republic of Korea
| | - Dae-Hyun Kim
- Department of Neurology (J.-K.C., D.-H.K.), Dong-A University Hospital, Busan, Republic of Korea
| | - Jun Lee
- Department of Neurology (J.L.), Yeungnam University Hospital, Daegu, Republic of Korea
| | - Man Seok Park
- Department of Neurology (J.-T.K., M.S.P.,), Chonnam National University Hospital, Gwangju, Republic of Korea
| | - Hee-Joon Bae
- Department of Neurology (B.J.K., H.-J.B.), Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Dong-Eog Kim
- National Priority Research Center for Stroke and Department of Neurology (W.-S.R, J.C., S.-W.J., D.-S.G., D.-E.K.), Dongguk University Ilsan Hospital, Goyang, Republic of Korea
- Bioimaging Data Curation Center (J.C., D.-S.G., D.-E.K.), KOREA-BioData Station, Daejeon, Republic of Korea
| |
Collapse
|
8
|
Kim J, Oh SW, Lee HY, Choi MH, Meyer H, Huwer S, Zhao G, Gibson E, Han D. Assessment of Deep Learning-Based Triage Application for Acute Ischemic Stroke on Brain MRI in the ER. Acad Radiol 2024; 31:4621-4628. [PMID: 38908922 DOI: 10.1016/j.acra.2024.04.046] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2024] [Revised: 04/22/2024] [Accepted: 04/26/2024] [Indexed: 06/24/2024]
Abstract
RATIONALE AND OBJECTIVES To assess a deep learning application (DLA) for acute ischemic stroke (AIS) detection on brain magnetic resonance imaging (MRI) in the emergency room (ER) and the effect of T2-weighted imaging (T2WI) on its performance. MATERIALS AND METHODS We retrospectively analyzed brain MRIs taken through the ER from March to October 2021 that included diffusion-weighted imaging (DWI) and fluid-attenuated inversion recovery (FLAIR) sequences. MRIs were processed by the DLA, and sensitivity, specificity, accuracy, and area under the receiver operating characteristic curve (AUROC) were evaluated, with three neuroradiologists establishing the gold standard for detection performance. In addition, we examined the impact of axial T2WI, when available, on the accuracy and processing time of DLA. RESULTS The study included 947 individuals (mean age ± standard deviation, 64 years ± 16; 461 men, 486 women), with 239 (25%) positive for AIS. The overall performance of DLA was as follows: sensitivity, 90%; specificity, 89%; accuracy, 89%; and AUROC, 0.95. The average processing time was 24 s. In the subgroup with T2WI, T2WI did not significantly impact MRI assessments but did result in longer processing times (35 s without T2WI compared to 48 s with T2WI, p < 0.001). CONCLUSION The DLA successfully identified AIS in the ER setting with an average processing time of 24 s. The absence of performance acquire with axial T2WI suggests that the DLA can diagnose AIS with just axial DWI and FLAIR sequences, potentially shortening the exam duration in the ER.
Collapse
Affiliation(s)
- Jimin Kim
- Department of Radiology, Eunpyeong St. Mary's Hospital, The Catholic University of Korea College of Medicine, Seoul 03312, Korea
| | - Se Won Oh
- Department of Radiology, Eunpyeong St. Mary's Hospital, The Catholic University of Korea College of Medicine, Seoul 03312, Korea.
| | - Ha Young Lee
- Department of Radiology, Eunpyeong St. Mary's Hospital, The Catholic University of Korea College of Medicine, Seoul 03312, Korea
| | - Moon Hyung Choi
- Department of Radiology, Eunpyeong St. Mary's Hospital, The Catholic University of Korea College of Medicine, Seoul 03312, Korea
| | - Heiko Meyer
- Siemens Healthineers AG, Erlangen 91052, Germany
| | - Stefan Huwer
- Siemens Healthineers AG, Erlangen 91052, Germany
| | - Gengyan Zhao
- Siemens Medical Solutions USA, Inc., Princeton, NJ 08540
| | - Eli Gibson
- Siemens Medical Solutions USA, Inc., Princeton, NJ 08540
| | | |
Collapse
|
9
|
Kim N, Ha SY, Park GH, Park JH, Kim D, Sunwoo L, Kye MS, Baik SH, Jung C, Ryu WS, Kim BJ. Comparison of two automated CT perfusion software packages in patients with ischemic stroke presenting within 24 h of onset. Front Neurosci 2024; 18:1398889. [PMID: 38868398 PMCID: PMC11168493 DOI: 10.3389/fnins.2024.1398889] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/11/2024] [Accepted: 05/03/2024] [Indexed: 06/14/2024] Open
Abstract
Background We compared the ischemic core and hypoperfused tissue volumes estimated by RAPID and JLK-CTP, a newly developed automated computed tomography perfusion (CTP) analysis package. We also assessed agreement between ischemic core volumes by two software packages against early follow-up infarct volumes on diffusion-weighted images (DWI). Methods This retrospective study analyzed 327 patients admitted to a single stroke center in Korea from January 2021 to May 2023, who underwent CTP scans within 24 h of onset. The concordance correlation coefficient (ρ) and Bland-Altman plots were utilized to compare the volumes of ischemic core and hypoperfused tissue volumes between the software packages. Agreement with early (within 3 h from CTP) follow-up infarct volumes on diffusion-weighted imaging (n = 217) was also evaluated. Results The mean age was 70.7 ± 13.0 and 137 (41.9%) were female. Ischemic core volumes by JLK-CTP and RAPID at the threshold of relative cerebral blood flow (rCBF) < 30% showed excellent agreement (ρ = 0.958 [95% CI, 0.949 to 0.966]). Excellent agreement was also observed for time to a maximum of the residue function (T max) > 6 s between JLK-CTP and RAPID (ρ = 0.835 [95% CI, 0.806 to 0.863]). Although early follow-up infarct volume showed substantial agreement in both packages (JLK-CTP, ρ = 0.751 and RAPID, ρ = 0.632), ischemic core volumes at the threshold of rCBF <30% tended to overestimate ischemic core volumes. Conclusion JLK-CTP and RAPID demonstrated remarkable concordance in estimating the volumes of the ischemic core and hypoperfused area based on CTP within 24 h from onset.
Collapse
Affiliation(s)
- Nakhoon Kim
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Sue Young Ha
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - Gi-Hun Park
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - Jong-Hyeok Park
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - Dongmin Kim
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - Leonard Sunwoo
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Min-Surk Kye
- Department of Neurology, Seongnam Citizens Medical Center, Seongnam, Republic of Korea
| | - Sung Hyun Baik
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Cheolkyu Jung
- Department of Radiology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| | - Wi-Sun Ryu
- Artificial Intelligence Research Center, JLK Inc., Seoul, Republic of Korea
| | - Beom Joon Kim
- Department of Neurology, Seoul National University Bundang Hospital, Seongnam, Republic of Korea
| |
Collapse
|
10
|
Ryu WS, Schellingerhout D, Lee H, Lee KJ, Kim CK, Kim BJ, Chung JW, Lim JS, Kim JT, Kim DH, Cha JK, Sunwoo L, Kim D, Suh SI, Bang OY, Bae HJ, Kim DE. Deep Learning-Based Automatic Classification of Ischemic Stroke Subtype Using Diffusion-Weighted Images. J Stroke 2024; 26:300-311. [PMID: 38836277 PMCID: PMC11164582 DOI: 10.5853/jos.2024.00535] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/06/2024] [Revised: 04/04/2024] [Accepted: 05/07/2024] [Indexed: 06/06/2024] Open
Abstract
BACKGROUND AND PURPOSE Accurate classification of ischemic stroke subtype is important for effective secondary prevention of stroke. We used diffusion-weighted image (DWI) and atrial fibrillation (AF) data to train a deep learning algorithm to classify stroke subtype. METHODS Model development was done in 2,988 patients with ischemic stroke from three centers by using U-net for infarct segmentation and EfficientNetV2 for subtype classification. Experienced neurologists (n=5) determined subtypes for external test datasets, while establishing a consensus for clinical trial datasets. Automatically segmented infarcts were fed into the model (DWI-only algorithm). Subsequently, another model was trained, with AF included as a categorical variable (DWI+AF algorithm). These models were tested: (1) internally against the opinion of the labeling experts, (2) against fresh external DWI data, and (3) against clinical trial dataset. RESULTS In the training-and-validation datasets, the mean (±standard deviation) age was 68.0±12.5 (61.1% male). In internal testing, compared with the experts, the DWI-only and the DWI+AF algorithms respectively achieved moderate (65.3%) and near-strong (79.1%) agreement. In external testing, both algorithms again showed good agreements (59.3%-60.7% and 73.7%-74.0%, respectively). In the clinical trial dataset, compared with the expert consensus, percentage agreements and Cohen's kappa were respectively 58.1% and 0.34 for the DWI-only vs. 72.9% and 0.57 for the DWI+AF algorithms. The corresponding values between experts were comparable (76.0% and 0.61) to the DWI+AF algorithm. CONCLUSION Our model trained on a large dataset of DWI (both with or without AF information) was able to classify ischemic stroke subtypes comparable to a consensus of stroke experts.
Collapse
Affiliation(s)
- Wi-Sun Ryu
- Department of Neurology, Dongguk University Ilsan Hospital, Goyang, Korea
- Artificial Intelligence Research Center, JLK Inc., Seoul, Korea
| | - Dawid Schellingerhout
- Department of Neuroradiology and Imaging Physics, The University of Texas M.D. Anderson Cancer Center, Houston, TX, USA
| | - Hoyoun Lee
- Artificial Intelligence Research Center, JLK Inc., Seoul, Korea
| | - Keon-Joo Lee
- Department of Neurology, Korea University Guro Hospital, Seoul, Korea
| | - Chi Kyung Kim
- Department of Neurology, Korea University Guro Hospital, Seoul, Korea
| | - Beom Joon Kim
- Department of Neurology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Jong-Won Chung
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Jae-Sung Lim
- Department of Neurology, Asan Medical Center, University of Ulsan College of Medicine, Seoul, Korea
| | - Joon-Tae Kim
- Department of Neurology, Chonnam National University Hospital, Chonnam National University Medical School, Gwangju, Korea
| | - Dae-Hyun Kim
- Department of Neurology, Dong-A University Hospital, Busan, Korea
| | - Jae-Kwan Cha
- Department of Neurology, Dong-A University Hospital, Busan, Korea
| | - Leonard Sunwoo
- Department of Radiology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Dongmin Kim
- Artificial Intelligence Research Center, JLK Inc., Seoul, Korea
| | - Sang-Il Suh
- Department of Radiology, Korea University Guro Hospital, Korea University College of Medicine, Seoul, Korea
| | - Oh Young Bang
- Department of Neurology, Samsung Medical Center, Sungkyunkwan University School of Medicine, Seoul, Korea
| | - Hee-Joon Bae
- Department of Neurology, Seoul National University College of Medicine, Seoul National University Bundang Hospital, Seongnam, Korea
| | - Dong-Eog Kim
- Department of Neurology, Dongguk University Ilsan Hospital, Goyang, Korea
- National Priority Research Center for Stroke, Goyang, Korea
| |
Collapse
|