1
|
Veeturi SS, Hall S, Fujimura S, Mossa-Basha M, Sagues E, Samaniego EA, Tutino VM. Imaging of Intracranial Aneurysms: A Review of Standard and Advanced Imaging Techniques. Transl Stroke Res 2025; 16:1016-1027. [PMID: 38856829 DOI: 10.1007/s12975-024-01261-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2024] [Revised: 04/16/2024] [Accepted: 05/13/2024] [Indexed: 06/11/2024]
Abstract
The treatment of intracranial aneurysms is dictated by its risk of rupture in the future. Several clinical and radiological risk factors for aneurysm rupture have been described and incorporated into prediction models. Despite the recent technological advancements in aneurysm imaging, linear length and visible irregularity with a bleb are the only radiological measure used in clinical prediction models. The purpose of this article is to summarize both the standard imaging techniques, including their limitations, and the advanced techniques being used experimentally to image aneurysms. It is expected that as our understanding of advanced techniques improves, and their ability to predict clinical events is demonstrated, they become an increasingly routine part of aneurysm assessment. It is important that neurovascular specialists understand the spectrum of imaging techniques available.
Collapse
Affiliation(s)
- Sricharan S Veeturi
- Canon Stroke and Vascular Research Center, Clinical and Translational Research Center, University at Buffalo, 875 Ellicott Street, Buffalo, NY, 14214, USA
- Department of Neurosurgery, University at Buffalo, Buffalo, NY, USA
| | - Samuel Hall
- Department of Neurosurgery, University Hospital Southampton NHS Foundation Trust, Southampton, UK
| | - Soichiro Fujimura
- Department of Mechanical Engineering, Tokyo University of Science, Tokyo, Japan
- Division of Innovation for Medical Information Technology, The Jikei University School of Medicine, Tokyo, Japan
| | | | - Elena Sagues
- Department of Neurology, University of Iowa, Iowa City, IA, USA
| | | | - Vincent M Tutino
- Canon Stroke and Vascular Research Center, Clinical and Translational Research Center, University at Buffalo, 875 Ellicott Street, Buffalo, NY, 14214, USA.
- Department of Pathology and Anatomical Sciences, University at Buffalo, Buffalo, NY, USA.
| |
Collapse
|
2
|
Delfan N, Abbasi F, Emamzadeh N, Bahri A, Parvaresh Rizi M, Motamedi A, Moshiri B, Iranmehr A. Advancing Intracranial Aneurysm Detection: A Comprehensive Systematic Review and Meta-analysis of Deep Learning Models Performance, Clinical Integration, and Future Directions. J Clin Neurosci 2025; 136:111243. [PMID: 40306254 DOI: 10.1016/j.jocn.2025.111243] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2025] [Revised: 03/16/2025] [Accepted: 04/13/2025] [Indexed: 05/02/2025]
Abstract
BACKGROUND Cerebral aneurysms pose a significant risk to patient safety, particularly when ruptured, emphasizing the need for early detection and accurate prediction. Traditional diagnostic methods, reliant on clinician-based evaluations, face challenges in sensitivity and consistency, prompting the exploration of deep learning (DL) systems for improved performance. METHODS This systematic review and meta-analysis assessed the performance of DL models in detecting and predicting intracranial aneurysms compared to clinician-based evaluations. Imaging modalities included CT angiography (CTA), digital subtraction angiography (DSA), and time-of-flight MR angiography (TOF-MRA). Data on lesion-wise sensitivity, specificity, and the impact of DL assistance on clinician performance were analyzed. Subgroup analyses evaluated DL sensitivity by aneurysm size and location, and interrater agreement was measured using Fleiss' κ. RESULTS DL systems achieved an overall lesion-wise sensitivity of 90 % and specificity of 94 %, outperforming human diagnostics. Clinician specificity improved significantly with DL assistance, increasing from 83 % to 85 % in the patient-wise scenario and from 93 % to 95 % in the lesion-wise scenario. Similarly, clinician sensitivity also showed notable improvement with DL assistance, rising from 82 % to 96 % in the patient-wise scenario and from 82 % to 88 % in the lesion-wise scenario. Subgroup analysis showed DL sensitivity varied with aneurysm size and location, reaching 100 % for aneurysms larger than 10 mm. Additionally, DL assistance improved interrater agreement among clinicians, with Fleiss' κ increasing from 0.668 to 0.862. CONCLUSIONS DL models demonstrate transformative potential in managing cerebral aneurysms by enhancing diagnostic accuracy, reducing missed cases, and supporting clinical decision-making. However, further validation in diverse clinical settings and seamless integration into standard workflows are necessary to fully realize the benefits of DL-driven diagnostics.
Collapse
Affiliation(s)
- Niloufar Delfan
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran; Neuraitex Research Center, School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran
| | - Fatemeh Abbasi
- Student Research Committee, Faculty of Medicine, Mazandaran University of Medical Sciences, Mazandaran, Iran
| | - Negar Emamzadeh
- Doctor of Medicine (MD), Iran University of Medical Sciences, Tehran, Iran
| | - Amirmohammad Bahri
- Student Research Committee, School of Medicine, Iran University of Medical Science, Tehran, Iran
| | - Mansour Parvaresh Rizi
- Department of Neurosurgery, Hazrat Rasool Hospital, Iran University of Medical Sciences, Tehran, Iran
| | - Alireza Motamedi
- Student Research Committee, School of Medicine, Tabriz University of Medical Sciences, Tabriz, Iran
| | - Behzad Moshiri
- School of Electrical and Computer Engineering, College of Engineering, University of Tehran, Tehran, Iran; Department of Electrical and Computer Engineering University of Waterloo, Waterloo, Canada.
| | - Arad Iranmehr
- Department of Neurosurgery, Sina Hospital, Tehran University of Medical Sciences, Tehran, Iran; Gammaknife Center, Yas Hospital, Tehran University of Medical Sciences, Tehran, Iran.
| |
Collapse
|
3
|
Hsu WC, Meuschke M, Frangi AF, Preim B, Lawonn K. A survey of intracranial aneurysm detection and segmentation. Med Image Anal 2025; 101:103493. [PMID: 39970529 DOI: 10.1016/j.media.2025.103493] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2023] [Revised: 01/31/2025] [Accepted: 02/01/2025] [Indexed: 02/21/2025]
Abstract
Intracranial aneurysms (IAs) are a critical public health concern: they are asymptomatic and can lead to fatal subarachnoid hemorrhage in case of rupture. Neuroradiologists rely on advanced imaging techniques to identify aneurysms in a patient and consider the characteristics of IAs along with several other patient-related factors for rupture risk assessment and treatment decision-making. The process of diagnostic image reading is time-intensive and prone to inter- and intra-individual variations, so researchers have proposed many computer-aided diagnosis (CAD) systems for aneurysm detection and segmentation. This paper provides a comprehensive literature survey of semi-automated and automated approaches for IA detection and segmentation and proposes a taxonomy to classify the approaches. We also discuss the current issues and give some insight into the future direction of CAD systems for IA detection and segmentation.
Collapse
Affiliation(s)
- Wei-Chan Hsu
- Friedrich Schiller University Jena, Faculty of Mathematics and Computer Science, Ernst-Abbe-Platz 2, Jena, 07743, Thuringia, Germany.
| | - Monique Meuschke
- Otto von Guericke University Magdeburg, Department of Simulation and Graphics, Universitätsplatz 2, Magdeburg, 39106, Saxony-Anhalt, Germany
| | - Alejandro F Frangi
- University of Manchester, Christabel Pankhurst Institute, Schools of Engineering and Health Sciences, Oxford Rd, Manchester, M13 9PL, Greater Manchester, United Kingdom
| | - Bernhard Preim
- Otto von Guericke University Magdeburg, Department of Simulation and Graphics, Universitätsplatz 2, Magdeburg, 39106, Saxony-Anhalt, Germany
| | - Kai Lawonn
- Friedrich Schiller University Jena, Faculty of Mathematics and Computer Science, Ernst-Abbe-Platz 2, Jena, 07743, Thuringia, Germany
| |
Collapse
|
4
|
Hou L, Zhang J, Zhao L, Meng K, Feng X. CTA image segmentation method for intracranial aneurysms based on MGLIA net. Sci Rep 2025; 15:10593. [PMID: 40148442 PMCID: PMC11950224 DOI: 10.1038/s41598-025-95143-2] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/11/2024] [Accepted: 03/19/2025] [Indexed: 03/29/2025] Open
Abstract
Accurately segmenting the aneurysm area from CTA data can reconstruct the three-dimensional morphology of the aneurysm, effectively evaluating the type, size, and risk of rupture of the aneurysm. However, accurate separation of the aneurysm is limited by the accuracy of image segmentation algorithms. Currently, the segmentation methods for intracranial aneurysms using CTA big data and deep learning lack universality. When faced with a new hospital acquired imaging modality, it is usually necessary to redesign and train the segmentation network. In response to this issue, this article proposes a more universal segmentation model and develops the GLIA Net algorithm (MGLIA Net model) based on MoblieNet, which can perform adaptive target segmentation on aneurysm images collected under different conditions. To verify the effectiveness of the algorithm in intracranial aneurysm segmentation, performance tests were conducted on an open-source dataset. The results showed that the proposed algorithm achieved segmentation accuracy of 55.9% and 73.1% on two datasets, respectively, significantly better than the original GLIA-Net algorithm.
Collapse
Affiliation(s)
- Lijie Hou
- School of Life Science and Technology, Changchun University of Science and Technology, ChangChun City, 130000, China
| | - Jian Zhang
- School of Life Science and Technology, Changchun University of Science and Technology, ChangChun City, 130000, China
| | - Lihui Zhao
- School of Life Science and Technology, Changchun University of Science and Technology, ChangChun City, 130000, China
| | - Ke Meng
- The Third Bethune Hospital of JiLin University, Neurosurgery, ChangChun City, 130000, China
| | - Xin Feng
- School of Life Science and Technology, Changchun University of Science and Technology, ChangChun City, 130000, China.
- School of Computer Science and Technology, ChangChun University of Science and Technology, 7089 Weiguang Street, ChangChun City, 130000, China.
| |
Collapse
|
5
|
Mata-Castillo M, Hernández-Villegas A, Gordillo-Castillo N, Díaz-Román J. Systematic review of artificial intelligence methods for detection and segmentation of unruptured intracranial aneurysms using medical imaging. Med Biol Eng Comput 2025:10.1007/s11517-025-03345-7. [PMID: 40095414 DOI: 10.1007/s11517-025-03345-7] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/26/2024] [Accepted: 03/07/2025] [Indexed: 03/19/2025]
Abstract
Unruptured intracranial aneurysms are protuberances that appear in cerebral arteries, and their diagnostic evaluation can be a complex, time-consuming, and exhaustive task. In recent years, computer-aided systems have been developed to improve diagnostic processes. Although the proposed methods have already been reviewed to assess their suitability for clinical use, the segmentation methods have not been reviewed in detail, nor has there been a standardized way to compare segmentation and detection tasks. A systematic review was conducted to examine the technical and methodological factors contributing to this limitation. The analysis encompassed 49 studies conducted between 2019 and 2023 that utilized artificial intelligence methods and any medical imaging modality for the detection or segmentation of intracranial aneurysms. Most of the included studies focused exclusively on detection (57%), magnetic resonance angiography was the predominant imaging modality (47%), and the methodologies generally used 3D imaging as the input (71%). The reported sensitivities ranged from 0.68 to 0.90, specificities from 0.18 to 1.0, false positives per case from 0.18 to 13.8, and the Dice similarity coefficient from 0.53 to 0.98. Variations in aneurysm size were found to have a substantial impact on system performance. Studies were evaluated using a diagnostic accuracy study quality assessment tool, which revealed significant concerns regarding applicability. These concerns primarily stem from the poor reproducibility and inconsistent reporting of metrics. Recommendations for reporting outcomes were made to compare procedures across different types of imaging and tasks.
Collapse
Affiliation(s)
- Mario Mata-Castillo
- Department of Electrical and Computer Engineering, Autonomous University of Ciudad Juarez, Ciudad Juárez, México
| | - Andrea Hernández-Villegas
- Department of Electrical and Computer Engineering, Autonomous University of Ciudad Juarez, Ciudad Juárez, México
| | - Nelly Gordillo-Castillo
- Department of Electrical and Computer Engineering, Autonomous University of Ciudad Juarez, Ciudad Juárez, México
| | - José Díaz-Román
- Department of Electrical and Computer Engineering, Autonomous University of Ciudad Juarez, Ciudad Juárez, México.
| |
Collapse
|
6
|
Li B, Liu N, Bai J, Xu J, Tang Y, Liu Y. MTMU: Multi-domain Transformation based Mamba-UNet designed for unruptured intracranial aneurysm segmentation. BMC Med Imaging 2025; 25:80. [PMID: 40050794 PMCID: PMC11887374 DOI: 10.1186/s12880-025-01611-6] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/24/2024] [Accepted: 02/24/2025] [Indexed: 03/09/2025] Open
Abstract
The management of Unruptured Intracranial aneurysm (UIA) depends on the shape parameters assessment of lesions, which requires target segmentation. However, the segmentation of UIA is a challenging task due to the small volume of the lesions and the indistinct boundary between the lesion and the parent arteries. To relieve these issues, this article proposes a multi-domain transformation-based Mamba-UNet (MTMU) for UIA segmentation. The model employs a U-shaped segmentation architecture, equipped with the feature encoder consisting of a set of Mamba and Flip (MF) blocks. It endows the model with the capability of long-range dependency perceiving while balancing computational cost. Fourier Transform (FT) based connection allows for the enhancement of edge information in feature maps, thereby mitigating the difficulties in feature extraction caused by the small size of the target and the limited number of foreground pixels. Additionally, a sub task providing target geometry constrain (GC) is utilized to constrain the model training, aiming at splitting aneurysm dome from its parent artery accurately. Extensive experiments have been conducted to demonstrate the superior performance of the proposed method compared to other competitive medical segmentation methods. The results prove that the proposed method have great clinical application prospects.
Collapse
Affiliation(s)
- Bing Li
- College of Electrical Engineering, Sichuan University, Chengdu, 610065, China
| | - Nian Liu
- College of Electrical Engineering, Sichuan University, Chengdu, 610065, China
| | - Jianbin Bai
- Department of Neurosurgery 3201 Hospital, Hanzhong, 723000, China
| | - Jianfeng Xu
- Neurosurgery of the Third People's Hospital of Mianyang/Sichuan Mental Health Center, Mianyang, 621000, China
| | - Yi Tang
- North Sichuan Medical College, Nanchong, 637000, China
| | - Yan Liu
- College of Electrical Engineering, Sichuan University, Chengdu, 610065, China.
| |
Collapse
|
7
|
Tan S, He J, Cui M, Gao Y, Sun D, Xie Y, Cai J, Zaki N, Qin W. Interstitial-guided automatic clinical tumor volume segmentation network for cervical cancer brachytherapy. Comput Med Imaging Graph 2025; 123:102520. [PMID: 40120492 DOI: 10.1016/j.compmedimag.2025.102520] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/05/2024] [Revised: 02/23/2025] [Accepted: 02/25/2025] [Indexed: 03/25/2025]
Abstract
Automatic clinical tumor volume (CTV) delineation is pivotal to improving outcomes for interstitial brachytherapy cervical cancer. However, the prominent differences in gray values due to the interstitial needles bring great challenges on deep learning-based segmentation model. In this study, we proposed a novel interstitial-guided segmentation network termed advance reverse guided network (ARGNet) for cervical tumor segmentation with interstitial brachytherapy. Firstly, the location information of interstitial needles was integrated into the deep learning framework via multi-task by a cross-stitch way to share encoder feature learning. Secondly, a spatial reverse attention mechanism is introduced to mitigate the distraction characteristic of needles on tumor segmentation. Furthermore, an uncertainty area module is embedded between the skip connections and the encoder of the tumor segmentation task, which is to enhance the model's capability in discerning ambiguous boundaries between the tumor and the surrounding tissue. Comprehensive experiments were conducted retrospectively on 191 CT scans under multi-course interstitial brachytherapy. The experiment results demonstrated that the characteristics of interstitial needles play a role in enhancing the segmentation, achieving the state-of-the-art performance, which is anticipated to be beneficial in radiotherapy planning.
Collapse
Affiliation(s)
- Shudong Tan
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; University of Chinese Academy of Sciences, Beijing 101400, China
| | - Jiahui He
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China; School of Computer Science, Faculty of Science and Engineering, University of Nottingham Ningbo China, Ningbo 315100, China
| | - Ming Cui
- Liaoning Cancer Hospital and Institute, Shenyang, Liaoning 110042, China
| | - Yuhua Gao
- Liaoning Cancer Hospital and Institute, Shenyang, Liaoning 110042, China
| | - Deyu Sun
- Liaoning Cancer Hospital and Institute, Shenyang, Liaoning 110042, China
| | - Yaoqin Xie
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China
| | - Jing Cai
- Department of Health Technology and Informatics, The Hong Kong Polytechnic University, 999077, Hong Kong SAR, China
| | - Nazar Zaki
- Department of Computer Science and Software Engineering, College of Information Technology, United Arab Emirates University, Al Ain, United Arab Emirates
| | - Wenjian Qin
- Shenzhen Institutes of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, China.
| |
Collapse
|
8
|
Owens M, Tenhoeve SA, Rawson C, Azab M, Karsy M. Systematic Review of Radiomics and Artificial Intelligence in Intracranial Aneurysm Management. J Neuroimaging 2025; 35:e70037. [PMID: 40095247 PMCID: PMC11912304 DOI: 10.1111/jon.70037] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/26/2024] [Revised: 03/05/2025] [Accepted: 03/06/2025] [Indexed: 03/19/2025] Open
Abstract
Intracranial aneurysms, with an annual incidence of 2%-3%, reflect a rare disease associated with significant mortality and morbidity risks when ruptured. Early detection, risk stratification of high-risk subgroups, and prediction of patient outcomes are important to treatment. Radiomics is an emerging field using the quantification of medical imaging to identify parameters beyond traditional radiology interpretation that may offer diagnostic or prognostic significance. The general radiomic workflow involves image normalization and segmentation, feature extraction, feature selection or dimensional reduction, training of a predictive model, and validation of the said model. Artificial intelligence (AI) techniques have shown increasing interest in applications toward vascular pathologies, with some commercially successful software including AiDoc, RapidAI, and Viz.AI, as well as the more recent Viz Aneurysm. We performed a systematic review of 684 articles and identified 84 articles exploring the applications of radiomics and AI in aneurysm treatment. Most studies were published between 2018 and 2024, with over half of articles in 2022 and 2023. Studies included categories such as aneurysm diagnosis (25.0%), rupture risk prediction (50.0%), growth rate prediction (4.8%), hemodynamic assessment (2.4%), clinical outcome prediction (11.9%), and occlusion or stenosis assessment (6.0%). Studies utilized molecular data (2.4%), radiologic data alone (51.2%), clinical data alone (28.6%), and combined radiologic and clinical data (17.9%). These results demonstrate the current status of this emerging and exciting field. An increased pace of innovation in this space is likely with the expansion of clinical applications of radiomics and AI in multiple vascular pathologies.
Collapse
Affiliation(s)
- Monica‐Rae Owens
- Spencer Fox Eccles School of MedicineUniversity of UtahSalt Lake CityUtahUSA
| | - Samuel A. Tenhoeve
- Spencer Fox Eccles School of MedicineUniversity of UtahSalt Lake CityUtahUSA
| | - Clayton Rawson
- College of Osteopathic MedicineNOORDA CollegeProvoUtahUSA
| | - Mohammed Azab
- Kasr Al Ainy School of MedicineCairo UniversityAl ManialEgypt
| | - Michael Karsy
- Department of NeurosurgeryUniversity of MichiganAnn ArborMichiganUSA
| |
Collapse
|
9
|
Yao L, Chen D, Zhao X, Fei M, Song Z, Xue Z, Zhan Y, Song B, Shi F, Wang Q, Shen D. AASeg: Artery-Aware Global-to-Local Framework for Aneurysm Segmentation in Head and Neck CTA Images. IEEE TRANSACTIONS ON MEDICAL IMAGING 2025; 44:1273-1283. [PMID: 39527438 DOI: 10.1109/tmi.2024.3496194] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/16/2024]
Abstract
Aneurysm segmentation in computed tomography angiography (CTA) images is essential for medical intervention aimed at preventing subarachnoid hemorrhages. However, most existing studies tend to overlook the topological characteristics of arteries related to aneurysms, often resulting in suboptimal performance in aneurysm segmentation. To address this challenge, we propose an artery-aware global-to-local framework for aneurysm segmentation (AASeg) using CTA images of head and neck. This framework consists of two key components: 1) a centerline graph network (CG-Net) for aneurysm global localization, and 2) a point cloud network (PC-Net) for local aneurysm segmentation. The centerline graph is generated by extracting artery centerline structures from vessel masks obtained through a pre-trained model for head and neck vessel segmentation. This representation serves as a high-level representation of the artery structure, allowing for analysis of aneurysms along the entire arteries. It facilitates aneurysm localization via aneurysm-segment graph classification along the arteries. Then, local region of aneurysm segment can be sampled from the vessel mask according to the aneurysm-segment graph. Subsequently, aneurysm segmentation is performed on the point cloud constructed from the aneurysm segment through the PC-Net. Extensive experiments show that the proposed framework achieves state-of-the-art performance in aneurysm localization on a main dataset and an external testing dataset, with Recall of 84.1% and 80.7%, false positives per case of 1.72 and 1.69, and segmentation DSC of 66.1% and 60.2%, respectively.
Collapse
|
10
|
Schmidt CC, Stahl R, Mueller F, Fischer TD, Forbrig R, Brem C, Isik H, Seelos K, Thon N, Stoecklein S, Liebig T, Rueckel J. Evaluation of AI-Powered Routine Screening of Clinically Acquired cMRIs for Incidental Intracranial Aneurysms. Diagnostics (Basel) 2025; 15:254. [PMID: 39941184 PMCID: PMC11816387 DOI: 10.3390/diagnostics15030254] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/27/2024] [Revised: 01/10/2025] [Accepted: 01/19/2025] [Indexed: 02/16/2025] Open
Abstract
Objectives: To quantify the clinical value of integrating a commercially available artificial intelligence (AI) algorithm for intracranial aneurysm detection in a screening setting that utilizes cranial magnetic resonance imaging (cMRI) scans acquired primarily for other clinical purposes. Methods: A total of 907 consecutive cMRI datasets, including time-of-flight-angiography (TOF-MRA), were retrospectively identified from patients unaware of intracranial aneurysms. cMRIs were analyzed by a commercial AI algorithm and reassessed by consultant-level neuroradiologists, who provided confidence scores and workup recommendations for suspicious findings. Patients with newly identified findings (relative to initial cMRI reports) were contacted for on-site consultations, including cMRI follow-up or catheter angiography. The number needed to screen (NNS) was defined as the cMRI quantity that must undergo AI screening to achieve various clinical endpoints. Results: The algorithm demonstrates high sensitivities (100% for findings >4 mm in diameter), a 17.8% MRA alert rate and positive predictive values of 11.5-43.8% (depending on whether inconclusive findings are considered or not). Initial cMRI reports missed 50 out of 59 suspicious findings, including 13 certain intradural aneurysms. The NNS for additionally identifying highly suspicious and therapeutically relevant (unruptured intracranial aneurysm treatment scores balanced or in favor of treatment) findings was 152. The NNS for recommending additional follow-/workup imaging (cMRI or catheter angiography) was 26, suggesting an additional up to 4% increase in imaging procedures resulting from a preceding AI screening. Conclusions: AI-powered routine screening of cMRIs clearly lowers the high risk of incidental aneurysm non-reporting but results in a substantial burden of additional imaging follow-up for minor or inconclusive findings.
Collapse
Affiliation(s)
| | - Robert Stahl
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| | - Franziska Mueller
- Department of Radiology, University Hospital, LMU Munich, 81377 Munich, Germany
| | - Thomas David Fischer
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| | - Robert Forbrig
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| | - Christian Brem
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| | - Hakan Isik
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| | - Klaus Seelos
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| | - Niklas Thon
- Department of Neurosurgery, University Hospital, LMU Munich, 81377 Munich, Germany
| | - Sophia Stoecklein
- Department of Radiology, University Hospital, LMU Munich, 81377 Munich, Germany
| | - Thomas Liebig
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| | - Johannes Rueckel
- Institute of Neuroradiology, University Hospital, LMU Munich, 81377 Munich, Germany; (C.C.S.)
| |
Collapse
|
11
|
Lei W, Xu W, Li K, Zhang X, Zhang S. MedLSAM: Localize and segment anything model for 3D CT images. Med Image Anal 2025; 99:103370. [PMID: 39447436 DOI: 10.1016/j.media.2024.103370] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2023] [Revised: 09/09/2024] [Accepted: 10/09/2024] [Indexed: 10/26/2024]
Abstract
Recent advancements in foundation models have shown significant potential in medical image analysis. However, there is still a gap in models specifically designed for medical image localization. To address this, we introduce MedLAM, a 3D medical foundation localization model that accurately identifies any anatomical part within the body using only a few template scans. MedLAM employs two self-supervision tasks: unified anatomical mapping (UAM) and multi-scale similarity (MSS) across a comprehensive dataset of 14,012 CT scans. Furthermore, we developed MedLSAM by integrating MedLAM with the Segment Anything Model (SAM). This innovative framework requires extreme point annotations across three directions on several templates to enable MedLAM to locate the target anatomical structure in the image, with SAM performing the segmentation. It significantly reduces the amount of manual annotation required by SAM in 3D medical imaging scenarios. We conducted extensive experiments on two 3D datasets covering 38 distinct organs. Our findings are twofold: (1) MedLAM can directly localize anatomical structures using just a few template scans, achieving performance comparable to fully supervised models; (2) MedLSAM closely matches the performance of SAM and its specialized medical adaptations with manual prompts, while minimizing the need for extensive point annotations across the entire dataset. Moreover, MedLAM has the potential to be seamlessly integrated with future 3D SAM models, paving the way for enhanced segmentation performance. Our code is public at https://github.com/openmedlab/MedLSAM.
Collapse
Affiliation(s)
- Wenhui Lei
- School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China; Shanghai AI Lab, Shanghai, China
| | - Wei Xu
- School of Biomedical Engineering, Division of Life Sciences and Medicine, University of Science and Technology of China, Hefei, China; West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
| | - Kang Li
- Shanghai AI Lab, Shanghai, China; West China Biomedical Big Data Center, West China Hospital, Sichuan University, Chengdu, China
| | - Xiaofan Zhang
- School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China; Shanghai AI Lab, Shanghai, China.
| | - Shaoting Zhang
- School of Electronic Information and Electrical Engineering, Shanghai Jiao Tong University, Shanghai, China; Shanghai AI Lab, Shanghai, China
| |
Collapse
|
12
|
You W, Feng J, Lu J, Chen T, Liu X, Wu Z, Gong G, Sui Y, Wang Y, Zhang Y, Ye W, Chen X, Lv J, Wei D, Tang Y, Deng D, Gui S, Lin J, Chen P, Wang Z, Gong W, Wang Y, Zhu C, Zhang Y, Saloner DA, Mitsouras D, Guan S, Li Y, Jiang Y, Wang Y. Diagnosis of intracranial aneurysms by computed tomography angiography using deep learning-based detection and segmentation. J Neurointerv Surg 2024; 17:e132-e138. [PMID: 38238009 DOI: 10.1136/jnis-2023-021022] [Citation(s) in RCA: 2] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/10/2023] [Accepted: 11/11/2023] [Indexed: 12/28/2024]
Abstract
BACKGROUND Detecting and segmenting intracranial aneurysms (IAs) from angiographic images is a laborious task. OBJECTIVE To evaluates a novel deep-learning algorithm, named vessel attention (VA)-Unet, for the efficient detection and segmentation of IAs. METHODS This retrospective study was conducted using head CT angiography (CTA) examinations depicting IAs from two hospitals in China between 2010 and 2021. Training included cases with subarachnoid hemorrhage (SAH) and arterial stenosis, common accompanying vascular abnormalities. Testing was performed in cohorts with reference-standard digital subtraction angiography (cohort 1), with SAH (cohort 2), acquired outside the time interval of training data (cohort 3), and an external dataset (cohort 4). The algorithm's performance was evaluated using sensitivity, recall, false positives per case (FPs/case), and Dice coefficient, with manual segmentation as the reference standard. RESULTS The study included 3190 CTA scans with 4124 IAs. Sensitivity, recall, and FPs/case for detection of IAs were, respectively, 98.58%, 96.17%, and 2.08 in cohort 1; 95.00%, 88.8%, and 3.62 in cohort 2; 96.00%, 93.77%, and 2.60 in cohort 3; and, 96.17%, 94.05%, and 3.60 in external cohort 4. The segmentation accuracy, as measured by the Dice coefficient, was 0.78, 0.71, 0.71, and 0.66 for cohorts 1-4, respectively. VA-Unet detection recall and FPs/case and segmentation accuracy were affected by several clinical factors, including aneurysm size, bifurcation aneurysms, and the presence of arterial stenosis and SAH. CONCLUSIONS VA-Unet accurately detected and segmented IAs in head CTA comparably to expert interpretation. The proposed algorithm has significant potential to assist radiologists in efficiently detecting and segmenting IAs from CTA images.
Collapse
Affiliation(s)
- Wei You
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Junqiang Feng
- Department of Neurosurgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Jing Lu
- Department of Radiology, Third Medical Center of Chinese PLA General Hospital, Beijing, China
| | - Ting Chen
- School of Biomedical Engineering, Capital Medical University, Beijing, China
| | - Xinke Liu
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Zhenzhou Wu
- Artificial Intelligence Research Center, China National Clinical Research Center for Neurological Diseases, Beijing, China
| | - Guoyang Gong
- Artificial Intelligence Research Center, China National Clinical Research Center for Neurological Diseases, Beijing, China
| | - Yutong Sui
- Artificial Intelligence Research Center, China National Clinical Research Center for Neurological Diseases, Beijing, China
| | - Yanwen Wang
- Artificial Intelligence Research Center, China National Clinical Research Center for Neurological Diseases, Beijing, China
| | - Yifan Zhang
- Artificial Intelligence Research Center, China National Clinical Research Center for Neurological Diseases, Beijing, China
| | - Wanxing Ye
- Artificial Intelligence Research Center, China National Clinical Research Center for Neurological Diseases, Beijing, China
| | - Xiheng Chen
- Department of Neurosurgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Jian Lv
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Dachao Wei
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Yudi Tang
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Dingwei Deng
- Department of Intervention, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Siming Gui
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Jun Lin
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Peike Chen
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
| | - Ziyao Wang
- Department of Interventional Neuroradiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Wentao Gong
- Department of Interventional Neuroradiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Yang Wang
- Department of Neurosurgery, Beijing Chaoyang Hospital, Capital Medical University, Beijing, China
| | - Chengcheng Zhu
- Department of Radiology, University of Washington, Seattle, Washington, USA
| | - Yue Zhang
- San Francisco Veterans Affairs Medical Center, San Francisco, California, USA
| | - David A Saloner
- San Francisco Veterans Affairs Medical Center, San Francisco, California, USA
- Department of Radiology and Biomedical Imaging, University California, San Francisco, San Francisco, California, USA
| | - Dimitrios Mitsouras
- San Francisco Veterans Affairs Medical Center, San Francisco, California, USA
- Department of Radiology and Biomedical Imaging, University California, San Francisco, San Francisco, California, USA
| | - Sheng Guan
- Department of Interventional Neuroradiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China
| | - Youxiang Li
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
- Department of Neurointerventional Engineering and Technology (NO: BG0287), Beijing Engineering Research Center, Beijing, China
| | - Yuhua Jiang
- Department of Neurosurgery, Beijing Tiantan Hospital and Beijing Neurosurgical Institute, Capital Medical University, Beijing, China
- Department of Neurointerventional Engineering and Technology (NO: BG0287), Beijing Engineering Research Center, Beijing, China
| | - Yan Wang
- San Francisco Veterans Affairs Medical Center, San Francisco, California, USA
- Department of Radiology and Biomedical Imaging, University California, San Francisco, San Francisco, California, USA
| |
Collapse
|
13
|
Vaccaro M, Almaatouq A, Malone T. When combinations of humans and AI are useful: A systematic review and meta-analysis. Nat Hum Behav 2024; 8:2293-2303. [PMID: 39468277 DOI: 10.1038/s41562-024-02024-1] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2023] [Accepted: 09/23/2024] [Indexed: 10/30/2024]
Abstract
Inspired by the increasing use of artificial intelligence (AI) to augment humans, researchers have studied human-AI systems involving different tasks, systems and populations. Despite such a large body of work, we lack a broad conceptual understanding of when combinations of humans and AI are better than either alone. Here we addressed this question by conducting a preregistered systematic review and meta-analysis of 106 experimental studies reporting 370 effect sizes. We searched an interdisciplinary set of databases (the Association for Computing Machinery Digital Library, the Web of Science and the Association for Information Systems eLibrary) for studies published between 1 January 2020 and 30 June 2023. Each study was required to include an original human-participants experiment that evaluated the performance of humans alone, AI alone and human-AI combinations. First, we found that, on average, human-AI combinations performed significantly worse than the best of humans or AI alone (Hedges' g = -0.23; 95% confidence interval, -0.39 to -0.07). Second, we found performance losses in tasks that involved making decisions and significantly greater gains in tasks that involved creating content. Finally, when humans outperformed AI alone, we found performance gains in the combination, but when AI outperformed humans alone, we found losses. Limitations of the evidence assessed here include possible publication bias and variations in the study designs analysed. Overall, these findings highlight the heterogeneity of the effects of human-AI collaboration and point to promising avenues for improving human-AI systems.
Collapse
Affiliation(s)
- Michelle Vaccaro
- MIT Center for Collective Intelligence, Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA
- Institute for Data, Systems, and Society, Schwarzman College of Computing, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Abdullah Almaatouq
- MIT Center for Collective Intelligence, Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA
| | - Thomas Malone
- MIT Center for Collective Intelligence, Sloan School of Management, Massachusetts Institute of Technology, Cambridge, MA, USA.
| |
Collapse
|
14
|
Bizjak Ž, Choi JH, Park W, Pernuš F, Špiclin Ž. Deep geometric learning for intracranial aneurysm detection: towards expert rater performance. J Neurointerv Surg 2024; 16:1157-1162. [PMID: 37833055 DOI: 10.1136/jnis-2023-020905] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2023] [Accepted: 09/19/2023] [Indexed: 10/15/2023]
Abstract
BACKGROUND Early detection of intracranial aneurysms (IAs) is crucial for patient outcomes. Typically identified on angiographic scans such as CT angiography (CTA) or MR angiography (MRA), the sensitivity of experts in studies on small IAs (diameter <3 mm) was moderate (64-74.1% for CTAs and 70-92.8% for MRAs), and these figures could be lower in a routine clinical setting. Recent research shows that the expert level of sensitivity might be achieved using deep learning approaches. METHODS A large multisite dataset including 1054 MRA and 2174 CTA scans with expert IA annotations was collected. A novel modality-agnostic two-step IA detection approach was proposed. The first step used nnU-Net for segmenting vascular structures, with model training performed separately for each modality. In the second step, segmentations were converted to vascular surface that was parcellated by sampling point clouds and, using a PointNet++ model, each point was labeled as an aneurysm or vessel class. RESULTS Quantitative validation of the test data from different sites than the training data showed that the proposed approach achieved pooled sensitivity of 85% and 90% on 157 MRA scans and 1338 CTA scans, respectively, while the sensitivity for small IAs was 72% and 83%, respectively. The corresponding number of false findings per image was low at 1.54 and 1.57, and 0.4 and 0.83 on healthy subject data. CONCLUSIONS The proposed approach achieved a state-of-the-art balance between the sensitivity and the number of false findings, matched the expert-level sensitivity to small (and other) IAs on external data, and therefore seems fit for computer-assisted detection of IAs in a clinical setting.
Collapse
Affiliation(s)
- Žiga Bizjak
- Laboratory of Imaging Technologies, University of Ljubljana Faculty of Electrical Engineering, Ljubljana, Slovenia
| | - June Ho Choi
- Department of Neurological Surgery, Asan Medical Center, Songpa-gu, Seoul, Korea
| | - Wonhyoung Park
- Department of Neurological Surgery, Asan Medical Center, Songpa-gu, Seoul, Korea
| | - Franjo Pernuš
- Laboratory of Imaging Technologies, University of Ljubljana Faculty of Electrical Engineering, Ljubljana, Slovenia
| | - Žiga Špiclin
- Laboratory of Imaging Technologies, University of Ljubljana Faculty of Electrical Engineering, Ljubljana, Slovenia
| |
Collapse
|
15
|
Ceballos-Arroyo AM, Nguyen HT, Zhu F, Yadav SM, Kim J, Qin L, Young G, Jiang H. Vessel-aware aneurysm detection using multi-scale deformable 3D attention. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2024; 15005:754-765. [PMID: 40226842 PMCID: PMC11986933 DOI: 10.1007/978-3-031-72086-4_71] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 04/15/2025]
Abstract
Manual detection of intracranial aneurysms (IAs) in computed tomography (CT) scans is a complex, time-consuming task even for expert clinicians, and automating the process is no less challenging. Critical difficulties associated with detecting aneurysms include their small (yet varied) size compared to scans and a high potential for false positive (FP) predictions. To address these issues, we propose a 3D, multi-scale neural architecture that detects aneurysms via a deformable attention mechanism that operates on vessel distance maps derived from vessel segmentations and 3D features extracted from the layers of a convolutional network. Likewise, we reformulate aneurysm segmentation as bounding cuboid prediction using binary cross entropy and three localization losses (location, size, IoU). Given three validation sets comprised of 152/138/38 CT scans and containing 126/101/58 aneurysms, we achieved a Sensitivity of 91.3%/97.0%/74.1% @ FP rates 0.53/0.56/0.87, with Sensitivity around 80% on small aneurysms. Manual inspection of outputs by experts showed our model only tends to miss aneurysms located in unusual locations. Code and model weights are available online.
Collapse
Affiliation(s)
| | | | | | | | | | - Lei Qin
- Brigham and Women's Hospital
| | | | | |
Collapse
|
16
|
Chai L, Xue S, Tang D, Liu J, Sun N, Liu X. TLF: Triple learning framework for intracranial aneurysms segmentation from unreliable labeled CTA scans. Comput Med Imaging Graph 2024; 116:102421. [PMID: 39084165 DOI: 10.1016/j.compmedimag.2024.102421] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/24/2024] [Revised: 07/21/2024] [Accepted: 07/21/2024] [Indexed: 08/02/2024]
Abstract
Intracranial aneurysm (IA) is a prevalent disease that poses a significant threat to human health. The use of computed tomography angiography (CTA) as a diagnostic tool for IAs remains time-consuming and challenging. Deep neural networks (DNNs) have made significant advancements in the field of medical image segmentation. Nevertheless, training large-scale DNNs demands substantial quantities of high-quality labeled data, making the annotation of numerous brain CTA scans a challenging endeavor. To address these challenges and effectively develop a robust IAs segmentation model from a large amount of unlabeled training data, we propose a triple learning framework (TLF). The framework primarily consists of three learning paradigms: pseudo-supervised learning, contrastive learning, and confident learning. This paper introduces an enhanced mean teacher model and voxel-selective strategy to conduct pseudo-supervised learning on unreliable labeled training data. Concurrently, we construct the positive and negative training pairs within the high-level semantic feature space to improve the overall learning efficiency of the TLF through contrastive learning. In addition, a multi-scale confident learning is proposed to correct unreliable labels, which enables the acquisition of broader local structural information instead of relying on individual voxels. To evaluate the effectiveness of our method, we conducted extensive experiments on a self-built database of hundreds of cases of brain CTA scans with IAs. Experimental results demonstrate that our method can effectively learn a robust CTA scan-based IAs segmentation model using unreliable labeled data, outperforming state-of-the-art methods in terms of segmentation accuracy. Codes are released at https://github.com/XueShuangqian/TLF.
Collapse
Affiliation(s)
- Lei Chai
- Engineering Research Center of Wideband Wireless Communication Technology, Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
| | - Shuangqian Xue
- Engineering Research Center of Wideband Wireless Communication Technology, Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
| | - Daodao Tang
- Engineering Research Center of Wideband Wireless Communication Technology, Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
| | - Jixin Liu
- Engineering Research Center of Wideband Wireless Communication Technology, Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China
| | - Ning Sun
- Engineering Research Center of Wideband Wireless Communication Technology, Ministry of Education, Nanjing University of Posts and Telecommunications, Nanjing 210003, China.
| | - Xiujuan Liu
- Department of Radiology, Zhuhai People's Hospital(Zhuhai Clinical Medical College of Jinan University), Zhuhai 519000, China
| |
Collapse
|
17
|
Wei J, Song X, Wei X, Yang Z, Dai L, Wang M, Sun Z, Jin Y, Ma C, Hu C, Xie X, Yang Z, Zhang Y, Lv F, Lu J, Zhu Y, Li Y. Knowledge-Augmented Deep Learning for Segmenting and Detecting Cerebral Aneurysms With CT Angiography: A Multicenter Study. Radiology 2024; 312:e233197. [PMID: 39162636 DOI: 10.1148/radiol.233197] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 08/21/2024]
Abstract
Background Deep learning (DL) could improve the labor-intensive, challenging processes of diagnosing cerebral aneurysms but requires large multicenter data sets. Purpose To construct a DL model using a multicenter data set for accurate cerebral aneurysm segmentation and detection on CT angiography (CTA) images and to compare its performance with radiology reports. Materials and Methods Consecutive head or head and neck CTA images of suspected unruptured cerebral aneurysms were gathered retrospectively from eight hospitals between February 2018 and October 2021 for model development. An external test set with reference standard digital subtraction angiography (DSA) scans was obtained retrospectively from one of the eight hospitals between February 2022 and February 2023. Radiologists (reference standard) assessed aneurysm segmentation, while model performance was evaluated using the Dice similarity coefficient (DSC). The model's aneurysm detection performance was assessed by sensitivity and comparing areas under the receiver operating characteristic curves (AUCs) between the model and radiology reports in the DSA data set with use of the DeLong test. Results Images from 6060 patients (mean age, 56 years ± 12 [SD]; 3375 [55.7%] female) were included for model development (training: 4342; validation: 1086; and internal test set: 632). Another 118 patients (mean age, 59 years ± 14; 79 [66.9%] female) were included in an external test set to evaluate performance based on DSA. The model achieved a DSC of 0.87 for aneurysm segmentation performance in the internal test set. Using DSA, the model achieved 85.7% (108 of 126 aneurysms [95% CI: 78.1, 90.1]) sensitivity in detecting aneurysms on per-vessel analysis, with no evidence of a difference versus radiology reports (AUC, 0.93 [95% CI: 0.90, 0.95] vs 0.91 [95% CI: 0.87, 0.94]; P = .67). Model processing time from reconstruction to detection was 1.76 minutes ± 0.32 per scan. Conclusion The proposed DL model could accurately segment and detect cerebral aneurysms at CTA with no evidence of a significant difference in diagnostic performance compared with radiology reports. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Payabvash in this issue.
Collapse
Affiliation(s)
- Jianyong Wei
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Xinyu Song
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Xiaoer Wei
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Zhiwen Yang
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Lisong Dai
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Mengfei Wang
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Zheng Sun
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Yidong Jin
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Chune Ma
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Chunhong Hu
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Xueqian Xie
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Zhenghan Yang
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Yonggao Zhang
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Fajin Lv
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Jie Lu
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Yueqi Zhu
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| | - Yuehua Li
- From the Clinical Research Center (J.W.) and Institute of Diagnostic and Interventional Radiology, Department of Radiology (X.S., X.W., L.D., Z.S., Y. Zhu, Y.L.), Shanghai Sixth People's Hospital Affiliated to Shanghai Jiao Tong University School of Medicine, No. 600 Yi Shan Rd, Shanghai 200233, China; School of Health Science and Engineering, University of Shanghai for Science and Technology, Shanghai, China (J.W., M.W., Y.J.); Shukun (Beijing) Network Technology, Beijing, China (Zhiwen Yang, C.M.); Department of Radiology, The First Affiliated Hospital of Soochow University, Jiangsu, China (C.H.); Department of Radiology, Shanghai General Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai, China (X.X.); Department of Cardiology, Beijing Friendship Hospital of Capital Medical University, Beijing, China (Zhenghan Yang); Department of Radiology, The First Affiliated Hospital of Zhengzhou University, Zhengzhou, Henan, China (Y. Zhang); Department of Radiology, The First Affiliated Hospital of Chongqing Medical University, Chongqing, China (F.L.); and Department of Nuclear Medicine, Xuanwu Hospital, Capital Medical University, Beijing, China (J.L.)
| |
Collapse
|
18
|
Zheng H, Liu X, Huang Z, Ren Y, Fu B, Shi T, Liu L, Guo Q, Tian C, Liang D, Wang R, Chen J, Hu Z. Deep learning for intracranial aneurysm segmentation using CT angiography. Phys Med Biol 2024; 69:155024. [PMID: 39008990 DOI: 10.1088/1361-6560/ad6372] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/15/2024] [Accepted: 07/15/2024] [Indexed: 07/17/2024]
Abstract
Objective.This study aimed to employ a two-stage deep learning method to accurately detect small aneurysms (4-10 mm in size) in computed tomography angiography images.Approach.This study included 956 patients from 6 hospitals and a public dataset obtained with 6 CT scanners from different manufacturers. The proposed method consists of two components: a lightweight and fast head region selection (HRS) algorithm and an adaptive 3D nnU-Net network, which is used as the main architecture for segmenting aneurysms. Segments generated by the deep neural network were compared with expert-generated manual segmentation results and assessed using Dice scores.MainResults.The area under the curve (AUC) exceeded 79% across all datasets. In particular, the precision and AUC reached 85.2% and 87.6%, respectively, on certain datasets. The experimental results demonstrated the promising performance of this approach, which reduced the inference time by more than 50% compared to direct inference without HRS.Significance.Compared with a model without HRS, the deep learning approach we developed can accurately segment aneurysms by automatically localizing brain regions and can accelerate aneurysm inference by more than 50%.
Collapse
Affiliation(s)
- Huizhong Zheng
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Xinfeng Liu
- Department of Radiology, Guizhou Provincial People's Hospital, Guiyang 550002, People's Republic of China
| | - Zhenxing Huang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Yan Ren
- AI for Science (AI4S)-Preferred Program, Peking University Shenzhen Graduate School, Shenzhen 518055, People's Republic of China
- School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen 518005, People's Republic of China
| | - Bin Fu
- AI for Science (AI4S)-Preferred Program, Peking University Shenzhen Graduate School, Shenzhen 518055, People's Republic of China
- School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen 518005, People's Republic of China
| | - Tianliang Shi
- Department of Radiology, Tongren Municipal People's Hospital, Tongren, Guizhou 554300, People's Republic of China
| | - Lu Liu
- Department of Radiology, The Second People's Hospital of Guiyang, Guiyang, Guizhou 550002, People's Republic of China
| | - Qiping Guo
- Department of Radiology, Xingyi Municipal People's Hospital, Xingyi, Guizhou 562400, People's Republic of China
| | - Chong Tian
- Department of Radiology, Guizhou Provincial People's Hospital, Guiyang 550002, People's Republic of China
| | - Dong Liang
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| | - Rongpin Wang
- Department of Radiology, Guizhou Provincial People's Hospital, Guiyang 550002, People's Republic of China
| | - Jie Chen
- AI for Science (AI4S)-Preferred Program, Peking University Shenzhen Graduate School, Shenzhen 518055, People's Republic of China
- School of Electronic and Computer Engineering, Peking University Shenzhen Graduate School, Shenzhen 518005, People's Republic of China
- Peng Cheng Laboratory, Shenzhen 518005, People's Republic of China
| | - Zhanli Hu
- Lauterbur Research Center for Biomedical Imaging, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen 518055, People's Republic of China
| |
Collapse
|
19
|
Xu Y, Zhou J, Liu Y. Multiple angle key points detection guided screening of unruptured intracranial aneurysms. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2024; 2024:1-4. [PMID: 40039221 DOI: 10.1109/embc53108.2024.10782775] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 03/06/2025]
Abstract
Early screening of unruptured intracranial aneurysms is critical for disease control so as to attract a lot of attention. However, the extremly small size of lesions and large variance of appearances pose difficulties in algorithm modeling. To tackle this challenge, the paper proposes a multiple angle key points detection guided screening method for localization and segmentation of intracranial aneurysms. The proposed method consists of two modules, multiple angle key points detection and multi-task learning based segmentation. The key points detection is performed on multiple projection directions thus to localize aneurysms candidates. Once obtaining region of interest patches, segmentation models constrained by parallel multi downstream task headers perform the delineation accordingly. Validation has been performed on a dataset containing computational tomograhpic angiography scans of patients with intracranial aneurysms. Results have shown that the proposed method could significantly improve segmentation and detection performance from target-wise and voxel-wise point of views, which have also demonstrated its effectiveness and application prospects.
Collapse
|
20
|
Wen Z, Wang Y, Zhong Y, Hu Y, Yang C, Peng Y, Zhan X, Zhou P, Zeng Z. Advances in research and application of artificial intelligence and radiomic predictive models based on intracranial aneurysm images. Front Neurol 2024; 15:1391382. [PMID: 38694771 PMCID: PMC11061371 DOI: 10.3389/fneur.2024.1391382] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2024] [Accepted: 04/02/2024] [Indexed: 05/04/2024] Open
Abstract
Intracranial aneurysm is a high-risk disease, with imaging playing a crucial role in their diagnosis and treatment. The rapid advancement of artificial intelligence in imaging technology holds promise for the development of AI-based radiomics predictive models. These models could potentially enable the automatic detection and diagnosis of intracranial aneurysms, assess their status, and predict outcomes, thereby assisting in the creation of personalized treatment plans. In addition, these techniques could improve diagnostic efficiency for physicians and patient prognoses. This article aims to review the progress of artificial intelligence radiomics in the study of intracranial aneurysms, addressing the challenges faced and future prospects, in hopes of introducing new ideas for the precise diagnosis and treatment of intracranial aneurysms.
Collapse
Affiliation(s)
- Zhongjian Wen
- School of Nursing, Southwest Medical University, Luzhou, China
- Wound Healing Basic Research and Clinical Application Key Laboratory of Luzhou, School of Nursing, Southwest Medical University, Luzhou, China
| | - Yiren Wang
- School of Nursing, Southwest Medical University, Luzhou, China
- Wound Healing Basic Research and Clinical Application Key Laboratory of Luzhou, School of Nursing, Southwest Medical University, Luzhou, China
| | - Yuxin Zhong
- School of Nursing, Guizhou Medical University, Guiyang, China
| | - Yiheng Hu
- Department of Medical Imaging, Southwest Medical University, Luzhou, China
| | - Cheng Yang
- School of Basic Medical Sciences, Southwest Medical University, Luzhou, China
| | - Yan Peng
- Department of Interventional Medicine, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Xiang Zhan
- Department of Radiology, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Ping Zhou
- Wound Healing Basic Research and Clinical Application Key Laboratory of Luzhou, School of Nursing, Southwest Medical University, Luzhou, China
- Department of Radiology, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| | - Zhen Zeng
- Psychiatry Department, The Affiliated Hospital of Southwest Medical University, Luzhou, China
| |
Collapse
|
21
|
Nishi H, Cancelliere NM, Rustici A, Charbonnier G, Chan V, Spears J, Marotta TR, Mendes Pereira V. Deep learning-based cerebral aneurysm segmentation and morphological analysis with three-dimensional rotational angiography. J Neurointerv Surg 2024; 16:197-203. [PMID: 37192786 DOI: 10.1136/jnis-2023-020192] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/16/2023] [Accepted: 04/14/2023] [Indexed: 05/18/2023]
Abstract
BACKGROUND The morphological assessment of cerebral aneurysms based on cerebral angiography is an essential step when planning strategy and device selection in endovascular treatment, but manual evaluation by human raters only has moderate interrater/intrarater reliability. METHODS We collected data for 889 cerebral angiograms from consecutive patients with suspected cerebral aneurysms at our institution from January 2017 to October 2021. The automatic morphological analysis model was developed on the derivation cohort dataset consisting of 388 scans with 437 aneurysms, and the performance of the model was tested on the validation cohort dataset consisting of 96 scans with 124 aneurysms. Five clinically important parameters were automatically calculated by the model: aneurysm volume, maximum aneurysm size, neck size, aneurysm height, and aspect ratio. RESULTS On the validation cohort dataset the average aneurysm size was 7.9±4.6 mm. The proposed model displayed high segmentation accuracy with a mean Dice similarity index of 0.87 (median 0.93). All the morphological parameters were significantly correlated with the reference standard (all P<0.0001; Pearson correlation analysis). The difference in the maximum aneurysm size between the model prediction and reference standard was 0.5±0.7 mm (mean±SD). The difference in neck size between the model prediction and reference standard was 0.8±1.7 mm (mean±SD). CONCLUSION The automatic aneurysm analysis model based on angiography data exhibited high accuracy for evaluating the morphological characteristics of cerebral aneurysms.
Collapse
Affiliation(s)
- Hidehisa Nishi
- Department of Surgery, Division of Neurosurgery, St Michael's Hospital, Toronto, Ontario, Canada
- RADIS Lab, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
| | - Nicole M Cancelliere
- Department of Surgery, Division of Neurosurgery, St Michael's Hospital, Toronto, Ontario, Canada
- RADIS Lab, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
| | - Ariana Rustici
- RADIS Lab, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
| | - Guillaume Charbonnier
- RADIS Lab, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
| | - Vanessa Chan
- RADIS Lab, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
| | - Julian Spears
- Department of Surgery, Division of Neurosurgery, St Michael's Hospital, Toronto, Ontario, Canada
| | - Thomas R Marotta
- Department of Medical Imaging, St Michael's Hospital, Toronto, Ontario, Canada
| | - Vitor Mendes Pereira
- Department of Surgery, Division of Neurosurgery, St Michael's Hospital, Toronto, Ontario, Canada
- RADIS Lab, Li Ka Shing Knowledge Institute, St Michael's Hospital, Toronto, Ontario, Canada
| |
Collapse
|
22
|
García-García S, Cepeda S, Müller D, Mosteiro A, Torné R, Agudo S, de la Torre N, Arrese I, Sarabia R. Mortality Prediction of Patients with Subarachnoid Hemorrhage Using a Deep Learning Model Based on an Initial Brain CT Scan. Brain Sci 2023; 14:10. [PMID: 38248225 PMCID: PMC10812955 DOI: 10.3390/brainsci14010010] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/05/2023] [Revised: 12/10/2023] [Accepted: 12/21/2023] [Indexed: 01/23/2024] Open
Abstract
BACKGROUND Subarachnoid hemorrhage (SAH) entails high morbidity and mortality rates. Convolutional neural networks (CNN) are capable of generating highly accurate predictions from imaging data. Our objective was to predict mortality in SAH patients by processing initial CT scans using a CNN-based algorithm. METHODS We conducted a retrospective multicentric study of a consecutive cohort of patients with SAH. Demographic, clinical and radiological variables were analyzed. Preprocessed baseline CT scan images were used as the input for training using the AUCMEDI framework. Our model's architecture leveraged a DenseNet121 structure, employing transfer learning principles. The output variable was mortality in the first three months. RESULTS Images from 219 patients were processed; 175 for training and validation and 44 for the model's evaluation. Of the patients, 52% (115/219) were female and the median age was 58 (SD = 13.06) years. In total, 18.5% (39/219) had idiopathic SAH. The mortality rate was 28.5% (63/219). The model showed good accuracy at predicting mortality in SAH patients when exclusively using the images of the initial CT scan (accuracy = 74%, F1 = 75% and AUC = 82%). CONCLUSION Modern image processing techniques based on AI and CNN make it possible to predict mortality in SAH patients with high accuracy using CT scan images as the only input. These models might be optimized by including more data and patients, resulting in better training, development and performance on tasks that are beyond the skills of conventional clinical knowledge.
Collapse
Affiliation(s)
- Sergio García-García
- Neurosurgery Department, Rio Hortega University Hospital, 47012 Valladolid, Spain; (S.C.); (S.A.); (N.d.l.T.); (I.A.); (R.S.)
| | - Santiago Cepeda
- Neurosurgery Department, Rio Hortega University Hospital, 47012 Valladolid, Spain; (S.C.); (S.A.); (N.d.l.T.); (I.A.); (R.S.)
| | - Dominik Müller
- IT-Infrastructure for Translational Medical Research, University of Augsburg, 86159 Augsburg, Germany;
| | - Alejandra Mosteiro
- Neurosurgery Department, Hospital Clinic de Barcelona, 08036 Barcelona, Spain; (A.M.); (R.T.)
| | - Ramón Torné
- Neurosurgery Department, Hospital Clinic de Barcelona, 08036 Barcelona, Spain; (A.M.); (R.T.)
| | - Silvia Agudo
- Neurosurgery Department, Rio Hortega University Hospital, 47012 Valladolid, Spain; (S.C.); (S.A.); (N.d.l.T.); (I.A.); (R.S.)
| | - Natalia de la Torre
- Neurosurgery Department, Rio Hortega University Hospital, 47012 Valladolid, Spain; (S.C.); (S.A.); (N.d.l.T.); (I.A.); (R.S.)
| | - Ignacio Arrese
- Neurosurgery Department, Rio Hortega University Hospital, 47012 Valladolid, Spain; (S.C.); (S.A.); (N.d.l.T.); (I.A.); (R.S.)
| | - Rosario Sarabia
- Neurosurgery Department, Rio Hortega University Hospital, 47012 Valladolid, Spain; (S.C.); (S.A.); (N.d.l.T.); (I.A.); (R.S.)
| |
Collapse
|
23
|
Abdollahifard S, Farrokhi A, Kheshti F, Jalali M, Mowla A. Application of convolutional network models in detection of intracranial aneurysms: A systematic review and meta-analysis. Interv Neuroradiol 2023; 29:738-747. [PMID: 35549574 PMCID: PMC10680951 DOI: 10.1177/15910199221097475] [Citation(s) in RCA: 4] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/03/2022] [Accepted: 04/11/2022] [Indexed: 11/15/2022] Open
Abstract
INTRODUCTION Intracranial aneurysms have a high prevalence in human population. It also has a heavy burden of disease and high mortality rate in the case of rupture. Convolutional neural network(CNN) is a type of deep learning architecture which has been proven powerful to detect intracranial aneurysms. METHODS Four databases were searched using artificial intelligence, intracranial aneurysms, and synonyms to find eligible studies. Articles which had applied CNN for detection of intracranial aneurisms were included in this review. Sensitivity and specificity of the models and human readers regarding modality, size, and location of aneurysms were sought to be extracted. Random model was the preferred model for analyses using CMA 2 to determine pooled sensitivity and specificity. RESULTS Overall, 20 studies were used in this review. Deep learning models could detect intracranial aneurysms with a sensitivity of 90/6% (CI: 87/2-93/2%) and specificity of 94/6% (CI: 0/914-0/966). CTA was the most sensitive modality (92.0%(CI:85/2-95/8%)). Overall sensitivity of the models for aneurysms more than 3 mm was above 98% (98%-100%) and 74.6 for aneurysms less than 3 mm. With the aid of AI, the clinicians' sensitivity increased to 12/8% and interrater agreement to 0/193. CONCLUSION CNN models had an acceptable sensitivity for detection of intracranial aneurysms, surpassing human readers in some fields. The logical approach for application of deep learning models would be its use as a highly capable assistant. In essence, deep learning models are a groundbreaking technology that can assist clinicians and allow them to diagnose intracranial aneurysms more accurately.
Collapse
Affiliation(s)
- Saeed Abdollahifard
- Research center for neuromodulation and pain, Shiraz, Iran
- Student research committee, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Amirmohammad Farrokhi
- Research center for neuromodulation and pain, Shiraz, Iran
- Student research committee, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Fatemeh Kheshti
- Research center for neuromodulation and pain, Shiraz, Iran
- Student research committee, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Mahtab Jalali
- Research center for neuromodulation and pain, Shiraz, Iran
- Student research committee, Shiraz University of Medical Sciences, Shiraz, Iran
| | - Ashkan Mowla
- Division of Stroke and Endovascular Neurosurgery, Department of Neurological Surgery, Keck School of Medicine, University of Southern California (USC), Los Angeles, CA, USA
| |
Collapse
|
24
|
Bizjak Ž, Špiclin Ž. A Systematic Review of Deep-Learning Methods for Intracranial Aneurysm Detection in CT Angiography. Biomedicines 2023; 11:2921. [PMID: 38001922 PMCID: PMC10669551 DOI: 10.3390/biomedicines11112921] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/01/2023] [Revised: 10/26/2023] [Accepted: 10/27/2023] [Indexed: 11/26/2023] Open
Abstract
Background: Subarachnoid hemorrhage resulting from cerebral aneurysm rupture is a significant cause of morbidity and mortality. Early identification of aneurysms on Computed Tomography Angiography (CTA), a frequently used modality for this purpose, is crucial, and artificial intelligence (AI)-based algorithms can improve the detection rate and minimize the intra- and inter-rater variability. Thus, a systematic review and meta-analysis were conducted to assess the diagnostic accuracy of deep-learning-based AI algorithms in detecting cerebral aneurysms using CTA. Methods: PubMed (MEDLINE), Embase, and the Cochrane Library were searched from January 2015 to July 2023. Eligibility criteria involved studies using fully automated and semi-automatic deep-learning algorithms for detecting cerebral aneurysms on the CTA modality. Eligible studies were assessed using the Preferred Reporting Items for Systematic Reviews and Meta-Analysis (PRISMA) guidelines and the Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2) tool. A diagnostic accuracy meta-analysis was conducted to estimate pooled lesion-level sensitivity, size-dependent lesion-level sensitivity, patient-level specificity, and the number of false positives per image. An enhanced FROC curve was utilized to facilitate comparisons between the studies. Results: Fifteen eligible studies were assessed. The findings indicated that the methods exhibited high pooled sensitivity (0.87, 95% confidence interval: 0.835 to 0.91) in detecting intracranial aneurysms at the lesion level. Patient-level sensitivity was not reported due to the lack of a unified patient-level sensitivity definition. Only five studies involved a control group (healthy subjects), whereas two provided information on detection specificity. Moreover, the analysis of size-dependent sensitivity reported in eight studies revealed that the average sensitivity for small aneurysms (<3 mm) was rather low (0.56). Conclusions: The studies included in the analysis exhibited a high level of accuracy in detecting intracranial aneurysms larger than 3 mm in size. Nonetheless, there is a notable gap that necessitates increased attention and research focus on the detection of smaller aneurysms, the use of a common test dataset, and an evaluation of a consistent set of performance metrics.
Collapse
Affiliation(s)
- Žiga Bizjak
- Laboratory of Imaging Technologies, Faculty of Electrical Engineering, University of Ljubljana, 1000 Ljubljana, Slovenia
| | | |
Collapse
|
25
|
Gilotra K, Swarna S, Mani R, Basem J, Dashti R. Role of artificial intelligence and machine learning in the diagnosis of cerebrovascular disease. Front Hum Neurosci 2023; 17:1254417. [PMID: 37746051 PMCID: PMC10516608 DOI: 10.3389/fnhum.2023.1254417] [Citation(s) in RCA: 8] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2023] [Accepted: 08/23/2023] [Indexed: 09/26/2023] Open
Abstract
Introduction Cerebrovascular diseases are known to cause significant morbidity and mortality to the general population. In patients with cerebrovascular disease, prompt clinical evaluation and radiographic interpretation are both essential in optimizing clinical management and in triaging patients for critical and potentially life-saving neurosurgical interventions. With recent advancements in the domains of artificial intelligence (AI) and machine learning (ML), many AI and ML algorithms have been developed to further optimize the diagnosis and subsequent management of cerebrovascular disease. Despite such advances, further studies are needed to substantively evaluate both the diagnostic accuracy and feasibility of these techniques for their application in clinical practice. This review aims to analyze the current use of AI and MI algorithms in the diagnosis of, and clinical decision making for cerebrovascular disease, and to discuss both the feasibility and future applications of utilizing such algorithms. Methods We review the use of AI and ML algorithms to assist clinicians in the diagnosis and management of ischemic stroke, hemorrhagic stroke, intracranial aneurysms, and arteriovenous malformations (AVMs). After identifying the most widely used algorithms, we provide a detailed analysis of the accuracy and effectiveness of these algorithms in practice. Results The incorporation of AI and ML algorithms for cerebrovascular patients has demonstrated improvements in time to detection of intracranial pathologies such as intracerebral hemorrhage (ICH) and infarcts. For ischemic and hemorrhagic strokes, commercial AI software platforms such as RapidAI and Viz.AI have bene implemented into routine clinical practice at many stroke centers to expedite the detection of infarcts and ICH, respectively. Such algorithms and neural networks have also been analyzed for use in prognostication for such cerebrovascular pathologies. These include predicting outcomes for ischemic stroke patients, hematoma expansion, risk of aneurysm rupture, bleeding of AVMs, and in predicting outcomes following interventions such as risk of occlusion for various endovascular devices. Preliminary analyses have yielded promising sensitivities when AI and ML are used in concert with imaging modalities and a multidisciplinary team of health care providers. Conclusion The implementation of AI and ML algorithms to supplement clinical practice has conferred a high degree of accuracy, efficiency, and expedited detection in the clinical and radiographic evaluation and management of ischemic and hemorrhagic strokes, AVMs, and aneurysms. Such algorithms have been explored for further purposes of prognostication for these conditions, with promising preliminary results. Further studies should evaluate the longitudinal implementation of such techniques into hospital networks and residency programs to supplement clinical practice, and the extent to which these techniques improve patient care and clinical outcomes in the long-term.
Collapse
Affiliation(s)
| | | | | | | | - Reza Dashti
- Dashti Lab, Department of Neurological Surgery, Stony Brook University Hospital, Stony Brook, NY, United States
| |
Collapse
|
26
|
Zhang J, Zhao Y, Liu X, Jiang J, Li Y. FSTIF-UNet: A Deep Learning-Based Method Towards Automatic Segmentation of Intracranial Aneurysms in Un-Reconstructed 3D-RA. IEEE J Biomed Health Inform 2023; 27:4028-4039. [PMID: 37216251 DOI: 10.1109/jbhi.2023.3278472] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Segmentation of intracranial aneurysms (IAs) is an important step for the diagnosis and treatment of IAs. However, the process by which clinicians manually recognize and localize IAs is overly labor intensive. This study aims to develop a deep-learning-based framework (defined as FSTIF-UNet) towards IAs segmentation in un-reconstructed 3D Rotational Angiography (3D-RA) images. 3D-RA sequences from 300 patients with IAs from Beijing Tiantan Hospital are enrolled. Inspired by radiologists' clincial skills, a Skip-Review attention mechanism is proposed to repeatedly fuse the long-term spatiotemporal features of several images with the most obvious IA's features (sellected by a pre-detection network). Then, a Conv-LSTM is used to fuse the short-term spatiotemporal features of the selected 15 3D-RA images from the equally-spaced viewing angles. The combination of the two modules realizes the full-scale spatiotemporal information fusion of the 3D-RA sequence. FSTIF-UNet achieves DSC, IoU, Sens, Haus, and F1-Score of 0.9109, 0.8586, 0.9314, 1.358 and 0.8883, respectively, and time taken for network segmentation is 0.89 s/case. The results show significant improvement in IA segmentation performance with FSTIF-UNet compared with baseline networks (with DSC from 0.8486 - 0.8794). The proposed FSTIF-UNet establishes a practical method to assist the radiologists in clinical diagnosis.
Collapse
|
27
|
Xie Y, Liu S, Lin H, Wu M, Shi F, Pan F, Zhang L, Song B. Automatic risk prediction of intracranial aneurysm on CTA image with convolutional neural networks and radiomics analysis. Front Neurol 2023; 14:1126949. [PMID: 37456640 PMCID: PMC10345199 DOI: 10.3389/fneur.2023.1126949] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/18/2022] [Accepted: 05/30/2023] [Indexed: 07/18/2023] Open
Abstract
BACKGROUND Intracranial aneurysm (IA) is a nodular protrusion of the arterial wall caused by the localized abnormal enlargement of the lumen of a brain artery, which is the primary cause of subarachnoid hemorrhage. Accurate rupture risk prediction can effectively aid treatment planning, but conventional rupture risk estimation based on clinical information is subjective and time-consuming. METHODS We propose a novel classification method based on the CTA images for differentiating aneurysms that are prone to rupture. The main contribution of this study is that the learning-based method proposed in this study leverages deep learning and radiomics features and integrates clinical information for a more accurate prediction of the risk of rupture. Specifically, we first extracted the provided aneurysm regions from the CTA images as 3D patches with the lesions located at their centers. Then, we employed an encoder using a 3D convolutional neural network (CNN) to extract complex latent features automatically. These features were then combined with radiomics features and clinical information. We further applied the LASSO regression method to find optimal features that are highly relevant to the rupture risk information, which is fed into a support vector machine (SVM) for final rupture risk prediction. RESULTS The experimental results demonstrate that our classification method can achieve accuracy and AUC scores of 89.78% and 89.09%, respectively, outperforming all the alternative methods. DISCUSSION Our study indicates that the incorporation of CNN and radiomics analysis can improve the prediction performance, and the selected optimal feature set can provide essential biomarkers for the determination of rupture risk, which is also of great clinical importance for individualized treatment planning and patient care of IA.
Collapse
Affiliation(s)
- Yuan Xie
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Shuyu Liu
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Hen Lin
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Min Wu
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| | - Feng Shi
- Department of Research and Development, Shanghai United Imaging Intelligence Co., Ltd., Shanghai, China
| | - Feng Pan
- Department of Pulmonary Medicine, Shanghai Chest Hospital, Shanghai Jiao Tong University, Shanghai, China
| | - Lichi Zhang
- School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, China
| | - Bin Song
- Department of Radiology, West China Hospital of Sichuan University, Chengdu, China
| |
Collapse
|
28
|
Li P, Liu Y, Zhou J, Tu S, Zhao B, Wan J, Yang Y, Xu L. A deep-learning method for the end-to-end prediction of intracranial aneurysm rupture risk. PATTERNS (NEW YORK, N.Y.) 2023; 4:100709. [PMID: 37123440 PMCID: PMC10140611 DOI: 10.1016/j.patter.2023.100709] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 09/05/2022] [Revised: 11/09/2022] [Accepted: 02/22/2023] [Indexed: 05/02/2023]
Abstract
It is critical to accurately predict the rupture risk of an intracranial aneurysm (IA) for timely and appropriate treatment because the fatality rate after rupture is 50 % . Existing methods relying on morphological features (e.g., height-width ratio) measured manually by neuroradiologists are labor intensive and have limited use for risk assessment. Therefore, we propose an end-to-end deep-learning method, called TransIAR net, to automatically learn the morphological features from 3D computed tomography angiography (CTA) data and accurately predict the status of IA rupture. We devise a multiscale 3D convolutional neural network (CNN) to extract the structural patterns of the IA and its neighborhood with a dual branch of shared network structures. Moreover, we learn the spatial dependence within the IA neighborhood with a transformer encoder. Our experiments demonstrated that the features learned by TransIAR are more effective and robust than handcrafted features, resulting in a 10 % - 15 % improvement in the accuracy of rupture status prediction.
Collapse
Affiliation(s)
- Peiying Li
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Yongchang Liu
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
| | - Jiafeng Zhou
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang 325000, China
| | - Shikui Tu
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- Corresponding author
| | - Bing Zhao
- Department of Neurosurgery, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China
| | - Jieqing Wan
- Department of Neurosurgery, Ren Ji Hospital, Shanghai Jiao Tong University School of Medicine, Shanghai 200127, China
| | - Yunjun Yang
- Department of Radiology, The First Affiliated Hospital of Wenzhou Medical University, Wenzhou, Zhejiang 325000, China
- Corresponding author
| | - Lei Xu
- Department of Computer Science and Engineering, Shanghai Jiao Tong University, Shanghai 200240, China
- Guangdong Institute of Intelligence Science and Technology, Zhuhai, Guangdong 519031, China
- Corresponding author
| |
Collapse
|
29
|
Zhu G, Luo X, Yang T, Cai L, Yeo JH, Yan G, Yang J. Deep learning-based recognition and segmentation of intracranial aneurysms under small sample size. Front Physiol 2022; 13:1084202. [PMID: 36601346 PMCID: PMC9806214 DOI: 10.3389/fphys.2022.1084202] [Citation(s) in RCA: 13] [Impact Index Per Article: 4.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2022] [Accepted: 11/28/2022] [Indexed: 12/23/2022] Open
Abstract
The manual identification and segmentation of intracranial aneurysms (IAs) involved in the 3D reconstruction procedure are labor-intensive and prone to human errors. To meet the demands for routine clinical management and large cohort studies of IAs, fast and accurate patient-specific IA reconstruction becomes a research Frontier. In this study, a deep-learning-based framework for IA identification and segmentation was developed, and the impacts of image pre-processing and convolutional neural network (CNN) architectures on the framework's performance were investigated. Three-dimensional (3D) segmentation-dedicated architectures, including 3D UNet, VNet, and 3D Res-UNet were evaluated. The dataset used in this study included 101 sets of anonymized cranial computed tomography angiography (CTA) images with 140 IA cases. After the labeling and image pre-processing, a training set and test set containing 112 and 28 IA lesions were used to train and evaluate the convolutional neural network mentioned above. The performances of three convolutional neural networks were compared in terms of training performance, segmentation performance, and segmentation efficiency using multiple quantitative metrics. All the convolutional neural networks showed a non-zero voxel-wise recall (V-Recall) at the case level. Among them, 3D UNet exhibited a better overall segmentation performance under the relatively small sample size. The automatic segmentation results based on 3D UNet reached an average V-Recall of 0.797 ± 0.140 (3.5% and 17.3% higher than that of VNet and 3D Res-UNet), as well as an average dice similarity coefficient (DSC) of 0.818 ± 0.100, which was 4.1%, and 11.7% higher than VNet and 3D Res-UNet. Moreover, the average Hausdorff distance (HD) of the 3D UNet was 3.323 ± 3.212 voxels, which was 8.3% and 17.3% lower than that of VNet and 3D Res-UNet. The three-dimensional deviation analysis results also showed that the segmentations of 3D UNet had the smallest deviation with a max distance of +1.4760/-2.3854 mm, an average distance of 0.3480 mm, a standard deviation (STD) of 0.5978 mm, a root mean square (RMS) of 0.7269 mm. In addition, the average segmentation time (AST) of the 3D UNet was 0.053s, equal to that of 3D Res-UNet and 8.62% shorter than VNet. The results from this study suggested that the proposed deep learning framework integrated with 3D UNet can provide fast and accurate IA identification and segmentation.
Collapse
Affiliation(s)
- Guangyu Zhu
- School of Energy and Power Engineering, Xi’an Jiaotong University, Xi’an, China,*Correspondence: Guangyu Zhu, ; Jian Yang,
| | - Xueqi Luo
- School of Energy and Power Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Tingting Yang
- School of Energy and Power Engineering, Xi’an Jiaotong University, Xi’an, China
| | - Li Cai
- Xi’an Key Laboratory of Scientific Computation and Applied Statistics, Xi’an, China,School of Mathematics and Statistics, Northwestern Polytechnical University, Xi’an, China
| | - Joon Hock Yeo
- School of Mechanical and Aerospace Engineering, Nanyang Technological University, Singapore, Singapore
| | - Ge Yan
- Department of Radiology, The First Affiliated Hospital of Xi’an Jiaotong University, Xi’an, China
| | - Jian Yang
- Department of Radiology, The First Affiliated Hospital of Xi’an Jiaotong University, Xi’an, China,*Correspondence: Guangyu Zhu, ; Jian Yang,
| |
Collapse
|
30
|
Zhang L, Shi Z, Chen M, Chen Y, Cheng J, Fan L, Hong N, Jia W, Jiang G, Ju S, Li X, Li X, Liang C, Liao W, Liu S, Lu Z, Ma L, Ren K, Rong P, Song B, Sun G, Wang R, Wen Z, Xu H, Xu K, Yan F, Yu Y, Zha Y, Zhang F, Zheng M, Zhou Z, Zhu W, Lu G, Jin Z. Study design of deep learning based automatic detection of cerebrovascular diseases on medical imaging: a position paper from Chinese Association of Radiologists. INTELLIGENT MEDICINE 2022; 2:221-229. [DOI: 10.1016/j.imed.2022.07.001] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2025]
|
31
|
Ou C, Qian Y, Chong W, Hou X, Zhang M, Zhang X, Si W, Duan CZ. A deep learning-based automatic system for intracranial aneurysms diagnosis on three-dimensional digital subtraction angiographic images. Med Phys 2022; 49:7038-7053. [PMID: 35792717 DOI: 10.1002/mp.15846] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/21/2022] [Revised: 06/11/2022] [Accepted: 06/27/2022] [Indexed: 01/09/2023] Open
Abstract
BACKGROUND Intracranial aneurysms (IAs) are a life-threatening disease. Their rupture can lead to hemorrhagic stroke. Most studies applying deep learning for the detection of aneurysms are based on angiographic images. However, critical diagnostic information such as morphology and aneurysm location are not captured by deep learning algorithms and still require manual assessments. PURPOSE Digital subtraction angiography (DSA) is the gold standard for aneurysm diagnosis. To facilitate the fully automatic diagnosis of aneurysms, we proposed a comprehensive system for the detection, morphology measurement, and location classification of aneurysms on three-dimensional DSA images, allowing automatic diagnosis without further human input. METHODS The system comprised three neural networks: a network for aneurysm detection, a network for morphology measurement, and a network for aneurysm location identification. A cross-scale dual-path transformer module was proposed to effectively fuse local and global information to capture aneurysms of varying sizes. A multitask learning approach was also proposed to allow an accurate localization of aneurysm neck for morphology measurement. RESULTS The cross-scale dual-path transformer module was shown to outperform other state-of-the-art network architectures, improving segmentation, and classification accuracy. The detection network in our system achieved an F2 score of 0.946 (recall 93%, precision 100%), better than the winning team in the Cerebral Aneurysm Detection and Analysis challenge. The measurement network achieved a relative error of less than 10% for morphology measurement, at the same level as human operators. Perfect accuracy (100%) was achieved on aneurysm location classification. CONCLUSIONS We have demonstrated that a comprehensive system can automatically detect, measure morphology and report the aneurysm location of aneurysms without human intervention. This can be a potential tool for the diagnosis of IAs, improving radiologists' performance and reducing their workload.
Collapse
Affiliation(s)
- Chubin Ou
- Neurosurgery Center, Department of Cerebrovascular Surgery, The National Key Clinical Specialty, The Engineering Technology Research Center of Education Ministry of China on Diagnosis and Treatment of Cerebrovascular Disease, Guangdong Provincial Key Laboratory on Brain Function Repair and Regeneration, The Neurosurgery Institute of Guangdong Province, Zhujiang Hospital, Southern Medical University, Guangzhou, China.,Faculty of Medicine and Health Sciences, Macquarie University, Sydney, New South Wales, Australia
| | - Yi Qian
- Neurosurgery Center, Department of Cerebrovascular Surgery, The National Key Clinical Specialty, The Engineering Technology Research Center of Education Ministry of China on Diagnosis and Treatment of Cerebrovascular Disease, Guangdong Provincial Key Laboratory on Brain Function Repair and Regeneration, The Neurosurgery Institute of Guangdong Province, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | | | - Xiaoxi Hou
- Faculty of Medicine and Health Sciences, Macquarie University, Sydney, New South Wales, Australia
| | - Mingzi Zhang
- Faculty of Medicine and Health Sciences, Macquarie University, Sydney, New South Wales, Australia
| | - Xin Zhang
- Neurosurgery Center, Department of Cerebrovascular Surgery, The National Key Clinical Specialty, The Engineering Technology Research Center of Education Ministry of China on Diagnosis and Treatment of Cerebrovascular Disease, Guangdong Provincial Key Laboratory on Brain Function Repair and Regeneration, The Neurosurgery Institute of Guangdong Province, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| | - Weixin Si
- Guangdong Provincial Key Laboratory of Computer Vision and Virtual Reality Technology, Shenzhen Institute of Advanced Technology, Chinese Academy of Sciences, Shenzhen, China
| | - Chuan-Zhi Duan
- Neurosurgery Center, Department of Cerebrovascular Surgery, The National Key Clinical Specialty, The Engineering Technology Research Center of Education Ministry of China on Diagnosis and Treatment of Cerebrovascular Disease, Guangdong Provincial Key Laboratory on Brain Function Repair and Regeneration, The Neurosurgery Institute of Guangdong Province, Zhujiang Hospital, Southern Medical University, Guangzhou, China
| |
Collapse
|
32
|
Yu AC, Mohajer B, Eng J. External Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review. Radiol Artif Intell 2022; 4:e210064. [PMID: 35652114 DOI: 10.1148/ryai.210064] [Citation(s) in RCA: 155] [Impact Index Per Article: 51.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/25/2021] [Revised: 03/09/2022] [Accepted: 04/12/2022] [Indexed: 01/17/2023]
Abstract
Purpose To assess generalizability of published deep learning (DL) algorithms for radiologic diagnosis. Materials and Methods In this systematic review, the PubMed database was searched for peer-reviewed studies of DL algorithms for image-based radiologic diagnosis that included external validation, published from January 1, 2015, through April 1, 2021. Studies using nonimaging features or incorporating non-DL methods for feature extraction or classification were excluded. Two reviewers independently evaluated studies for inclusion, and any discrepancies were resolved by consensus. Internal and external performance measures and pertinent study characteristics were extracted, and relationships among these data were examined using nonparametric statistics. Results Eighty-three studies reporting 86 algorithms were included. The vast majority (70 of 86, 81%) reported at least some decrease in external performance compared with internal performance, with nearly half (42 of 86, 49%) reporting at least a modest decrease (≥0.05 on the unit scale) and nearly a quarter (21 of 86, 24%) reporting a substantial decrease (≥0.10 on the unit scale). No study characteristics were found to be associated with the difference between internal and external performance. Conclusion Among published external validation studies of DL algorithms for image-based radiologic diagnosis, the vast majority demonstrated diminished algorithm performance on the external dataset, with some reporting a substantial performance decrease.Keywords: Meta-Analysis, Computer Applications-Detection/Diagnosis, Neural Networks, Computer Applications-General (Informatics), Epidemiology, Technology Assessment, Diagnosis, Informatics Supplemental material is available for this article. © RSNA, 2022.
Collapse
Affiliation(s)
- Alice C Yu
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 1800 Orleans St, Baltimore, MD 21287
| | - Bahram Mohajer
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 1800 Orleans St, Baltimore, MD 21287
| | - John Eng
- Russell H. Morgan Department of Radiology and Radiological Science, Johns Hopkins University School of Medicine, 1800 Orleans St, Baltimore, MD 21287
| |
Collapse
|
33
|
Yuan W, Peng Y, Guo Y, Ren Y, Xue Q. DCAU-Net: dense convolutional attention U-Net for segmentation of intracranial aneurysm images. Vis Comput Ind Biomed Art 2022; 5:9. [PMID: 35344098 PMCID: PMC8960533 DOI: 10.1186/s42492-022-00105-4] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/02/2021] [Accepted: 02/21/2022] [Indexed: 12/14/2022] Open
Abstract
Segmentation of intracranial aneurysm images acquired using magnetic resonance angiography (MRA) is essential for medical auxiliary treatments, which can effectively prevent subarachnoid hemorrhages. This paper proposes an image segmentation model based on a dense convolutional attention U-Net, which fuses deep and rich semantic information with shallow-detail information for adaptive and accurate segmentation of MRA-acquired aneurysm images with large size differences. The U-Net model serves as a backbone, combining dense block and convolution block attention module (CBAM). The dense block is composed of a batch normalization layer, an randomly rectified linear unit activation function, and a convolutional layer, for mitigation of vanishing gradients, for multiplexing of aneurysm features, and for improving the network training efficiency. The CBAM is composed of a channel attention module and a spatial attention module, improving the segmentation performance of feature discrimination and enhancing the acquisition of key feature information. Owing to the large variation of aneurysm sizes, multi-scale fusion is performed during up-sampling, for adaptive segmentation of MRA-acquired aneurysm images. The model was tested on the MICCAI 2020 ADAM dataset, and its generalizability was validated on the clinical aneurysm dataset (aneurysm sizes: < 3 mm, 3–7 mm, and > 7 mm) supplied by the Affiliated Hospital of Qingdao University. A good clinical application segmentation performance was demonstrated.
Collapse
Affiliation(s)
- Wenwen Yuan
- College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, 266590, China
| | - Yanjun Peng
- College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, 266590, China.
| | - Yanfei Guo
- College of Computer Science and Engineering, Shandong University of Science and Technology, Qingdao, 266590, China
| | - Yande Ren
- The Department of Radiology, the Affiliated Hospital of Qingdao University, Qingdao, 266000, China.
| | - Qianwen Xue
- Qingdao Maternal & Child Health and Family Planning Service Center, Qingdao, 266034, China
| |
Collapse
|
34
|
Mensah E, Pringle C, Roberts G, Gurusinghe N, Golash A, Alalade AF. Deep Learning in the Management of Intracranial Aneurysms and Cerebrovascular Diseases: A Review of the Current Literature. World Neurosurg 2022; 161:39-45. [DOI: 10.1016/j.wneu.2022.02.006] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/14/2021] [Revised: 01/31/2022] [Accepted: 02/01/2022] [Indexed: 01/10/2023]
|