Artificial Intelligence Applications in Intracranial Aneurysm: Achievements, Challenges and Opportunities

Advancing Intracranial Aneurysm Detection: A Comprehensive Systematic Review and Meta-analysis of Deep Learning Models Performance, Clinical Integration, and Future Directions

BACKGROUND

Cerebral aneurysms pose a significant risk to patient safety, particularly when ruptured, emphasizing the need for early detection and accurate prediction. Traditional diagnostic methods, reliant on clinician-based evaluations, face challenges in sensitivity and consistency, prompting the exploration of deep learning (DL) systems for improved performance.

METHODS

This systematic review and meta-analysis assessed the performance of DL models in detecting and predicting intracranial aneurysms compared to clinician-based evaluations. Imaging modalities included CT angiography (CTA), digital subtraction angiography (DSA), and time-of-flight MR angiography (TOF-MRA). Data on lesion-wise sensitivity, specificity, and the impact of DL assistance on clinician performance were analyzed. Subgroup analyses evaluated DL sensitivity by aneurysm size and location, and interrater agreement was measured using Fleiss' κ.

RESULTS

DL systems achieved an overall lesion-wise sensitivity of 90 % and specificity of 94 %, outperforming human diagnostics. Clinician specificity improved significantly with DL assistance, increasing from 83 % to 85 % in the patient-wise scenario and from 93 % to 95 % in the lesion-wise scenario. Similarly, clinician sensitivity also showed notable improvement with DL assistance, rising from 82 % to 96 % in the patient-wise scenario and from 82 % to 88 % in the lesion-wise scenario. Subgroup analysis showed DL sensitivity varied with aneurysm size and location, reaching 100 % for aneurysms larger than 10 mm. Additionally, DL assistance improved interrater agreement among clinicians, with Fleiss' κ increasing from 0.668 to 0.862.

CONCLUSIONS

DL models demonstrate transformative potential in managing cerebral aneurysms by enhancing diagnostic accuracy, reducing missed cases, and supporting clinical decision-making. However, further validation in diverse clinical settings and seamless integration into standard workflows are necessary to fully realize the benefits of DL-driven diagnostics.

Artificial intelligence applied to development of predictive stability model for intracranial aneurysms

BACKGROUND

We aimed to develop multiple machine learning models to predict the risk of early intracranial aneurysms (IAs) rupture, evaluate and compare the performance of predictive models.

METHODS

Information related to patients diagnosed with IA by CT angiography and clinicians in Central hospital of Dalian University of Technology from January 2010 to June 2022 was collected, including clinical characteristics, blood indicators and IA morphological parameters. IA with rupture or maximum growth ≥ 0.5 mm within 1 month of first diagnosis was considered unstable. The relevant factors affecting IA stability were screened and predictive models were developed based on the above three levels, including random forest (RF), support vector machine (SVM), and artificial neural network (ANN). Sensitivity, specificity, accuracy and area under curve (AUC) value were used to evaluate the predictive models.

RESULTS

A total of 989 IA patients were included in the study, including 561 stable patients and 428 unstable patients. For RF models, the training set showed that sensitivity, specificity, accuracy and the AUC values were 72.8-83.7%, 76.9-86.9%, 75.1-84.1% and 0.748 (0.719-0.778)-0.839 (0.814-0.864), respectively; after test set validation, the results were 71.9-78.8%, 75.0-84.0%, 73.6-81.1% and 0.734 (0.688-0.781)-0.809 (0.768-0.850), respectively. For SVM models, the training set were 66.0-80.2%, 76.5-85.5%, 71.7-82.3%, 0.712 (0.682-0.743)-0.913 (0.884-0.924), respectively; the test set were 44.2-78.3%, 63.4-84.4%, 57.9-80.9%, 0.699 (0.651-0.747)-0.806 (0.765-0.848), respectively. For ANN models, the training set were 66.8-83.0%, 75.3-82.3%, 71.6-82.1%, 0.783 (0.757-0.808)-0.897 (0.879-0.914); the test set were 63.1-76.3%, 65.5-84.0%, 64.4-80.6%, 0.680 (0.593-0.694)-0.860 (0.821-0.899). The results of variable importance showed that age, white blood cell count (WBC) and uric acid (UA) played an important role in predicting the stability of IA.

CONCLUSIONS

The predictive stability models of IA based on three artificial intelligence methods shows good clinical application. Age, WBC and UA played an important role in predicting the IA stability, and were potentially important predictors.

Evaluation of the clinical application value of artificial intelligence in diagnosing head and neck aneurysms

OBJECTIVE

To evaluate the performance of a semi-automated artificial intelligence (AI) software program (CerebralDoc® system) in aneurysm detection and morphological measurement.

METHODS

In this study, 354 cases of computed tomographic angiography (CTA) were retrospectively collected in our hospital. Among them, 280 cases were diagnosed with aneurysms by either digital subtraction angiography (DSA) and CTA (DSA group, n = 102), or CTA-only (non-DSA group, n = 178). The presence or absence of aneurysms, as well as their location and related morphological features determined by AI were evaluated using DSA and radiologist findings. Besides, post-processing image quality from AI and radiologists were also rated and compared.

RESULTS

In the DSA group, AI achieved a sensitivity of 88.24% and an accuracy of 81.97%, whereas radiologists achieved a sensitivity of 95.10% and an accuracy of 84.43%, using DSA results as the gold standard. The AI in the non-DSA group achieved 81.46% sensitivity and 76.29% accuracy, as per the radiologists' findings. The comparison of position consistency results showed better performance under loose criteria than strict criteria. In terms of morphological characteristics, both the DSA and the non-DSA groups agreed well with the diagnostic results for neck width and maximum diameter, demonstrating excellent ICC reliability exceeding 0.80. The AI-generated images exhibited superior quality compared to the standard software for post-processing, while also demonstrating a significantly reduced processing time.

CONCLUSIONS

The AI-based aneurysm detection rate demonstrates a commendable performance, while the extracted morphological parameters exhibit a remarkable consistency with those assessed by radiologists, thereby showcasing significant potential for clinical application.

Knowledge-Augmented Deep Learning for Segmenting and Detecting Cerebral Aneurysms With CT Angiography: A Multicenter Study

Background Deep learning (DL) could improve the labor-intensive, challenging processes of diagnosing cerebral aneurysms but requires large multicenter data sets. Purpose To construct a DL model using a multicenter data set for accurate cerebral aneurysm segmentation and detection on CT angiography (CTA) images and to compare its performance with radiology reports. Materials and Methods Consecutive head or head and neck CTA images of suspected unruptured cerebral aneurysms were gathered retrospectively from eight hospitals between February 2018 and October 2021 for model development. An external test set with reference standard digital subtraction angiography (DSA) scans was obtained retrospectively from one of the eight hospitals between February 2022 and February 2023. Radiologists (reference standard) assessed aneurysm segmentation, while model performance was evaluated using the Dice similarity coefficient (DSC). The model's aneurysm detection performance was assessed by sensitivity and comparing areas under the receiver operating characteristic curves (AUCs) between the model and radiology reports in the DSA data set with use of the DeLong test. Results Images from 6060 patients (mean age, 56 years ± 12 [SD]; 3375 [55.7%] female) were included for model development (training: 4342; validation: 1086; and internal test set: 632). Another 118 patients (mean age, 59 years ± 14; 79 [66.9%] female) were included in an external test set to evaluate performance based on DSA. The model achieved a DSC of 0.87 for aneurysm segmentation performance in the internal test set. Using DSA, the model achieved 85.7% (108 of 126 aneurysms [95% CI: 78.1, 90.1]) sensitivity in detecting aneurysms on per-vessel analysis, with no evidence of a difference versus radiology reports (AUC, 0.93 [95% CI: 0.90, 0.95] vs 0.91 [95% CI: 0.87, 0.94]; P = .67). Model processing time from reconstruction to detection was 1.76 minutes ± 0.32 per scan. Conclusion The proposed DL model could accurately segment and detect cerebral aneurysms at CTA with no evidence of a significant difference in diagnostic performance compared with radiology reports. © RSNA, 2024 Supplemental material is available for this article. See also the editorial by Payabvash in this issue.

Use of Artificial Intelligence Software to Detect Intracranial Aneurysms: A Comprehensive Stroke Center Experience

OBJECTIVE

To evaluate variability in aneurysm detection and the potential of artificial intelligence (AI) software as a screening tool by comparing conventional computed tomography angiography (CTA) images (standard care) with AI software.

METHODS

Neuroradiologists reviewed 770 CTA images and reported the presence or absence of saccular aneurysms. Subsequently, the images were analyzed by AI software. If the software suspected an aneurysm, it flagged the corresponding image. In cases where there was a mismatch between the radiologist's report and the AI findings, an expert neurosurgeon evaluated CTA images providing a definitive conclusion on the presence or absence of an aneurysm.

RESULTS

AI software flagged 33 cases as potential aneurysms; 16 cases were positively identified as aneurysms by radiologists, and 17 were dismissed. A total of 737 cases were considered negative by AI software, while in the same group, radiologists identified aneurysms in 28 CTA images. Compared with the radiologist's report, AI performance had a sensitivity of 36%, specificity of 97.6%, and negative predictive value of 96.2%. There were 45 mismatch cases between AI and radiologists. AI flagged 17 images as showing an aneurysm that was unreported by radiologists; the expert neurosurgeon confirmed that 7 of the 17 images showed an aneurysm. In 28 images considered negative by AI, radiologists indicated aneurysms; 17 of those confirmed by the neurosurgeon.

CONCLUSIONS

AI has the potential to increase the diagnosis of unruptured intracranial aneurysms. However, it must be used as an adjacent tool within the standard of care due to limited applicability in real-world settings.

Digital Subtraction Angiography of Cerebral Arteries: Influence of Cranial Dimensions on X-ray Tube Performance

(1) Background. Digital subtraction angiography (DSA) is indispensable for diagnosing cerebral aneurysms due to its superior imaging precision. However, optimizing X-ray parameters is crucial for accurate diagnosis, with X-ray tube settings significantly influencing image quality. Understanding the relationship between skull dimensions and X-ray parameters is pivotal for tailoring imaging protocols to individual patients. (2) Methods. A retrospective analysis of DSA data from a single center was conducted, involving 251 patients. Cephalometric measurements and statistical analyses were performed to assess correlations between skull dimensions and X-ray tube parameters (voltage and current). (3) Results. The study revealed significant correlations between skull dimensions and X-ray tube parameters, highlighting the importance of considering individual anatomical variations. Gender-based differences in X-ray parameters were observed, emphasizing the need for personalized imaging protocols. (4) Conclusions. Personalized approaches to DSA imaging, integrating individual anatomical variations and gender-specific differences, are essential for optimizing diagnostic outcomes. While this study provides valuable insights, further research across multiple centers and diverse imaging equipment is warranted to validate these findings.

Plasma levels of CD36 and glutathione as biomarkers for ruptured intracranial aneurysm

Evidence has proved that intracranial aneurysm (IA) formation and rupture might be closely related to inflammatory response and oxidative stress. Our objective was to evaluate the potential of CD36 and glutathione (GSH) as biomarkers for IA. In this study, the enzyme-linked immunosorbent assay was used to measure the plasma levels of CD36 and GSH in 30 IA patients and 30 healthy controls. Then, correlation analysis, receiver operating characteristic (ROC) curve, and logistic regression analysis were performed. The results showed that the plasma level of CD36 in IA patients was significantly higher than that in the control group (P < 0.0001), and plasma GSH was significantly lower compared with that in the control group (P < 0.0001). ROC analysis showed that CD36 and GSH had high sensitivity (90.0 and 96.6%) and specificity (96.6 and 86.6%) for IA diagnosis. The combined sensitivity and specificity achieved were 100 and 100%, respectively. The plasma levels of CD36 and GSH did not show a significant correlation with age, the Glasgow Coma Scale, Hunter-Hess score, aneurysm size, aneurysm height, aneurysm neck, and aspect ratio. The AUC of the logistic regression model based on CD36 and GSH was 0.505. Our results suggested that the combination of plasma CD36 and GSH could serve as potential biomarkers for IA rupture.

Topological Data Analysis and Use of Mapper for Cerebral Aneurysm Rupture Status Discrimination Based on 3-Dimensional Shape Analysis

BACKGROUND AND OBJECTIVES

Topological data analysis (TDA), which identifies patterns in data through simplified topological signatures, has yet to be applied to aneurysm research. We investigate TDA Mapper graphs (Mapper) for aneurysm rupture discrimination.

METHODS

Two hundred sixteen bifurcation aneurysms (90 ruptured) from 3-dimensional rotational angiography were segmented from vasculature and evaluated for 12 size/shape and 18 enhanced radiomics features. Using Mapper, uniformly dense aneurysm models were represented as graph structures and described by graph shape metrics. Mapper dissimilarity scores (MDS) were computed between pairs of aneurysms based on shape metrics. Lower MDS described similar shapes, whereas high MDS represented shapes that do not share common characteristics. Ruptured/unruptured average MDS scores (how "far" an aneurysm is shape-wise to ruptured/unruptured data sets, respectively) were evaluated for each aneurysm. Rupture status discrimination univariate and multivariate statistics were reported for all features.

RESULTS

The average MDS for pairs of ruptured aneurysms were significantly larger compared with unruptured pairs (0.055 ± 0.027 vs 0.039 ± 0.015, P < .0001). Low MDS suggest that, in contrast to ruptured aneurysms, unruptured aneurysms have similar shape characteristics. An MDS threshold value of 0.0417 (area under the curve [AUC] = 0.73, 80% specificity, 60% sensitivity) was identified for rupture status classification. Under this predictive model, MDS scores <0.0417 would identify unruptured status. MDS statistical performance in discriminating rupture status was similar to that of nonsphericity and radiomics Flatness (AUC = 0.73), outperforming other features. Ruptured aneurysms were more elongated ( P < .0001), flatter ( P < .0001), and showed higher nonsphericity ( P < .0001) compared with unruptured. Including MDS in multivariate analysis resulted in AUC = 0.82, outperforming multivariate analysis on size/shape (AUC = 0.76) and enhanced radiomics (AUC = 0.78) alone.

CONCLUSION

A novel application of Mapper TDA was proposed for aneurysm evaluation, with promising results for rupture status classification. Multivariate analysis incorporating Mapper resulted in high accuracy, which is particularly important given that bifurcation aneurysms are challenging to classify morphologically. This proof-of-concept study warrants future investigation into optimizing Mapper functionality for aneurysm research.

Detection of Intracranial Aneurysms Using Multiphase CT Angiography with a Deep Learning Model

RATIONALE AND OBJECTIVES

Determine the effect of a multiphase fusion deep-learning model with automatic phase selection in detection of intracranial aneurysm (IA) from computed tomography angiography (CTA) images.

MATERIALS AND METHODS

CTA images of intracranial arteries from patients at Ningbo First Hospital were retrospectively analyzed. Images were randomly classified as training data, internal validation data, or test data. CTA images from cases examined by digital subtraction angiography (DSA) were examined for independent validation. A deep-learning model was constructed by automatic phase selection of multiphase fusion, and compared to the single-phase algorithm to evaluate algorithm sensitivity.

RESULTS

We analyzed 1110 patients (1493 aneurysms) as training data, 139 patients (174 aneurysms) as internal validation data, and 134 patients (175 aneurysms) as test data. The sensitivity of the multiphase analysis of the internal validation data, test data, and independent validation data were greater than from the single-phase analysis. The recall of the multiphase selection was greater or equal to that of single-phase selection in the aneurysm position, shape, size, and rupture status. Use of the test data to determine the presence and absence of aneurysm rupture led to a recall from multiphase selection of 94.8% and 87.6% respectively; both of these values were greater than those from single-phase selection (89.6% and 79.4%).

CONCLUSION

A multiphase fusion deep learning model with automatic phase selection provided automated detection of IAs with high sensitivity.

Clinical applications of artificial intelligence in radiology

The rapid growth of medical imaging has placed increasing demands on radiologists. In this scenario, artificial intelligence (AI) has become an attractive partner, one that may complement case interpretation and may aid in various non-interpretive aspects of the work in the radiological clinic. In this review, we discuss interpretative and non-interpretative uses of AI in the clinical practice, as well as report on the barriers to AI's adoption in the clinic. We show that AI currently has a modest to moderate penetration in the clinical practice, with many radiologists still being unconvinced of its value and the return on its investment. Moreover, we discuss the radiologists' liabilities regarding the AI decisions, and explain how we currently do not have regulation to guide the implementation of explainable AI or of self-learning algorithms.