A deep learning algorithm may automate intracranial aneurysm detection on MR angiography with high diagnostic performance

Advancing Intracranial Aneurysm Detection: A Comprehensive Systematic Review and Meta-analysis of Deep Learning Models Performance, Clinical Integration, and Future Directions

BACKGROUND

Cerebral aneurysms pose a significant risk to patient safety, particularly when ruptured, emphasizing the need for early detection and accurate prediction. Traditional diagnostic methods, reliant on clinician-based evaluations, face challenges in sensitivity and consistency, prompting the exploration of deep learning (DL) systems for improved performance.

METHODS

This systematic review and meta-analysis assessed the performance of DL models in detecting and predicting intracranial aneurysms compared to clinician-based evaluations. Imaging modalities included CT angiography (CTA), digital subtraction angiography (DSA), and time-of-flight MR angiography (TOF-MRA). Data on lesion-wise sensitivity, specificity, and the impact of DL assistance on clinician performance were analyzed. Subgroup analyses evaluated DL sensitivity by aneurysm size and location, and interrater agreement was measured using Fleiss' κ.

RESULTS

DL systems achieved an overall lesion-wise sensitivity of 90 % and specificity of 94 %, outperforming human diagnostics. Clinician specificity improved significantly with DL assistance, increasing from 83 % to 85 % in the patient-wise scenario and from 93 % to 95 % in the lesion-wise scenario. Similarly, clinician sensitivity also showed notable improvement with DL assistance, rising from 82 % to 96 % in the patient-wise scenario and from 82 % to 88 % in the lesion-wise scenario. Subgroup analysis showed DL sensitivity varied with aneurysm size and location, reaching 100 % for aneurysms larger than 10 mm. Additionally, DL assistance improved interrater agreement among clinicians, with Fleiss' κ increasing from 0.668 to 0.862.

CONCLUSIONS

DL models demonstrate transformative potential in managing cerebral aneurysms by enhancing diagnostic accuracy, reducing missed cases, and supporting clinical decision-making. However, further validation in diverse clinical settings and seamless integration into standard workflows are necessary to fully realize the benefits of DL-driven diagnostics.

Multi-centric AI Model for Unruptured Intracranial Aneurysm Detection and Volumetric Segmentation in 3D TOF-MRI

The aim of this study was to develop an open-source nnU-Net-based AI model for combined detection and segmentation of unruptured intracranial aneurysms (UICA) in 3D TOF-MRI and compare models trained on datasets with aneurysm-like differential diagnoses. This retrospective study (2020–2023) included 385 anonymized 3D TOF-MRI images from 345 patients (mean age 59 years, 60% female) at multiple centers plus 113 subjects from the ADAM challenge. Images featured untreated or possible UICA and differential diagnoses. Four distinct training datasets were created, and the nnU-Net framework was used for model development. Performance was assessed on a separate test set using sensitivity and false positive (FP)/case rate for detection and DICE score and NSD (normalized surface distance, 0.5 mm threshold) for segmentation. Segmentation performance on the test set was also compared to a second human reader. The four models achieved overall sensitivity between 82 and 85% and an FP/case rate of 0.20 to 0.31, with no significant differences (p = 0.90 and p = 0.16) between them. The primary model showed 85% sensitivity and 0.23 FP/case rate, outperforming the ADAM-challenge winner (61%) and a nnU-Net trained on ADAM data (51%) in sensitivity (p < 0.05). Mean DICE (0.73) and NSD (0.84 for 0.5 mm threshold) for correctly detected UICA did not significantly differ from human reader performance. Our open-source, nnU-Net-based AI model (available at https://zenodo.org/records/13386859) demonstrates high sensitivity, low FP rates, and consistent segmentation accuracy for UICA detection and segmentation in 3D TOF-MRI, suggesting its potential to improve clinical diagnosis and monitoring of UICA.

Multi-centric AI Model for Unruptured Intracranial Aneurysm Detection and Volumetric Segmentation in 3D TOF-MRI

The aim of this study was to develop an open-source nnU-Net-based AI model for combined detection and segmentation of unruptured intracranial aneurysms (UICA) in 3D TOF-MRI and compare models trained on datasets with aneurysm-like differential diagnoses. This retrospective study (2020-2023) included 385 anonymized 3D TOF-MRI images from 345 patients (mean age 59 years, 60% female) at multiple centers plus 113 subjects from the ADAM challenge. Images featured untreated or possible UICA and differential diagnoses. Four distinct training datasets were created, and the nnU-Net framework was used for model development. Performance was assessed on a separate test set using sensitivity and false positive (FP)/case rate for detection and DICE score and NSD (normalized surface distance, 0.5 mm threshold) for segmentation. Segmentation performance on the test set was also compared to a second human reader. The four models achieved overall sensitivity between 82 and 85% and an FP/case rate of 0.20 to 0.31, with no significant differences (p = 0.90 and p = 0.16) between them. The primary model showed 85% sensitivity and 0.23 FP/case rate, outperforming the ADAM-challenge winner (61%) and a nnU-Net trained on ADAM data (51%) in sensitivity (p < 0.05). Mean DICE (0.73) and NSD (0.84 for 0.5 mm threshold) for correctly detected UICA did not significantly differ from human reader performance. Our open-source, nnU-Net-based AI model (available at https://zenodo.org/records/13386859 ) demonstrates high sensitivity, low FP rates, and consistent segmentation accuracy for UICA detection and segmentation in 3D TOF-MRI, suggesting its potential to improve clinical diagnosis and monitoring of UICA.

Accuracy of an nnUNet Neural Network for the Automatic Segmentation of Intracranial Aneurysms, Their Parent Vessels, and Major Cerebral Arteries from MRI-TOF

BACKGROUND AND PURPOSE

The automatic recognition of intracraial aneurysms by means of machine-learning algorithms represents a new frontier for diagnostic and therapeutic goals. Yet, the current algorithms focus solely on the aneurysms and not on the recognition of their parent vessels. The purpose of the present study is the development of a new machine-learning algorithm for fully automatic identification of cerebral arteries and intracranial aneurysms (IAs) based on a manually segmented MRA-TOF data set.

MATERIALS AND METHODS

In this retrospective single-center study, 62 MRA-TOF scans of a total of 73 untreated, unruptured IAs were manually color-labeled in 21 classes. A nnUNet architecture was trained on MRA-TOF images. The performance of the automatic segmentation was compared with the manual segmentation by using the Dice Similarity Coefficient (DSC), Centerline Dice (ClDice), and 95th percentile Hausdorff Distance (HD95). Sensitivity was computed for aneurysm detection.

RESULTS

Across all 21 classes, the median DSC was 0.86 [95% CI: 0.81-0.89], the median ClDice was 0.91 [0.85, 0.94], and the median HD95 was 2.9 [1.0, 14.9] mm. Sensitivity of the model for aneurysm detection was 0.8. For this class specifically, a median DSC of 0.88 [0.13, 0.92], median ClDice of 0.89 [0.06, 1.0], and median HD95 of 1.8 [0.58, 81] mm was achieved. The volume of the labeled anatomic structure was the most relevant determinant of accuracy in this model. Median time to predict was 130.6 [60.9, 284.1] seconds.

CONCLUSIONS

The nnUNet MRA-TOF-based algorithm provided a fast and adequate automatic extraction of unruptured IAs, their parent vessels, and the most relevant cerebral arteries. Future steps involve the expansion of the training set with the inclusion of more MRA-TOF studies with and without IAs and its incorporation in 3D imaging viewers and treatment prediction.

PMMNet: A Dual Branch Fusion Network of Point Cloud and Multi-View for Intracranial Aneurysm Classification and Segmentation

Intracranial aneurysm (IA) is a vascular disease of the brain arteries caused by pathological vascular dilation, which can result in subarachnoid hemorrhage if ruptured. Automatically classification and segmentation of intracranial aneurysms are essential for their diagnosis and treatment. However, the majority of current research is focused on two-dimensional images, ignoring the 3D spatial information that is also critical. In this work, we propose a novel dual-branch fusion network called the Point Cloud and Multi-View Medical Neural Network (PMMNet) for IA classification and segmentation. Specifically, one branch based on 3D point clouds serves the purpose of extracting spatial features, whereas the other branch based on multi-view images acquires 2D pixel features. Ultimately, the two types of features are fused for IA classification and segmentation. To extract both local and global features from 3D point clouds, Multilayer Perceptron (MLP) and the attention mechanism are used in parallel. In addition, a SPSA module is proposed for multi-view image feature learning, which extracts more exquisite channel and spatial multi-scale features from 2D images. Experiments conducted on the IntrA dataset outperform other state-of-the-art methods, demonstrating that the proposed PMMNet exhibits strong superiority on the medical 3D dataset. We also obtain competitive results on public datasets, including ModelNet40, ModelNet10, and ShapeNetPart, which further validate the robustness and generality of the PMMNet.

Diagnostic Accuracy of a Deep Learning Algorithm for Detecting Unruptured Intracranial Aneurysms in Magnetic Resonance Angiography: A Multicenter Pivotal Trial

BACKGROUND

Intracranial aneurysm rupture is associated with high mortality and disability rates. Early detection is crucial, but increasing diagnostic workloads place significant strain on radiologists. We evaluated the efficacy of a deep learning algorithm in detecting unruptured intracranial aneurysms (UIAs) using time-of-flight (TOF) magnetic resonance angiography (MRA).

METHODS

Data from 675 participants (189 aneurysm-positive [221 UIAs] and 486 aneurysm-negative) were collected from 2 hospitals (2019-2023). Positive cases were confirmed by digital subtraction angiography, and images were annotated by vascular experts. The 3D U-Net-based model was trained on 988 nonoverlapped TOF MRA datasets and evaluated by patient- and lesion-level sensitivity, specificity, and false-positive rates.

RESULTS

The mean age was 59.6 years (standard deviation 11.3), and 52.0% were female. The model achieved patient-level sensitivity of 95.2% and specificity of 80.5%, with lesion-level sensitivity of 89.6% and a false-positive rate of 0.19 per patient. Sensitivity by aneurysm size was 72.3% for lesions <3 mm, 91.8% for 3-5 mm, and 94.3% for >5 mm. Performance was consistent across institutions, with an area under the receiver operating characteristic curve of 0.949.

CONCLUSIONS

The software demonstrated high sensitivity and low false-positive rates for UIA detection in TOF MRA, suggesting its utility in reducing diagnostic errors and alleviating radiologist workload. Expert review remains essential, particularly for small or complex aneurysms.

Automatic diagnosis and measurement of intracranial aneurysms using deep learning in MRA raw images

BACKGROUND

The traditional procedure of intracranial aneurysm (IA) diagnosis and evaluation in MRA is manually operated, which is time-consuming and labor-intensive. In this study, a deep learning model was established to diagnose and measure IA automatically based on the original MR images.

METHODS

A total of 1,014 IAs (from 852 patients) from hospital 1 were included and randomly divided into training, testing, and internal validation sets in a 7:2:1 ratio. Additionally, 315 patients (179 cases with IA and 136 cases without IA) from hospital 2 were used for independent validation. A deep learning model of MR 3DUnet was established for IA diagnosis and size measurement. The true positive (TP), false positive (FP), false negative (FN), recall, sensitivity, and specificity indices were used to evaluate the diagnosis performance of MR 3DUnet. The two-sample t-test was used to compare the size measurement results of MR 3DUnet and two radiologists. A p-value of < 0.05 was considered statistically significant.

RESULTS

The fully automatic model processed the original MRA data in 13.6 s and provided real-time results, including IA diagnosis and size measurement. For the IA diagnosis, in the training, testing, and internal validation sets, the recall rates were 0.80, 0.75, and 0.79, and the sensitivities were 0.82, 0.75, and 0.75, respectively. In the independent validation set, the recall rate, sensitivity, specificity, and AUC were 0.71, 0.74, 0.77, and 0.75, respectively. Subgroup analysis showed a recall rate of 0.74 for IA diagnosis based on DSA. For IA size measurement, no significant difference was found between our MR 3DUnet and the manual measurements of DSA or MRA.

CONCLUSION

In this study, a one-click, fully automatic deep learning model was developed for automatic IA diagnosis and size measurement based on 2D original images. It has the potential to significantly improve doctors' work efficiency and reduce patients' examination time, making it highly valuable in clinical practice.

A survey of intracranial aneurysm detection and segmentation

Intracranial aneurysms (IAs) are a critical public health concern: they are asymptomatic and can lead to fatal subarachnoid hemorrhage in case of rupture. Neuroradiologists rely on advanced imaging techniques to identify aneurysms in a patient and consider the characteristics of IAs along with several other patient-related factors for rupture risk assessment and treatment decision-making. The process of diagnostic image reading is time-intensive and prone to inter- and intra-individual variations, so researchers have proposed many computer-aided diagnosis (CAD) systems for aneurysm detection and segmentation. This paper provides a comprehensive literature survey of semi-automated and automated approaches for IA detection and segmentation and proposes a taxonomy to classify the approaches. We also discuss the current issues and give some insight into the future direction of CAD systems for IA detection and segmentation.

Automation bias in AI-assisted detection of cerebral aneurysms on time-of-flight MR angiography

PURPOSE

To determine how automation bias (inclination of humans to overly trust-automated decision-making systems) can affect radiologists when interpreting AI-detected cerebral aneurysm findings in time-of-flight magnetic resonance angiography (TOF-MRA) studies.

MATERIAL AND METHODS

Nine radiologists with varying levels of experience evaluated twenty TOF-MRA examinations for the presence of cerebral aneurysms. Every case was evaluated with and without assistance by the AI software © mdbrain, with a washout period of at least four weeks in-between. Half of the cases included at least one false-positive AI finding. Aneurysm ratings, follow-up recommendations, and reading times were assessed using the Wilcoxon signed-rank test.

RESULTS

False-positive AI results led to significantly higher suspicion of aneurysm findings (p = 0.01). Inexperienced readers further recommended significantly more intense follow-up examinations when presented with false-positive AI findings (p = 0.005). Reading times were significantly shorter with AI assistance in inexperienced (164.1 vs 228.2 s; p < 0.001), moderately experienced (126.2 vs 156.5 s; p < 0.009), and very experienced (117.9 vs 153.5 s; p < 0.001) readers alike.

CONCLUSION

Our results demonstrate the susceptibility of radiology readers to automation bias in detecting cerebral aneurysms in TOF-MRA studies when encountering false-positive AI findings. While AI systems for cerebral aneurysm detection can provide benefits, challenges in human-AI interaction need to be mitigated to ensure safe and effective adoption.

Systematic review of artificial intelligence methods for detection and segmentation of unruptured intracranial aneurysms using medical imaging

Unruptured intracranial aneurysms are protuberances that appear in cerebral arteries, and their diagnostic evaluation can be a complex, time-consuming, and exhaustive task. In recent years, computer-aided systems have been developed to improve diagnostic processes. Although the proposed methods have already been reviewed to assess their suitability for clinical use, the segmentation methods have not been reviewed in detail, nor has there been a standardized way to compare segmentation and detection tasks. A systematic review was conducted to examine the technical and methodological factors contributing to this limitation. The analysis encompassed 49 studies conducted between 2019 and 2023 that utilized artificial intelligence methods and any medical imaging modality for the detection or segmentation of intracranial aneurysms. Most of the included studies focused exclusively on detection (57%), magnetic resonance angiography was the predominant imaging modality (47%), and the methodologies generally used 3D imaging as the input (71%). The reported sensitivities ranged from 0.68 to 0.90, specificities from 0.18 to 1.0, false positives per case from 0.18 to 13.8, and the Dice similarity coefficient from 0.53 to 0.98. Variations in aneurysm size were found to have a substantial impact on system performance. Studies were evaluated using a diagnostic accuracy study quality assessment tool, which revealed significant concerns regarding applicability. These concerns primarily stem from the poor reproducibility and inconsistent reporting of metrics. Recommendations for reporting outcomes were made to compare procedures across different types of imaging and tasks.

Building a Synthetic Vascular Model: Evaluation in an Intracranial Aneurysms Detection Scenario

We hereby present a full synthetic model, able to mimic the various constituents of the cerebral vascular tree, including the cerebral arteries, bifurcations and intracranial aneurysms. This model intends to provide a substantial dataset of brain arteries which could be used by a 3D convolutional neural network to efficiently detect Intra-Cranial Aneurysms. The cerebral aneurysms most often occur on a particular structure of the vascular tree named the Circle of Willis. Various studies have been conducted to detect and monitor the aneurysms and those based on Deep Learning achieve the best performance. Specifically, in this work, we propose a full synthetic 3D model able to mimic the brain vasculature as acquired by Magnetic Resonance Angiography, Time Of Flight principle. Among the various MRI modalities, this latter allows for a good rendering of the blood vessels and is non-invasive. Our model has been designed to simultaneously mimic the arteries' geometry, the aneurysm shape, and the background noise. The vascular tree geometry is modeled thanks to an interpolation with 3D Spline functions, and the statistical properties of the background noise is collected from angiography acquisitions and reproduced within the model. In this work, we thoroughly describe the synthetic vasculature model, we build up a neural network designed for aneurysm segmentation and detection, finally, we carry out an in-depth evaluation of the performance gap gained thanks to the synthetic model data augmentation.

Intracranial Aneurysm Segmentation with a Dual-Path Fusion Network

Intracranial aneurysms (IAs), a significant medical concern due to their prevalence and life-threatening nature, pose challenges regarding diagnosis owing to their diminutive and variable morphology. There are currently challenges surrounding automating the segmentation of IAs, which is essential for diagnostic precision. Existing deep learning methods in IAs segmentation tend to emphasize semantic features at the expense of detailed information, potentially compromising segmentation quality. Our research introduces the innovative Dual-Path Fusion Network (DPF-Net), an advanced deep learning architecture crafted to refine IAs segmentation by adeptly incorporating detailed information. DPF-Net, with its unique resolution-preserving detail branch, ensures minimal loss of detail during feature extraction, while its cross-fusion module effectively promotes the connection of semantic information and finer detail features, enhancing segmentation precision. The network also integrates a detail aggregation module for effective fusion of multi-scale detail features. A view fusion strategy is employed to address spatial disruptions in patch generation, thereby improving feature extraction efficiency. Evaluated on the CADA dataset, DPF-Net achieves a remarkable mean Dice similarity coefficient (DSC) of 0.8967, highlighting its potential in automated IAs diagnosis in clinical settings. Furthermore, DPF-Net's outstanding performance on the BraTS 2020 MRI dataset for brain tumor segmentation with a mean DSC of 0.8535 further confirms its robustness and generalizability.

Incidental findings in research brain MRI: Definition, prevalence and ethical implications

Radiological incidental findings (IFs) are previously undetected abnormalities which are unrelated to the original indication for imaging and are unexpectedly discovered. In brain magnetic resonance imaging (MRI), the prevalence of IFs is increasing. By reviewing the literature on IFs in brain MRI performed for research purposes and discussing ethical considerations of IFs, this paper provides an overview of brain IF research results and factors contributing to inconsistencies and considers how the consent process can be improved from an ethical perspective. We found that despite extensive literature regarding IFs in research MRI of the brain, there are major inconsistencies in the reported prevalence, ranging from 1.3% to 99%. Many factors appear to contribute to this broad range: lack of standardised definition, participant demographics variance, heterogenous MRI scanner strength and sequences, reporter variation and results classification. We also found significant discrepancies in the review, consent and clinical communication processes pertaining to the ethical nature of these studies. These findings have implications for future studies, particularly those involving artificial intelligence. Further research, particularly in relation to MRI brain IFs would be useful to explore the generalisability of study results.

Patch-Wise Deep Learning Method for Intracranial Stenosis and Aneurysm Detection-the Tromsø Study

Intracranial atherosclerotic stenosis (ICAS) and intracranial aneurysms are prevalent conditions in the cerebrovascular system. ICAS causes a narrowing of the arterial lumen, thereby restricting blood flow, while aneurysms involve the ballooning of blood vessels. Both conditions can lead to severe outcomes, such as stroke or vessel rupture, which can be fatal. Early detection is crucial for effective intervention. In this study, we introduced a method that combines classical computer vision techniques with deep learning to detect intracranial aneurysms and ICAS in time-of-flight magnetic resonance angiography images. The process began with skull-stripping, followed by an affine transformation to align the images to a common atlas space. We then focused on the region of interest, including the circle of Willis, by cropping the relevant area. A segmentation algorithm was used to isolate the arteries, after which a patch-wise residual neural network was applied across the image. A voting mechanism was then employed to identify the presence of atrophies. Our method achieved accuracies of 76.5% for aneurysms and 82.4% for ICAS. Notably, when occlusions were not considered, the accuracy for ICAS detection improved to 85.7%. While the algorithm performed well for localized pathological findings, it was less effective at detecting occlusions, which involved long-range dependencies in the MRIs. This limitation was due to the architectural design of the patch-wise deep learning approach. Regardless, this can, in the future, be mitigated in a multi-scale patch-wise algorithm.

Advancements in opportunistic intracranial aneurysm screening: The impact of a deep learning algorithm on radiologists' analysis of T2-weighted cranial MRI

(1) Background: Unruptured Intracranial Aneurysms (UIAs) are common blood vessel malformations, occurring in up to 3 % of healthy adults. Magnetic Resonance Angiography (MRA) is frequently used for the screening of UIAs due to its high resolution in vascular anatomy. However, T2-Weighted Magnetic Resonance Imaging (T2WI) is a standard sequence utilized for the majority of outpatient head scans. By employing a sequence such as T2WI, there is a possible shift towards early detection of UIAs through opportunistic screening. Here, we assess a Deep Learning Algorithm (DLA) developed to assist radiologists in identifying and reporting UIAs on T2WI in a routine clinical setting. (2) Methods: A DLA was trained on a set of 110 patients undergoing an MR head scan with the gold standard set by two radiology experts. Eight radiologists were given a cohort of 50 cranial T2WI studies and asked for a routine report. After a 10-day washout period, they reviewed the same cases randomized and supported by the DLA predictions. We assessed changes in sensitivity, specificity, accuracy, and false positives. (3) Results: During routine reporting, the models' assistance improved the sensitivity of the eight participants by an average of 36.19 and the accuracy by 10.00 percentage points. (4) Conclusion: Our results indicate the potential benefit of deep learning to improve radiologists' detection of UIAs during routine reporting. From this, we can infer that the combination of T2WI with our DLA supports opportunistic screening, suggesting potential approaches for future research and application.

Patient-specific cerebral 3D vessel model reconstruction using deep learning

Three-dimensional vessel model reconstruction from patient-specific magnetic resonance angiography (MRA) images often requires some manual maneuvers. This study aimed to establish the deep learning (DL)-based method for vessel model reconstruction. Time of flight MRA of 40 patients with internal carotid artery aneurysms was prepared, and three-dimensional vessel models were constructed using the threshold and region-growing method. Using those datasets, supervised deep learning using 2D U-net was performed to reconstruct 3D vessel models. The accuracy of the DL-based vessel segmentations was assessed using 20 MRA images outside the training dataset. The dice coefficient was used as the indicator of the model accuracy, and the blood flow simulation was performed using the DL-based vessel model. The created DL model could successfully reconstruct a three-dimensional model in all 60 cases. The dice coefficient in the test dataset was 0.859. Of note, the DL-generated model proved its efficacy even for large aneurysms (> 10 mm in their diameter). The reconstructed model was feasible in performing blood flow simulation to assist clinical decision-making. Our DL-based method could successfully reconstruct a three-dimensional vessel model with moderate accuracy. Future studies are warranted to exhibit that DL-based technology can promote medical image processing.

Intracranial aneurysm detection: an object detection perspective

PURPOSE

Intracranial aneurysm detection from 3D Time-Of-Flight Magnetic Resonance Angiography images is a problem of increasing clinical importance. Recently, a streak of methods have shown promising performance by using segmentation neural networks. However, these methods may be less relevant in a clinical settings where diagnostic decisions rely on detecting objects rather than their segmentation.

METHODS

We introduce a 3D single-stage object detection method tailored for small object detection such as aneurysms. Our anchor-free method incorporates fast data annotation, adapted data sampling and generation to address class imbalance problem, and spherical representations for improved detection.

RESULTS

A comprehensive evaluation was conducted, comparing our method with the state-of-the-art SCPM-Net, nnDetection and nnUNet baselines, using two datasets comprising 402 subjects. The evaluation used adapted object detection metrics. Our method exhibited comparable or superior performance, with an average precision of 78.96%, sensitivity of 86.78%, and 0.53 false positives per case.

CONCLUSION

Our method significantly reduces the detection complexity compared to existing methods and highlights the advantages of object detection over segmentation-based approaches for aneurysm detection. It also holds potential for application to other small object detection problems.

Deep learning-based platform performs high detection sensitivity of intracranial aneurysms in 3D brain TOF-MRA: An external clinical validation study

PURPOSE

To evaluate the diagnostic efficacy of a developed artificial intelligence (AI) platform incorporating deep learning algorithms for the automated detection of intracranial aneurysms in time-of-flight (TOF) magnetic resonance angiography (MRA).

METHOD

This retrospective study encompassed 3D TOF MRA images acquired between January 2023 and June 2023, aiming to validate the presence of intracranial aneurysms via our developed AI platform. The manual segmentation results by experienced neuroradiologists served as the "gold standard". Following annotation of MRA images by neuroradiologists using InferScholar software, the AI platform conducted automatic segmentation of intracranial aneurysms. Various metrics including accuracy (ACC), balanced ACC, area under the curve (AUC), sensitivity (SE), specificity (SP), F1 score, Brier Score, and Net Benefit were utilized to evaluate the generalization of AI platform. Comparison of intracranial aneurysm identification performance was conducted between the AI platform and six radiologists with experience ranging from 3 to 12 years in interpreting MR images. Additionally, a comparative analysis was carried out between radiologists' detection performance based on independent visual diagnosis and AI-assisted diagnosis. Subgroup analyses were also performed based on the size and location of the aneurysms to explore factors impacting aneurysm detectability.

RESULTS

510 patients were enrolled including 215 patients (42.16 %) with intracranial aneurysms and 295 patients (57.84 %) without aneurysms. Compared with six radiologists, the AI platform showed competitive discrimination power (AUC, 0.96), acceptable calibration (Brier Score loss, 0.08), and clinical utility (Net Benefit, 86.96 %). The AI platform demonstrated superior performance in detecting aneurysms with an overall SE, SP, ACC, balanced ACC, and F1 score of 91.63 %, 92.20 %, 91.96 %, 91.92 %, and 90.57 % respectively, outperforming the detectability of the two resident radiologists. For subgroup analysis based on aneurysm size and location, we observed that the SE of the AI platform for identifying tiny (diameter＜3mm), small (3 mm ≤ diameter＜5mm), medium (5 mm ≤ diameter＜7mm) and large aneurysms (diameter ≥ 7 mm) was 87.80 %, 93.14 %, 95.45 %, and 100 %, respectively. Furthermore, the SE for detecting aneurysms in the anterior circulation was higher than that in the posterior circulation. Utilizing the AI assistance, six radiologists (i.e., two residents, two attendings and two professors) achieved statistically significant improvements in mean SE (residents: 71.40 % vs. 88.37 %; attendings: 82.79 % vs. 93.26 %; professors: 90.07 % vs. 97.44 %; P < 0.05) and ACC (residents: 85.29 % vs. 94.12 %; attendings: 91.76 % vs. 97.06 %; professors: 95.29 % vs. 98.82 %; P < 0.05) while no statistically significant change was observed in SP. Overall, radiologists' mean SE increased by 11.40 %, mean SP increased by 1.86 %, and mean ACC increased by 5.88 %, mean balanced ACC promoted by 6.63 %, mean F1 score grew by 7.89 %, and Net Benefit rose by 12.52 %, with a concurrent decrease in mean Brier score declined by 0.06.

CONCLUSIONS

The deep learning algorithms implemented in the AI platform effectively detected intracranial aneurysms on TOF-MRA and notably enhanced the diagnostic capabilities of radiologists. This indicates that the AI-based auxiliary diagnosis model can provide dependable and precise prediction to improve the diagnostic capacity of radiologists.

Classification, detection, and segmentation performance of image-based AI in intracranial aneurysm: a systematic review

BACKGROUND

The detection and management of intracranial aneurysms (IAs) are vital to prevent life-threatening complications like subarachnoid hemorrhage (SAH). Artificial Intelligence (AI) can analyze medical images, like CTA or MRA, spotting nuances possibly overlooked by humans. Early detection facilitates timely interventions and improved outcomes. Moreover, AI algorithms offer quantitative data on aneurysm attributes, aiding in long-term monitoring and assessing rupture risks.

METHODS

We screened four databases (PubMed, Web of Science, IEEE and Scopus) for studies using artificial intelligence algorithms to identify IA. Based on algorithmic methodologies, we categorized them into classification, segmentation, detection and combined, and then their merits and shortcomings are compared. Subsequently, we elucidate potential challenges that contemporary algorithms might encounter within real-world clinical diagnostic contexts. Then we outline prospective research trajectories and underscore key concerns in this evolving field.

RESULTS

Forty-seven studies of IA recognition based on AI were included based on search and screening criteria. The retrospective results represent that current studies can identify IA in different modal images and predict their risk of rupture and blockage. In clinical diagnosis, AI can effectively improve the diagnostic accuracy of IA and reduce missed detection and false positives.

CONCLUSIONS

The AI algorithm can detect unobtrusive IA more accurately in communicating arteries and cavernous sinus arteries to avoid further expansion. In addition, analyzing aneurysm rupture and blockage before and after surgery can help doctors plan treatment and reduce the uncertainties in the treatment process.

A deep learning framework for intracranial aneurysms automatic segmentation and detection on magnetic resonance T1 images

OBJECTIVES

To design a deep learning-based framework for automatic segmentation and detection of intracranial aneurysms (IAs) on magnetic resonance T1 images and test the robustness and performance of framework.

METHODS

A retrospective diagnostic study was conducted based on 159 IAs from 136 patients who underwent the T1 images. Among them, 127 cases were randomly selected for training and validation, and 32 cases were used to assess the accuracy and consistency of our algorithm. We developed and assembled three convolutional neural networks for the segmentation and detection of IAs. The segmentation and detection performance of the model were compared with the ground truth, and various metrics were calculated at the voxel level, IAs level, and patient level to show the performance of our framework.

RESULTS

Our assembled model achieved overall Dice, voxel-level sensitivity, specificity, balanced accuracy, and F1 score of 0.802, 0.874, 0.9998, 0.937, and 0.802, respectively. A coincidence greater than 0.7 between the aneurysms predicted by the model and the ground truth was considered as a true positive. For IAs detection, the sensitivity reached 90.63% with 0.58 false positives per case. The volume of IAs segmented by our model showed a high agreement and consistency with the volume of IAs labeled by experts.

CONCLUSION

The deep learning framework is achievable and robust for IAs segmentation and detection. Our model offers more clinical application opportunities compared to digital subtraction angiography (DSA)-based, CTA-based, and MRA-based methods.

CLINICAL RELEVANCE STATEMENT

Our deep learning framework effectively detects and segments intracranial aneurysms using clinical routine T1 sequences, showing remarkable effectiveness and offering great potential for improving the detection of latent intracranial aneurysms and enabling early identification.

KEY POINTS

•There is no segmentation method based on clinical routine T1 images. Our study shows that the proper deep learning framework can effectively localize the intracranial aneurysms. •The T1-based segmentation and detection method is more universal than other angiography-based detection methods, which can potentially reduce missed diagnoses caused by the absence of angiography images. •The deep learning framework is robust and has the potential to be applied in a clinical setting.

Deep learning-based cerebral aneurysm segmentation and morphological analysis with three-dimensional rotational angiography

BACKGROUND

The morphological assessment of cerebral aneurysms based on cerebral angiography is an essential step when planning strategy and device selection in endovascular treatment, but manual evaluation by human raters only has moderate interrater/intrarater reliability.

METHODS

We collected data for 889 cerebral angiograms from consecutive patients with suspected cerebral aneurysms at our institution from January 2017 to October 2021. The automatic morphological analysis model was developed on the derivation cohort dataset consisting of 388 scans with 437 aneurysms, and the performance of the model was tested on the validation cohort dataset consisting of 96 scans with 124 aneurysms. Five clinically important parameters were automatically calculated by the model: aneurysm volume, maximum aneurysm size, neck size, aneurysm height, and aspect ratio.

RESULTS

On the validation cohort dataset the average aneurysm size was 7.9±4.6 mm. The proposed model displayed high segmentation accuracy with a mean Dice similarity index of 0.87 (median 0.93). All the morphological parameters were significantly correlated with the reference standard (all P<0.0001; Pearson correlation analysis). The difference in the maximum aneurysm size between the model prediction and reference standard was 0.5±0.7 mm (mean±SD). The difference in neck size between the model prediction and reference standard was 0.8±1.7 mm (mean±SD).

CONCLUSION

The automatic aneurysm analysis model based on angiography data exhibited high accuracy for evaluating the morphological characteristics of cerebral aneurysms.

Application of convolutional network models in detection of intracranial aneurysms: A systematic review and meta-analysis

INTRODUCTION

Intracranial aneurysms have a high prevalence in human population. It also has a heavy burden of disease and high mortality rate in the case of rupture. Convolutional neural network(CNN) is a type of deep learning architecture which has been proven powerful to detect intracranial aneurysms.

METHODS

Four databases were searched using artificial intelligence, intracranial aneurysms, and synonyms to find eligible studies. Articles which had applied CNN for detection of intracranial aneurisms were included in this review. Sensitivity and specificity of the models and human readers regarding modality, size, and location of aneurysms were sought to be extracted. Random model was the preferred model for analyses using CMA 2 to determine pooled sensitivity and specificity.

RESULTS

Overall, 20 studies were used in this review. Deep learning models could detect intracranial aneurysms with a sensitivity of 90/6% (CI: 87/2-93/2%) and specificity of 94/6% (CI: 0/914-0/966). CTA was the most sensitive modality (92.0%(CI:85/2-95/8%)). Overall sensitivity of the models for aneurysms more than 3 mm was above 98% (98%-100%) and 74.6 for aneurysms less than 3 mm. With the aid of AI, the clinicians' sensitivity increased to 12/8% and interrater agreement to 0/193.

CONCLUSION

CNN models had an acceptable sensitivity for detection of intracranial aneurysms, surpassing human readers in some fields. The logical approach for application of deep learning models would be its use as a highly capable assistant. In essence, deep learning models are a groundbreaking technology that can assist clinicians and allow them to diagnose intracranial aneurysms more accurately.

Effectiveness of tuning an artificial intelligence algorithm for cerebral aneurysm diagnosis: a study of 10,000 consecutive cases

Diagnostic image analysis for unruptured cerebral aneurysms using artificial intelligence has a very high sensitivity. However, further improvement is needed because of a relatively high number of false positives. This study aimed to confirm the clinical utility of tuning an artificial intelligence algorithm for cerebral aneurysm diagnosis. We extracted 10,000 magnetic resonance imaging scans of participants who underwent brain screening using the "Brain Dock" system. The sensitivity and false positives/case for aneurysm detection were compared before and after tuning the algorithm. The initial diagnosis included only cases for which feedback to the algorithm was provided. In the primary analysis, the sensitivity of aneurysm diagnosis decreased from 96.5 to 90% and the false positives/case improved from 2.06 to 0.99 after tuning the algorithm (P < 0.001). In the secondary analysis, the sensitivity of aneurysm diagnosis decreased from 98.8 to 94.6% and the false positives/case improved from 1.99 to 1.03 after tuning the algorithm (P < 0.001). The false positives/case reduced without a significant decrease in sensitivity. Using large clinical datasets, we demonstrated that by tuning the algorithm, we could significantly reduce false positives with a minimal decline in sensitivity.

Role of artificial intelligence and machine learning in the diagnosis of cerebrovascular disease

Introduction

Cerebrovascular diseases are known to cause significant morbidity and mortality to the general population. In patients with cerebrovascular disease, prompt clinical evaluation and radiographic interpretation are both essential in optimizing clinical management and in triaging patients for critical and potentially life-saving neurosurgical interventions. With recent advancements in the domains of artificial intelligence (AI) and machine learning (ML), many AI and ML algorithms have been developed to further optimize the diagnosis and subsequent management of cerebrovascular disease. Despite such advances, further studies are needed to substantively evaluate both the diagnostic accuracy and feasibility of these techniques for their application in clinical practice. This review aims to analyze the current use of AI and MI algorithms in the diagnosis of, and clinical decision making for cerebrovascular disease, and to discuss both the feasibility and future applications of utilizing such algorithms.

Methods

We review the use of AI and ML algorithms to assist clinicians in the diagnosis and management of ischemic stroke, hemorrhagic stroke, intracranial aneurysms, and arteriovenous malformations (AVMs). After identifying the most widely used algorithms, we provide a detailed analysis of the accuracy and effectiveness of these algorithms in practice.

Results

The incorporation of AI and ML algorithms for cerebrovascular patients has demonstrated improvements in time to detection of intracranial pathologies such as intracerebral hemorrhage (ICH) and infarcts. For ischemic and hemorrhagic strokes, commercial AI software platforms such as RapidAI and Viz.AI have bene implemented into routine clinical practice at many stroke centers to expedite the detection of infarcts and ICH, respectively. Such algorithms and neural networks have also been analyzed for use in prognostication for such cerebrovascular pathologies. These include predicting outcomes for ischemic stroke patients, hematoma expansion, risk of aneurysm rupture, bleeding of AVMs, and in predicting outcomes following interventions such as risk of occlusion for various endovascular devices. Preliminary analyses have yielded promising sensitivities when AI and ML are used in concert with imaging modalities and a multidisciplinary team of health care providers.

Conclusion

The implementation of AI and ML algorithms to supplement clinical practice has conferred a high degree of accuracy, efficiency, and expedited detection in the clinical and radiographic evaluation and management of ischemic and hemorrhagic strokes, AVMs, and aneurysms. Such algorithms have been explored for further purposes of prognostication for these conditions, with promising preliminary results. Further studies should evaluate the longitudinal implementation of such techniques into hospital networks and residency programs to supplement clinical practice, and the extent to which these techniques improve patient care and clinical outcomes in the long-term.

Modern Imaging of Aneurysmal Subarachnoid Hemorrhage

In this review, we discuss the imaging of aneurysmal subarachnoid hemorrhage (SAH). We discuss emergency brain imaging, aneurysm detection techniques, and the management of CTA-negative SAH. We also review the concepts of cerebral vasospasm and delayed cerebral ischemia that occurs after aneurysm rupture and their impact on patient outcomes. These pathologies are distinct, and the use of multimodal imaging modalities is essential for prompt diagnosis and management to minimize morbidity from these conditions. Lastly, new advances in artificial intelligence and advanced imaging modalities such as PET and MR imaging scans have been shown to improve the detection of aneurysms and potentially predict outcomes early in the course of SAH.

Deep Learning-Based Computed Tomography Image Standardization to Improve Generalizability of Deep Learning-Based Hepatic Segmentation

OBJECTIVE

We aimed to investigate whether image standardization using deep learning-based computed tomography (CT) image conversion would improve the performance of deep learning-based automated hepatic segmentation across various reconstruction methods.

MATERIALS AND METHODS

We collected contrast-enhanced dual-energy CT of the abdomen that was obtained using various reconstruction methods, including filtered back projection, iterative reconstruction, optimum contrast, and monoenergetic images with 40, 60, and 80 keV. A deep learning based image conversion algorithm was developed to standardize the CT images using 142 CT examinations (128 for training and 14 for tuning). A separate set of 43 CT examinations from 42 patients (mean age, 10.1 years) was used as the test data. A commercial software program (MEDIP PRO v2.0.0.0, MEDICALIP Co. Ltd.) based on 2D U-NET was used to create liver segmentation masks with liver volume. The original 80 keV images were used as the ground truth. We used the paired t-test to compare the segmentation performance in the Dice similarity coefficient (DSC) and difference ratio of the liver volume relative to the ground truth volume before and after image standardization. The concordance correlation coefficient (CCC) was used to assess the agreement between the segmented liver volume and ground-truth volume.

RESULTS

The original CT images showed variable and poor segmentation performances. The standardized images achieved significantly higher DSCs for liver segmentation than the original images (DSC [original, 5.40%-91.27%] vs. [standardized, 93.16%-96.74%], all P < 0.001). The difference ratio of liver volume also decreased significantly after image conversion (original, 9.84%-91.37% vs. standardized, 1.99%-4.41%). In all protocols, CCCs improved after image conversion (original, -0.006-0.964 vs. standardized, 0.990-0.998).

CONCLUSION

Deep learning-based CT image standardization can improve the performance of automated hepatic segmentation using CT images reconstructed using various methods. Deep learning-based CT image conversion may have the potential to improve the generalizability of the segmentation network.

Detection of cerebral aneurysms using artificial intelligence: a systematic review and meta-analysis

BACKGROUND

Subarachnoid hemorrhage from cerebral aneurysm rupture is a major cause of morbidity and mortality. Early aneurysm identification, aided by automated systems, may improve patient outcomes. Therefore, a systematic review and meta-analysis of the diagnostic accuracy of artificial intelligence (AI) algorithms in detecting cerebral aneurysms using CT, MRI or DSA was performed.

METHODS

MEDLINE, Embase, Cochrane Library and Web of Science were searched until August 2021. Eligibility criteria included studies using fully automated algorithms to detect cerebral aneurysms using MRI, CT or DSA. Following Preferred Reporting Items for Systematic Reviews and Meta-Analysis: Diagnostic Test Accuracy (PRISMA-DTA), articles were assessed using Quality Assessment of Diagnostic Accuracy Studies 2 (QUADAS-2). Meta-analysis included a bivariate random-effect model to determine pooled sensitivity, specificity, and area under the receiver operator characteristic curve (ROC-AUC).

PROSPERO

CRD42021278454.

RESULTS

43 studies were included, and 41/43 (95%) were retrospective. 34/43 (79%) used AI as a standalone tool, while 9/43 (21%) used AI assisting a reader. 23/43 (53%) used deep learning. Most studies had high bias risk and applicability concerns, limiting conclusions. Six studies in the standalone AI meta-analysis gave (pooled) 91.2% (95% CI 82.2% to 95.8%) sensitivity; 16.5% (95% CI 9.4% to 27.1%) false-positive rate (1-specificity); 0.936 ROC-AUC. Five reader-assistive AI studies gave (pooled) 90.3% (95% CI 88.0% - 92.2%) sensitivity; 7.9% (95% CI 3.5% to 16.8%) false-positive rate; 0.910 ROC-AUC.

CONCLUSION

AI has the potential to support clinicians in detecting cerebral aneurysms. Interpretation is limited due to high risk of bias and poor generalizability. Multicenter, prospective studies are required to assess AI in clinical practice.

Dense, deep learning-based intracranial aneurysm detection on TOF MRI using two-stage regularized U-Net

BACKGROUND AND PURPOSE

The prevalence of unruptured intracranial aneurysms in the general population is high and aneurysms are usually asymptomatic. Their diagnosis is often fortuitous on MRI and might be difficult and time consuming for the radiologist. The purpose of this study was to develop a deep learning neural network tool for automated segmentation of intracranial arteries and automated detection of intracranial aneurysms from 3D time-of-flight magnetic resonance angiography (TOF-MRA).

MATERIALS AND METHODS

3D TOF-MRA with aneurysms were retrospectively extracted. All were confirmed with angiography. The data were divided into two sets: a training set of 24 examinations and a test set of 25 examinations. Manual annotations of intracranial blood vessels and aneurysms were performed by neuroradiologists. A double convolutional neuronal network based on the U-Net architecture with regularization was used to increase performance despite a small amount of training data. The performance was evaluated for the test set. Subgroup analyses according to size and location of aneurysms were performed.

RESULTS

The average processing time was 15 min. Overall, the sensitivity and the positive predictive value of the proposed algorithm were 78% (21 of 27; 95% CI: 62-94) and 62% (21 of 34; 95%CI: 46-78) respectively, with 0.5 FP/case. Despite gradual improvement in sensitivity regarding aneurysm size, there was no significant difference of sensitivity detection between subgroups of size and location.

CONCLUSIONS

This developed tool based on a double CNN with regularization trained with small dataset, enables accurate intracranial arteries segmentation as well as effective aneurysm detection on 3D TOF MRA.

Towards Automated Brain Aneurysm Detection in TOF-MRA: Open Data, Weak Labels, and Anatomical Knowledge

Brain aneurysm detection in Time-Of-Flight Magnetic Resonance Angiography (TOF-MRA) has undergone drastic improvements with the advent of Deep Learning (DL). However, performances of supervised DL models heavily rely on the quantity of labeled samples, which are extremely costly to obtain. Here, we present a DL model for aneurysm detection that overcomes the issue with "weak" labels: oversized annotations which are considerably faster to create. Our weak labels resulted to be four times faster to generate than their voxel-wise counterparts. In addition, our model leverages prior anatomical knowledge by focusing only on plausible locations for aneurysm occurrence. We first train and evaluate our model through cross-validation on an in-house TOF-MRA dataset comprising 284 subjects (170 females / 127 healthy controls / 157 patients with 198 aneurysms). On this dataset, our best model achieved a sensitivity of 83%, with False Positive (FP) rate of 0.8 per patient. To assess model generalizability, we then participated in a challenge for aneurysm detection with TOF-MRA data (93 patients, 20 controls, 125 aneurysms). On the public challenge, sensitivity was 68% (FP rate = 2.5), ranking 4th/18 on the open leaderboard. We found no significant difference in sensitivity between aneurysm risk-of-rupture groups (p = 0.75), locations (p = 0.72), or sizes (p = 0.15). Data, code and model weights are released under permissive licenses. We demonstrate that weak labels and anatomical knowledge can alleviate the necessity for prohibitively expensive voxel-wise annotations.

Automated detection of intracranial artery stenosis and occlusion in magnetic resonance angiography: A preliminary study based on deep learning

BACKGROUND AND OBJECTIVES

Intracranial atherosclerotic stenosis of a major intracranial artery is the common cause of ischemic stroke. We evaluate the feasibility of using deep learning to automatically detect intracranial arterial steno-occlusive lesions from time-of-flight magnetic resonance angiography.

METHODS

In a retrospective study, magnetic resonance images with radiological reports of intracranial arterial stenosis and occlusion were extracted. The images were randomly divided into a training set and a test set. The manual annotation of lesions with a bounding box labeled "moderate stenosis," "severe stenosis," "occlusion," and "absence of signal" was considered as ground truth. A deep learning algorithm based on you only look once version 5 (YOLOv5) detection model was developed with the training set, and its sensitivity and positive predictive values to detect lesions were evaluated in the test set.

RESULTS

A dataset of 200 examinations consisted of a total of 411 lesions-242 moderate stenoses, 84 severe stenoses, 70 occlusions, and 15 absence of signal. The magnetic resonance images contained 291 lesions in the training set and 120 lesions in the test set. The sensitivity and positive predictive values were 64.2 and 83.7%, respectively. The detection sensitivity in relation to the location was greatest in the internal carotid artery (86.2%).

CONCLUSIONS

Applying deep learning algorithms in the automated detection of intracranial arterial steno-occlusive lesions from time-of-flight magnetic resonance angiography is feasible and has great potential.

Evaluation of an automated intracranial aneurysm detection and rupture analysis approach using cascade detection and classification networks

Intracranial aneurysm is commonly found in human brains especially for the elderly, and its rupture accounts for a high rate of subarachnoid hemorrhages. However, it is time-consuming and requires special expertise to pinpoint small aneurysms from computed tomography angiography (CTA) images. Deep learning-based detection has helped improve much efficiency but false-positives still render difficulty to be ruled out. To study the feasibility of deep learning algorithms for aneurysm analysis in clinical applications, this paper proposes a pipeline for aneurysm detection, segmentation, and rupture classification and validates its performance using CTA images of 1508 subjects. A cascade aneurysm detection model is employed by first using a fine-tuned feature pyramid network (FPN) for candidate detection and then applying a dual-channel ResNet aneurysm classifier to further reduce false positives. Detected aneurysms are then segmented by applying a traditional 3D V-Net to their image patches. Radiomics features of aneurysms are extracted after detection and segmentation. The machine-learning-based and deep learning-based rupture classification can be used to distinguish ruptured and un-ruptured ones. Experimental results show that the dual-channel ResNet aneurysm classifier utilizing image and vesselness information helps boost sensitivity of detection compared to single image channel input. Overall, the proposed pipeline can achieve a sensitivity of 90 % for 1 false positive per image, and 95 % for 2 false positives per image. For rupture classification the area under curve (AUC) of 0.906 can be achieved for the testing dataset. The results suggest feasibility of the pipeline for potential clinical use to assist radiologists in aneurysm detection and classification of ruptured and un-ruptured aneurysms.

RAPID Aneurysm: Artificial intelligence for unruptured cerebral aneurysm detection on CT angiography

OBJECTIVES

Cerebral aneurysms may result in significant morbidity and mortality. Identification of these aneurysms on CT Angiography (CTA) studies is critical to guide patient treatment. Artificial intelligence platforms to assist with automated aneurysm detection are of high interest. We determined the performance of a semi-automated artificial intelligence software program (RAPID Aneurysm) for the detection of cerebral aneurysms.

MATERIALS AND METHODS

RAPID Aneurysm was used to detect retrospectively the presence of cerebral aneurysms in CTA studies performed between January 2019 and December 2020. The gold standard was aneurysm presence and location as determined by the consensus of three expert neuroradiologists. Aneurysm detection accuracy, sensitivity, specificity, positive predictive value, negative predictive value, and positive and negative likelihood ratios by RAPID Aneurysm were determined.

RESULTS

51 patients (mean age, 56±15; 24 women [47.1%]) with a single CTA were included. A total of 60 aneurysms were identified. RAPID Aneurysm had a sensitivity of 0.950 (95% CI: 0.863-0.983), specificity of 1.000 (95% CI: 0.996-1.000), a positive predictive value (PPV) of 1.000 (95% CI: 0.937-1.000), a negative predictive value (NPV) of 0.997 (95% CI: 0.991-0.999), and an accuracy of 0.997 (95% CI: 0.991-0.999) for cerebral aneurysm detection.

CONCLUSIONS

RAPID Aneurysm is highly accurate for the detection of cerebral aneurysms on CTA.

A Review of Artificial Intelligence in Cerebrovascular Disease Imaging: Applications and Challenges

BACKGROUND

A variety of emerging medical imaging technologies based on artificial intelligence have been widely applied in many diseases, but they are still limitedly used in the cerebrovascular field even though the diseases can lead to catastrophic consequences.

OBJECTIVE

This work aims to discuss the current challenges and future directions of artificial intelligence technology in cerebrovascular diseases through reviewing the existing literature related to applications in terms of computer-aided detection, prediction and treatment of cerebrovascular diseases.

METHODS

Based on artificial intelligence applications in four representative cerebrovascular diseases including intracranial aneurysm, arteriovenous malformation, arteriosclerosis and moyamoya disease, this paper systematically reviews studies published between 2006 and 2021 in five databases: National Center for Biotechnology Information, Elsevier Science Direct, IEEE Xplore Digital Library, Web of Science and Springer Link. And three refinement steps were further conducted after identifying relevant literature from these databases.

RESULTS

For the popular research topic, most of the included publications involved computer-aided detection and prediction of aneurysms, while studies about arteriovenous malformation, arteriosclerosis and moyamoya disease showed an upward trend in recent years. Both conventional machine learning and deep learning algorithms were utilized in these publications, but machine learning techniques accounted for a larger proportion.

CONCLUSION

Algorithms related to artificial intelligence, especially deep learning, are promising tools for medical imaging analysis and will enhance the performance of computer-aided detection, prediction and treatment of cerebrovascular diseases.

External Validation of Deep Learning Algorithms for Radiologic Diagnosis: A Systematic Review

Purpose

To assess generalizability of published deep learning (DL) algorithms for radiologic diagnosis.

Materials and Methods

In this systematic review, the PubMed database was searched for peer-reviewed studies of DL algorithms for image-based radiologic diagnosis that included external validation, published from January 1, 2015, through April 1, 2021. Studies using nonimaging features or incorporating non-DL methods for feature extraction or classification were excluded. Two reviewers independently evaluated studies for inclusion, and any discrepancies were resolved by consensus. Internal and external performance measures and pertinent study characteristics were extracted, and relationships among these data were examined using nonparametric statistics.

Results

Eighty-three studies reporting 86 algorithms were included. The vast majority (70 of 86, 81%) reported at least some decrease in external performance compared with internal performance, with nearly half (42 of 86, 49%) reporting at least a modest decrease (≥0.05 on the unit scale) and nearly a quarter (21 of 86, 24%) reporting a substantial decrease (≥0.10 on the unit scale). No study characteristics were found to be associated with the difference between internal and external performance.

Conclusion

Among published external validation studies of DL algorithms for image-based radiologic diagnosis, the vast majority demonstrated diminished algorithm performance on the external dataset, with some reporting a substantial performance decrease.Keywords: Meta-Analysis, Computer Applications-Detection/Diagnosis, Neural Networks, Computer Applications-General (Informatics), Epidemiology, Technology Assessment, Diagnosis, Informatics Supplemental material is available for this article. © RSNA, 2022.

Detection and analysis of cerebral aneurysms based on X-ray rotational angiography - the CADA 2020 challenge

The Cerebral Aneurysm Detection and Analysis (CADA) challenge was organized to support the development and benchmarking of algorithms for detecting, analyzing, and risk assessment of cerebral aneurysms in X-ray rotational angiography (3DRA) images. 109 anonymized 3DRA datasets were provided for training, and 22 additional datasets were used to test the algorithmic solutions. Cerebral aneurysm detection was assessed using the F2 score based on recall and precision, and the fit of the delivered bounding box was assessed using the distance to the aneurysm. The segmentation quality was measured using the Jaccard index and a combination of different surface distance measures. Systematic errors were analyzed using volume correlation and bias. Rupture risk assessment was evaluated using the F2 score. 158 participants from 22 countries registered for the CADA challenge. The U-Net-based detection solutions presented by the community show similar accuracy compared to experts (F2 score 0.92), with a small number of missed aneurysms with diameters smaller than 3.5 mm. In addition, the delineation of these structures, based on U-Net variations, is excellent, with a Jaccard score of 0.92. The rupture risk estimation methods achieved an F2 score of 0.71. The performance of the detection and segmentation solutions is equivalent to that of human experts. The best results are obtained in rupture risk estimation by combining different image-based, morphological, and computational fluid dynamic parameters using machine learning methods. Furthermore, we evaluated the best methods pipeline, from detecting and delineating the vessel dilations to estimating the risk of rupture. The chain of these methods achieves an F2-score of 0.70, which is comparable to applying the risk prediction to the ground-truth delineation (0.71).

Artificial Intelligence-Enabled Medical Analysis for Intracranial Cerebral Hemorrhage Detection and Classification

Intracranial hemorrhage (ICH) becomes a crucial healthcare emergency, which requires earlier detection and accurate assessment. Owing to the increased death rate (around 40%), the earlier recognition and classification of disease using computed tomography (CT) images are necessary to ensure a favourable prediction and restrain the existence of neurologic deficits. Since the manual diagnosis approach is time-consuming, automated ICH detection and classification models using artificial intelligence (AI) models are required. With this motivation, this study introduces an AI-enabled medical analysis tool for ICH detection and classification (AIMA-ICHDC) using CT images. The proposed AIMA-ICHDC technique aims at identifying the presence of ICH and identifying the different grades. In addition, the AIMA-ICHDC technique involves the design of glowworm swarm optimization with fuzzy entropy clustering (GSO-FEC) technique for the segmentation process. Besides, the VGG-19 model was executed for generating a collection of feature vectors and the optimal mixed-kernel-based extreme learning machine (OMKELM) model is utilized as a classifier. To optimally select the weight parameter of the MKELM technique, the coyote optimization algorithm (COA) was utilized. A wide range of simulation analyses are carried out under varying aspects. As part of the AIMA-ICHDC method, ICH can be detected and graded using a single sample. For segmentation, the AIMA-ICHDC technique uses the GSO-FEC method, which is the design of glowworm swarm optimization (GSO). The comparative outcomes highlighted the betterment of the AIMA-ICHDC technique compared to the recent state-of-the-art ICH classification approaches in terms of several measures.

Artificial Intelligence Applications in Intracranial Aneurysm: Achievements, Challenges and Opportunities

Intracranial aneurysms present in about 3% of the general population and the number of detected aneurysms is continuously rising with the advances in imaging techniques. Intracranial aneurysm rupture carries a high risk of death or permanent disabilities; therefore assessment of the intracranial aneurysm along the entire course is of great clinical importance. Given the outstanding performance of artificial intelligence (AI) in image-based tasks, many AI-based applications have emerged in recent years for the assessment of intracranial aneurysms. In this review we will summarize the state-of-the-art of AI applications in intracranial aneurysms, emphasizing the achievements, and exploring the challenges. We will also discuss the future prospects and potential opportunities. This article provides an updated view of the AI applications in intracranial aneurysms and may act as a basis for guiding the related future works.

Multidimensional Deep Learning Reduces False-Positives in the Automated Detection of Cerebral Aneurysms on Time-Of-Flight Magnetic Resonance Angiography: A Multi-Center Study

Current deep learning-based cerebral aneurysm detection demonstrates high sensitivity, but produces numerous false-positives (FPs), which hampers clinical application of automated detection systems for time-of-flight magnetic resonance angiography. To reduce FPs while maintaining high sensitivity, we developed a multidimensional convolutional neural network (MD-CNN) designed to unite planar and stereoscopic information about aneurysms. This retrospective study enrolled time-of-flight magnetic resonance angiography images of cerebral aneurysms from three institutions from June 2006 to April 2019. In the internal test, 80% of the entire data set was used for model training and 20% for the test, while for the external tests, data from different pairs of the three institutions were used for training and the remaining one for testing. Images containing aneurysms > 15 mm and images without aneurysms were excluded. Three deep learning models [planar information-only (2D-CNN), stereoscopic information-only (3D-CNN), and multidimensional information (MD-CNN)] were trained to classify whether the voxels contained aneurysms, and they were evaluated on each test. The performance of each model was assessed using free-response operating characteristic curves. In total, 732 aneurysms (5.9 ± 2.5 mm) of 559 cases (327, 120, and 112 from institutes A, B, and C; 469 and 263 for 1.5T and 3.0T MRI) were included in this study. In the internal test, the highest sensitivities were 80.4, 87.4, and 82.5%, and the FPs were 6.1, 7.1, and 5.0 FPs/case at a fixed sensitivity of 80% for the 2D-CNN, 3D-CNN, and MD-CNN, respectively. In the external test, the highest sensitivities were 82.1, 86.5, and 89.1%, and 5.9, 7.4, and 4.2 FPs/cases for them, respectively. MD-CNN was a new approach to maintain sensitivity and reduce the FPs simultaneously.

Artificial intelligence with deep learning in nuclear medicine and radiology

The use of deep learning in medical imaging has increased rapidly over the past few years, finding applications throughout the entire radiology pipeline, from improved scanner performance to automatic disease detection and diagnosis. These advancements have resulted in a wide variety of deep learning approaches being developed, solving unique challenges for various imaging modalities. This paper provides a review on these developments from a technical point of view, categorizing the different methodologies and summarizing their implementation. We provide an introduction to the design of neural networks and their training procedure, after which we take an extended look at their uses in medical imaging. We cover the different sections of the radiology pipeline, highlighting some influential works and discussing the merits and limitations of deep learning approaches compared to other traditional methods. As such, this review is intended to provide a broad yet concise overview for the interested reader, facilitating adoption and interdisciplinary research of deep learning in the field of medical imaging.

Machine Learning and Intracranial Aneurysms: From Detection to Outcome Prediction

Machine learning (ML) is a rapidly rising research tool in biomedical sciences whose applications include segmentation, classification, disease detection, and outcome prediction. With respect to traditional statistical methods, ML algorithms have the potential to learn and improve their predictive performance when fed with large data sets without the need of being specifically programmed. In recent years, this technology has been increasingly applied for tackling clinical issues in intracranial aneurysm (IA) research. Several studies attempted to provide reliable models for enhanced aneurysm detection. Convolutional neural networks trained with variable degrees of human interaction on data from diverse imaging modalities showed high sensitivity in aneurysm detection tasks, also outperforming expert image analysis. Algorithms were also shown to differentiate ruptured from unruptured IAs, with however limited clinical relevance. For prediction of rupture and stability assessment, ML was preliminarily shown to achieve better performance compared to conventional statistical methods and existing risk scores. ML-based complication and functional outcome prediction in the event of SAH have been more extensively reported, in contrast with periprocedural outcome investigation in unruptured IA patients. ML has the potential to be a game changer in IA patient management. Currently clinical translation of experimental results is limited.

A Deep Learning Model with High Standalone Performance for Diagnosis of Unruptured Intracranial Aneurysm

PURPOSE

This study aimed to investigate whether a deep learning model for automated detection of unruptured intracranial aneurysms on time-of-flight (TOF) magnetic resonance angiography (MRA) can achieve a target diagnostic performance comparable to that of human radiologists for approval from the Korean Ministry of Food and Drug Safety as an artificial intelligence-applied software.

MATERIALS AND METHODS

In this single-center, retrospective, confirmatory clinical trial, the diagnostic performance of the model was evaluated in a predetermined test set. After sample size estimation, the test set consisted of 135 aneurysm-containing examinations with 168 intracranial aneurysms and 197 aneurysm-free examinations. The target sensitivity and specificity were set as 87% and 92%, respectively. The patient-wise sensitivity and specificity of the model were analyzed. Moreover, the lesion-wise sensitivity and false-positive detection rate per case were also investigated.

RESULTS

The sensitivity and specificity of the model were 91.11% [95% confidence interval (CI): 84.99, 95.32] and 93.91% (95% CI: 89.60, 96.81), respectively, which met the target performance values. The lesion-wise sensitivity was 92.26%. The overall false-positive detection rate per case was 0.123. Of the 168 aneurysms, 13 aneurysms from 12 examinations were missed by the model.

CONCLUSION

The present deep learning model for automated detection of unruptured intracranial aneurysms on TOF MRA achieved the target diagnostic performance comparable to that of human radiologists. With high standalone performance, this model may be useful for accurate and efficient diagnosis of intracranial aneurysm.

Deep Learning-Based Software Improves Clinicians' Detection Sensitivity of Aneurysms on Brain TOF-MRA

BACKGROUND AND PURPOSE

The detection of cerebral aneurysms on MRA is a challenging task. Recent studies have used deep learning-based software for automated detection of aneurysms on MRA and have reported high performance. The purpose of this study was to evaluate the incremental value of using deep learning-based software for the detection of aneurysms on MRA by 2 radiologists, a neurosurgeon, and a neurologist.

MATERIALS AND METHODS

TOF-MRA examinations of intracranial aneurysms were retrospectively extracted. Four physicians interpreted the MRA blindly. After a washout period, they interpreted MRA again using the software. Sensitivity and specificity per patient, sensitivity per lesion, and the number of false-positives per case were measured. Diagnostic performances, including subgroup analysis of lesions, were compared. Logistic regression with a generalized estimating equation was used.

RESULTS

A total of 332 patients were evaluated; 135 patients had positive findings with 169 lesions. With software assistance, patient-based sensitivity was statistically improved after the washout period (73.5% versus 86.5%, P < .001). The neurosurgeon and neurologist showed a significant increase in patient-based sensitivity with software assistance (74.8% versus 85.2%, P = .03, and 56.3% versus 84.4%, P < .001, respectively), while the number of false-positive cases did not increase significantly (23 versus 30, P = .20, and 22 versus 24, P = .75, respectively).

CONCLUSIONS

Software-aided reading showed significant incremental value in the sensitivity of clinicians in the detection of aneurysms on MRA without a significant increase in false-positive findings, especially for the neurosurgeon and neurologist. Software-aided reading showed equivocal value for the radiologist.

Performance changes due to differences in training data for cerebral aneurysm detection in head MR angiography images

PURPOSE

The performance of computer-aided detection (CAD) software depends on the quality and quantity of the dataset used for machine learning. If the data characteristics in development and practical use are different, the performance of CAD software degrades. In this study, we investigated changes in detection performance due to differences in training data for cerebral aneurysm detection software in head magnetic resonance angiography images.

MATERIALS AND METHODS

We utilized three types of CAD software for cerebral aneurysm detection in MRA images, which were based on 3D local intensity structure analysis, graph-based features, and convolutional neural network. For each type of CAD software, we compared three types of training pattern, which were two types of training using single-site data and one type of training using multisite data. We also carried out internal and external evaluations.

RESULTS

In training using single-site data, the performance of CAD software largely and unpredictably fluctuated when the training dataset was changed. Training using multisite data did not show the lowest performance among the three training patterns for any CAD software and dataset.

CONCLUSION

The training of cerebral aneurysm detection software using data collected from multiple sites is desirable to ensure the stable performance of the software.

Multi-View Convolutional Neural Networks in Rupture Risk Assessment of Small, Unruptured Intracranial Aneurysms

Auto-detection of cerebral aneurysms via convolutional neural network (CNN) is being increasingly reported. However, few studies to date have accurately predicted the risk, but not the diagnosis itself. We developed a multi-view CNN for the prediction of rupture risk involving small unruptured intracranial aneurysms (UIAs) based on three-dimensional (3D) digital subtraction angiography (DSA). The performance of a multi-view CNN-ResNet50 in accurately predicting the rupture risk (high vs. non-high) of UIAs in the anterior circulation measuring less than 7 mm in size was compared with various CNN architectures (AlexNet and VGG16), with similar type but different layers (ResNet101 and ResNet152), and single image-based CNN (single-view ResNet50). The sensitivity, specificity, and overall accuracy of risk prediction were estimated and compared according to CNN architecture. The study included 364 UIAs in training and 93 in test datasets. A multi-view CNN-ResNet50 exhibited a sensitivity of 81.82 (66.76–91.29)%, a specificity of 81.63 (67.50–90.76)%, and an overall accuracy of 81.72 (66.98–90.92)% for risk prediction. AlexNet, VGG16, ResNet101, ResNet152, and single-view CNN-ResNet50 showed similar specificity. However, the sensitivity and overall accuracy were decreased (AlexNet, 63.64% and 76.34%; VGG16, 68.18% and 74.19%; ResNet101, 68.18% and 73.12%; ResNet152, 54.55% and 72.04%; and single-view CNN-ResNet50, 50.00% and 64.52%) compared with multi-view CNN-ResNet50. Regarding F1 score, it was the highest in multi-view CNN-ResNet50 (80.90 (67.29–91.81)%). Our study suggests that multi-view CNN-ResNet50 may be feasible to assess the rupture risk in small-sized UIAs.

The Recent Progress and Applications of Digital Technologies in Healthcare: A Review

BACKGROUND

The implementation of medical digital technologies can provide better accessibility and flexibility of healthcare for the public. It encompasses the availability of open information on the health, treatment, complications, and recent progress on biomedical research. At present, even in low-income countries, diagnostic and medical services are becoming more accessible and available. However, many issues related to digital health technologies remain unmet, including the reliability, safety, testing, and ethical aspects.

PURPOSE

The aim of the review is to discuss and analyze the recent progress on the application of big data, artificial intelligence, telemedicine, block-chain platforms, smart devices in healthcare, and medical education. Basic Design. The publication search was carried out using Google Scholar, PubMed, Web of Sciences, Medline, Wiley Online Library, and CrossRef databases. The review highlights the applications of artificial intelligence, "big data," telemedicine and block-chain technologies, and smart devices (internet of things) for solving the real problems in healthcare and medical education. Major Findings. We identified 252 papers related to the digital health area. However, the number of papers discussed in the review was limited to 152 due to the exclusion criteria. The literature search demonstrated that digital health technologies became highly sought due to recent pandemics, including COVID-19. The disastrous dissemination of COVID-19 through all continents triggered the need for fast and effective solutions to localize, manage, and treat the viral infection. In this regard, the use of telemedicine and other e-health technologies might help to lessen the pressure on healthcare systems. Summary. Digital platforms can help optimize diagnosis, consulting, and treatment of patients. However, due to the lack of official regulations and recommendations, the stakeholders, including private and governmental organizations, are facing the problem with adequate validation and approbation of novel digital health technologies. In this regard, proper scientific research is required before a digital product is deployed for the healthcare sector.