Multidimensional Deep Learning Reduces False-Positives in the Automated Detection of Cerebral Aneurysms on Time-Of-Flight Magnetic Resonance Angiography: A Multi-Center Study

Impact of an AI software on the diagnostic performance and reading time for the detection of cerebral aneurysms on time of flight MR-angiography

PURPOSE

To evaluate the impact of an AI-based software trained to detect cerebral aneurysms on TOF-MRA on the diagnostic performance and reading times across readers with varying experience levels.

METHODS

One hundred eighty-six MRI studies were reviewed by six readers to detect cerebral aneurysms. Initially, readings were assisted by the CNN-based software mdbrain. After 6 weeks, a second reading was conducted without software assistance. The results were compared to the consensus reading of two neuroradiological specialists and sensitivity (lesion and patient level), specificity (patient level), and false positives per case were calculated for the group of all readers, for the subgroup of physicians, and for each individual reader. Also, reading times for each reader were measured.

RESULTS

The dataset contained 54 aneurysms. The readers had no experience (three medical students), 2 years experience (resident in neuroradiology), 6 years experience (radiologist), and 12 years (neuroradiologist). Significant improvements of overall specificity and the overall number of false positives per case were observed in the reading with AI support. For the physicians, we found significant improvements of sensitivity on lesion and patient level and false positives per case. Four readers experienced reduced reading times with the software, while two encountered increased times.

CONCLUSION

In the reading with the AI-based software, we observed significant improvements in terms of specificity and false positives per case for the group of all readers and significant improvements of sensitivity and false positives per case for the physicians. Further studies are needed to investigate the effects of the AI-based software in a prospective setting.

Diagnosis of Small Unruptured Intracranial Aneurysms : Comparison of 7 T versus 3 T MRI

PURPOSE

Differentiating normal anatomical variants such as an infundibulum or a vascular loop from true intracranial aneurysms is crucial for patient management. We hypothesize that high-resolution 7 T magnetic resonance imaging (MRI) improves the detection and characterization of normal anatomical variants that may otherwise be misdiagnosed as small unruptured aneurysms.

METHODS

This is a retrospective, single-center study. All patients were scanned on a clinically approved 7 T MRI scanner and on a 3 T scanner. Image analysis was performed independently by three neuroradiologists blinded to clinical information. The presence of an unruptured intracranial aneurysm (UIA) and level of diagnostic certainty were assessed and the interrater agreement was calculated. If an aneurysm was present, the anatomic location and shape were recorded and compared.

RESULTS

In total, 53 patients with equivocal cerebrovascular findings on 1.5 T or 3 T MRI referred for a 7T MRI examination were included. Aneurysms were suspected in 42 patients examined at 3 T and in 23 patients at 7 T (rate difference 36%, 95% confidence interval, CI, 19-53%, p-value < 0.001). Major disagreement between the field strengths was observed in the A1 segment of anterior cerebral artery/anterior communicating artery (A1/ACOM) complex. The interrater agreement among the readers on the presence of an aneurysm on 7 T MRI was higher than that for 3 T MRI (0.925, 95% CI 0.866-0.983 vs. 0.786, 95% CI 0.700-0.873).

CONCLUSION

Our analysis demonstrates a significantly higher interrater agreement and improved diagnostic certainty when small intracranial aneurysms are visualized on 7 T MRI compared to 3 T. In a selected patient cohort, clinical implementation of 7 T MRI may help to establish the definitive diagnosis and thus have a beneficial impact on patient management.

Comparison of 1.5 T and 3 T magnetic resonance angiography for detecting cerebral aneurysms using deep learning-based computer-assisted detection software

PURPOSE

To compare the diagnostic performance of 1.5 T versus 3 T magnetic resonance angiography (MRA) for detecting cerebral aneurysms with clinically available deep learning-based computer-assisted detection software (EIRL aneurysm® [EIRL_an]), which has been approved by the Japanese Pharmaceuticals and Medical Devices Agency. We also sought to analyze the causes of potential false positives.

METHODS

In this single-center, retrospective study, we evaluated the MRA scans of 90 patients who underwent head MRA (1.5 T and 3 T in 45 patients each) in clinical practice. Overall, 51 patients had 70 aneurysms. We used MRI from a vendor not included in the dataset used to create the EIRL_an algorithm. Two radiologists determined the ground truth, the accuracy of the candidates noted by EIRL_an, and the causes of false positives. The sensitivity, number of false positives per case (FPs/case), and the causes of false positives were compared between 1.5 T and 3 T MRA. Pearson's χ2 test, Fisher's exact test, and the Mann‒Whitney U test were used for the statistical analyses as appropriate.

RESULTS

The sensitivity was high for 1.5 T and 3 T MRA (0.875‒1), but the number of FPs/case was significantly higher with 3 T MRA (1.511 vs. 2.578, p < 0.001). The most common causes of false positives (descending order) were the origin/bifurcation of vessels/branches, flow-related artifacts, and atherosclerosis and were similar between 1.5 T and 3 T MRA.

CONCLUSION

EIRL_an detected significantly more false-positive lesions with 3 T than with 1.5 T MRA in this external validation study. Our data may help physicians with limited experience with MRA to correctly diagnose aneurysms using EIRL_an.

Role of artificial intelligence and machine learning in the diagnosis of cerebrovascular disease

Introduction

Cerebrovascular diseases are known to cause significant morbidity and mortality to the general population. In patients with cerebrovascular disease, prompt clinical evaluation and radiographic interpretation are both essential in optimizing clinical management and in triaging patients for critical and potentially life-saving neurosurgical interventions. With recent advancements in the domains of artificial intelligence (AI) and machine learning (ML), many AI and ML algorithms have been developed to further optimize the diagnosis and subsequent management of cerebrovascular disease. Despite such advances, further studies are needed to substantively evaluate both the diagnostic accuracy and feasibility of these techniques for their application in clinical practice. This review aims to analyze the current use of AI and MI algorithms in the diagnosis of, and clinical decision making for cerebrovascular disease, and to discuss both the feasibility and future applications of utilizing such algorithms.

Methods

We review the use of AI and ML algorithms to assist clinicians in the diagnosis and management of ischemic stroke, hemorrhagic stroke, intracranial aneurysms, and arteriovenous malformations (AVMs). After identifying the most widely used algorithms, we provide a detailed analysis of the accuracy and effectiveness of these algorithms in practice.

Results

The incorporation of AI and ML algorithms for cerebrovascular patients has demonstrated improvements in time to detection of intracranial pathologies such as intracerebral hemorrhage (ICH) and infarcts. For ischemic and hemorrhagic strokes, commercial AI software platforms such as RapidAI and Viz.AI have bene implemented into routine clinical practice at many stroke centers to expedite the detection of infarcts and ICH, respectively. Such algorithms and neural networks have also been analyzed for use in prognostication for such cerebrovascular pathologies. These include predicting outcomes for ischemic stroke patients, hematoma expansion, risk of aneurysm rupture, bleeding of AVMs, and in predicting outcomes following interventions such as risk of occlusion for various endovascular devices. Preliminary analyses have yielded promising sensitivities when AI and ML are used in concert with imaging modalities and a multidisciplinary team of health care providers.

Conclusion

The implementation of AI and ML algorithms to supplement clinical practice has conferred a high degree of accuracy, efficiency, and expedited detection in the clinical and radiographic evaluation and management of ischemic and hemorrhagic strokes, AVMs, and aneurysms. Such algorithms have been explored for further purposes of prognostication for these conditions, with promising preliminary results. Further studies should evaluate the longitudinal implementation of such techniques into hospital networks and residency programs to supplement clinical practice, and the extent to which these techniques improve patient care and clinical outcomes in the long-term.

Detection of Gallbladder Disease Types Using Deep Learning: An Informative Medical Method

Nowadays, despite all the conducted research and the provided efforts in advancing the healthcare sector, there is a strong need to rapidly and efficiently diagnose various diseases. The complexity of some disease mechanisms on one side and the dramatic life-saving potential on the other side raise big challenges for the development of tools for the early detection and diagnosis of diseases. Deep learning (DL), an area of artificial intelligence (AI), can be an informative medical tomography method that can aid in the early diagnosis of gallbladder (GB) disease based on ultrasound images (UI). Many researchers considered the classification of only one disease of the GB. In this work, we successfully managed to apply a deep neural network (DNN)-based classification model to a rich built database in order to detect nine diseases at once and to determine the type of disease using UI. In the first step, we built a balanced database composed of 10,692 UI of the GB organ from 1782 patients. These images were carefully collected from three hospitals over roughly three years and then classified by professionals. In the second step, we preprocessed and enhanced the dataset images in order to achieve the segmentation step. Finally, we applied and then compared four DNN models to analyze and classify these images in order to detect nine GB disease types. All the models produced good results in detecting GB diseases; the best was the MobileNet model, with an accuracy of 98.35%.

Automated Detection of Cerebral Aneurysms on TOF-MRA Using a Deep Learning Approach: An External Validation Study

BACKGROUND AND PURPOSE

Cerebral aneurysms yield the risk of rupture, severe disability and death. Thus, early detection of cerebral aneurysms is crucial to ensure timely treatment, if necessary. AI-based software tools are expected to enhance radiologists' performance in detecting pathologies like cerebral aneurysms in the future. Our aim was to evaluate the diagnostic performance of an artificial intelligence-based software designed to detect intracranial aneurysms on TOF-MRA.

MATERIALS AND METHODS

One hundred ninety-one MR imaging data sets were analyzed using the software mdbrain for the presence of intracranial aneurysms on TOF-MRA obtained using two 3T MR imaging scanners or a 1.5T MR imaging scanner according to our clinical standard protocol. The results were compared with the reading of an experienced radiologist as a criterion standard to measure the sensitivity, specificity, positive and negative predictive values, and accuracy of the software. Additionally, detection rates depending on size, morphology, and location of the aneurysms were evaluated.

RESULTS

Fifty-four aneurysms were detected by the expert reader. The overall sensitivity of the software for the detection of cerebral aneurysms was 72.6%, the specificity was 87.2%, and the accuracy was 82.6%. The positive predictive value was 67.9%, and the negative predictive value was 88.5%. We observed a sensitivity of 100% for saccular aneurysms of >5 mm without signs of thrombosis and low detection rates for fusiform or thrombosed aneurysms of 33.3% and 16.7%, respectively. Of 8 aneurysms that were not included in the initial written reports but were detected by the expert reader, retrospectively, 4 were detected by the software.

CONCLUSIONS

Our data suggest that the software can assist radiologists in reporting TOF-MRA. The software was highly reliable in detecting saccular aneurysms, while for fusiform or thrombosed aneurysms, further improvements are needed. Further studies are necessary to investigate the impact of the software on detection rates, interrater reliability, and reading times.