Convolutional Neural Networks for the Detection and Measurement of Cerebral Aneurysms on Magnetic Resonance Angiography

Automated Detection and Diameter Estimation for Mouse Mesenteric Artery Using Semantic Segmentation

BACKGROUND

Pressurized myography is useful for the assessment of small artery structures and function. However, this procedure requires technical expertise for sample preparation and effort to choose an appropriate sized artery. In this study, we developed an automatic artery/vein differentiation and a size measurement system utilizing machine learning algorithms.

METHODS AND RESULTS

We used 654 independent mouse mesenteric artery images for model training. The model yielded an Intersection-over-Union of 0.744 ± 0.031 and a Dice coefficient of 0.881 ± 0.016. The vessel size and lumen size calculated from the predicted vessel contours demonstrated a strong linear correlation with manually determined vessel sizes (R = 0.722 ± 0.048, p < 0.001 for vessel size and R = 0.908 ± 0.027, p < 0.001 for lumen size). Last, we assessed the relation between the vessel size before and after dissection using a pressurized myography system. We observed a strong positive correlation between the wall/lumen ratio before dissection and the lumen expansion ratio (R = 0.832, p < 0.01). Using multivariate binary logistic regression, 2 models estimating whether the vessel met the size criteria (lumen size of 160-240 μm) were generated with an area under the receiver operating characteristic curve of 0.761 for the upper limit and 0.747 for the lower limit.

CONCLUSION

The U-Net-based image analysis method could streamline the experimental approach.

Advances in Deep Learning-Based Medical Image Analysis

Importance. With the booming growth of artificial intelligence (AI), especially the recent advancements of deep learning, utilizing advanced deep learning-based methods for medical image analysis has become an active research area both in medical industry and academia. This paper reviewed the recent progress of deep learning research in medical image analysis and clinical applications. It also discussed the existing problems in the field and provided possible solutions and future directions.Highlights. This paper reviewed the advancement of convolutional neural network-based techniques in clinical applications. More specifically, state-of-the-art clinical applications include four major human body systems: the nervous system, the cardiovascular system, the digestive system, and the skeletal system. Overall, according to the best available evidence, deep learning models performed well in medical image analysis, but what cannot be ignored are the algorithms derived from small-scale medical datasets impeding the clinical applicability. Future direction could include federated learning, benchmark dataset collection, and utilizing domain subject knowledge as priors.Conclusion. Recent advanced deep learning technologies have achieved great success in medical image analysis with high accuracy, efficiency, stability, and scalability. Technological advancements that can alleviate the high demands on high-quality large-scale datasets could be one of the future developments in this area.

Multi-View Convolutional Neural Networks in Rupture Risk Assessment of Small, Unruptured Intracranial Aneurysms

Auto-detection of cerebral aneurysms via convolutional neural network (CNN) is being increasingly reported. However, few studies to date have accurately predicted the risk, but not the diagnosis itself. We developed a multi-view CNN for the prediction of rupture risk involving small unruptured intracranial aneurysms (UIAs) based on three-dimensional (3D) digital subtraction angiography (DSA). The performance of a multi-view CNN-ResNet50 in accurately predicting the rupture risk (high vs. non-high) of UIAs in the anterior circulation measuring less than 7 mm in size was compared with various CNN architectures (AlexNet and VGG16), with similar type but different layers (ResNet101 and ResNet152), and single image-based CNN (single-view ResNet50). The sensitivity, specificity, and overall accuracy of risk prediction were estimated and compared according to CNN architecture. The study included 364 UIAs in training and 93 in test datasets. A multi-view CNN-ResNet50 exhibited a sensitivity of 81.82 (66.76–91.29)%, a specificity of 81.63 (67.50–90.76)%, and an overall accuracy of 81.72 (66.98–90.92)% for risk prediction. AlexNet, VGG16, ResNet101, ResNet152, and single-view CNN-ResNet50 showed similar specificity. However, the sensitivity and overall accuracy were decreased (AlexNet, 63.64% and 76.34%; VGG16, 68.18% and 74.19%; ResNet101, 68.18% and 73.12%; ResNet152, 54.55% and 72.04%; and single-view CNN-ResNet50, 50.00% and 64.52%) compared with multi-view CNN-ResNet50. Regarding F1 score, it was the highest in multi-view CNN-ResNet50 (80.90 (67.29–91.81)%). Our study suggests that multi-view CNN-ResNet50 may be feasible to assess the rupture risk in small-sized UIAs.

Detection of clustered anomalies in single-voxel morphometry as a rapid automated method for identifying intracranial aneurysms

Unruptured intracranial aneurysms (UIAs) are prevalent neurovascular anomalies which, in rare circumstances, rupture to cause a catastrophic subarachnoid haemorrhage. Although surgical management can reduce rupture risk, the majority of UIAs exist undiscovered until rupture. Current clinical practice in the detection of UIAs relies heavily on manual radiological review of standard imaging modalities. Recent computer-aided UIA diagnoses can sensitively detect and measure UIAs within cranial angiograms but remain limited to low specificities whose output also requires considerable radiologist interpretation not amenable to broad screening efforts. To address these limitations, we have developed a novel automatic pipeline algorithm which inputs medical images and outputs detected UIAs by characterising single-voxel morphometry of segmented neurovasculature. Once neurovascular anatomy of a specified resolution is segmented, correlations between voxel-specific morphometries are estimated and spatially-clustered outliers are identified as UIA candidates. Our automated solution detects UIAs within magnetic resonance angiograms (MRA) at unmatched 86% specificity and 81% sensitivity using 3 min on a conventional laptop. Our approach does not rely on interpatient comparisons or training datasets which could be difficult to amass and process for rare incidentally discovered UIAs within large MRA files, and in doing so, is versatile to user-defined segmentation quality, to detection sensitivity, and across a range of imaging resolutions and modalities. We propose this method as a unique tool to aid UIA screening, characterisation of abnormal vasculature in at-risk patients, morphometry-based rupture risk prediction, and identification of other vascular abnormalities.

MitoSegNet: Easy-to-use Deep Learning Segmentation for Analyzing Mitochondrial Morphology

While the analysis of mitochondrial morphology has emerged as a key tool in the study of mitochondrial function, efficient quantification of mitochondrial microscopy images presents a challenging task and bottleneck for statistically robust conclusions. Here, we present Mitochondrial Segmentation Network (MitoSegNet), a pretrained deep learning segmentation model that enables researchers to easily exploit the power of deep learning for the quantification of mitochondrial morphology. We tested the performance of MitoSegNet against three feature-based segmentation algorithms and the machine-learning segmentation tool Ilastik. MitoSegNet outperformed all other methods in both pixelwise and morphological segmentation accuracy. We successfully applied MitoSegNet to unseen fluorescence microscopy images of mitoGFP expressing mitochondria in wild-type and catp-6 ATP13A2 mutant C. elegans adults. Additionally, MitoSegNet was capable of accurately segmenting mitochondria in HeLa cells treated with fragmentation inducing reagents. We provide MitoSegNet in a toolbox for Windows and Linux operating systems that combines segmentation with morphological analysis.

Eye Tracking for Deep Learning Segmentation Using Convolutional Neural Networks

Deep learning with convolutional neural networks (CNNs) has experienced tremendous growth in multiple healthcare applications and has been shown to have high accuracy in semantic segmentation of medical (e.g., radiology and pathology) images. However, a key barrier in the required training of CNNs is obtaining large-scale and precisely annotated imaging data. We sought to address the lack of annotated data with eye tracking technology. As a proof of principle, our hypothesis was that segmentation masks generated with the help of eye tracking (ET) would be very similar to those rendered by hand annotation (HA). Additionally, our goal was to show that a CNN trained on ET masks would be equivalent to one trained on HA masks, the latter being the current standard approach. Step 1: Screen captures of 19 publicly available radiologic images of assorted structures within various modalities were analyzed. ET and HA masks for all regions of interest (ROIs) were generated from these image datasets. Step 2: Utilizing a similar approach, ET and HA masks for 356 publicly available T1-weighted postcontrast meningioma images were generated. Three hundred six of these image + mask pairs were used to train a CNN with U-net-based architecture. The remaining 50 images were used as the independent test set. Step 1: ET and HA masks for the nonneurological images had an average Dice similarity coefficient (DSC) of 0.86 between each other. Step 2: Meningioma ET and HA masks had an average DSC of 0.85 between each other. After separate training using both approaches, the ET approach performed virtually identically to HA on the test set of 50 images. The former had an area under the curve (AUC) of 0.88, while the latter had AUC of 0.87. ET and HA predictions had trimmed mean DSCs compared to the original HA maps of 0.73 and 0.74, respectively. These trimmed DSCs between ET and HA were found to be statistically equivalent with a p value of 0.015. We have demonstrated that ET can create segmentation masks suitable for deep learning semantic segmentation. Future work will integrate ET to produce masks in a faster, more natural manner that distracts less from typical radiology clinical workflow.

Artificial Intelligence in Neuroradiology: Current Status and Future Directions

Fueled by new techniques, computational tools, and broader availability of imaging data, artificial intelligence has the potential to transform the practice of neuroradiology. The recent exponential increase in publications related to artificial intelligence and the central focus on artificial intelligence at recent professional and scientific radiology meetings underscores the importance. There is growing momentum behind leveraging artificial intelligence techniques to improve workflow and diagnosis and treatment and to enhance the value of quantitative imaging techniques. This article explores the reasons why neuroradiologists should care about the investments in new artificial intelligence applications, highlights current activities and the roles neuroradiologists are playing, and renders a few predictions regarding the near future of artificial intelligence in neuroradiology.

Artificial Intelligence in the Management of Intracranial Aneurysms: Current Status and Future Perspectives

Intracranial aneurysms with subarachnoid hemorrhage lead to high morbidity and mortality. It is of critical importance to detect aneurysms, identify risk factors of rupture, and predict treatment response of aneurysms to guide clinical interventions. Artificial intelligence has received worldwide attention for its impressive performance in image-based tasks. Artificial intelligence serves as an adjunct to physicians in a series of clinical settings, which substantially improves diagnostic accuracy while reducing physicians' workload. Computer-assisted diagnosis systems of aneurysms based on MRA and CTA using deep learning have been evaluated, and excellent performances have been reported. Artificial intelligence has also been used in automated morphologic calculation, rupture risk stratification, and outcomes prediction with the implementation of machine learning methods, which have exhibited incremental value. This review summarizes current advances of artificial intelligence in the management of aneurysms, including detection and prediction. The challenges and future directions of clinical implementations of artificial intelligence are briefly discussed.

Deep learning for automated cerebral aneurysm detection on computed tomography images

PURPOSE

Cerebrovascular aneurysms are being observed with rapidly increasing incidence. Therefore, tools are needed for accurate and efficient detection of aneurysms. We used deep learning techniques with CT angiography acquired from multiple medical centers and different machines to develop and evaluate an automatic detection model.

METHODS

In this study, we have introduced a deep learning model, the faster RCNN model, in order to develop a tool for automatic detection of aneurysms from medical images. The inputs of the model were 2D nearby projection (NP) images from 3D CTA, which were made by the NP method proposed in this study. This method made aneurysms clearly visible on images and improved the model's performance. The study included 311 patients with 352 aneurysms, selected from three hospitals, and 208 and 103 of these patients, respectively, were randomly selected to train and test the models.

RESULTS

The sensitivity of the trained model was 91.8%. For aneurysm sizes larger than 3 mm, the sensitivity of successful aneurysm detection was 96.7%. We achieved state-of-the-art sensitivity for > 3 mm aneurysms. The sensitivities also indicated that there was no significant difference among aneurysms at different locations in the body. Computing time for the detection process was less than 25 s per case.

CONCLUSIONS

We successfully developed a deep learning model that can automatically detect aneurysms. The model performed well for aneurysms of different sizes or in different locations. This finding indicates that the deep learning model has the potential to vastly improve clinician performance by providing automated aneurysm detection.

Automatic detection on intracranial aneurysm from digital subtraction angiography with cascade convolutional neural networks

Background

An intracranial aneurysm is a cerebrovascular disorder that can result in various diseases. Clinically, diagnosis of an intracranial aneurysm utilizes digital subtraction angiography (DSA) modality as gold standard. The existing automatic computer-aided diagnosis (CAD) research studies with DSA modality were based on classical digital image processing (DIP) methods. However, the classical feature extraction methods were badly hampered by complex vascular distribution, and the sliding window methods were time-consuming during searching and feature extraction. Therefore, developing an accurate and efficient CAD method to detect intracranial aneurysms on DSA images is a meaningful task.

Methods

In this study, we proposed a two-stage convolutional neural network (CNN) architecture to automatically detect intracranial aneurysms on 2D-DSA images. In region localization stage (RLS), our detection system can locate a specific region to reduce the interference of the other regions. Then, in aneurysm detection stage (ADS), the detector could combine the information of frontal and lateral angiographic view to identify intracranial aneurysms, with a false-positive suppression algorithm.

Results

Our study was experimented on posterior communicating artery (PCoA) region of internal carotid artery (ICA). The data set contained 241 subjects for model training, and 40 prospectively collected subjects for testing. Compared with the classical DIP method which had an accuracy of 62.5% and an area under curve (AUC) of 0.69, the proposed architecture could achieve accuracy of 93.5% and the AUC of 0.942. In addition, the detection time cost of our method was about 0.569 s, which was one hundred times faster than the classical DIP method of 62.546 s.

Conclusion

The results illustrated that our proposed two-stage CNN-based architecture was more accurate and faster compared with the existing research studies of classical DIP methods. Overall, our study is a demonstration that it is feasible to assist physicians to detect intracranial aneurysm on DSA images using CNN.

Machine Learning Application for Rupture Risk Assessment in Small-Sized Intracranial Aneurysm

The assessment of rupture probability is crucial to identifying at risk intracranial aneurysms (IA) in patients harboring multiple aneurysms. We aimed to develop a computer-assisted detection system for small-sized aneurysm ruptures using a convolutional neural network (CNN) based on images of three-dimensional digital subtraction angiography. A retrospective data set, including 368 patients, was used as a training cohort for the CNN using the TensorFlow platform. Aneurysm images in six directions were obtained from each patient and the region-of-interest in each image was extracted. The resulting CNN was prospectively tested in 272 patients and the sensitivity, specificity, overall accuracy, and receiver operating characteristics (ROC) were compared to a human evaluator. Our system showed a sensitivity of 78.76% (95% CI: 72.30%-84.30%), a specificity of 72.15% (95% CI: 60.93%-81.65%), and an overall diagnostic accuracy of 76.84% (95% CI: 71.36%-81.72%) in aneurysm rupture predictions. The area under the ROC (AUROC) in the CNN was 0.755 (95% CI: 0.699%-0.805%), better than that obtained from a human evaluator (AUROC: 0.537; p < 0.001). The CNN-based prediction system was feasible to assess rupture risk in small-sized aneurysms with diagnostic accuracy superior to human evaluators. Additional studies based on a large data set are necessary to enhance diagnostic accuracy and to facilitate clinical application.