1
|
Tan D, Liu J, Chen S, Yao R, Li Y, Zhu S, Li L. Automatic Evaluating of Multi-Phase Cranial CTA Collateral Circulation Based on Feature Fusion Attention Network Model. IEEE Trans Nanobioscience 2023; 22:789-799. [PMID: 37276106 DOI: 10.1109/tnb.2023.3283049] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Stroke is one of the main causes of disability and death, and it can be divided into hemorrhagic stroke and ischemic stroke. Ischemic stroke is more common, and about 8 out of 10 stroke patients suffer from ischemic stroke. In clinical practice, doctors diagnose stroke by using computed tomography angiography (CTA) image to accurately evaluate the collateral circulation in stroke patients. This imaging information is of great significance in assisting doctors to determine the patient's treatment plan and prognosis. Currently, great progress has been made in the field of computer-aided diagnosis technology in medicine by using artificial intelligence. However, in related research based on deep learning algorithms, researchers usually only use single-phase data for training, lacking the temporal dimension information of multi-phase image data. This makes it difficult for the model to learn more comprehensive and effective collateral circulation feature representation, thereby limiting its performance. Therefore, combining data for training is expected to improve the accuracy and reliability of collateral circulation evaluation. In this study, we propose an effective hybrid mechanism to assist the feature encoding network in evaluating the degree of collateral circulation in the brain. By using a hybrid attention mechanism, additional guidance and regularization are provided to enhance the collateral circulation feature representation across multiple stages. Time dimension information is added to the input, and multiple feature-level fusion modules are designed in the multi-branch network. The first fusion module in the single-stage feature extraction network completes the fusion of deep and shallow vessel features in the single-branch network, followed by the multi-stage network feature fusion module, which achieves feature fusion for four stages. Tested on a dataset of multi-phase cranial CTA images, the accuracy rate exceeding 90.43%. The experimental results demonstrate that the addition of these modules can fully explore collateral vessel features, improve feature expression capabilities, and optimize the performance of deep learning network model.
Collapse
|
2
|
Bagcilar O, Alis D, Alis C, Seker ME, Yergin M, Ustundag A, Hikmet E, Tezcan A, Polat G, Akkus AT, Alper F, Velioglu M, Yildiz O, Selcuk HH, Oksuz I, Kizilkilic O, Karaarslan E. Automated LVO detection and collateral scoring on CTA using a 3D self-configuring object detection network: a multi-center study. Sci Rep 2023; 13:8834. [PMID: 37258516 DOI: 10.1038/s41598-023-33723-w] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/30/2022] [Accepted: 04/18/2023] [Indexed: 06/02/2023] Open
Abstract
The use of deep learning (DL) techniques for automated diagnosis of large vessel occlusion (LVO) and collateral scoring on computed tomography angiography (CTA) is gaining attention. In this study, a state-of-the-art self-configuring object detection network called nnDetection was used to detect LVO and assess collateralization on CTA scans using a multi-task 3D object detection approach. The model was trained on single-phase CTA scans of 2425 patients at five centers, and its performance was evaluated on an external test set of 345 patients from another center. Ground-truth labels for the presence of LVO and collateral scores were provided by three radiologists. The nnDetection model achieved a diagnostic accuracy of 98.26% (95% CI 96.25-99.36%) in identifying LVO, correctly classifying 339 out of 345 CTA scans in the external test set. The DL-based collateral scores had a kappa of 0.80, indicating good agreement with the consensus of the radiologists. These results demonstrate that the self-configuring 3D nnDetection model can accurately detect LVO on single-phase CTA scans and provide semi-quantitative collateral scores, offering a comprehensive approach for automated stroke diagnostics in patients with LVO.
Collapse
Affiliation(s)
- Omer Bagcilar
- Radiology Department, Sisli Hamidiye Etfal Research and Training Hospital, Istanbul, Turkey
| | - Deniz Alis
- Radiology Department, School of Medicine, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey.
- Artificial Intelligence, and Information Technologies, Hevi AI Health, Istanbul, Turkey.
| | - Ceren Alis
- Neurology Department, Istanbul Istinye State Hospital, Istanbul, Turkey
| | - Mustafa Ege Seker
- School of Medicine, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey
| | - Mert Yergin
- Artificial Intelligence, and Information Technologies, Hevi AI Health, Istanbul, Turkey
| | - Ahmet Ustundag
- Radiology Department, Cerrahpaşa Medical Faculty, Istanbul University-Cerrahpasa, Istanbul, Turkey
| | - Emil Hikmet
- Radiology Department, Cerrahpaşa Medical Faculty, Istanbul University-Cerrahpasa, Istanbul, Turkey
| | - Alperen Tezcan
- Radiology Department, School of Medicine, Erzurum Ataturk University, Istanbul, Turkey
| | - Gokhan Polat
- Radiology Department, School of Medicine, Erzurum Ataturk University, Istanbul, Turkey
| | - Ahmet Tugrul Akkus
- Radiology Department, School of Medicine, Erzurum Ataturk University, Istanbul, Turkey
| | - Fatih Alper
- Radiology Department, School of Medicine, Erzurum Ataturk University, Istanbul, Turkey
| | - Murat Velioglu
- Radiology Department, Istanbul Fatih Sultan Mehmet Training and Research Hospital, Istanbul, Turkey
| | - Omer Yildiz
- Radiology Department, Istanbul Fatih Sultan Mehmet Training and Research Hospital, Istanbul, Turkey
| | - Hakan Hatem Selcuk
- Radiology Department, Istanbul Bakırköy Sadi Konuk Training and Research Hospital, Istanbul, Turkey
| | - Ilkay Oksuz
- Computer Engineering Department, Istanbul Technical University, Istanbul, Turkey
| | - Osman Kizilkilic
- Radiology Department, Cerrahpaşa Medical Faculty, Istanbul University-Cerrahpasa, Istanbul, Turkey
| | - Ercan Karaarslan
- Radiology Department, School of Medicine, Acibadem Mehmet Ali Aydinlar University, Istanbul, Turkey
| |
Collapse
|
3
|
Aktar M, Reyes J, Tampieri D, Rivaz H, Xiao Y, Kersten-Oertel M. Deep learning for collateral evaluation in ischemic stroke with imbalanced data. Int J Comput Assist Radiol Surg 2023; 18:733-740. [PMID: 36635594 DOI: 10.1007/s11548-022-02826-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/26/2022] [Accepted: 12/22/2022] [Indexed: 01/14/2023]
Abstract
PURPOSE Collateral evaluation is typically done using visual inspection of cerebral images and thus suffers from intra- and inter-rater variability. Large open databases of ischemic stroke patients are rare, limiting the use of deep learning methods in treatment decision-making. METHODS We adapted a pre-trained EfficientNet B0 network through transfer learning to improve collateral evaluation using slice-based and subject-level classification. Our method uses stacking and overlapping of 2D slices from a patient's 4D computed tomography angiography (CTA) and a majority voting scheme to determine a patient's final collateral grade based on all classified 2D MIPs. Class imbalance is handled in the evaluation process by using the focal loss with class weight to penalize the majority class. RESULTS We evaluated our method using a nine-fold cross-validation performed with 83 subjects. Mean sensitivity of 0.71, specificity of 0.84, and a weighted F1 score of 0.71 in multi-class (good, intermediate, and poor) classification were obtained. Considering treatment effect, a dichotomized decision is also made for collateral scoring of a subject based on two classes (good/intermediate and poor) which achieves a sensitivity of 0.89 and specificity of 0.96 with a weighted F1 score of 0.95. CONCLUSION An automatic and robust collateral assessment method that mitigates the issues with the small imbalanced dataset was developed. Computer-aided evaluation of collaterals can help decision-making of ischemic stroke treatment strategy in clinical settings.
Collapse
Affiliation(s)
- Mumu Aktar
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada.
| | - Jonatan Reyes
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| | - Donatella Tampieri
- Department of Diagnostic Radiology, Kingston Health Sciences Centre, Kingston General Hospital, Kingston, ON, K7L 2V7, Canada
| | - Hassan Rivaz
- Electrical and Computer Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| | - Yiming Xiao
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| | - Marta Kersten-Oertel
- Computer Science and Software Engineering, Concordia University, 1455 boul. De Maisonneuve O., Montreal, QC, H3G 1M8, Canada
| |
Collapse
|
4
|
Automatic collateral circulation scoring in ischemic stroke using 4D CT angiography with low-rank and sparse matrix decomposition. Int J Comput Assist Radiol Surg 2020; 15:1501-1511. [PMID: 32662055 DOI: 10.1007/s11548-020-02216-w] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/23/2019] [Accepted: 06/11/2020] [Indexed: 10/23/2022]
Abstract
PURPOSE Sufficient collateral blood supply is crucial for favorable outcomes with endovascular treatment. The current practice of collateral scoring relies on visual inspection and thus can suffer from inter and intra-rater inconsistency. We present a robust and automatic method to score cerebral collateral blood supply to aid ischemic stroke treatment decision making. The developed method is based on 4D dynamic CT angiography (CTA) and the ASPECTS scoring protocol. METHODS The proposed method, ACCESS (Automatic Collateral Circulation Evaluation in iSchemic Stroke), estimates a target patient's unfilled cerebrovasculature in contrast-enhanced CTA using the lack of contrast agent due to clotting. To do so, the fast robust matrix completion algorithm with in-face extended Frank-Wolfe optimization is applied on a cohort of healthy subjects and a target patient, to model the patient's unfilled vessels and the estimated full vasculature as sparse and low-rank components, respectively. The collateral score is computed as the ratio of the unfilled vessels to the full vasculature, mimicking existing clinical protocols. RESULTS ACCESS was tested with 46 stroke patients and obtained an overall accuracy of 84.78%. The optimal threshold selection was evaluated using a receiver operating characteristics curve with the leave-one-out approach, and a mean area under the curve of 85.39% was obtained. CONCLUSION ACCESS automates collateral scoring to mitigate the shortcomings of the standard clinical practice. It is a robust approach, which resembles how radiologists score clinical scans, and can be used to help radiologists in clinical decisions of stroke treatment.
Collapse
|
5
|
Deep regression neural networks for collateral imaging from dynamic susceptibility contrast-enhanced magnetic resonance perfusion in acute ischemic stroke. Int J Comput Assist Radiol Surg 2019; 15:151-162. [PMID: 31482272 DOI: 10.1007/s11548-019-02060-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/10/2019] [Accepted: 08/27/2019] [Indexed: 12/19/2022]
Abstract
PURPOSE Acute ischemic stroke is one of the primary causes of death worldwide. Recent studies have shown that the assessment of collateral status could aid in improving the treatment for patients with acute ischemic stroke. We present a 3D deep regression neural network to automatically generate the collateral images from dynamic susceptibility contrast-enhanced magnetic resonance perfusion (DSC-MRP) in acute ischemic stroke. METHODS This retrospective study includes 144 subjects with acute ischemic stroke (stroke cases) and 201 subjects without acute ischemic stroke (controls). DSC-MRP images of these subjects were manually inspected for collateral assessment in arterial, capillary, early and late venous, and delay phases. The proposed network was trained on 205 subjects, and the optimal model was chosen using the validation set of 64 subjects. The predictive power of the network was assessed on the test set of 76 subjects using the squared correlation coefficient (R-squared), mean absolute error (MAE), Tanimoto measure (TM), and structural similarity index (SSIM). RESULTS The proposed network was able to predict the five phase maps with high accuracy. On average, 0.897 R-squared, 0.581 × 10-1 MAE, 0.946 TM, and 0.846 SSIM were achieved for the five phase maps. No statistically significant difference was, in general, found between controls and stroke cases. The performance of the proposed network was lower in the arterial and venous phases than the other three phases. CONCLUSION The results suggested that the proposed network performs equally well for both control and acute ischemic stroke groups. The proposed network could help automate the assessment of collateral status in an efficient and effective manner and improve the quality and yield of diagnosis of acute ischemic stroke. The follow-up study will entail the clinical evaluation of the collateral images that are generated by the proposed network.
Collapse
|