1
|
Zhang Y, Luo G, Wang W, Cao S, Dong S, Yu D, Wang X, Wang K. A continuous-action deep reinforcement learning-based agent for coronary artery centerline extraction in coronary CT angiography images. Med Biol Eng Comput 2025:10.1007/s11517-025-03284-3. [PMID: 39888471 DOI: 10.1007/s11517-025-03284-3] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/09/2024] [Accepted: 12/31/2024] [Indexed: 02/01/2025]
Abstract
The lumen centerline of the coronary artery allows vessel reconstruction used to detect stenoses and plaques. Discrete-action-based centerline extraction methods suffer from artifacts and plaques. This study aimed to develop a continuous-action-based method which performs more effectively in cases involving artifacts or plaques. A continuous-action deep reinforcement learning-based model was trained to predict the artery's direction and radius value. The model is based on an Actor-Critic architecture. The Actor learns a deterministic policy to output the actions made by an agent. These actions indicate the centerline's direction and radius value consecutively. The Critic learns a value function to evaluate the quality of the agent's actions. A novel DDR reward was introduced to measure the agent's action (both centerline extraction and radius estimate) at each step. The method achieved an average OV of 95.7%, OF of 93.6%, OT of 97.3%, and AI of 0.22 mm in 80 test data. In 53 cases with artifacts or plaques, it achieved an average OV of 95.0%, OF of 91.5%, OT of 96.7%, and AI of 0.23 mm. The 95% limits of agreement between the reference and estimated radius values were - 0.46 mm and 0.43 mm in the 80 test data. Experiments demonstrate that the Actor-Critic architecture can achieve efficient centerline extraction and radius estimate. Compared with discrete-action-based methods, our method performs more effectively in cases involving artifacts or plaques. The extracted centerlines and radius values allow accurate coronary artery reconstruction that facilitates the detection of stenoses and plaques.
Collapse
Affiliation(s)
- Yuyang Zhang
- Faculty of Computing, Harbin Institute of Technology, Harbin, 150001, China.
| | - Gongning Luo
- Faculty of Computing, Harbin Institute of Technology, Harbin, 150001, China
| | - Wei Wang
- School of Computer Science and Technology, Harbin Institute of Technology, Shenzhen, 518055, China
| | - Shaodong Cao
- Department of Radiology, Fourth Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Suyu Dong
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, 150040, China
| | - Daren Yu
- Department of Cardiology, Fourth Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Xiaoyun Wang
- Department of Cardiology, Fourth Affiliated Hospital of Harbin Medical University, Harbin, 150001, China
| | - Kuanquan Wang
- Faculty of Computing, Harbin Institute of Technology, Harbin, 150001, China.
| |
Collapse
|
2
|
Panuccio G, Abdelwahed YS, Carabetta N, Landmesser U, De Rosa S, Torella D. The Role of Coronary Imaging in Chronic Total Occlusions: Applications and Future Possibilities. J Cardiovasc Dev Dis 2024; 11:295. [PMID: 39330353 PMCID: PMC11432693 DOI: 10.3390/jcdd11090295] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/09/2024] [Revised: 09/17/2024] [Accepted: 09/18/2024] [Indexed: 09/28/2024] Open
Abstract
Chronic total occlusions (CTOs) represent a challenging scenario in coronary artery disease (CAD). The prevalence of CTOS in patients undergoing coronary angiography underscores the need for effective diagnostic and therapeutic strategies. Coronary angiography, while essential, offers limited insights into lesion morphology, vessel course, and myocardial viability. In contrast, coronary imaging techniques-including optical coherence tomography (OCT), intravascular ultrasound (IVUS), and coronary computed tomography angiography (CCTA)-provide comprehensive insights for each stage of CTO percutaneous coronary intervention (PCI). OCT facilitates the assessment of plaque morphology and stent optimization, despite low evidence and several limitations in CTO-PCI. IVUS offers deeper penetration, allowing managing proximal cap scenarios and guiding subintimal navigation. CCTA provides a non-invasive, three-dimensional view of coronary anatomy, enabling the precise evaluation of myocardial mass at risk and detailed procedural planning. Despite their individual limitations, these imaging modalities have enhanced the success rates of CTO-PCI, thus reducing procedural and long-term complications and improving patient outcomes. The future of CTO management lies in further technological advancements, including hybrid imaging, artificial intelligence (AI) integration, and improved fusion imaging. These innovations promise to refine procedural precision and personalize interventions, ultimately improving the care of patients with complex coronary artery disease.
Collapse
Affiliation(s)
- Giuseppe Panuccio
- Department of Experimental and Clinical Medicine, Magna Graecia University, 88100 Catanzaro, Italy;
- Department of Cardiology, Angiology and Intensive Care Medicine, Deutsches Herzzentrum der Charité, 12200 Berlin, Germany; (Y.S.A.); (U.L.)
| | - Youssef S. Abdelwahed
- Department of Cardiology, Angiology and Intensive Care Medicine, Deutsches Herzzentrum der Charité, 12200 Berlin, Germany; (Y.S.A.); (U.L.)
| | - Nicole Carabetta
- Department of Medical and Surgical Sciences, Magna Graecia University, 88100 Catanzaro, Italy; (N.C.); (S.D.R.)
| | - Ulf Landmesser
- Department of Cardiology, Angiology and Intensive Care Medicine, Deutsches Herzzentrum der Charité, 12200 Berlin, Germany; (Y.S.A.); (U.L.)
| | - Salvatore De Rosa
- Department of Medical and Surgical Sciences, Magna Graecia University, 88100 Catanzaro, Italy; (N.C.); (S.D.R.)
| | - Daniele Torella
- Department of Experimental and Clinical Medicine, Magna Graecia University, 88100 Catanzaro, Italy;
| |
Collapse
|
3
|
Sun Q, Yang J, Ma S, Huang Y, Yuan Y, Hou Y. 3D vessel extraction using a scale-adaptive hybrid parametric tracker. Med Biol Eng Comput 2023; 61:2467-2480. [PMID: 37184591 DOI: 10.1007/s11517-023-02815-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/11/2022] [Accepted: 02/28/2023] [Indexed: 05/16/2023]
Abstract
3D vessel extraction has great significance in the diagnosis of vascular diseases. However, accurate extraction of vessels from computed tomography angiography (CTA) data is challenging. For one thing, vessels in different body parts have a wide range of scales and large curvatures; for another, the intensity distributions of vessels in different CTA data vary considerably. Besides, surrounding interfering tissue, like bones or veins with similar intensity, also seriously affects vessel extraction. Considering all the above imaging and structural features of vessels, we propose a new scale-adaptive hybrid parametric tracker (SAHPT) to extract arbitrary vessels of different body parts. First, a geometry-intensity parametric model is constructed to calculate the geometry-intensity response. While geometry parameters are calculated to adapt to the variation in scale, intensity parameters can also be estimated to meet non-uniform intensity distributions. Then, a gradient parametric model is proposed to calculate the gradient response based on a multiscale symmetric normalized gradient filter which can effectively separate the target vessel from surrounding interfering tissue. Last, a hybrid parametric model that combines the geometry-intensity and gradient parametric models is constructed to evaluate how well it fits a local image patch. In the extraction process, a multipath spherical sampling strategy is used to solve the problem of anatomical complexity. We have conducted many quantitative experiments using the synthetic and clinical CTA data, asserting its superior performance compared to traditional or deep learning-based baselines.
Collapse
Affiliation(s)
- Qi Sun
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China
| | - Jinzhu Yang
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China.
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China.
| | - Shuang Ma
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China
| | - Yan Huang
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China
| | - Yuliang Yuan
- Key Laboratory of Intelligent Computing in Medical Image, Ministry of Education, Northeastern University, Shenyang, Liaoning, China
- School of Computer Science and Engineering, Northeastern University, Shenyang, Liaoning, China
| | - Yang Hou
- Department of Radiology, ShengJing Hospital of China Medical University, Shenyang, Liaoning, China
| |
Collapse
|
4
|
Zhang W, Li P, Chen X, He L, Zhang Q, Yu J. The Association of Coronary Fat Attenuation Index Quantified by Automated Software on Coronary Computed Tomography Angiography with Adverse Events in Patients with Less than Moderate Coronary Artery Stenosis. Diagnostics (Basel) 2023; 13:2136. [PMID: 37443530 DOI: 10.3390/diagnostics13132136] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/06/2023] [Revised: 05/28/2023] [Accepted: 06/19/2023] [Indexed: 07/15/2023] Open
Abstract
OBJECTIVE This study analyzed the relationship between the coronary FAI on CCTA and coronary adverse events in patients with moderate coronary artery disease based on machine learning. METHODS A total of 172 patients with coronary artery disease with moderate or lower coronary artery stenosis were included. According to whether the patients had coronary adverse events, the patients were divided into an adverse group and a non-adverse group. The coronary FAI of patients was quantified via machine learning, and significant differences between the two groups were analyzed via t-test. RESULTS The age difference between the two groups was statistically significant (p < 0.001). The group that had adverse reactions was older, and there was no statistically significant difference between the two groups in terms of sex and smoking status. There was no statistical significance in the blood biochemical indexes between the two groups (p > 0.05). There was a significant difference in the FAIs between the two groups (p < 0.05), with the FAI of the defective group being greater than that of the nonperforming group. Taking the age of patients as a covariate, an analysis of covariance showed that after excluding the influence of age, the FAIs between the two groups were still significantly different (p < 0.001).
Collapse
Affiliation(s)
- Wenzhao Zhang
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Peiling Li
- Department of Critical Care Medicine, Chengdu Shangjinnanfu Hospital, Chengdu 611730, China
| | - Xinyue Chen
- CT Collaboration, Siemens Healthineers, Chengdu 610041, China
| | - Liyi He
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, China
| | - Qiang Zhang
- Department of Epidemiology and Biostatistics, West China School of Public Health and West China Fourth Hospital, Sichuan University, Chengdu 610041, China
| | - Jianqun Yu
- Department of Radiology, West China Hospital, Sichuan University, Chengdu 610041, China
| |
Collapse
|
5
|
Denzinger F, Wels M, Breininger K, Taubmann O, Mühlberg A, Allmendinger T, Gülsün MA, Schöbinger M, André F, Buss SJ, Görich J, Sühling M, Maier A. How scan parameter choice affects deep learning-based coronary artery disease assessment from computed tomography. Sci Rep 2023; 13:2563. [PMID: 36781953 PMCID: PMC9925789 DOI: 10.1038/s41598-023-29347-9] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/16/2022] [Accepted: 02/02/2023] [Indexed: 02/15/2023] Open
Abstract
Recently, algorithms capable of assessing the severity of Coronary Artery Disease (CAD) in form of the Coronary Artery Disease-Reporting and Data System (CAD-RADS) grade from Coronary Computed Tomography Angiography (CCTA) scans using Deep Learning (DL) were proposed. Before considering to apply these algorithms in clinical practice, their robustness regarding different commonly used Computed Tomography (CT)-specific image formation parameters-including denoising strength, slab combination, and reconstruction kernel-needs to be evaluated. For this study, we reconstructed a data set of 500 patient CCTA scans under seven image formation parameter configurations. We select one default configuration and evaluate how varying individual parameters impacts the performance and stability of a typical algorithm for automated CAD assessment from CCTA. This algorithm consists of multiple preprocessing and a DL prediction step. We evaluate the influence of the parameter changes on the entire pipeline and additionally on only the DL step by propagating the centerline extraction results of the default configuration to all others. We consider the standard deviation of the CAD severity prediction grade difference between the default and variation configurations to assess the stability w.r.t. parameter changes. For the full pipeline we observe slight instability (± 0.226 CAD-RADS) for all variations. Predictions are more stable with centerlines propagated from the default to the variation configurations (± 0.122 CAD-RADS), especially for differing denoising strengths (± 0.046 CAD-RADS). However, stacking slabs with sharp boundaries instead of mixing slabs in overlapping regions (called true stack ± 0.313 CAD-RADS) and increasing the sharpness of the reconstruction kernel (± 0.150 CAD-RADS) leads to unstable predictions. Regarding the clinically relevant tasks of excluding CAD (called rule-out; AUC default 0.957, min 0.937) and excluding obstructive CAD (called hold-out; AUC default 0.971, min 0.964) the performance remains on a high level for all variations. Concluding, an influence of reconstruction parameters on the predictions is observed. Especially, scans reconstructed with the true stack parameter need to be treated with caution when using a DL-based method. Also, reconstruction kernels which are underrepresented in the training data increase the prediction uncertainty.
Collapse
Affiliation(s)
- Felix Denzinger
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany.
- Computed Tomography, Siemens Healthcare GmbH, Forchheim, Germany.
| | - Michael Wels
- Computed Tomography, Siemens Healthcare GmbH, Forchheim, Germany
| | - Katharina Breininger
- Department Artificial Intelligence in Biomedical Engineering, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| | - Oliver Taubmann
- Computed Tomography, Siemens Healthcare GmbH, Forchheim, Germany
| | | | | | - Mehmet A Gülsün
- Computed Tomography, Siemens Healthcare GmbH, Forchheim, Germany
| | - Max Schöbinger
- Computed Tomography, Siemens Healthcare GmbH, Forchheim, Germany
| | - Florian André
- Das Radiologische Zentrum-Radiology Center, Sinsheim-Eberbach-Erbach-Walldorf-Heidelberg, Germany
| | - Sebastian J Buss
- Das Radiologische Zentrum-Radiology Center, Sinsheim-Eberbach-Erbach-Walldorf-Heidelberg, Germany
| | - Johannes Görich
- Das Radiologische Zentrum-Radiology Center, Sinsheim-Eberbach-Erbach-Walldorf-Heidelberg, Germany
| | - Michael Sühling
- Computed Tomography, Siemens Healthcare GmbH, Forchheim, Germany
| | - Andreas Maier
- Pattern Recognition Lab, Friedrich-Alexander-Universität Erlangen-Nürnberg, Erlangen, Germany
| |
Collapse
|
6
|
Guo B, Zhou F, Liu B, Bai X. Voxel-Wise Adversarial FiboNet for 3D Cerebrovascular Segmentation on Magnetic Resonance Angiography Images. Front Neurosci 2021; 15:756536. [PMID: 34899162 PMCID: PMC8660083 DOI: 10.3389/fnins.2021.756536] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/10/2021] [Accepted: 10/13/2021] [Indexed: 11/13/2022] Open
Abstract
Cerebrovascular segmentation is important in various clinical applications, such as surgical planning and computer-aided diagnosis. In order to achieve high segmentation performance, three challenging problems should be taken into consideration: (1) large variations in vascular anatomies and voxel intensities; (2) severe class imbalance between foreground and background voxels; (3) image noise with different magnitudes. Limited accuracy was achieved without considering these challenges in deep learning-based methods for cerebrovascular segmentation. To overcome the limitations, we propose an end-to-end adversarial model called FiboNet-VANGAN. Specifically, our contributions can be summarized as follows: (1) to relieve the first problem mentioned above, a discriminator is proposed to regularize for voxel-wise distribution consistency between the segmentation results and the ground truth; (2) to mitigate the problem of class imbalance, we propose to use the addition of cross-entropy and Dice coefficient as the loss function of the generator. Focal loss is utilized as the loss function of the discriminator; (3) a new feature connection is proposed, based on which a generator called FiboNet is built. By incorporating Dice coefficient in the training of FiboNet, noise robustness can be improved by a large margin. We evaluate our method on a healthy magnetic resonance angiography (MRA) dataset to validate its effectiveness. A brain atrophy MRA dataset is also collected to test the performance of each method on abnormal cases. Results show that the three problems in cerebrovascular segmentation mentioned above can be alleviated and high segmentation accuracy can be achieved on both datasets using our method.
Collapse
Affiliation(s)
- Bin Guo
- Image Processing Center, School of Astronautics, Beihang University, Beijing, China
| | - Fugen Zhou
- Image Processing Center, School of Astronautics, Beihang University, Beijing, China
| | - Bo Liu
- Image Processing Center, School of Astronautics, Beihang University, Beijing, China
| | - Xiangzhi Bai
- Image Processing Center, School of Astronautics, Beihang University, Beijing, China
| |
Collapse
|
7
|
Mostafa A, Ghanem AM, El-Shatoury M, Basha T. Improved Centerline Extraction in Fully Automated Coronary Ostium Localization and Centerline Extraction Framework using Deep Learning. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2021; 2021:3846-3849. [PMID: 34892073 DOI: 10.1109/embc46164.2021.9629655] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Coronary artery extraction in cardiac CT angiography (CCTA) image volume is a necessary step for any quantitative assessment of stenoses and atherosclerotic plaque. In this work, we propose a fully automated workflow that depends on convolutional networks to extract the centerlines of the coronary arteries from CCTA image volumes, starting from identifying the ostium points and then tracking the vessel till its end based on its radius and direction. First, a regression U-Net is employed to identify the ostium points in the image volume, then these points are fed to an orientation and radius predictor CNN model to track and extract each artery till its end point. Our results show that an average of 96% of the ostium points were identified and located within less than 5mm from their true location. The coronary arteries centerlines extraction was performed with high accuracy and lower number of training parameters making it suitable for real clinical applications and continuous learning.
Collapse
|
8
|
Artificial Intelligence to Assist in Exclusion of Coronary Atherosclerosis During CCTA Evaluation of Chest Pain in the Emergency Department: Preparing an Application for Real-world Use. J Digit Imaging 2021; 34:554-571. [PMID: 33791909 DOI: 10.1007/s10278-021-00441-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/25/2020] [Revised: 11/09/2020] [Accepted: 03/01/2021] [Indexed: 12/22/2022] Open
Abstract
Coronary computed tomography angiography (CCTA) evaluation of chest pain patients in an emergency department (ED) is considered appropriate. While a "negative" CCTA interpretation supports direct patient discharge from an ED, labor-intensive analyses are required, with accuracy in jeopardy from distractions. We describe the development of an artificial intelligence (AI) algorithm and workflow for assisting qualified interpreting physicians in CCTA screening for total absence of coronary atherosclerosis. The two-phase approach consisted of (1) phase 1-development and preliminary testing of an algorithm for vessel-centerline extraction classification in a balanced study population (n = 500 with 50% disease prevalence) derived by retrospective random case selection, and (2) phase 2-simulated clinical Trialing of developed algorithm on a per-case (entire coronary artery tree) basis in a more "real-world" study population (n = 100 with 28% disease prevalence) from an ED chest pain series. This allowed pre-deployment evaluation of the AI-based CCTA screening application which provides vessel-by-vessel graphic display of algorithm inference results integrated into a clinically capable viewer. Algorithm performance evaluation used area under the receiver operating characteristic curve (AUC-ROC); confusion matrices reflected ground truth vs AI determinations. The vessel-based algorithm demonstrated strong performance with AUC-ROC = 0.96. In both phase 1 and phase 2, independent of disease prevalence differences, negative predictive values at the case level were very high at 95%. The rate of completion of the algorithm workflow process (96% with inference results in 55-80 s) in phase 2 depended on adequate image quality. There is potential for this AI application to assist in CCTA interpretation to help extricate atherosclerosis from chest pain presentations.
Collapse
|
9
|
Chen L, Sun J, Canton G, Balu N, Hippe DS, Zhao X, Li R, Hatsukami TS, Hwang JN, Yuan C. Automated Artery Localization and Vessel Wall Segmentation using Tracklet Refinement and Polar Conversion. IEEE ACCESS : PRACTICAL INNOVATIONS, OPEN SOLUTIONS 2020; 8:217603-217614. [PMID: 33777593 PMCID: PMC7996631 DOI: 10.1109/access.2020.3040616] [Citation(s) in RCA: 10] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/12/2023]
Abstract
Quantitative analysis of blood vessel wall structures is important to study atherosclerotic diseases and assess cardiovascular event risks. To achieve this, accurate identification of vessel luminal and outer wall contours is needed. Computer-assisted tools exist, but manual preprocessing steps, such as region of interest identification and/or boundary initialization, are still needed. In addition, prior knowledge of the ring shape of vessel walls has not been fully explored in designing segmentation methods. In this work, a fully automated artery localization and vessel wall segmentation system is proposed. A tracklet refinement algorithm was adapted to robustly identify the artery of interest from a neural network-based artery centerline identification architecture. Image patches were extracted from the centerlines and converted in a polar coordinate system for vessel wall segmentation. The segmentation method used 3D polar information and overcame problems such as contour discontinuity, complex vessel geometry, and interference from neighboring vessels. Verified by a large (>32000 images) carotid artery dataset collected from multiple sites, the proposed system was shown to better automatically segment the vessel wall than traditional vessel wall segmentation methods or standard convolutional neural network approaches. In addition, a segmentation uncertainty score was estimated to effectively identify slices likely to have errors and prompt manual confirmation of the segmentation. This robust vessel wall segmentation system has applications in different vascular beds and will facilitate vessel wall feature extraction and cardiovascular risk assessment.
Collapse
Affiliation(s)
- Li Chen
- Department of Electrical and Computer Engineering, University of Washington, Seattle, WA, 98195, USA
| | - Jie Sun
- Department of Radiology, University of Washington, Seattle, WA, 98195, USA
| | - Gador Canton
- Department of Radiology, University of Washington, Seattle, WA, 98195, USA
| | - Niranjan Balu
- Department of Radiology, University of Washington, Seattle, WA, 98195, USA
| | - Daniel S. Hippe
- Department of Radiology, University of Washington, Seattle, WA, 98195, USA
| | - Xihai Zhao
- Department of Biomedical Engineering, Tsinghua University School of Medicine, Beijing, China
| | - Rui Li
- Department of Biomedical Engineering, Tsinghua University School of Medicine, Beijing, China
| | | | - Jenq-Neng Hwang
- Department of Electrical and Computer Engineering, University of Washington, Seattle, WA, 98195, USA
| | - Chun Yuan
- Department of Radiology, University of Washington, Seattle, WA, 98195, USA
| |
Collapse
|
10
|
Gupta V, Demirer M, Bigelow M, Little KJ, Candemir S, Prevedello LM, White RD, O'Donnell TP, Wels M, Erdal BS. Performance of a Deep Neural Network Algorithm Based on a Small Medical Image Dataset: Incremental Impact of 3D-to-2D Reformation Combined with Novel Data Augmentation, Photometric Conversion, or Transfer Learning. J Digit Imaging 2020; 33:431-438. [PMID: 31625028 PMCID: PMC7165215 DOI: 10.1007/s10278-019-00267-3] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/05/2023] Open
Abstract
Collecting and curating large medical-image datasets for deep neural network (DNN) algorithm development is typically difficult and resource-intensive. While transfer learning (TL) decreases reliance on large data collections, current TL implementations are tailored to two-dimensional (2D) datasets, limiting applicability to volumetric imaging (e.g., computed tomography). Targeting performance enhancement of a DNN algorithm based on a small image dataset, we assessed incremental impact of 3D-to-2D projection methods, one supporting novel data augmentation (DA); photometric grayscale-to-color conversion (GCC); and/or TL on training of an algorithm from a small coronary computed tomography angiography (CCTA) dataset (200 examinations, 50% with atherosclerosis and 50% atherosclerosis-free) producing 245 diseased and 1127 normal coronary arteries/branches. Volumetric CCTA data was converted to a 2D format creating both an Aggregate Projection View (APV) and a Mosaic Projection View (MPV), supporting DA per vessel; both grayscale and color-mapped versions of each view were also obtained. Training was performed both without and with TL, and algorithm performance of all permutations was compared using area under the receiver operating characteristics curve. Without TL, APV performance was 0.74 and 0.87 on grayscale and color images, respectively, compared to 0.90 and 0.87 for MPV. With TL, APV performance was 0.78 and 0.88 on grayscale and color images, respectively, compared with 0.93 and 0.91 for MPV. In conclusion, TL enhances performance of a DNN algorithm from a small volumetric dataset after proposed 3D-to-2D reformatting, but additive gain is achieved with application of either GCC to APV or the proposed novel MPV technique for DA.
Collapse
Affiliation(s)
- Vikash Gupta
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA
| | - Mutlu Demirer
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA
| | - Matthew Bigelow
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA
| | - Kevin J Little
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA
| | - Sema Candemir
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA
| | - Luciano M Prevedello
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA
| | - Richard D White
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA
| | | | | | - Barbaros S Erdal
- Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Department of Radiology, Ohio State University College of Medicine, 395 West 12th Avenue, Columbus, OH, 43210, USA.
| |
Collapse
|
11
|
Demirer M, Candemir S, Bigelow MT, Yu SM, Gupta V, Prevedello LM, White RD, Yu JS, Grimmer R, Wels M, Wimmer A, Halabi AH, Ihsani A, O'Donnell TP, Erdal BS. A User Interface for Optimizing Radiologist Engagement in Image Data Curation for Artificial Intelligence. Radiol Artif Intell 2019; 1:e180095. [PMID: 33937804 DOI: 10.1148/ryai.2019180095] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/28/2018] [Revised: 06/14/2019] [Accepted: 06/25/2019] [Indexed: 11/11/2022]
Abstract
Purpose To delineate image data curation needs and describe a locally designed graphical user interface (GUI) to aid radiologists in image annotation for artificial intelligence (AI) applications in medical imaging. Materials and Methods GUI components support image analysis toolboxes, picture archiving and communication system integration, third-party applications, processing of scripting languages, and integration of deep learning libraries. For clinical AI applications, GUI components included two-dimensional segmentation and classification; three-dimensional segmentation and quantification; and three-dimensional segmentation, quantification, and classification. To assess radiologist engagement and performance efficiency associated with GUI-related capabilities, image annotation rate (studies per day) and speed (minutes per case) were evaluated in two clinical scenarios of varying complexity: hip fracture detection and coronary atherosclerotic plaque demarcation and stenosis grading. Results For hip fracture, 1050 radiographs were annotated over 7 days (150 studies per day; median speed: 10 seconds per study [interquartile range, 3-21 seconds per study]). A total of 294 coronary CT angiographic studies with 1843 arteries and branches were annotated for atherosclerotic plaque over 23 days (15.2 studies [80.1 vessels] per day; median speed: 6.08 minutes per study [interquartile range, 2.8-10.6 minutes per study] and 73 seconds per vessel [interquartile range, 20.9-155 seconds per vessel]). Conclusion GUI-component compatibility with common image analysis tools facilitates radiologist engagement in image data curation, including image annotation, supporting AI application development and evolution for medical imaging. When complemented by other GUI elements, a continuous integrated workflow supporting formation of an agile deep neural network life cycle results.Supplemental material is available for this article.© RSNA, 2019.
Collapse
Affiliation(s)
- Mutlu Demirer
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Sema Candemir
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Matthew T Bigelow
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Sarah M Yu
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Vikash Gupta
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Luciano M Prevedello
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Richard D White
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Joseph S Yu
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Rainer Grimmer
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Michael Wels
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Andreas Wimmer
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Abdul H Halabi
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Alvin Ihsani
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Thomas P O'Donnell
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| | - Barbaros S Erdal
- Department of Radiology, Laboratory for Augmented Intelligence in Imaging-Division of Medical Imaging Informatics, Ohio State University College of Medicine, OSU Wexner Medical Center, 395 W 12th Ave, Suite 452, Columbus, OH 43210 (M.D., S.C., M.T.B., S.M.Y., V.G., L.M.P., R.D.W., J.S.Y., B.S.E.); Siemens Healthineers, Erlangen, Germany (R.G., M.W., A.W.); NVIDIA, Santa Clara, Calif (A.H.H., A.I.); and Siemens Healthineers, Malvern, Pa (T.P.O.)
| |
Collapse
|
12
|
Selvan R, Petersen J, Pedersen JH, Bruijne M. Extracting tree structures in CT data by tracking multiple statistically ranked hypotheses. Med Phys 2019; 46:4431-4440. [DOI: 10.1002/mp.13711] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/16/2019] [Revised: 07/04/2019] [Accepted: 07/05/2019] [Indexed: 11/10/2022] Open
Affiliation(s)
- Raghavendra Selvan
- Department of Computer Science University of Copenhagen Copenhagen Denmark
| | - Jens Petersen
- Department of Computer Science University of Copenhagen Copenhagen Denmark
| | - Jesper H. Pedersen
- Department of Thoracic Surgery Rigshospitalet, University of Copenhagen Copenhagen Denmark
| | - Marleen Bruijne
- Department of Computer Science University of Copenhagen Copenhagen Denmark
- Biomedical Imaging Group Rotterdam, Department of Radiology and Nuclear Medicine Erasmus MC Rotterdam The Netherlands
| |
Collapse
|
13
|
Guo Z, Bai J, Lu Y, Wang X, Cao K, Song Q, Sonka M, Yin Y. DeepCenterline: A Multi-task Fully Convolutional Network for Centerline Extraction. LECTURE NOTES IN COMPUTER SCIENCE 2019. [DOI: 10.1007/978-3-030-20351-1_34] [Citation(s) in RCA: 12] [Impact Index Per Article: 2.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/23/2022]
|
14
|
Cao Q, Broersen A, Kitslaar PH, Lelieveldt BPF, Dijkstra J. A model-guided method for improving coronary artery tree extractions from CCTA images. Int J Comput Assist Radiol Surg 2018; 14:373-383. [PMID: 30488262 PMCID: PMC6373332 DOI: 10.1007/s11548-018-1891-7] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/27/2018] [Accepted: 10/24/2018] [Indexed: 11/28/2022]
Abstract
Purpose Automatically extracted coronary artery trees (CATs) from coronary computed tomography angiography images could contain incorrect extractions which require manual corrections before they can be used in clinical practice. A model-guided method for improving the extracted CAT is described to automatically detect potential incorrect extractions and improve them. Methods The proposed method is a coarse-to-fine approach. A coarse improvement is first applied on all vessels in the extracted CAT, and then a fine improvement is applied only on vessels with higher clinical significance. Based upon a decision tree, the proposed method automatically and iteratively performs improvement operations for the entire extracted CAT until it meets the stop criteria. The improvement in the extraction quality obtained by the proposed method is measured using a scoring system. 18 datasets were used to determine optimal values for the parameters involved in the model-guided method and 122 datasets were used for evaluation. Results Compared to the initial automatic extractions, the proposed method improves the CATs for 122 datasets from an average quality score of 87 ± 6 to 93 ± 4. The developed method is able to run within 2 min on a typical workstation. The difference in extraction quality after automatic improvement is negatively correlated with the initial extraction quality (R = − 0.694, P < 0.001). Conclusion Without deteriorating the initially extracted CATs, the presented method automatically detects incorrect extractions and improves the CATs to an average quality score of 93 guided by anatomical statistical models. Electronic supplementary material The online version of this article (10.1007/s11548-018-1891-7) contains supplementary material, which is available to authorized users.
Collapse
Affiliation(s)
- Qing Cao
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Alexander Broersen
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Pieter H Kitslaar
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands.,Medis Medical Imaging Systems BV, Leiden, The Netherlands
| | - Boudewijn P F Lelieveldt
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands
| | - Jouke Dijkstra
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden, The Netherlands.
| |
Collapse
|
15
|
Freiman M, Nickisch H, Prevrhal S, Schmitt H, Vembar M, Maurovich-Horvat P, Donnelly P, Goshen L. Improving CCTA-based lesions' hemodynamic significance assessment by accounting for partial volume modeling in automatic coronary lumen segmentation. Med Phys 2017; 44:1040-1049. [DOI: 10.1002/mp.12121] [Citation(s) in RCA: 18] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/20/2016] [Revised: 01/12/2017] [Accepted: 01/15/2017] [Indexed: 12/19/2022] Open
Affiliation(s)
- Moti Freiman
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| | - Hannes Nickisch
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| | - Sven Prevrhal
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| | - Holger Schmitt
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| | - Mani Vembar
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| | - Pál Maurovich-Horvat
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| | - Patrick Donnelly
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| | - Liran Goshen
- Philips Medical Systems Technologies Ltd.; Advanced Technologies Center; Haifa 3100202 Israel
| |
Collapse
|
16
|
Wolterink JM, Leiner T, de Vos BD, Coatrieux JL, Kelm BM, Kondo S, Salgado RA, Shahzad R, Shu H, Snoeren M, Takx RAP, van Vliet LJ, van Walsum T, Willems TP, Yang G, Zheng Y, Viergever MA, Išgum I. An evaluation of automatic coronary artery calcium scoring methods with cardiac CT using the orCaScore framework. Med Phys 2017; 43:2361. [PMID: 27147348 DOI: 10.1118/1.4945696] [Citation(s) in RCA: 46] [Impact Index Per Article: 5.8] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/20/2022] Open
Abstract
PURPOSE The amount of coronary artery calcification (CAC) is a strong and independent predictor of cardiovascular disease (CVD) events. In clinical practice, CAC is manually identified and automatically quantified in cardiac CT using commercially available software. This is a tedious and time-consuming process in large-scale studies. Therefore, a number of automatic methods that require no interaction and semiautomatic methods that require very limited interaction for the identification of CAC in cardiac CT have been proposed. Thus far, a comparison of their performance has been lacking. The objective of this study was to perform an independent evaluation of (semi)automatic methods for CAC scoring in cardiac CT using a publicly available standardized framework. METHODS Cardiac CT exams of 72 patients distributed over four CVD risk categories were provided for (semi)automatic CAC scoring. Each exam consisted of a noncontrast-enhanced calcium scoring CT (CSCT) and a corresponding coronary CT angiography (CCTA) scan. The exams were acquired in four different hospitals using state-of-the-art equipment from four major CT scanner vendors. The data were divided into 32 training exams and 40 test exams. A reference standard for CAC in CSCT was defined by consensus of two experts following a clinical protocol. The framework organizers evaluated the performance of (semi)automatic methods on test CSCT scans, per lesion, artery, and patient. RESULTS Five (semi)automatic methods were evaluated. Four methods used both CSCT and CCTA to identify CAC, and one method used only CSCT. The evaluated methods correctly detected between 52% and 94% of CAC lesions with positive predictive values between 65% and 96%. Lesions in distal coronary arteries were most commonly missed and aortic calcifications close to the coronary ostia were the most common false positive errors. The majority (between 88% and 98%) of correctly identified CAC lesions were assigned to the correct artery. Linearly weighted Cohen's kappa for patient CVD risk categorization by the evaluated methods ranged from 0.80 to 1.00. CONCLUSIONS A publicly available standardized framework for the evaluation of (semi)automatic methods for CAC identification in cardiac CT is described. An evaluation of five (semi)automatic methods within this framework shows that automatic per patient CVD risk categorization is feasible. CAC lesions at ambiguous locations such as the coronary ostia remain challenging, but their detection had limited impact on CVD risk determination.
Collapse
Affiliation(s)
- Jelmer M Wolterink
- Image Sciences Institute, University Medical Center Utrecht, Utrecht 3508 GA, The Netherlands
| | - Tim Leiner
- Department of Radiology, University Medical Center Utrecht, Utrecht 3508 GA, The Netherlands
| | - Bob D de Vos
- Image Sciences Institute, University Medical Center Utrecht, Utrecht 3508 GA, The Netherlands
| | - Jean-Louis Coatrieux
- INSERM, U1099, Rennes F-35000, France; LTSI, Université de Rennes 1, Rennes F-35000, France; and Centre de Recherche en Information Biomédicale Sino-Français (LIA CRIBs), Nanjing 210096, China
| | - B Michael Kelm
- Imaging and Computer Vision, Corporate Technology, Siemens AG, Erlangen 91051, Germany
| | | | - Rodrigo A Salgado
- Department of Radiology, University Hospital Antwerpen, Edegem 2650, Belgium
| | - Rahil Shahzad
- Division of Image Processing, Department of Radiology, Leiden University Medical Center, Leiden 2300 RC, The Netherlands; Biomedical Imaging Group Rotterdam, Departments of Radiology and Medical Informatics, Erasmus MC, Rotterdam 3000 CA, The Netherlands; and Quantitative Imaging Group, Department of Imaging Physics, Faculty of Applied Sciences, Delft University of Technology, Delft 2600 GA, The Netherlands
| | - Huazhong Shu
- Centre de Recherche en Information Biomédicale Sino-Français (LIA CRIBs), Nanjing 210096, China and Lab of Image Science and Technology, School of Computer Science and Technology, Nanjing 210096, China
| | - Miranda Snoeren
- Department of Radiology, Radboud University Medical Center, Nijmegen 6500 HB, The Netherlands
| | - Richard A P Takx
- Department of Radiology, University Medical Center Utrecht, Utrecht 3508 GA, The Netherlands
| | - Lucas J van Vliet
- Quantitative Imaging Group, Department of Imaging Physics, Faculty of Applied Sciences, Delft University of Technology, Delft 2600 GA, The Netherlands
| | - Theo van Walsum
- Biomedical Imaging Group Rotterdam, Departments of Radiology and Medical Informatics, Erasmus MC, Rotterdam 3000 CA, The Netherlands
| | - Tineke P Willems
- Department of Radiology, University Medical Center Groningen, Groningen 9700 RB, The Netherlands
| | - Guanyu Yang
- Lab of Image Science and Technology, School of Computer Science and Technology, Nanjing 210096, China and Centre de Recherche en Information Biomédicale Sino-Français (LIA CRIBs), Nanjing 210096, China
| | - Yefeng Zheng
- Imaging and Computer Vision, Corporate Technology, Siemens Corporation, Princeton, New Jersey 08540-6632
| | - Max A Viergever
- Image Sciences Institute, University Medical Center Utrecht, Utrecht 3508 GA, The Netherlands
| | - Ivana Išgum
- Image Sciences Institute, University Medical Center Utrecht, Utrecht 3508 GA, The Netherlands
| |
Collapse
|
17
|
Xiong G, Sun P, Zhou H, Ha S, Hartaigh BO, Truong QA, Min JK. Comprehensive Modeling and Visualization of Cardiac Anatomy and Physiology from CT Imaging and Computer Simulations. IEEE TRANSACTIONS ON VISUALIZATION AND COMPUTER GRAPHICS 2017; 23:1014-1028. [PMID: 26863663 PMCID: PMC4975682 DOI: 10.1109/tvcg.2016.2520946] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/13/2023]
Abstract
In clinical cardiology, both anatomy and physiology are needed to diagnose cardiac pathologies. CT imaging and computer simulations provide valuable and complementary data for this purpose. However, it remains challenging to gain useful information from the large amount of high-dimensional diverse data. The current tools are not adequately integrated to visualize anatomic and physiologic data from a complete yet focused perspective. We introduce a new computer-aided diagnosis framework, which allows for comprehensive modeling and visualization of cardiac anatomy and physiology from CT imaging data and computer simulations, with a primary focus on ischemic heart disease. The following visual information is presented: (1) Anatomy from CT imaging: geometric modeling and visualization of cardiac anatomy, including four heart chambers, left and right ventricular outflow tracts, and coronary arteries; (2) Function from CT imaging: motion modeling, strain calculation, and visualization of four heart chambers; (3) Physiology from CT imaging: quantification and visualization of myocardial perfusion and contextual integration with coronary artery anatomy; (4) Physiology from computer simulation: computation and visualization of hemodynamics (e.g., coronary blood velocity, pressure, shear stress, and fluid forces on the vessel wall). Substantially, feedback from cardiologists have confirmed the practical utility of integrating these features for the purpose of computer-aided diagnosis of ischemic heart disease.
Collapse
|
18
|
Review of Deep Learning Methods in Mammography, Cardiovascular, and Microscopy Image Analysis. DEEP LEARNING AND CONVOLUTIONAL NEURAL NETWORKS FOR MEDICAL IMAGE COMPUTING 2017. [DOI: 10.1007/978-3-319-42999-1_2] [Citation(s) in RCA: 20] [Impact Index Per Article: 2.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/17/2023]
|
19
|
Durlak F, Wels M, Schwemmer C, Sühling M, Steidl S, Maier A. Growing a Random Forest with Fuzzy Spatial Features for Fully Automatic Artery-Specific Coronary Calcium Scoring. MACHINE LEARNING IN MEDICAL IMAGING 2017. [DOI: 10.1007/978-3-319-67389-9_4] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/14/2022]
|
20
|
Han D, Shim H, Jeon B, Jang Y, Hong Y, Jung S, Ha S, Chang HJ. Automatic Coronary Artery Segmentation Using Active Search for Branches and Seemingly Disconnected Vessel Segments from Coronary CT Angiography. PLoS One 2016; 11:e0156837. [PMID: 27536939 PMCID: PMC4990346 DOI: 10.1371/journal.pone.0156837] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/14/2015] [Accepted: 05/22/2016] [Indexed: 11/19/2022] Open
Abstract
We propose a Bayesian tracking and segmentation method of coronary arteries on coronary computed tomographic angiography (CCTA). The geometry of coronary arteries including lumen boundary is estimated in Maximum A Posteriori (MAP) framework. Three consecutive sphere based filtering is combined with a stochastic process that is based on the similarity of the consecutive local neighborhood voxels and the geometric constraint of a vessel. It is also founded on the prior knowledge that an artery can be seen locally disconnected and consist of branches which may be seemingly disconnected due to plaque build up. For such problem, an active search method is proposed to find branches and seemingly disconnected but actually connected vessel segments. Several new measures have been developed for branch detection, disconnection check and planar vesselness measure. Using public domain Rotterdam CT dataset, the accuracy of extracted centerline is demonstrated and automatic reconstruction of coronary artery mesh is shown.
Collapse
Affiliation(s)
- Dongjin Han
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
| | - Hackjoon Shim
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
| | - Byunghwan Jeon
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
| | - Yeonggul Jang
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
| | - Youngtaek Hong
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
| | - Sunghee Jung
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
| | - Seongmin Ha
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
| | - Hyuk-Jae Chang
- Yonsei University, College of Medicine, 134 Sinchon, Seodaemun, Seoul, Korea
- * E-mail:
| |
Collapse
|
21
|
Khoo Y, Kapoor A. Non-Iterative Rigid 2D/3D Point-Set Registration Using Semidefinite Programming. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2016; 25:2956-2970. [PMID: 26978822 DOI: 10.1109/tip.2016.2540810] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
We describe a convex programming framework for pose estimation in 2D/3D point-set registration with unknown point correspondences. We give two mixed-integer nonlinear program (MINLP) formulations of the 2D/3D registration problem when there are multiple 2D images, and propose convex relaxations for both the MINLPs to semidefinite programs that can be solved efficiently by interior point methods. Our approach to the 2D/3D registration problem is non-iterative in nature as we jointly solve for pose and correspondence. Furthermore, these convex programs can readily incorporate feature descriptors of points to enhance registration results. We prove that the convex programs exactly recover the solution to the MINLPs under certain noiseless condition. We apply these formulations to the registration of 3D models of coronary vessels to their 2D projections obtained from multiple intra-operative fluoroscopic images. For this application, we experimentally corroborate the exact recovery property in the absence of noise and further demonstrate robustness of the convex programs in the presence of noise.
Collapse
|
22
|
Gülsün MA, Funka-Lea G, Sharma P, Rapaka S, Zheng Y. Coronary Centerline Extraction via Optimal Flow Paths and CNN Path Pruning. LECTURE NOTES IN COMPUTER SCIENCE 2016. [DOI: 10.1007/978-3-319-46726-9_37] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 12/04/2022]
|
23
|
Cetin S, Unal G. A higher-order tensor vessel tractography for segmentation of vascular structures. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:2172-2185. [PMID: 25910058 DOI: 10.1109/tmi.2015.2425535] [Citation(s) in RCA: 40] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
A new vascular structure segmentation method, which is based on a cylindrical flux-based higher order tensor (HOT), is presented. On a vessel structure, the HOT naturally models branching points, which create challenges for vessel segmentation algorithms. In a general linear HOT model embedded in 3D, one has to work with an even order tensor due to an enforced antipodal-symmetry on the unit sphere. However, in scenarios such as in a bifurcation, the antipodally-symmetric tensor embedded in 3D will not be useful. In order to overcome that limitation, we embed the tensor in 4D and obtain a structure that can model asymmetric junction scenarios. During construction of a higher order tensor (e.g. third or fourth order) in 4D, the orientation vectors lie on the unit 3-sphere, in contrast to the unit 2-sphere in 3D tensor modeling. This 4D tensor is exploited in a seed-based vessel segmentation algorithm, where the principal directions of the 4D HOT is obtained by decomposition, and used in a HOT tractography approach. We demonstrate quantitative validation of the proposed algorithm on both synthetic complex tubular structures as well as real cerebral vasculature in Magnetic Resonance Angiography (MRA) datasets and coronary arteries from Computed Tomography Angiography (CTA) volumes.
Collapse
|
24
|
Skibbe H, Reisert M, Maeda SI, Koyama M, Oba S, Ito K, Ishii S. Efficient Monte Carlo image analysis for the location of vascular entity. IEEE TRANSACTIONS ON MEDICAL IMAGING 2015; 34:628-643. [PMID: 25347876 DOI: 10.1109/tmi.2014.2364404] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Tubular shaped networks appear not only in medical images like X-ray-, time-of-flight MRI- or CT-angiograms but also in microscopic images of neuronal networks. We present EMILOVE (Efficient Monte-carlo Image-analysis for the Location Of Vascular Entity), a novel modeling algorithm for tubular networks in biomedical images. The model is constructed using tablet shaped particles and edges connecting them. The particles encode the intrinsic information of tubular structure, including position, scale and orientation. The edges connecting the particles determine the topology of the networks. For simulated data, EMILOVE was able to accurately extract the tubular network. EMILOVE showed high performance in real data as well; it successfully modeled vascular networks in real cerebral X-ray and time-of-flight MRI angiograms. We also show some promising, preliminary results on microscopic images of neurons.
Collapse
|
25
|
CTA coronary labeling through efficient geodesics between trees using anatomy priors. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2015; 17:521-8. [PMID: 25485419 DOI: 10.1007/978-3-319-10470-6_65] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [Subscribe] [Scholar Register] [Indexed: 11/27/2022]
Abstract
We present an efficient realization of recent work on unique geodesic paths between tree shapes for the application of matching coronary arteries to a standard model of coronary anatomy in order to label the coronary arteries. Automatically labeled coronary arteries would speed reporting for physicians. The efficiency of the approach and the quality of the results are enhanced using the relative position of detected cardiac structures. We explain how to efficiently compute the geodesic paths between tree shapes using Dijkstra's algorithm and we present a methodology to account for missing side branches during matching. For nearly all labels our approach shows promise compared with recent work and we results for 8 additional labels.
Collapse
|
26
|
Lu S, Huang X, Wang Z, Zheng Y. Sparse appearance learning based automatic coronary sinus segmentation in CTA. MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION : MICCAI ... INTERNATIONAL CONFERENCE ON MEDICAL IMAGE COMPUTING AND COMPUTER-ASSISTED INTERVENTION 2014; 17:779-787. [PMID: 25333190 DOI: 10.1007/978-3-319-10404-1_97] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
Interventional cardiologists are often challenged by a high degree of variability in the coronary venous anatomy during coronary sinus cannulation and left ventricular epicardial lead placement for cardiac resynchronization therapy (CRT), making it important to have a precise and fully-automatic segmentation solution for detecting the coronary sinus. A few approaches have been proposed for automatic segmentation of tubular structures utilizing various vesselness measurements. Although working well on contrasted coronary arteries, these methods fail in segmenting the coronary sinus that has almost no contrast in computed tomography angiography (CTA) data, making it difficult to distinguish from surrounding tissues. In this work we propose a multiscale sparse appearance learning based method for estimating vesselness towards automatically extracting the centerlines. Instead of modeling the subtle discrimination at the low-level intensity, we leverage the flexibility of sparse representation to model the inherent spatial coherence of vessel/background appearance and derive a vesselness measurement. After centerline extraction, the coronary sinus lumen is segmented using a learning based boundary detector and Markov random field (MRF) based optimal surface extraction. Quantitative evaluation on a large cardiac CTA dataset (consisting of 204 3D volumes) demonstrates the superior accuracy of the proposed method in both centerline extraction and lumen segmentation, compared to the state-of-the-art.
Collapse
|
27
|
Lugauer F, Zheng Y, Hornegger J, Kelm BM. Precise Lumen Segmentation in Coronary Computed Tomography Angiography. MEDICAL COMPUTER VISION: ALGORITHMS FOR BIG DATA 2014. [DOI: 10.1007/978-3-319-13972-2_13] [Citation(s) in RCA: 9] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/31/2023]
|