1
|
Alblas D, Vos IN, Lipplaa MM, Brune C, van der Schaaf IC, Velthuis MRE, Velthuis BK, Kuijf HJ, Ruigrok YM, Wolterink JM. Deep-learning-based extraction of circle of Willis topology with anatomical priors. Sci Rep 2024; 14:31630. [PMID: 39738351 PMCID: PMC11686194 DOI: 10.1038/s41598-024-80574-0] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/18/2024] [Accepted: 11/19/2024] [Indexed: 01/02/2025] Open
Abstract
The circle of Willis (CoW) is a circular arrangement of arteries in the human brain, exhibiting significant anatomical variability. The CoW is extensively studied in relation to neurovascular pathologies, with certain anatomical variants previously linked to ischemic stroke and intracranial aneurysms. In an individual CoW, arteries might be absent (aplasia) or underdeveloped (hypoplasia, diameter < 1 mm). As the assessment of such variations is time-consuming and susceptible to subjectivity, robust automatic extraction of personalized CoW topology from time-of-flight magnetic resonance angiography (TOF-MRA) images would highly benefit large-scale clinical investigations. Previous work has sought to extract CoW topology from voxel-based semantic segmentation masks. However, hypoplastic arteries are challenging to recover in voxel-based segmentation. Instead, we propose using a complete CoW as an anatomical prior for extracting all possible CoW arteries as shortest paths between automatically identified anatomical landmarks, guided by automatically determined artery orientation vector fields. These fields are obtained using a scale-invariant and rotation-equivariant mesh-CNN-based model (SIRE). For a 3D TOF-MRA volume, a potentially overcomplete graph of the CoW is thus extracted in which each edge represents an artery. Subsequently, a binary Random Forest classifier labels each artery as normal or hypo-/aplastic. The model was optimized and validated using a data set of 351 3D TOF-MRA scans in a cross-validation setup. We showed that using a shortest path algorithm with a cost function based on local artery orientations results in continuous artery paths, even in hypoplastic cases. We tracked the correct path in the posterior communicating arteries in 70-74% of the cases, an artery that is known to pose challenges in voxel-based segmentation models. Our downstream artery path classifier obtained an average F1 score of 0.91, demonstrating the potential of our proposed framework to extract personalized CoW topology automatically.
Collapse
Affiliation(s)
- Dieuwertje Alblas
- Department of Applied Mathematics, Technical Medical Centre, University of Twente, Enschede, The Netherlands.
| | - Iris N Vos
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Micha M Lipplaa
- Department of Biomedical Engineering, Eindhoven University of Technology, Eindhoven, The Netherlands
| | - Christoph Brune
- Department of Applied Mathematics, Technical Medical Centre, University of Twente, Enschede, The Netherlands
| | | | - Mireille R E Velthuis
- Department of Radiology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Birgitta K Velthuis
- Department of Radiology, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Hugo J Kuijf
- Image Sciences Institute, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Ynte M Ruigrok
- Department of Neurology and Neurosurgery, University Medical Center Utrecht, Utrecht, The Netherlands
| | - Jelmer M Wolterink
- Department of Applied Mathematics, Technical Medical Centre, University of Twente, Enschede, The Netherlands
| |
Collapse
|
2
|
Su J, Li S, Wolff L, van Zwam W, Niessen WJ, van der Lugt A, van Walsum T. Deep reinforcement learning for cerebral anterior vessel tree extraction from 3D CTA images. Med Image Anal 2023; 84:102724. [PMID: 36525842 DOI: 10.1016/j.media.2022.102724] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/17/2022] [Revised: 11/24/2022] [Accepted: 12/02/2022] [Indexed: 12/13/2022]
Abstract
Extracting the cerebral anterior vessel tree of patients with an intracranial large vessel occlusion (LVO) is relevant to investigate potential biomarkers that can contribute to treatment decision making. The purpose of our work is to develop a method that can achieve this from routinely acquired computed tomography angiography (CTA) and computed tomography perfusion (CTP) images. To this end, we regard the anterior vessel tree as a set of bifurcations and connected centerlines. The method consists of a proximal policy optimization (PPO) based deep reinforcement learning (DRL) approach for tracking centerlines, a convolutional neural network based bifurcation detector, and a breadth-first vessel tree construction approach taking the tracking and bifurcation detection results as input. We experimentally determine the added values of various components of the tracker. Both DRL vessel tracking and CNN bifurcation detection were assessed in a cross validation experiment using 115 subjects. The anterior vessel tree formation was evaluated on an independent test set of 25 subjects, and compared to interobserver variation on a small subset of images. The DRL tracking result achieves a median overlapping rate until the first error (1.8 mm off the reference standard) of 100, [46, 100] % on 8032 vessels over 115 subjects. The bifurcation detector reaches an average recall and precision of 76% and 87% respectively during the vessel tree formation process. The final vessel tree formation achieves a median recall of 68% and precision of 70%, which is in line with the interobserver agreement.
Collapse
Affiliation(s)
- Jiahang Su
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands.
| | - Shuai Li
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Lennard Wolff
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Wim van Zwam
- Department of Radiology & Nuclear Medicine, Maastricht UMC, Cardiovascular Research Institute Maastricht, The Netherlands
| | - Wiro J Niessen
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands; Faculty of Applied Sciences, Delft University of Technology, The Netherlands
| | - Aad van der Lugt
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| | - Theo van Walsum
- Department of Radiology & Nuclear Medicine, Erasmus MC, University Medical Center Rotterdam, The Netherlands
| |
Collapse
|
3
|
Sudre CH, Moriconi S, Rehwald R, Smith L, Tillin T, Barnes J, Atkinson D, Ourselin S, Chaturvedi N, Hughes AD, Jäger HR, Cardoso MJ. Accelerated vascular aging: Ethnic differences in basilar artery length and diameter, and its association with cardiovascular risk factors and cerebral small vessel disease. Front Cardiovasc Med 2022; 9:939680. [PMID: 35966566 PMCID: PMC9366336 DOI: 10.3389/fcvm.2022.939680] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2022] [Accepted: 06/27/2022] [Indexed: 11/13/2022] Open
Abstract
Background and aims Risk of stroke and dementia is markedly higher in people of South Asian and African Caribbean descent than white Europeans in the UK. This is unexplained by cardiovascular risk factors (CVRF). We hypothesized this might indicate accelerated early vascular aging (EVA) and that EVA might account for stronger associations between cerebral large artery characteristics and markers of small vessel disease. Methods 360 participants in a tri-ethnic population-based study (120 per ethnic group) underwent cerebral and vertebral MRI. Length and median diameter of the basilar artery (BA) were derived from Time of Flight images, while white matter hyperintensities (WMH) volumes were obtained from T1 and FLAIR images. Associations between BA characteristics and CVRF were assessed using multivariable linear regression. Partial correlation coefficients between WMH load and BA characteristics were calculated after adjustment for CVRF and other potential confounders. Results BA diameter was strongly associated with age in South Asians (+11.3 μm/year 95% CI = [3.05; 19.62]; p = 0.008), with unconvincing relationships in African Caribbeans (3.4 μm/year [-5.26, 12.12]; p = 0.436) or Europeans (2.6 μm/year [-5.75, 10.87]; p = 0.543). BA length was associated with age in South Asians (+0.34 mm/year [0.02; 0.65]; p = 0.037) and African Caribbeans (+0.39 mm/year [0.12; 0.65]; p = 0.005) but not Europeans (+0.08 mm/year [-0.26; 0.41]; p = 0.653). BA diameter (rho = 0.210; p = 0.022) and length (rho = 0.261; p = 0.004) were associated with frontal WMH load in South Asians (persisting after multivariable adjustment for CVRF). Conclusions Compared with Europeans, the basilar artery undergoes more accelerated EVA in South Asians and in African Caribbeans, albeit to a lesser extent. Such EVA may contribute to the higher burden of CSVD observed in South Asians and excess risk of stroke, vascular cognitive impairment and dementia observed in these ethnic groups.
Collapse
Affiliation(s)
- Carole H. Sudre
- MRC Unit for Lifelong Health and Ageing at UCL, Department of Population Science and Experimental Medicine, UCL Institute of Cardiovascular Science, University College London, London, United Kingdom
- Department of Computer Science, Centre for Medical Image Computing, University College London, London, United Kingdom
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Stefano Moriconi
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Rafael Rehwald
- Department of Radiology, School of Clinical Medicine, University of Cambridge, Cambridge, United Kingdom
- Neuroradiological Academic Unit, Department of Brain Repair and Rehabilitation, Queen Square Institute of Neurology, University College London, London, United Kingdom
| | - Lorna Smith
- Centre for Medical Imaging, Division of Medicine, University College London, London, United Kingdom
| | - Therese Tillin
- MRC Unit for Lifelong Health and Ageing at UCL, Department of Population Science and Experimental Medicine, UCL Institute of Cardiovascular Science, University College London, London, United Kingdom
| | - Josephine Barnes
- Dementia Research Centre, UCL Institute of Neurology, University College London, London, United Kingdom
| | - David Atkinson
- Centre for Medical Imaging, Division of Medicine, University College London, London, United Kingdom
| | - Sébastien Ourselin
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| | - Nish Chaturvedi
- MRC Unit for Lifelong Health and Ageing at UCL, Department of Population Science and Experimental Medicine, UCL Institute of Cardiovascular Science, University College London, London, United Kingdom
| | - Alun D. Hughes
- MRC Unit for Lifelong Health and Ageing at UCL, Department of Population Science and Experimental Medicine, UCL Institute of Cardiovascular Science, University College London, London, United Kingdom
| | - H. Rolf Jäger
- Neuroradiological Academic Unit, Department of Brain Repair and Rehabilitation, Queen Square Institute of Neurology, University College London, London, United Kingdom
| | - M. Jorge Cardoso
- School of Biomedical Engineering and Imaging Sciences, King's College London, London, United Kingdom
| |
Collapse
|
4
|
Dang VN, Galati F, Cortese R, Di Giacomo G, Marconetto V, Mathur P, Lekadir K, Lorenzi M, Prados F, Zuluaga MA. Vessel-CAPTCHA: An efficient learning framework for vessel annotation and segmentation. Med Image Anal 2021; 75:102263. [PMID: 34731770 DOI: 10.1016/j.media.2021.102263] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/29/2021] [Revised: 10/04/2021] [Accepted: 10/06/2021] [Indexed: 12/22/2022]
Abstract
Deep learning techniques for 3D brain vessel image segmentation have not been as successful as in the segmentation of other organs and tissues. This can be explained by two factors. First, deep learning techniques tend to show poor performances at the segmentation of relatively small objects compared to the size of the full image. Second, due to the complexity of vascular trees and the small size of vessels, it is challenging to obtain the amount of annotated training data typically needed by deep learning methods. To address these problems, we propose a novel annotation-efficient deep learning vessel segmentation framework. The framework avoids pixel-wise annotations, only requiring weak patch-level labels to discriminate between vessel and non-vessel 2D patches in the training set, in a setup similar to the CAPTCHAs used to differentiate humans from bots in web applications. The user-provided weak annotations are used for two tasks: (1) to synthesize pixel-wise pseudo-labels for vessels and background in each patch, which are used to train a segmentation network, and (2) to train a classifier network. The classifier network allows to generate additional weak patch labels, further reducing the annotation burden, and it acts as a second opinion for poor quality images. We use this framework for the segmentation of the cerebrovascular tree in Time-of-Flight angiography (TOF) and Susceptibility-Weighted Images (SWI). The results show that the framework achieves state-of-the-art accuracy, while reducing the annotation time by ∼77% w.r.t. learning-based segmentation methods using pixel-wise labels for training.
Collapse
Affiliation(s)
- Vien Ngoc Dang
- Data Science Department, EURECOM, Sophia Antipolis, France; Artificial Intelligence in Medicine Lab, Facultat de Matemátiques I Informática, Universitat de Barcelona, Spain
| | | | - Rosa Cortese
- Queen Square MS Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, Faculty of Brain Sciences, University College London, UK; Department of Medicine, Surgery and Neuroscience, University of Siena, Italy
| | - Giuseppe Di Giacomo
- Data Science Department, EURECOM, Sophia Antipolis, France; Politecnico di Torino, Turin, Italy
| | - Viola Marconetto
- Data Science Department, EURECOM, Sophia Antipolis, France; Politecnico di Torino, Turin, Italy
| | - Prateek Mathur
- Data Science Department, EURECOM, Sophia Antipolis, France
| | - Karim Lekadir
- Artificial Intelligence in Medicine Lab, Facultat de Matemátiques I Informática, Universitat de Barcelona, Spain
| | - Marco Lorenzi
- Université Côte d'Azur, Inria Sophia Antipolis, Epione Research Group, Valbonne, France
| | - Ferran Prados
- Centre for Medical Image Computing, Department of Medical Physics and Bioengineering, University College London, UK; Queen Square MS Centre, Department of Neuroinflammation, UCL Queen Square Institute of Neurology, Faculty of Brain Sciences, University College London, UK; National Institute for Health Research, University College London Hospitals, Biomedical Research Centre, London, UK; e-health Center, Universitat Oberta de Catalunya, Barcelona, Spain
| | | |
Collapse
|
5
|
Nazir A, Cheema MN, Sheng B, Li P, Kim J, Lee TY. Living Donor-Recipient Pair Matching for Liver Transplant via Ternary Tree Representation With Cascade Incremental Learning. IEEE Trans Biomed Eng 2021; 68:2540-2551. [PMID: 33417536 DOI: 10.1109/tbme.2021.3050310] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Visual understanding of liver vessels anatomy between the living donor-recipient (LDR) pair can assist surgeons to optimize transplant planning by avoiding non-targeted arteries which can cause severe complications. We propose to visually analyze the anatomical variants of the liver vessels anatomy to maximize similarity for finding a suitable Living Donor-Recipient (LDR) pair. Liver vessels are segmented from computed tomography angiography (CTA) volumes by employing a cascade incremental learning (CIL) model. Our CIL architecture is able to find optimal solutions, which we use to update the model with liver vessel CTA images. A novel ternary tree based algorithm is proposed to map all the possible liver vessel variants into their respective tree topologies. The tree topologies of the recipient's and donor's liver vessels are then used for an appropriate matching. The proposed algorithm utilizes a set of defined vessel tree variants which are updated to maintain the maximum matching options by leveraging the accurate segmentation results of the vessels derived from the incremental learning ability of the CIL. We introduce a novel concept of in-order digital string based comparison to match the geometry of two anatomically varied trees. Experiments through visual illustrations and quantitative analysis demonstrated the effectiveness of our approach compared to state-of-the-art.
Collapse
|
6
|
Mistelbauer G, Morar A, Schernthaner R, Strassl A, Fleischmann D, Moldoveanu F, Gröller ME. Semi-automatic vessel detection for challenging cases of peripheral arterial disease. Comput Biol Med 2021; 133:104344. [PMID: 33915360 DOI: 10.1016/j.compbiomed.2021.104344] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/09/2020] [Revised: 02/26/2021] [Accepted: 03/12/2021] [Indexed: 12/19/2022]
Abstract
OBJECTIVES Manual or semi-automated segmentation of the lower extremity arterial tree in patients with Peripheral arterial disease (PAD) remains a notoriously difficult and time-consuming task. The complex manifestations of the disease, including discontinuities of the vascular flow channels, the presence of calcified atherosclerotic plaque in close vicinity to adjacent bone, and the presence of metal or other imaging artifacts currently preclude fully automated vessel identification. New machine learning techniques may alleviate this challenge, but require large and reasonably well segmented training data. METHODS We propose a novel semi-automatic vessel tracking approach for peripheral arteries to facilitate and accelerate the creation of annotated training data by expert cardiovascular radiologists or technologists, while limiting the number of necessary manual interactions, and reducing processing time. After automatically classifying blood vessels, bones, and other tissue, the relevant vessels are tracked and organized in a tree-like structure for further visualization. RESULTS We conducted a pilot (N = 9) and a clinical study (N = 24) in which we assess the accuracy and required time for our approach to achieve sufficient quality for clinical application, with our current clinically established workflow as the standard of reference. Our approach enabled expert physicians to readily identify all clinically relevant lower extremity arteries, even in problematic cases, with an average sensitivity of 92.9%, and an average specificity and overall accuracy of 99.9%. CONCLUSIONS Compared to the clinical workflow in our collaborating hospitals (28:40 ± 7:45 [mm:ss]), our approach (17:24 ± 6:44 [mm:ss]) is on average 11:16 [mm:ss] (39%) faster.
Collapse
Affiliation(s)
- Gabriel Mistelbauer
- Department of Simulation and Graphics, Otto-von-Guericke University Magdeburg, Germany.
| | - Anca Morar
- Department of Computer Science, University Politehnica of Bucharest, Romania.
| | | | - Andreas Strassl
- Department of Biomedical Imaging and Image-guided Therapy, Medical University of Vienna, Austria.
| | - Dominik Fleischmann
- Department of Radiology, Stanford University School of Medicine, Stanford, USA.
| | - Florica Moldoveanu
- Department of Computer Science, University Politehnica of Bucharest, Romania.
| | - M Eduard Gröller
- Institute of Visual Computing and Human-Centered Technology, TU Wien, Austria; VRVis Research Center, Austria.
| |
Collapse
|
7
|
Damseh R, Delafontaine-Martel P, Pouliot P, Cheriet F, Lesage F. Laplacian Flow Dynamics on Geometric Graphs for Anatomical Modeling of Cerebrovascular Networks. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:381-394. [PMID: 32986549 DOI: 10.1109/tmi.2020.3027500] [Citation(s) in RCA: 7] [Impact Index Per Article: 1.8] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Generating computational anatomical models of cerebrovascular networks is vital for improving clinical practice and understanding brain oxygen transport. This is achieved by extracting graph-based representations based on pre-mapping of vascular structures. Recent graphing methods can provide smooth vessels trajectories and well-connected vascular topology. However, they require water-tight surface meshes as inputs. Furthermore, adding vessels radii information on their graph compartments restricts their alignment along vascular centerlines. Here, we propose a novel graphing scheme that works with relaxed input requirements and intrinsically captures vessel radii information. The proposed approach is based on deforming geometric graphs constructed within vascular boundaries. Under a laplacian optimization framework, we assign affinity weights on the initial geometry that drives its iterative contraction toward vessels centerlines. We present a mechanism to decimate graph structure at each run and a convergence criterion to stop the process. A refinement technique is then introduced to obtain final vascular models. Our implementation is available on https://github.com/Damseh/VascularGraph. We benchmarked our results with that obtained using other efficient and state-of-the-art graphing schemes, validating on both synthetic and real angiograms acquired with different imaging modalities. The experiments indicate that the proposed scheme produces the lowest geometric and topological error rates on various angiograms. Furthermore, it surpasses other techniques in providing representative models that capture all anatomical aspects of vascular structures.
Collapse
|