1
|
Guo Q, Song H, Fan J, Ai D, Gao Y, Yu X, Yang J. Portal Vein and Hepatic Vein Segmentation in Multi-Phase MR Images Using Flow-Guided Change Detection. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2022; 31:2503-2517. [PMID: 35275817 DOI: 10.1109/tip.2022.3157136] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/14/2023]
Abstract
Segmenting portal vein (PV) and hepatic vein (HV) from magnetic resonance imaging (MRI) scans is important for hepatic tumor surgery. Compared with single phase-based methods, multiple phases-based methods have better scalability in distinguishing HV and PV by exploiting multi-phase information. However, these methods just coarsely extract HV and PV from different phase images. In this paper, we propose a unified framework to automatically and robustly segment 3D HV and PV from multi-phase MR images, which considers both the change and appearance caused by the vascular flow event to improve segmentation performance. Firstly, inspired by change detection, flow-guided change detection (FGCD) is designed to detect the changed voxels related to hepatic venous flow by generating hepatic venous phase map and clustering the map. The FGCD uniformly deals with HV and PV clustering by the proposed shared clustering, thus making the appearance correlated with portal venous flow robustly delineate without increasing framework complexity. Then, to refine vascular segmentation results produced by both HV and PV clustering, interclass decision making (IDM) is proposed by combining the overlapping region discrimination and neighborhood direction consistency. Finally, our framework is evaluated on multi-phase clinical MR images of the public dataset (TCGA) and local hospital dataset. The quantitative and qualitative evaluations show that our framework outperforms the existing methods.
Collapse
|
2
|
Ciecholewski M, Kassjański M. Computational Methods for Liver Vessel Segmentation in Medical Imaging: A Review. SENSORS 2021; 21:s21062027. [PMID: 33809361 PMCID: PMC7999381 DOI: 10.3390/s21062027] [Citation(s) in RCA: 29] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/11/2021] [Revised: 03/07/2021] [Accepted: 03/09/2021] [Indexed: 12/12/2022]
Abstract
The segmentation of liver blood vessels is of major importance as it is essential for formulating diagnoses, planning and delivering treatments, as well as evaluating the results of clinical procedures. Different imaging techniques are available for application in clinical practice, so the segmentation methods should take into account the characteristics of the imaging technique. Based on the literature, this review paper presents the most advanced and effective methods of liver vessel segmentation, as well as their performance according to the metrics used. This paper includes results available for four imaging methods, namely: computed tomography (CT), computed tomography angiography (CTA), magnetic resonance (MR), and ultrasonography (USG). The publicly available datasets used in research are also presented. This paper may help researchers gain better insight into the available materials and methods, making it easier to develop new, more effective solutions, as well as to improve existing approaches. This article analyzes in detail various segmentation methods, which can be divided into three groups: active contours, tracking-based, and machine learning techniques. For each group of methods, their theoretical and practical characteristics are discussed, and the pros and cons are highlighted. The most advanced and promising approaches are also suggested. However, we conclude that liver vasculature segmentation is still an open problem, because of the various deficiencies and constraints researchers need to address and try to eliminate from the solutions used.
Collapse
|
3
|
Voglreiter P, Mariappan P, Pollari M, Flanagan R, Blanco Sequeiros R, Portugaller RH, Fütterer J, Schmalstieg D, Kolesnik M, Moche M. RFA Guardian: Comprehensive Simulation of Radiofrequency Ablation Treatment of Liver Tumors. Sci Rep 2018; 8:787. [PMID: 29335429 PMCID: PMC5768804 DOI: 10.1038/s41598-017-18899-2] [Citation(s) in RCA: 19] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/04/2017] [Accepted: 12/08/2017] [Indexed: 01/29/2023] Open
Abstract
The RFA Guardian is a comprehensive application for high-performance patient-specific simulation of radiofrequency ablation of liver tumors. We address a wide range of usage scenarios. These include pre-interventional planning, sampling of the parameter space for uncertainty estimation, treatment evaluation and, in the worst case, failure analysis. The RFA Guardian is the first of its kind that exhibits sufficient performance for simulating treatment outcomes during the intervention. We achieve this by combining a large number of high-performance image processing, biomechanical simulation and visualization techniques into a generalized technical workflow. Further, we wrap the feature set into a single, integrated application, which exploits all available resources of standard consumer hardware, including massively parallel computing on graphics processing units. This allows us to predict or reproduce treatment outcomes on a single personal computer with high computational performance and high accuracy. The resulting low demand for infrastructure enables easy and cost-efficient integration into the clinical routine. We present a number of evaluation cases from the clinical practice where users performed the whole technical workflow from patient-specific modeling to final validation and highlight the opportunities arising from our fast, accurate prediction techniques.
Collapse
Affiliation(s)
- Philip Voglreiter
- Graz University of Technology, Faculty of Computer Science and Biomedical Engineering, Graz, 8010, Austria.
| | | | - Mika Pollari
- Aalto University School of Science and Technology, Department of Computer Science, Espoo, 02150, Finland
| | | | | | - Rupert Horst Portugaller
- Medical University of Graz, Division of Neuroradiology, Vascular and Interventional Radiology, Graz, 8010, Austria
| | - Jurgen Fütterer
- Radboud University Nijmegen, Radboud University Medical Centre, Nijmegen, 6525, Netherlands
| | - Dieter Schmalstieg
- Graz University of Technology, Faculty of Computer Science and Biomedical Engineering, Graz, 8010, Austria
| | - Marina Kolesnik
- Fraunhofer Gesellschaft, Fraunhofer Institute for Applied Information Technology FIT, Sankt Augustin, 53754, Germany
| | - Michael Moche
- University Hospital Leipzig, Clinic for Diagnostic and Interventional Radiology, Leipzig, 04109, Germany
| |
Collapse
|
4
|
Mariappan P, Weir P, Flanagan R, Voglreiter P, Alhonnoro T, Pollari M, Moche M, Busse H, Futterer J, Portugaller HR, Sequeiros RB, Kolesnik M. GPU-based RFA simulation for minimally invasive cancer treatment of liver tumours. Int J Comput Assist Radiol Surg 2016; 12:59-68. [PMID: 27538836 DOI: 10.1007/s11548-016-1469-1] [Citation(s) in RCA: 25] [Impact Index Per Article: 2.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/12/2016] [Accepted: 08/04/2016] [Indexed: 12/13/2022]
Abstract
PURPOSE Radiofrequency ablation (RFA) is one of the most popular and well-standardized minimally invasive cancer treatments (MICT) for liver tumours, employed where surgical resection has been contraindicated. Less-experienced interventional radiologists (IRs) require an appropriate planning tool for the treatment to help avoid incomplete treatment and so reduce the tumour recurrence risk. Although a few tools are available to predict the ablation lesion geometry, the process is computationally expensive. Also, in our implementation, a few patient-specific parameters are used to improve the accuracy of the lesion prediction. METHODS Advanced heterogeneous computing using personal computers, incorporating the graphics processing unit (GPU) and the central processing unit (CPU), is proposed to predict the ablation lesion geometry. The most recent GPU technology is used to accelerate the finite element approximation of Penne's bioheat equation and a three state cell model. Patient-specific input parameters are used in the bioheat model to improve accuracy of the predicted lesion. RESULTS A fast GPU-based RFA solver is developed to predict the lesion by doing most of the computational tasks in the GPU, while reserving the CPU for concurrent tasks such as lesion extraction based on the heat deposition at each finite element node. The solver takes less than 3 min for a treatment duration of 26 min. When the model receives patient-specific input parameters, the deviation between real and predicted lesion is below 3 mm. CONCLUSION A multi-centre retrospective study indicates that the fast RFA solver is capable of providing the IR with the predicted lesion in the short time period before the intervention begins when the patient has been clinically prepared for the treatment.
Collapse
Affiliation(s)
| | - Phil Weir
- NUMA Engineering Services Ltd, Dundalk, Ireland
| | | | - Philip Voglreiter
- Institute for Computer Graphics and Vision, Graz University of Technology, Graz, Austria
| | - Tuomas Alhonnoro
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Mika Pollari
- Department of Neuroscience and Biomedical Engineering, Aalto University, Espoo, Finland
| | - Michael Moche
- Department of Diagnostic and Interventional Radiology, Leipzig University Hospital, Leipzig, Germany
| | - Harald Busse
- Department of Diagnostic and Interventional Radiology, Leipzig University Hospital, Leipzig, Germany
| | - Jurgen Futterer
- Radbound University Nijmegen Medical Center, Nijmegen, The Netherlands
| | | | | | - Marina Kolesnik
- Fraunhofer Institute for Applied Information Technology, Sankt Augustin, Germany
| |
Collapse
|
5
|
Luu HM, Klink C, Moelker A, Niessen W, van Walsum T. Quantitative evaluation of noise reduction and vesselness filters for liver vessel segmentation on abdominal CTA images. Phys Med Biol 2015; 60:3905-26. [PMID: 25909487 DOI: 10.1088/0031-9155/60/10/3905] [Citation(s) in RCA: 30] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Liver vessel segmentation in CTA images is a challenging task, especially in the case of noisy images. This paper investigates whether pre-filtering improves liver vessel segmentation in 3D CTA images. We introduce a quantitative evaluation of several well-known filters based on a proposed liver vessel segmentation method on CTA images. We compare the effect of different diffusion techniques i.e. Regularized Perona-Malik, Hybrid Diffusion with Continuous Switch and Vessel Enhancing Diffusion as well as the vesselness approaches proposed by Sato, Frangi and Erdt. Liver vessel segmentation of the pre-processed images is performed using a histogram-based region grown with local maxima as seed points. Quantitative measurements (sensitivity, specificity and accuracy) are determined based on manual landmarks inside and outside the vessels, followed by T-tests for statistic comparisons on 51 clinical CTA images. The evaluation demonstrates that all the filters make liver vessel segmentation have a significantly higher accuracy than without using a filter (p < 0.05); Hybrid Diffusion with Continuous Switch achieves the best performance. Compared to the diffusion filters, vesselness filters have a greater sensitivity but less specificity. In addition, the proposed liver vessel segmentation method with pre-filtering is shown to perform robustly on a clinical dataset having a low contrast-to-noise of up to 3 (dB). The results indicate that the pre-filtering step significantly improves liver vessel segmentation on 3D CTA images.
Collapse
Affiliation(s)
- Ha Manh Luu
- Biomedical Imaging Group Rotterdam, Departments of Radiology and Medical Informatics, Erasmus MC, Dr. Molewaterplein 50/60, Rotterdam, The Netherlands
| | | | | | | | | |
Collapse
|
6
|
Marcan M, Pavliha D, Music MM, Fuckan I, Magjarevic R, Miklavcic D. Segmentation of hepatic vessels from MRI images for planning of electroporation-based treatments in the liver. Radiol Oncol 2014; 48:267-81. [PMID: 25177241 PMCID: PMC4110083 DOI: 10.2478/raon-2014-0022] [Citation(s) in RCA: 26] [Impact Index Per Article: 2.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/09/2014] [Accepted: 04/10/2014] [Indexed: 12/11/2022] Open
Abstract
INTRODUCTION Electroporation-based treatments rely on increasing the permeability of the cell membrane by high voltage electric pulses delivered to tissue via electrodes. To ensure that the whole tumor is covered by the sufficiently high electric field, accurate numerical models are built based on individual patient geometry. For the purpose of reconstruction of hepatic vessels from MRI images we searched for an optimal segmentation method that would meet the following initial criteria: identify major hepatic vessels, be robust and work with minimal user input. MATERIALS AND METHODS We tested the approaches based on vessel enhancement filtering, thresholding, and their combination in local thresholding. The methods were evaluated on a phantom and clinical data. RESULTS Results show that thresholding based on variance minimization provides less error than the one based on entropy maximization. Best results were achieved by performing local thresholding of the original de-biased image in the regions of interest which were determined through previous vessel-enhancement filtering. In evaluation on clinical cases the proposed method scored in average sensitivity of 93.68%, average symmetric surface distance of 0.89 mm and Hausdorff distance of 4.04 mm. CONCLUSIONS The proposed method to segment hepatic vessels from MRI images based on local thresholding meets all the initial criteria set at the beginning of the study and necessary to be used in treatment planning of electroporation-based treatments: it identifies the major vessels, provides results with consistent accuracy and works completely automatically. Whether the achieved accuracy is acceptable or not for treatment planning models remains to be verified through numerical modeling of effects of the segmentation error on the distribution of the electric field.
Collapse
Affiliation(s)
- Marija Marcan
- University of Ljubljana, Faculty of Electrical Engineering, Ljubljana, Slovenia
| | - Denis Pavliha
- University of Ljubljana, Faculty of Electrical Engineering, Ljubljana, Slovenia
| | | | - Igor Fuckan
- Clinical Department for Diagnostic and Interventional Radiology, Clinical Hospital “Dubrava”, Zagreb, Croatia
| | - Ratko Magjarevic
- University of Zagreb, Faculty of Electrical Engineering and Computing, Zagreb, Croatia
| | - Damijan Miklavcic
- University of Ljubljana, Faculty of Electrical Engineering, Ljubljana, Slovenia
| |
Collapse
|
7
|
Seise M, Alhonnoro T, Kolesnik M. Interactive registration of 2D histology and 3D CT data for assessment of radiofrequency ablation treatment. J Pathol Inform 2012; 2:S9. [PMID: 22811965 PMCID: PMC3312715 DOI: 10.4103/2153-3539.92036] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/20/2011] [Accepted: 10/20/2011] [Indexed: 11/05/2022] Open
Abstract
Histological investigation of a lesion induced by radiofrequency ablation (RFA) treatment provides ground-truth about the true lesion size, thus verifying the success or failure of the RFA treatment. This work presents a framework for registration of two-dimensional large-scale histological sections and three-dimensional CT data typically used to guide the RFA intervention. The focus is on the developed interactive methods for reconstruction of the histological volume data by fusion of histological and high-resolution CT (MicroCT) data and registration into CT data based on natural feature points. The framework is evaluated using RFA interventions in a porcine liver and applying medically relevant metrics. The results of registration are within clinically required precision targets; thus the developed methods are suitable for validation of the RFA treatment.
Collapse
Affiliation(s)
- Matthias Seise
- Fraunhofer Institute for Applied Information Technology, D-53754 Schloss Birlinghoven, Germany
| | | | | |
Collapse
|
8
|
Manh Luu H, Moelker A, Klink C, Mendrik A, Niessen W, van Walsum T. Evaluation of Diffusion Filters for 3D CTA Liver Vessel Enhancement. LECTURE NOTES IN COMPUTER SCIENCE 2012. [DOI: 10.1007/978-3-642-33612-6_18] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 01/21/2023]
|
9
|
Payne S, Flanagan R, Pollari M, Alhonnoro T, Bost C, O'Neill D, Peng T, Stiegler P. Image-based multi-scale modelling and validation of radio-frequency ablation in liver tumours. PHILOSOPHICAL TRANSACTIONS. SERIES A, MATHEMATICAL, PHYSICAL, AND ENGINEERING SCIENCES 2011; 369:4233-4254. [PMID: 21969674 DOI: 10.1098/rsta.2011.0240] [Citation(s) in RCA: 27] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/31/2023]
Abstract
The treatment of cancerous tumours in the liver remains clinically challenging, despite the wide range of treatment possibilities, including radio-frequency ablation (RFA), high-intensity focused ultrasound and resection, which are currently available. Each has its own advantages and disadvantages. For non- or minimally invasive modalities, such as RFA, considered here, it is difficult to monitor the treatment in vivo. This is particularly problematic in the liver, where large blood vessels act as heat sinks, dissipating delivered heat and shrinking the size of the lesion (the volume damaged by the heat treatment) locally; considerable experience is needed on the part of the clinician to optimize the heat treatment to prevent recurrence. In this paper, we outline our work towards developing a simulation tool kit that could be used both to optimize treatment protocols in advance and to train the less-experienced clinicians for RFA treatment of liver tumours. This tool is based on a comprehensive mathematical model of bio-heat transfer and cell death. We show how simulations of ablations in two pigs, based on individualized imaging data, compare directly with experimentally measured lesion sizes and discuss the likely sources of error and routes towards clinical implementation. This is the first time that such a 'loop' of mathematical modelling and experimental validation in vivo has been performed in this context, and such validation enables us to make quantitative estimates of error.
Collapse
Affiliation(s)
- Stephen Payne
- Department of Engineering Science, Institute of Biomedical Engineering, University of Oxford, Oxford OX1 3PJ, UK.
| | | | | | | | | | | | | | | |
Collapse
|