1
|
Marinov Z, Jager PF, Egger J, Kleesiek J, Stiefelhagen R. Deep Interactive Segmentation of Medical Images: A Systematic Review and Taxonomy. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2024; 46:10998-11018. [PMID: 39213271 DOI: 10.1109/tpami.2024.3452629] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/04/2024]
Abstract
Interactive segmentation is a crucial research area in medical image analysis aiming to boost the efficiency of costly annotations by incorporating human feedback. This feedback takes the form of clicks, scribbles, or masks and allows for iterative refinement of the model output so as to efficiently guide the system towards the desired behavior. In recent years, deep learning-based approaches have propelled results to a new level causing a rapid growth in the field with 121 methods proposed in the medical imaging domain alone. In this review, we provide a structured overview of this emerging field featuring a comprehensive taxonomy, a systematic review of existing methods, and an in-depth analysis of current practices. Based on these contributions, we discuss the challenges and opportunities in the field. For instance, we find that there is a severe lack of comparison across methods which needs to be tackled by standardized baselines and benchmarks.
Collapse
|
2
|
Torres HR, Oliveira B, Fritze A, Birdir C, Rudiger M, Fonseca JC, Morais P, Vilaca JL. Deep-DM: Deep-Driven Deformable Model for 3D Image Segmentation Using Limited Data. IEEE J Biomed Health Inform 2024; 28:7287-7299. [PMID: 39110559 DOI: 10.1109/jbhi.2024.3440171] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 03/05/2025]
Abstract
Objective - Medical image segmentation is essential for several clinical tasks, including diagnosis, surgical and treatment planning, and image-guided interventions. Deep Learning (DL) methods have become the state-of-the-art for several image segmentation scenarios. However, a large and well-annotated dataset is required to effectively train a DL model, which is usually difficult to obtain in clinical practice, especially for 3D images. Methods - In this paper, we proposed Deep-DM, a learning-guided deformable model framework for 3D medical imaging segmentation using limited training data. In the proposed method, an energy function is learned by a Convolutional Neural Network (CNN) and integrated into an explicit deformable model to drive the evolution of an initial surface towards the object to segment. Specifically, the learning-based energy function is iteratively retrieved from localized anatomical representations of the image containing the image information around the evolving surface at each iteration. By focusing on localized regions of interest, this representation excludes irrelevant image information, facilitating the learning process. Results and conclusion - The performance of the proposed method is demonstrated for the tasks of left ventricle and fetal head segmentation in ultrasound, left atrium segmentation in Magnetic Resonance, and bladder segmentation in Computed Tomography, using different numbers of training volumes in each study. The results obtained showed the feasibility of the proposed method to segment different anatomical structures in different imaging modalities. Moreover, the results also showed that the proposed approach is less dependent on the size of the training dataset in comparison with state-of-the-art DL-based segmentation methods, outperforming them for all tasks when a low number of samples is available. Significance - Overall, by offering a more robust and less data-intensive approach to accurately segmenting anatomical structures, the proposed method has the potential to enhance clinical tasks that require image segmentation strategies.
Collapse
|
3
|
Akbari S, Tabassian M, Pedrosa J, Queiros S, Papangelopoulou K, D'hooge J. BEAS-Net: A Shape-Prior-Based Deep Convolutional Neural Network for Robust Left Ventricular Segmentation in 2-D Echocardiography. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2024; 71:1565-1576. [PMID: 38913532 DOI: 10.1109/tuffc.2024.3418030] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/26/2024]
Abstract
Left ventricle (LV) segmentation of 2-D echocardiography images is an essential step in the analysis of cardiac morphology and function and-more generally-diagnosis of cardiovascular diseases (CVD). Several deep learning (DL) algorithms have recently been proposed for the automatic segmentation of the LV, showing significant performance improvement over the traditional segmentation algorithms. However, unlike the traditional methods, prior information about the segmentation problem, e.g., anatomical shape information, is not usually incorporated for training the DL algorithms. This can degrade the generalization performance of the DL models on unseen images if their characteristics are somewhat different from those of the training images, e.g., low-quality testing images. In this study, a new shape-constrained deep convolutional neural network (CNN)-called B-spline explicit active surface (BEAS)-Net-is introduced for automatic LV segmentation. The BEAS-Net learns how to associate the image features, encoded by its convolutional layers, with anatomical shape-prior information derived by the BEAS algorithm to generate physiologically meaningful segmentation contours when dealing with artifactual or low-quality images. The performance of the proposed network was evaluated using three different in vivo datasets and was compared with a deep segmentation algorithm based on the U-Net model. Both the networks yielded comparable results when tested on images of acceptable quality, but the BEAS-Net outperformed the benchmark DL model on artifactual and low-quality images.
Collapse
|
4
|
Freitas J, Gomes-Fonseca J, Tonelli AC, Correia-Pinto J, Fonseca JC, Queirós S. Automatic multi-view pose estimation in focused cardiac ultrasound. Med Image Anal 2024; 94:103146. [PMID: 38537416 DOI: 10.1016/j.media.2024.103146] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 06/13/2023] [Revised: 03/18/2024] [Accepted: 03/19/2024] [Indexed: 04/16/2024]
Abstract
Focused cardiac ultrasound (FoCUS) is a valuable point-of-care method for evaluating cardiovascular structures and function, but its scope is limited by equipment and operator's experience, resulting in primarily qualitative 2D exams. This study presents a novel framework to automatically estimate the 3D spatial relationship between standard FoCUS views. The proposed framework uses a multi-view U-Net-like fully convolutional neural network to regress line-based heatmaps representing the most likely areas of intersection between input images. The lines that best fit the regressed heatmaps are then extracted, and a system of nonlinear equations based on the intersection between view triplets is created and solved to determine the relative 3D pose between all input images. The feasibility and accuracy of the proposed pipeline were validated using a novel realistic in silico FoCUS dataset, demonstrating promising results. Interestingly, as shown in preliminary experiments, the estimation of the 2D images' relative poses enables the application of 3D image analysis methods and paves the way for 3D quantitative assessments in FoCUS examinations.
Collapse
Affiliation(s)
- João Freitas
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal
| | - João Gomes-Fonseca
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal
| | | | - Jorge Correia-Pinto
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; Department of Pediatric Surgery, Hospital de Braga, Braga, Portugal
| | - Jaime C Fonseca
- Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal
| | - Sandro Queirós
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, Braga, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal.
| |
Collapse
|
5
|
Guo Z, Zhang Y, Qiu Z, Dong S, He S, Gao H, Zhang J, Chen Y, He B, Kong Z, Qiu Z, Li Y, Li C. An improved contrastive learning network for semi-supervised multi-structure segmentation in echocardiography. Front Cardiovasc Med 2023; 10:1266260. [PMID: 37808878 PMCID: PMC10556699 DOI: 10.3389/fcvm.2023.1266260] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/25/2023] [Accepted: 09/12/2023] [Indexed: 10/10/2023] Open
Abstract
Cardiac diseases have high mortality rates and are a significant threat to human health. Echocardiography is a commonly used imaging technique to diagnose cardiac diseases because of its portability, non-invasiveness and low cost. Precise segmentation of basic cardiac structures is crucial for cardiologists to efficiently diagnose cardiac diseases, but this task is challenging due to several reasons, such as: (1) low image contrast, (2) incomplete structures of cardiac, and (3) unclear border between the ventricle and the atrium in some echocardiographic images. In this paper, we applied contrastive learning strategy and proposed a semi-supervised method for echocardiographic images segmentation. This proposed method solved the above challenges effectively and made use of unlabeled data to achieve a great performance, which could help doctors improve the accuracy of CVD diagnosis and screening. We evaluated this method on a public dataset (CAMUS), achieving mean Dice Similarity Coefficient (DSC) of 0.898, 0.911, 0.916 with 1/4, 1/2 and full labeled data on two-chamber (2CH) echocardiography images, and of 0.903, 0.921, 0.928 with 1/4, 1/2 and full labeled data on four-chamber (4CH) echocardiography images. Compared with other existing methods, the proposed method had fewer parameters and better performance. The code and models are available at https://github.com/gpgzy/CL-Cardiac-segmentation.
Collapse
Affiliation(s)
- Ziyu Guo
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Yuting Zhang
- School of Computer Science, University of Birmingham, Birmingham, United Kingdom
| | - Zishan Qiu
- College of Art and Science, New York University Shanghai, Shanghai, China
| | - Suyu Dong
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Shan He
- School of Computer Science, University of Birmingham, Birmingham, United Kingdom
| | - Huan Gao
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Jinao Zhang
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Yingtao Chen
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Bingtao He
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Zhe Kong
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Zhaowen Qiu
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Yan Li
- College of Computer and Control Engineering, Northeast Forestry University, Harbin, China
| | - Caijuan Li
- Department of Medical Ultrasonics, Hongqi Hospital of Mudanjiang Medical University, Mudanjiang, China
| |
Collapse
|
6
|
Dietenbeck T, Bouaou K, Houriez-Gombaud-Saintonge S, Guo J, Gencer U, Charpentier E, Giron A, De Cesare A, Nguyen V, Gallo A, Boussouar S, Pasi N, Soulat G, Redheuil A, Mousseaux E, Kachenoura N. Value of aortic volumes assessed by automated segmentation of 3D MRI data in patients with thoracic aortic dilatation: A case-control study. Diagn Interv Imaging 2023; 104:419-426. [PMID: 37105782 DOI: 10.1016/j.diii.2023.04.004] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/27/2022] [Revised: 04/04/2023] [Accepted: 04/11/2023] [Indexed: 04/29/2023]
Abstract
PURPOSE The purpose of this study was to investigate the benefit of aortic volumes compared to diameters or cross-sectional areas on three-dimensional (3D) magnetic resonance imaging (MRI) in discriminating between patients with dilated aorta and matched controls. MATERIALS AND METHODS Sixty-two patients (47 men and 15 women; median age, 66 years; age range: 33-86 years) with tricuspid aortic valve and ascending thoracic aorta aneurysm (TAV-ATAA) and 43 patients (35 men and 8 women; median age, 51 years; age range: 17-76 years) with bicuspid aortic valve and dilated ascending aorta (BAV) were studied. One group of 54 controls matched for age and sex to patients with TAV-ATAA (39 men and 15 women; median age, 68 years; age range: 33-81 years) and one group of 42 controls matched for age and sex to patients with BAV (34 men and 8 women; median age, 50 years; age range: 17-77 years) were identified. All participants underwent 3D MRI, used for 3D-segmentation for measuring aortic length, maximal diameter, maximal cross-sectional area (CSA) and volume for the ascending aorta. RESULTS An increase in ascending aorta volume (TAV-ATAA: +107%; BAV: +171% vs. controls; P < 0.001) was found, which was three times greater than the increase in diameter (TAV-ATAA: +29%; BAV: +40% vs. controls; P < 0.001). In differentiating patients with TAV-ATAA from their controls, the indexed ascending aorta volume showed better performances (AUC, 0.935 [95% confidence interval (CI): 0.882-0.989]; accuracy, 88.7% [95% CI: 82.9-94.5]) than indexed ascending aorta length (P < 0.001), indexed ascending aorta maximal diameter (P = 0.003) and indexed ascending aorta maximal CSA (P = 0.03). In differentiating patients with BAV from matched controls, indexed ascending aorta volume showed significantly better performances performance (AUC, 0.908 [95% CI: 0.829-0.987]; accuracy, 88.0% [95% CI: 80.9-95.0]) than indexed ascending aorta length (P = 0.02) and not different from indexed ascending aorta maximal diameter (P = 0.07) or from indexed ascending aorta maximal CSA (P = 0.27) CONCLUSION: Aortic volume measured by 3D-MRI integrates both elongation and luminal dilatation, resulting in greater classification performance than maximal diameter and length in differentiating patients with dilated ascending aorta or aneurysm from controls.
Collapse
Affiliation(s)
- Thomas Dietenbeck
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France.
| | - Kevin Bouaou
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France
| | - Sophia Houriez-Gombaud-Saintonge
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France; ESME Sudria Research Lab, 75006 Paris, France
| | - Jia Guo
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France
| | - Umit Gencer
- Université Paris Cité, PARCC, INSERM, 75015 Paris, France; Department of Radiology, Hôpital Européen Georges Pompidou, Assistance Publique Hôpitaux de Paris, 75015 Paris, France
| | - Etienne Charpentier
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France; Department of Cardiothoracic Imaging, Sorbonne Université, AP-HP, Groupe Hospitalier Pitié-Salpêtrière, 75013 Paris, France
| | - Alain Giron
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France
| | - Alain De Cesare
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France
| | - Vincent Nguyen
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France
| | - Antonio Gallo
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France
| | - Samia Boussouar
- Department of Cardiothoracic Imaging, Sorbonne Université, AP-HP, Groupe Hospitalier Pitié-Salpêtrière, 75013 Paris, France
| | - Nicoletta Pasi
- Department of Cardiothoracic Imaging, Sorbonne Université, AP-HP, Groupe Hospitalier Pitié-Salpêtrière, 75013 Paris, France
| | - Gilles Soulat
- Université Paris Cité, PARCC, INSERM, 75015 Paris, France; Department of Radiology, Hôpital Européen Georges Pompidou, Assistance Publique Hôpitaux de Paris, 75015 Paris, France
| | - Alban Redheuil
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France; Department of Cardiothoracic Imaging, Sorbonne Université, AP-HP, Groupe Hospitalier Pitié-Salpêtrière, 75013 Paris, France
| | - Elie Mousseaux
- Université Paris Cité, PARCC, INSERM, 75015 Paris, France; Department of Radiology, Hôpital Européen Georges Pompidou, Assistance Publique Hôpitaux de Paris, 75015 Paris, France
| | - Nadjia Kachenoura
- Sorbonne Université, CNRS, INSERM, Laboratoire d'Imagerie Biomédicale, LIB, 75006 Paris, France; Institute of Cardiometabolism and Nutrition (ICAN), 75013 Paris, France
| |
Collapse
|
7
|
Wei H, Ma J, Zhou Y, Xue W, Ni D. Co-learning of appearance and shape for precise ejection fraction estimation from echocardiographic sequences. Med Image Anal 2023; 84:102686. [PMID: 36455332 DOI: 10.1016/j.media.2022.102686] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/23/2021] [Revised: 10/31/2022] [Accepted: 11/07/2022] [Indexed: 11/17/2022]
Abstract
Accurate estimation of ejection fraction (EF) from echocardiography is of great importance for evaluation of cardiac function. It is usually obtained by the Simpson's bi-plane method based on the segmentation of the left ventricle (LV) in two keyframes. However, obtaining accurate EF estimation from echocardiography is challenging due to (1) noisy appearance in ultrasound images, (2) temporal dynamic movement of myocardium, (3) sparse annotation of the full sequence, and (4) potential quality degradation during scanning. In this paper, we propose a multi-task semi-supervised framework, which is denoted as MCLAS, for precise EF estimation from echocardiographic sequences of two cardiac views. Specifically, we first propose a co-learning mechanism to explore the mutual benefits of cardiac segmentation and myocardium tracking iteratively on appearance level and shape level, therefore alleviating the noisy appearance and enforcing the temporal consistency of the segmentation results. This temporal consistency, as shown in our work, is critical for precise EF estimation. Then we propose two auxiliary tasks for the encoder, (1) view classification to help extract the discriminative features of each view, and automatize the whole pipeline of EF estimation in clinical practice, and (2) EF regression to help regularize the spatiotemporal embedding of the echocardiographic sequence. Both two auxiliary tasks can improve the segmentation-based EF prediction, especially for sequences of poor quality. Our method is capable of automating the whole pipeline of EF estimation, from view identification, cardiac structures segmentation to EF calculation. The effectiveness of our method is validated in aspects of segmentation, tracking, consistency analysis, and clinical parameters estimation. When compared with existing methods, our method shows obvious superiority for LV volumes on ED and ES phases, and EF estimation, with Pearson correlation of 0.975, 0.983 and 0.946, respectively. This is a significant improvement for echocardiography-based EF estimation and improves the potential of automated EF estimation in clinical practice. Besides, our method can obtain accurate and temporal-consistent segmentation for the in-between frames, which enables it for cardiac dynamic function evaluation.
Collapse
Affiliation(s)
- Hongrong Wei
- School of Biomedical Engineering, Health Science Center, Shenzhen University, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, China; Medical Ultrasound Image Computing (MUSIC) Lab, Shenzhen University, China
| | - Junqiang Ma
- School of Biomedical Engineering, Health Science Center, Shenzhen University, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, China; Medical Ultrasound Image Computing (MUSIC) Lab, Shenzhen University, China
| | - Yongjin Zhou
- School of Biomedical Engineering, Health Science Center, Shenzhen University, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, China
| | - Wufeng Xue
- School of Biomedical Engineering, Health Science Center, Shenzhen University, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, China; Medical Ultrasound Image Computing (MUSIC) Lab, Shenzhen University, China.
| | - Dong Ni
- School of Biomedical Engineering, Health Science Center, Shenzhen University, China; National-Regional Key Technology Engineering Laboratory for Medical Ultrasound, Guangdong Key Laboratory for Biomedical Measurements and Ultrasound Imaging, China; Medical Ultrasound Image Computing (MUSIC) Lab, Shenzhen University, China.
| |
Collapse
|
8
|
Li FY, Li W, Gao X, Xiao B. A Novel Framework with Weighted Decision Map Based on Convolutional Neural Network for Cardiac MR Segmentation. IEEE J Biomed Health Inform 2021; 26:2228-2239. [PMID: 34851840 DOI: 10.1109/jbhi.2021.3131758] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
For diagnosing cardiovascular disease, an accurate segmentation method is needed. There are several unre-solved issues in the complex field of cardiac magnetic resonance imaging, some of which have been partially addressed by using deep neural networks. To solve two problems of over-segmentation and under-segmentation of anatomical shapes in the short-axis view from different cardiac magnetic resonance sequences, we propose a novel two-stage framework with a weighted decision map based on convolutional neural networks to segment the myocardium (Myo), left ventricle (LV), and right ventricle (RV) simultaneously. The framework comprises a deci-sion map extractor and a cardiac segmenter. A cascaded U-Net++ is used as a decision map extractor to acquire the decision map that decides the category of each pixel. Cardiac segmenter is a multiscale dual-path feature ag-gregation network (MDFA-Net) which consists of a densely connected network and an asymmetric encoding and decoding network. The input to the cardiac seg-menter is derived from processed original images weighted by the output of the decision map extractor. We conducted experiments on two datasets of mul-ti-sequence cardiac magnetic resonance segmentation challenge 2019 (MS-CMRSeg 2019) and myocardial pa-thology segmentation challenge 2020 (MyoPS 2020). Test results obtained on MyoPS 2020 show that proposed method with average Dice coefficient of 84.70%, 86.00% and 86.31% in the segmentation task of Myo, LV, and RV, respectively.
Collapse
|
9
|
Abd Elaziz M, Lu S, He S. A multi-leader whale optimization algorithm for global optimization and image segmentation. EXPERT SYSTEMS WITH APPLICATIONS 2021; 175:114841. [DOI: 10.1016/j.eswa.2021.114841] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/02/2023]
|
10
|
Nazir A, Cheema MN, Sheng B, Li P, Kim J, Lee TY. Living Donor-Recipient Pair Matching for Liver Transplant via Ternary Tree Representation With Cascade Incremental Learning. IEEE Trans Biomed Eng 2021; 68:2540-2551. [PMID: 33417536 DOI: 10.1109/tbme.2021.3050310] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022]
Abstract
Visual understanding of liver vessels anatomy between the living donor-recipient (LDR) pair can assist surgeons to optimize transplant planning by avoiding non-targeted arteries which can cause severe complications. We propose to visually analyze the anatomical variants of the liver vessels anatomy to maximize similarity for finding a suitable Living Donor-Recipient (LDR) pair. Liver vessels are segmented from computed tomography angiography (CTA) volumes by employing a cascade incremental learning (CIL) model. Our CIL architecture is able to find optimal solutions, which we use to update the model with liver vessel CTA images. A novel ternary tree based algorithm is proposed to map all the possible liver vessel variants into their respective tree topologies. The tree topologies of the recipient's and donor's liver vessels are then used for an appropriate matching. The proposed algorithm utilizes a set of defined vessel tree variants which are updated to maintain the maximum matching options by leveraging the accurate segmentation results of the vessels derived from the incremental learning ability of the CIL. We introduce a novel concept of in-order digital string based comparison to match the geometry of two anatomically varied trees. Experiments through visual illustrations and quantitative analysis demonstrated the effectiveness of our approach compared to state-of-the-art.
Collapse
|
11
|
Jalali M, Behnam H, Shojaeifard M. Echocardiography image enhancement using texture-cartoon separation. Comput Biol Med 2021; 134:104535. [PMID: 34098242 DOI: 10.1016/j.compbiomed.2021.104535] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/12/2021] [Revised: 05/09/2021] [Accepted: 05/22/2021] [Indexed: 11/16/2022]
Abstract
Due to the speckled nature of cardiac ultrasound imaging, it is not easy to process and extract useful information directly from the acquired image. In this work, we have proposed a method to reduce the effect of speckle artifacts through the decomposition of echocardiography images into cartoon and texture components. The first component (i.e., cartoon image) contains image structures containing smooth areas and sharp edges, and the texture component is mainly composed of highly oscillating and repetitive patterns. To decompose the image into these two subcomponents, convolutional sparse coding has been utilized as a solid tool for solving the decomposition optimization function. The significant advantage of using convolutional sparse coding, compared to classical sparse coding methods, is image quality enhancement due to not using the block coding, making the classic solutions computationally feasible. The original image has been masked with the cartoon part leading to suppress speckle artifacts which result in image quality enhancement. Besides, it has been shown that using this speckle reduction scenario, considerable accuracy enhancement of the segmentation task can be achieved, compared to segmentation of the original image. Numerical results provide acceptable reasons to prove the efficiency of the proposed algorithm. Resulting echocardiography videos show a mean segmentation enhancement of 15.98 for Hausdorff distance (in pixels) and 0.0632 for the Dice similarity coefficient.
Collapse
Affiliation(s)
- Mohammad Jalali
- The Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, 1684613114, Iran
| | - Hamid Behnam
- The Department of Biomedical Engineering, School of Electrical Engineering, Iran University of Science and Technology, Tehran, 1684613114, Iran.
| | - Maryam Shojaeifard
- The Echocardiography Research Center, Rajaie Cardiovascular Medical and Research Center, Iran University of Medical Sciences, Tehran, Iran
| |
Collapse
|
12
|
A New Semi-automated Algorithm for Volumetric Segmentation of the Left Ventricle in Temporal 3D Echocardiography Sequences. Cardiovasc Eng Technol 2021; 13:55-68. [PMID: 34046844 DOI: 10.1007/s13239-021-00547-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 08/27/2020] [Accepted: 05/13/2021] [Indexed: 10/21/2022]
Abstract
PURPOSE Echocardiography is commonly used as a non-invasive imaging tool in clinical practice for the assessment of cardiac function. However, delineation of the left ventricle is challenging due to the inherent properties of ultrasound imaging, such as the presence of speckle noise and the low signal-to-noise ratio. METHODS We propose a semi-automated segmentation algorithm for the delineation of the left ventricle in temporal 3D echocardiography sequences. The method requires minimal user interaction and relies on a diffeomorphic registration approach. Advantages of the method include no dependence on prior geometrical information, training data, or registration from an atlas. RESULTS The method was evaluated using three-dimensional ultrasound scan sequences from 18 patients from the Mazankowski Alberta Heart Institute, Edmonton, Canada, and compared to manual delineations provided by an expert cardiologist and four other registration algorithms. The segmentation approach yielded the following results over the cardiac cycle: a mean absolute difference of 1.01 (0.21) mm, a Hausdorff distance of 4.41 (1.43) mm, and a Dice overlap score of 0.93 (0.02). CONCLUSION The method performed well compared to the four other registration algorithms.
Collapse
|
13
|
Kazwiny Y, Pedrosa J, Zhang Z, Boesmans W, D'hooge J, Vanden Berghe P. Extracting neuronal activity signals from microscopy recordings of contractile tissue using B-spline Explicit Active Surfaces (BEAS) cell tracking. Sci Rep 2021; 11:10937. [PMID: 34035411 PMCID: PMC8149687 DOI: 10.1038/s41598-021-90448-4] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/04/2021] [Accepted: 05/06/2021] [Indexed: 01/13/2023] Open
Abstract
Ca2+ imaging is a widely used microscopy technique to simultaneously study cellular activity in multiple cells. The desired information consists of cell-specific time series of pixel intensity values, in which the fluorescence intensity represents cellular activity. For static scenes, cellular signal extraction is straightforward, however multiple analysis challenges are present in recordings of contractile tissues, like those of the enteric nervous system (ENS). This layer of critical neurons, embedded within the muscle layers of the gut wall, shows optical overlap between neighboring neurons, intensity changes due to cell activity, and constant movement. These challenges reduce the applicability of classical segmentation techniques and traditional stack alignment and regions-of-interest (ROIs) selection workflows. Therefore, a signal extraction method capable of dealing with moving cells and is insensitive to large intensity changes in consecutive frames is needed. Here we propose a b-spline active contour method to delineate and track neuronal cell bodies based on local and global energy terms. We develop both a single as well as a double-contour approach. The latter takes advantage of the appearance of GCaMP expressing cells, and tracks the nucleus' boundaries together with the cytoplasmic contour, providing a stable delineation of neighboring, overlapping cells despite movement and intensity changes. The tracked contours can also serve as landmarks to relocate additional and manually-selected ROIs. This improves the total yield of efficacious cell tracking and allows signal extraction from other cell compartments like neuronal processes. Compared to manual delineation and other segmentation methods, the proposed method can track cells during large tissue deformations and high-intensity changes such as during neuronal firing events, while preserving the shape of the extracted Ca2+ signal. The analysis package represents a significant improvement to available Ca2+ imaging analysis workflows for ENS recordings and other systems where movement challenges traditional Ca2+ signal extraction workflows.
Collapse
Affiliation(s)
- Youcef Kazwiny
- Laboratory for Enteric NeuroScience (LENS), Translational Research Center for Gastrointestinal Disorders (TARGID), University of Leuven (KU Leuven), Leuven, Belgium
| | - João Pedrosa
- Laboratory of Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, University of Leuven (KU Leuven), Leuven, Belgium
- Institute for Systems and Computer Engineering, Technology and Science, INESC TEC, Porto, Portugal
| | - Zhiqing Zhang
- Laboratory for Enteric NeuroScience (LENS), Translational Research Center for Gastrointestinal Disorders (TARGID), University of Leuven (KU Leuven), Leuven, Belgium
| | - Werend Boesmans
- Department of Pathology, GROW-School for Oncology and Developmental Biology, Maastricht University Medical Center, Maastricht, The Netherlands
- Biomedical Research Institute (BIOMED), Hasselt University, Hasselt, Belgium
| | - Jan D'hooge
- Laboratory of Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, University of Leuven (KU Leuven), Leuven, Belgium
| | - Pieter Vanden Berghe
- Laboratory for Enteric NeuroScience (LENS), Translational Research Center for Gastrointestinal Disorders (TARGID), University of Leuven (KU Leuven), Leuven, Belgium.
| |
Collapse
|
14
|
Weitzel WF, Rajaram N, Krishnamurthy VN, Hamilton J, Thelen BJ, Zheng Y, Morgan T, Funes-Lora MA, Yessayan L, Bishop B, Shih AJ. Sono-angiography for dialysis vascular access based on the freehand 2D ultrasound scanning. J Vasc Access 2021; 23:871-876. [PMID: 33971754 DOI: 10.1177/11297298211015066] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/12/2022] Open
Abstract
INTRODUCTION Dialysis vascular access, preferably an autogenous arteriovenous fistula, remains an end stage renal disease (ESRD) patient's lifeline providing a means of connecting the patient to the dialysis machine. Once an access is created, the current gold standard of care for maintenance of vascular access is angiography and angioplasty to treat stenosis. While point of care 2D ultrasound has been used to detect access problems, we sought to reproduce angiographic results comparable to the gold standard angiogram (fistulogram) using ultrasound data acquired from a conventional 2D ultrasound scanner. METHODS A 2D ultrasound probe was used to acquire a series of cross sectional images of the vascular access including arteriovenous anastomosis of a subject with a radio-cephalic fistula. These 2D B-mode images were used for 3D vessel reconstruction by binary thresholding to categorize vascular versus non-vascular structures followed by standard image segmentation to select the structure representative of dialysis vascular access and morphologic filtering. Image processing was done using open source Python Software. RESULTS The open source software was able to: (1) view the gold standard fistulogram images, (2) reconstruct 2D planar images of the fistula from ultrasound data as viewed from the top, analogous to computerized tomography images, and (3) construct a 2D representation of vascular access similar to the angiogram. CONCLUSION We present a simple approach to obtain an angiogram-like representation of the vascular access from readily available, non-proprietary 2D ultrasound data in the point of care setting. While the sono-angiogram is not intended to replace angiography, it may be useful in providing 3D imaging at the point of care in the dialysis unit, outpatient clinic, or for pre-operative planning for interventional procedures. Future work will focus on improving the robustness and quality of the imaging data while preserving the straightforward freehand approach used for ultrasound data acquisition.
Collapse
Affiliation(s)
- William F Weitzel
- VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Internal Medicine, University of Michigan, Ann Arbor, MI, USA
| | - Nirmala Rajaram
- VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Psychiatry, University of Michigan, Ann Arbor, MI, USA
| | - Venkataramu N Krishnamurthy
- VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Departments of Radiology and Surgery, University of Michigan, Ann Arbor, MI, USA
| | - James Hamilton
- VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Emerge Now Inc., Los Angeles, CA, USA
| | - Brian J Thelen
- VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Statistics, University of Michigan, Ann Arbor, MI, USA.,Michigan Tech Research Institute, Michigan Technological University, Ann Arbor, MI, USA
| | - Yihao Zheng
- VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Mechanical Engineering, Worcester Polytechnic Institute, Worcester, MA, USA
| | | | | | - Lenar Yessayan
- VA Ann Arbor Healthcare System, Ann Arbor, MI, USA.,Department of Internal Medicine, University of Michigan, Ann Arbor, MI, USA
| | | | - Albert J Shih
- Department of Mechanical Engineering, University of Michigan, Ann Arbor, MI, USA
| |
Collapse
|
15
|
Torres HR, Queiros S, Morais P, Oliveira B, Gomes-Fonseca J, Mota P, Lima E, D'Hooge J, Fonseca JC, Vilaca JL. Kidney Segmentation in 3-D Ultrasound Images Using a Fast Phase-Based Approach. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2021; 68:1521-1531. [PMID: 33211657 DOI: 10.1109/tuffc.2020.3039334] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/11/2023]
Abstract
Renal ultrasound (US) imaging is the primary imaging modality for the assessment of the kidney's condition and is essential for diagnosis, treatment and surgical intervention planning, and follow-up. In this regard, kidney delineation in 3-D US images represents a relevant and challenging task in clinical practice. In this article, a novel framework is proposed to accurately segment the kidney in 3-D US images. The proposed framework can be divided into two stages: 1) initialization of the segmentation method and 2) kidney segmentation. Within the initialization stage, a phase-based feature detection method is used to detect edge points at kidney boundaries, from which the segmentation is automatically initialized. In the segmentation stage, the B-spline explicit active surface framework is adapted to obtain the final kidney contour. Here, a novel hybrid energy functional that combines localized region- and edge-based terms is used during segmentation. For the edge term, a fast-signed phase-based detection approach is applied. The proposed framework was validated in two distinct data sets: 1) 15 3-D challenging poor-quality US images used for experimental development, parameters assessment, and evaluation and 2) 42 3-D US images (both healthy and pathologic kidneys) used to unbiasedly assess its accuracy. Overall, the proposed method achieved a Dice overlap around 81% and an average point-to-surface error of ~2.8 mm. These results demonstrate the potential of the proposed method for clinical usage.
Collapse
|
16
|
Arafati A, Morisawa D, Avendi MR, Amini MR, Assadi RA, Jafarkhani H, Kheradvar A. Generalizable fully automated multi-label segmentation of four-chamber view echocardiograms based on deep convolutional adversarial networks. J R Soc Interface 2020; 17:20200267. [PMID: 32811299 PMCID: PMC7482559 DOI: 10.1098/rsif.2020.0267] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2020] [Accepted: 07/27/2020] [Indexed: 11/12/2022] Open
Abstract
A major issue in translation of the artificial intelligence platforms for automatic segmentation of echocardiograms to clinics is their generalizability. The present study introduces and verifies a novel generalizable and efficient fully automatic multi-label segmentation method for four-chamber view echocardiograms based on deep fully convolutional networks (FCNs) and adversarial training. For the first time, we used generative adversarial networks for pixel classification training, a novel method in machine learning not currently used for cardiac imaging, to overcome the generalization problem. The method's performance was validated against manual segmentations as the ground-truth. Furthermore, to verify our method's generalizability in comparison with other existing techniques, we compared our method's performance with a state-of-the-art method on our dataset in addition to an independent dataset of 450 patients from the CAMUS (cardiac acquisitions for multi-structure ultrasound segmentation) challenge. On our test dataset, automatic segmentation of all four chambers achieved a dice metric of 92.1%, 86.3%, 89.6% and 91.4% for LV, RV, LA and RA, respectively. LV volumes' correlation between automatic and manual segmentation were 0.94 and 0.93 for end-diastolic volume and end-systolic volume, respectively. Excellent agreement with chambers' reference contours and significant improvement over previous FCN-based methods suggest that generative adversarial networks for pixel classification training can effectively design generalizable fully automatic FCN-based networks for four-chamber segmentation of echocardiograms even with limited number of training data.
Collapse
Affiliation(s)
- Arghavan Arafati
- The Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, 2410 Engineering Hall, Irvine, CA 92697-2730, USA
| | - Daisuke Morisawa
- The Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, 2410 Engineering Hall, Irvine, CA 92697-2730, USA
| | - Michael R. Avendi
- The Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, 2410 Engineering Hall, Irvine, CA 92697-2730, USA
- Center for Pervasive Communications and Computing, University of California, 4217 Engineering Hall, Irvine, CA 92697-2700, USA
| | - M. Reza Amini
- Loma Linda University Medical Center, Loma Linda, CA 92354, USA
| | - Ramin A. Assadi
- Division of Cardiology, David Geffen School of Medicine at UCLA, Los Angeles, CA 90095, USA
| | - Hamid Jafarkhani
- Center for Pervasive Communications and Computing, University of California, 4217 Engineering Hall, Irvine, CA 92697-2700, USA
| | - Arash Kheradvar
- The Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, 2410 Engineering Hall, Irvine, CA 92697-2730, USA
| |
Collapse
|
17
|
van Knippenberg L, van Sloun RJG, Shulepov S, Bouwman RA, Mischi M. An Angle-Independent Cross-Sectional Doppler Method for Flow Estimation in the Common Carotid Artery. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2020; 67:1513-1524. [PMID: 32086206 DOI: 10.1109/tuffc.2020.2975315] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/10/2023]
Abstract
The Doppler ultrasound is the most common technique for noninvasive quantification of blood flow, which, in turn, is of major clinical importance for the assessment of the cardiovascular condition. In this article, a method is proposed in which the vessel is imaged in the short axis, which has the advantage of capturing the whole flow profile while measuring the vessel area simultaneously. This view is easier to obtain than the longitudinal image that is currently used in flow velocity estimation, reducing operator dependence. However, the Doppler angle in cross-sectional images is unknown since the vessel wall can no longer be used to estimate the flow direction. The proposed method to estimate the Doppler angle in these images is based on the elliptical intersection between a cylindrical vessel and the ultrasound plane. The parameters of this ellipse (major axis, minor axis, and rotation) are used to estimate the Doppler angle by solving a least-squares problem. Theoretical feasibility was shown in a geometrical model, after which the Doppler angle was estimated in simulated ultrasound images generated in Field II, yielding a mean error within 4°. In vitro, across 15 short-axis measurements with a wide variety of Doppler angles, errors in the flow estimates were below 10%, and in vivo, the average velocities in systole obtained from longitudinal ( v=69.1 cm/s) and cross-sectional ( v=66.5 cm/s) acquisitions were in agreement. Further research is required to validate these results on a larger population.
Collapse
|
18
|
3D Segmentation Algorithms for Computerized Tomographic Imaging: a Systematic Literature Review. J Digit Imaging 2019; 31:799-850. [PMID: 29915942 DOI: 10.1007/s10278-018-0101-z] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/07/2023] Open
Abstract
This paper presents a systematic literature review concerning 3D segmentation algorithms for computerized tomographic imaging. This analysis covers articles published in the range 2006-March 2018 found in four scientific databases (Science Direct, IEEEXplore, ACM, and PubMed), using the methodology for systematic review proposed by Kitchenham. We present the analyzed segmentation methods categorized according to its application, algorithmic strategy, validation, and use of prior knowledge, as well as its general conceptual description. Additionally, we present a general overview, discussions, and further prospects for the 3D segmentation methods applied for tomographic images.
Collapse
|
19
|
Arafati A, Hu P, Finn JP, Rickers C, Cheng AL, Jafarkhani H, Kheradvar A. Artificial intelligence in pediatric and adult congenital cardiac MRI: an unmet clinical need. Cardiovasc Diagn Ther 2019; 9:S310-S325. [PMID: 31737539 PMCID: PMC6837938 DOI: 10.21037/cdt.2019.06.09] [Citation(s) in RCA: 21] [Impact Index Per Article: 3.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/30/2019] [Accepted: 06/03/2019] [Indexed: 01/09/2023]
Abstract
Cardiac MRI (CMR) allows non-invasive, non-ionizing assessment of cardiac function and anatomy in patients with congenital heart disease (CHD). The utility of CMR as a non-invasive imaging tool for evaluation of CHD have been growing exponentially over the past decade. The algorithms based on artificial intelligence (AI), and in particular, deep learning, have rapidly become a methodology of choice for analyzing CMR. A wide range of applications for AI have been developed to tackle challenges in various aspects of CMR, and significant advances have also been made from image acquisition to image analysis and diagnosis. We include an overview of AI definitions, different architectures, and details on well-known methods. This paper reviews the major deep learning concepts used for analyses of patients with CHD. In the end, we have summarized a list of open challenges and concerns to be considered for future studies.
Collapse
Affiliation(s)
- Arghavan Arafati
- The Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, Irvine, CA, USA
| | - Peng Hu
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - J. Paul Finn
- Department of Radiological Sciences, David Geffen School of Medicine at UCLA, Los Angeles, CA, USA
| | - Carsten Rickers
- University Heart Center, Adult with Congenital Heart Disease Unit, University Hospital Hamburg-Eppendorf, Hamburg, Germany
| | - Andrew L. Cheng
- Department of Pediatrics, Keck School of Medicine, University of Southern California, Los Angeles, CA, USA
- Division of Pediatric Cardiology, Children’s Hospital, Los Angeles, CA, USA
| | - Hamid Jafarkhani
- Center for Pervasive Communications and Computing, University of California, Irvine, CA, USA
| | - Arash Kheradvar
- The Edwards Lifesciences Center for Advanced Cardiovascular Technology, University of California, Irvine, CA, USA
| |
Collapse
|
20
|
Leclerc S, Smistad E, Pedrosa J, Ostvik A, Cervenansky F, Espinosa F, Espeland T, Berg EAR, Jodoin PM, Grenier T, Lartizien C, Dhooge J, Lovstakken L, Bernard O. Deep Learning for Segmentation Using an Open Large-Scale Dataset in 2D Echocardiography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2019; 38:2198-2210. [PMID: 30802851 DOI: 10.1109/tmi.2019.2900516] [Citation(s) in RCA: 223] [Impact Index Per Article: 37.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Delineation of the cardiac structures from 2D echocardiographic images is a common clinical task to establish a diagnosis. Over the past decades, the automation of this task has been the subject of intense research. In this paper, we evaluate how far the state-of-the-art encoder-decoder deep convolutional neural network methods can go at assessing 2D echocardiographic images, i.e., segmenting cardiac structures and estimating clinical indices, on a dataset, especially, designed to answer this objective. We, therefore, introduce the cardiac acquisitions for multi-structure ultrasound segmentation dataset, the largest publicly-available and fully-annotated dataset for the purpose of echocardiographic assessment. The dataset contains two and four-chamber acquisitions from 500 patients with reference measurements from one cardiologist on the full dataset and from three cardiologists on a fold of 50 patients. Results show that encoder-decoder-based architectures outperform state-of-the-art non-deep learning methods and faithfully reproduce the expert analysis for the end-diastolic and end-systolic left ventricular volumes, with a mean correlation of 0.95 and an absolute mean error of 9.5 ml. Concerning the ejection fraction of the left ventricle, results are more contrasted with a mean correlation coefficient of 0.80 and an absolute mean error of 5.6%. Although these results are below the inter-observer scores, they remain slightly worse than the intra-observer's ones. Based on this observation, areas for improvement are defined, which open the door for accurate and fully-automatic analysis of 2D echocardiographic images.
Collapse
|
21
|
Pedrosa J, Duchenne J, Queirós S, Degtiarova G, Gheysens O, Claus P, Voigt JU, D'hooge J. Non-invasive myocardial performance mapping using 3D echocardiographic stress-strain loops. Phys Med Biol 2019; 64:115026. [PMID: 31096199 DOI: 10.1088/1361-6560/ab21f8] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/12/2022]
Abstract
Regional contribution to left ventricular (LV) ejection is of much clinical importance but its assessment is notably challenging. While deformation imaging is often used, this does not take into account loading conditions. Recently, a method for intraventricular pressure estimation was proposed, thus allowing for loading conditions to be taken into account in a non-invasive way. In this work, a method for 3D automatic myocardial performance mapping in echocardiography is proposed by performing 3D myocardial segmentation and tracking, thus giving access to local geometry and strain. This is then used to assess local LV stress-strain relationships which can be seen as a measure of local myocardial work. The proposed method was validated against 18F-fluorodeoxyglucose positron emission tomography, the reference method to clinically assess local metabolism. Averaged over all patients, the mean correlation between FDG-PET and the proposed method was [Formula: see text]. In conclusion, stress-strain loops were, for the first time, estimated from 3D echocardiography and correlated to the clinical gold standard for local metabolism, showing the future potential of real-time 3D echocardiography (RT3DE) for the assessment of local metabolic activity of the heart.
Collapse
Affiliation(s)
- João Pedrosa
- Laboratory on Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, KU Leuven, Belgium
| | | | | | | | | | | | | | | |
Collapse
|
22
|
Kubik T, Kałużyński K, Burger C, Passeri A, Margiacchi S, Saletti P, Bonini R, Lorenzini E, Sciagrà R. Novel 3D heart left ventricle muscle segmentation method for PET-gated protocol and its verification. Ann Nucl Med 2019; 33:629-638. [PMID: 31154573 PMCID: PMC6660505 DOI: 10.1007/s12149-019-01373-6] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/13/2019] [Accepted: 05/22/2019] [Indexed: 12/01/2022]
Abstract
Objective The aim of this study was to propose and verify a universal method of left ventricular myocardium segmentation, able to operate on heart gated PET data with different sizes, shapes and uptake distributions. The proposed method can be classified as active model method and is based on the BEAS (B-spline Explicit Active Surface) algorithm published by Barbosa et al. The method was implemented within the Pmod PCARD software package. Method verification by comparison with reference software and phantom data is also presented in the paper. Methods The proposed method extends the BEAS model by defining mechanical features of the model: tensile strength and bending resistance. Formulas describing model internal energy increase during its stretching and bending are proposed. The segmentation model was applied to the data of 60 patients, who had undergone cardiac gated PET scanning. QGS by Cedars-Sinai and ECTb by Emory University Medical Centre served as reference software for comparing ventricular volumes. The method was also verified using data of left ventricular phantoms of known volume. Results The results of the proposed method are well correlated with the results of QGS (slope: 0.841, intercept: 0.944 ml, R2: 0.867) and ECTb (slope: 0.830, intercept: 2.109 ml, R2: 0.845). The volumes calculated by the proposed method were very close to the true cavity volumes of two different phantoms. Conclusions The analysis of gated PET data by the proposed method results in volume measurements comparable to established methods. Phantom experiments demonstrate that the volume values correspond to the physical ones.
Collapse
Affiliation(s)
- Tomasz Kubik
- Faculty of Mechatronics, Institute for Metrology and Biomedical Engineering, Warsaw University of Technology, ul. św. Andrzeja Boboli 8, 02-525, Warsaw, Poland.
- Pmod Technologies LLC, Sumatrastrasse 25, 8006, Zurich, Switzerland.
| | - Krzysztof Kałużyński
- Faculty of Mechatronics, Institute for Metrology and Biomedical Engineering, Warsaw University of Technology, ul. św. Andrzeja Boboli 8, 02-525, Warsaw, Poland
| | - Cyrill Burger
- Pmod Technologies LLC, Sumatrastrasse 25, 8006, Zurich, Switzerland
| | - Alessandro Passeri
- Nuclear Medicine, ECBSD, University of Florence, Largo Brambilla 3, 50134, Florence, Italy
| | - Selene Margiacchi
- Nuclear Medicine, ECBSD, University of Florence, Largo Brambilla 3, 50134, Florence, Italy
| | - Paola Saletti
- Medical Physics, AOU Careggi, Largo Brambilla 3, 50134, Florence, Italy
| | - Rita Bonini
- Nuclear Medicine, ASL Nord Ovest, Via Risorgimento 18, 54100, Massa, Italy
| | - Elena Lorenzini
- Medical Physics, ASL Nord Ovest, Piazza Sacco e Vanzetti 5, 54033, Carrara, Italy
| | - Roberto Sciagrà
- Nuclear Medicine, ECBSD, University of Florence, Largo Brambilla 3, 50134, Florence, Italy
| |
Collapse
|
23
|
Gomes-Fonseca J, Queirós S, Morais P, Pinho ACM, Fonseca JC, Correia-Pinto J, Lima E, Vilaça JL. Surface-based registration between CT and US for image-guided percutaneous renal access - A feasibility study. Med Phys 2019; 46:1115-1126. [DOI: 10.1002/mp.13369] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/06/2018] [Revised: 12/13/2018] [Accepted: 12/19/2018] [Indexed: 12/30/2022] Open
Affiliation(s)
- João Gomes-Fonseca
- Life and Health Sciences Research Institute (ICVS); School of Medicine; University of Minho; Braga Portugal
- ICVS/3B's-PT; Government Associate Laboratory; Braga/Guimarães 4710-057 Portugal
| | - Sandro Queirós
- Life and Health Sciences Research Institute (ICVS); School of Medicine; University of Minho; Braga Portugal
- ICVS/3B's-PT; Government Associate Laboratory; Braga/Guimarães 4710-057 Portugal
- 2Ai; Polytechnic Institute of Cávado and Ave; Barcelos Portugal
| | - Pedro Morais
- Life and Health Sciences Research Institute (ICVS); School of Medicine; University of Minho; Braga Portugal
- ICVS/3B's-PT; Government Associate Laboratory; Braga/Guimarães 4710-057 Portugal
- 2Ai; Polytechnic Institute of Cávado and Ave; Barcelos Portugal
| | - António C. M. Pinho
- Department of Mechanical Engineering; School of Engineering; University of Minho; Guimarães Portugal
| | - Jaime C. Fonseca
- Algoritmi Center; School of Engineering; University of Minho; Guimarães Portugal
- Department of Industrial Electronics; School of Engineering; University of Minho; Guimarães Portugal
| | - Jorge Correia-Pinto
- Life and Health Sciences Research Institute (ICVS); School of Medicine; University of Minho; Braga Portugal
- ICVS/3B's-PT; Government Associate Laboratory; Braga/Guimarães 4710-057 Portugal
- Department of Pediatric Surgery; Hospital of Braga; Braga Portugal
| | - Estêvão Lima
- Life and Health Sciences Research Institute (ICVS); School of Medicine; University of Minho; Braga Portugal
- ICVS/3B's-PT; Government Associate Laboratory; Braga/Guimarães 4710-057 Portugal
- Deparment of Urology; Hospital of Braga; Braga Portugal
| | - João L. Vilaça
- Life and Health Sciences Research Institute (ICVS); School of Medicine; University of Minho; Braga Portugal
- ICVS/3B's-PT; Government Associate Laboratory; Braga/Guimarães 4710-057 Portugal
- 2Ai; Polytechnic Institute of Cávado and Ave; Barcelos Portugal
| |
Collapse
|
24
|
Dietenbeck T, Craiem D, Rosenbaum D, Giron A, De Cesare A, Bouaou K, Girerd X, Cluzel P, Redheuil A, Kachenoura N. 3D aortic morphology and stiffness in MRI using semi-automated cylindrical active surface provides optimized description of the vascular effects of aging and hypertension. Comput Biol Med 2018; 103:101-108. [DOI: 10.1016/j.compbiomed.2018.10.006] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/31/2018] [Revised: 09/17/2018] [Accepted: 10/07/2018] [Indexed: 11/28/2022]
|
25
|
Morais P, Queiros S, Meester PD, Budts W, Vilaca JL, Tavares JMRS, D'Hooge J. Fast Segmentation of the Left Atrial Appendage in 3-D Transesophageal Echocardiographic Images. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2018; 65:2332-2342. [PMID: 30281444 DOI: 10.1109/tuffc.2018.2872816] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/08/2023]
Abstract
Left atrial appendage (LAA) has been generally described as "our most lethal attachment," being considered the major source of thromboembolism in patients with nonvalvular atrial fibrillation. Currently, LAA occlusion can be offered as a treatment for these patients, obstructing the LAA through a percutaneously delivered device. Nevertheless, correct device sizing is not straightforward, requiring manual analysis of peri-procedural images. This approach is suboptimal, time demanding, and highly variable between experts, which can result in lengthy procedures and excess manipulations. In this paper, a semiautomatic LAA segmentation technique for 3-D transesophageal echocardiography (TEE) images is presented. Specifically, the proposed technique relies on a novel segmentation pipeline where a curvilinear blind-ended model is optimized through a double stage strategy: 1) fast contour evolution using global terms and 2) contour refinement based on regional energies. To reduce its computational cost, and thus make it more attractive to real interventions, the B-spline explicit active surface framework was used. This novel method was evaluated in a clinical database of 20 patients. Manual analysis performed by two observers was used as ground truth. The 3-D segmentation results corroborated the accuracy, robustness to the variation of the parameters, and computationally attractiveness of the proposed method, taking approximately 14 s to segment the LAA with an average accuracy of ~0.9 mm. Moreover, a performance comparable to the interobserver variability was found. Finally, the advantages of the segmented model were evaluated, while semiautomatically extracting the clinical measurements for device selection, showing a similar accuracy but with a higher reproducibility when compared to the current practice. Overall, the proposed segmentation method shows potential for an improved planning of LAA occlusion, demonstrating its added value for normal clinical practice.
Collapse
|
26
|
Krishnaswamy D, Hareendranathan AR, Suwatanaviroj T, Boulanger P, Becher H, Noga M, Punithakumar K. A Novel 4D Semi-Automated Algorithm for Volumetric Segmentation in Echocardiography. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2018; 2018:1119-1122. [PMID: 30440586 DOI: 10.1109/embc.2018.8512424] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/09/2023]
Abstract
Segmentation of the left ventricle (LV) in temporal 3D echocardiography sequences poses a challenge. However, it is an essential component in generating quantitative clinical measurements for the diagnosis and treatment of various cardiac diseases. Identifying the endocardial borders of the left ventricle can be difficult due to the inherent properties of ultrasound. This study proposes a 4D segmentation algorithm that segments over temporal 3D volumes that has minimal user interaction and is based on a diffeomorphic registration approach. In contrast to several existing algorithms, the proposed method does not depend on training data or make any geometrical assumptions. The algorithm was evaluated on seven patients obtained from the Mazankowski Alberta Heart Institute, Edmonton, Canada in comparison to expert manual segmentation. The proposed approach yielded Dice scores of 0.94 (0.01), 0.91 (0.03) and 0.92 (0.02) at end diastole, at end systole and over the entire cardiac cycle, respectively. The corresponding Hausdorff distance values were 4.49 (1.01) mm, 4.94 (1.41) mm, and 5.05 (0.85) mm, respectively. These results demonstrate that the proposed 4D segmentation approach for the left ventricle is robust and can potentially be used in clinical practice.
Collapse
|
27
|
Morais P, Vilaça JL, Queirós S, Marchi A, Bourier F, Deisenhofer I, D'hooge J, Tavares JMRS. Automated segmentation of the atrial region and fossa ovalis towards computer-aided planning of inter-atrial wall interventions. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2018; 161:73-84. [PMID: 29852969 DOI: 10.1016/j.cmpb.2018.04.014] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 02/21/2018] [Revised: 03/29/2018] [Accepted: 04/17/2018] [Indexed: 06/08/2023]
Abstract
BACKGROUND AND OBJECTIVE Image-fusion strategies have been applied to improve inter-atrial septal (IAS) wall minimally-invasive interventions. Hereto, several landmarks are initially identified on richly-detailed datasets throughout the planning stage and then combined with intra-operative images, enhancing the relevant structures and easing the procedure. Nevertheless, such planning is still performed manually, which is time-consuming and not necessarily reproducible, hampering its regular application. In this article, we present a novel automatic strategy to segment the atrial region (left/right atrium and aortic tract) and the fossa ovalis (FO). METHODS The method starts by initializing multiple 3D contours based on an atlas-based approach with global transforms only and refining them to the desired anatomy using a competitive segmentation strategy. The obtained contours are then applied to estimate the FO by evaluating both IAS wall thickness and the expected FO spatial location. RESULTS The proposed method was evaluated in 41 computed tomography datasets, by comparing the atrial region segmentation and FO estimation results against manually delineated contours. The automatic segmentation method presented a performance similar to the state-of-the-art techniques and a high feasibility, failing only in the segmentation of one aortic tract and of one right atrium. The FO estimation method presented an acceptable result in all the patients with a performance comparable to the inter-observer variability. Moreover, it was faster and fully user-interaction free. CONCLUSIONS Hence, the proposed method proved to be feasible to automatically segment the anatomical models for the planning of IAS wall interventions, making it exceptionally attractive for use in the clinical practice.
Collapse
Affiliation(s)
- Pedro Morais
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, 4710-057 Braga, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Portugal; Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven - University of Leuven, Leuven, Belgium.
| | - João L Vilaça
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, 4710-057 Braga, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; 2Ai - Polytechnic Institute of Cávado and Ave, Barcelos, Portugal.
| | - Sandro Queirós
- Life and Health Sciences Research Institute (ICVS), School of Medicine, University of Minho, 4710-057 Braga, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven - University of Leuven, Leuven, Belgium; Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal.
| | - Alberto Marchi
- Cardiomyopathies Unit, Careggi University Hospital Florence, Italy
| | - Felix Bourier
- German Heart Center Munich, Technical University, Munich, Germany.
| | | | - Jan D'hooge
- Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven - University of Leuven, Leuven, Belgium.
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Portugal.
| |
Collapse
|
28
|
Meiburger KM, Acharya UR, Molinari F. Automated localization and segmentation techniques for B-mode ultrasound images: A review. Comput Biol Med 2017; 92:210-235. [PMID: 29247890 DOI: 10.1016/j.compbiomed.2017.11.018] [Citation(s) in RCA: 66] [Impact Index Per Article: 8.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/10/2017] [Revised: 11/30/2017] [Accepted: 11/30/2017] [Indexed: 12/14/2022]
Abstract
B-mode ultrasound imaging is used extensively in medicine. Hence, there is a need to have efficient segmentation tools to aid in computer-aided diagnosis, image-guided interventions, and therapy. This paper presents a comprehensive review on automated localization and segmentation techniques for B-mode ultrasound images. The paper first describes the general characteristics of B-mode ultrasound images. Then insight on the localization and segmentation of tissues is provided, both in the case in which the organ/tissue localization provides the final segmentation and in the case in which a two-step segmentation process is needed, due to the desired boundaries being too fine to locate from within the entire ultrasound frame. Subsequenly, examples of some main techniques found in literature are shown, including but not limited to shape priors, superpixel and classification, local pixel statistics, active contours, edge-tracking, dynamic programming, and data mining. Ten selected applications (abdomen/kidney, breast, cardiology, thyroid, liver, vascular, musculoskeletal, obstetrics, gynecology, prostate) are then investigated in depth, and the performances of a few specific applications are compared. In conclusion, future perspectives for B-mode based segmentation, such as the integration of RF information, the employment of higher frequency probes when possible, the focus on completely automatic algorithms, and the increase in available data are discussed.
Collapse
Affiliation(s)
- Kristen M Meiburger
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy
| | - U Rajendra Acharya
- Department of Electronic & Computer Engineering, Ngee Ann Polytechnic, Singapore; Department of Biomedical Engineering, School of Science and Technology, SUSS University, Singapore; Department of Biomedical Imaging, Faculty of Medicine, University of Malaya, Kuala Lumpur, Malaysia
| | - Filippo Molinari
- Biolab, Department of Electronics and Telecommunications, Politecnico di Torino, Torino, Italy.
| |
Collapse
|
29
|
Barbosa D, Pedrosa J, Heyde B, Dietenbeck T, Friboulet D, Bernard O, D’hooge J. heartBEATS: A hybrid energy approach for real-time B-spline explicit active tracking of surfaces. Comput Med Imaging Graph 2017; 62:26-33. [DOI: 10.1016/j.compmedimag.2017.07.004] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/09/2016] [Revised: 07/24/2017] [Accepted: 07/25/2017] [Indexed: 11/29/2022]
|
30
|
Queirós S, Vilaça JL, Morais P, Fonseca JC, D'hooge J, Barbosa D. Fast left ventricle tracking using localized anatomical affine optical flow. INTERNATIONAL JOURNAL FOR NUMERICAL METHODS IN BIOMEDICAL ENGINEERING 2017; 33. [PMID: 28208231 DOI: 10.1002/cnm.2871] [Citation(s) in RCA: 10] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 08/26/2016] [Accepted: 02/12/2017] [Indexed: 06/06/2023]
Abstract
In daily clinical cardiology practice, left ventricle (LV) global and regional function assessment is crucial for disease diagnosis, therapy selection, and patient follow-up. Currently, this is still a time-consuming task, spending valuable human resources. In this work, a novel fast methodology for automatic LV tracking is proposed based on localized anatomically constrained affine optical flow. This novel method can be combined to previously proposed segmentation frameworks or manually delineated surfaces at an initial frame to obtain fully delineated datasets and, thus, assess both global and regional myocardial function. Its feasibility and accuracy were investigated in 3 distinct public databases, namely in realistically simulated 3D ultrasound, clinical 3D echocardiography, and clinical cine cardiac magnetic resonance images. The method showed accurate tracking results in all databases, proving its applicability and accuracy for myocardial function assessment. Moreover, when combined to previous state-of-the-art segmentation frameworks, it outperformed previous tracking strategies in both 3D ultrasound and cardiac magnetic resonance data, automatically computing relevant cardiac indices with smaller biases and narrower limits of agreement compared to reference indices. Simultaneously, the proposed localized tracking method showed to be suitable for online processing, even for 3D motion assessment. Importantly, although here evaluated for LV tracking only, this novel methodology is applicable for tracking of other target structures with minimal adaptations.
Collapse
Affiliation(s)
- Sandro Queirós
- ICVS/3B's-PT Government Associate Laboratory, Braga/Guimarães, Portugal
- Lab on Cardiovascular Imaging and Dynamics, Dept. of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
- Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal
| | - João L Vilaça
- ICVS/3B's-PT Government Associate Laboratory, Braga/Guimarães, Portugal
- DIGARC-Polytechnic Institute of Cávado and Ave (IPCA), Barcelos, Portugal
| | - Pedro Morais
- ICVS/3B's-PT Government Associate Laboratory, Braga/Guimarães, Portugal
- Lab on Cardiovascular Imaging and Dynamics, Dept. of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
- INEGI, Faculty of Engineering, University of Porto, Porto, Portugal
| | - Jaime C Fonseca
- Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal
| | - Jan D'hooge
- Lab on Cardiovascular Imaging and Dynamics, Dept. of Cardiovascular Sciences, KU Leuven, Leuven, Belgium
| | - Daniel Barbosa
- ICVS/3B's-PT Government Associate Laboratory, Braga/Guimarães, Portugal
| |
Collapse
|
31
|
Pedrosa J, Queiros S, Bernard O, Engvall J, Edvardsen T, Nagel E, D'hooge J. Fast and Fully Automatic Left Ventricular Segmentation and Tracking in Echocardiography Using Shape-Based B-Spline Explicit Active Surfaces. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:2287-2296. [PMID: 28783626 DOI: 10.1109/tmi.2017.2734959] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Cardiac volume/function assessment remains a critical step in daily cardiology, and 3-D ultrasound plays an increasingly important role. Fully automatic left ventricular segmentation is, however, a challenging task due to the artifacts and low contrast-to-noise ratio of ultrasound imaging. In this paper, a fast and fully automatic framework for the full-cycle endocardial left ventricle segmentation is proposed. This approach couples the advantages of the B-spline explicit active surfaces framework, a purely image information approach, to those of statistical shape models to give prior information about the expected shape for an accurate segmentation. The segmentation is propagated throughout the heart cycle using a localized anatomical affine optical flow. It is shown that this approach not only outperforms other state-of-the-art methods in terms of distance metrics with a mean average distances of 1.81±0.59 and 1.98±0.66 mm at end-diastole and end-systole, respectively, but is computationally efficient (in average 11 s per 4-D image) and fully automatic.
Collapse
|
32
|
Morais P, Queirós S, Heyde B, Engvall J, 'hooge JD, Vilaça JL. Fully automatic left ventricular myocardial strain estimation in 2D short-axis tagged magnetic resonance imaging. Phys Med Biol 2017; 62:6899-6919. [PMID: 28783715 DOI: 10.1088/1361-6560/aa7dc2] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 02/03/2023]
Abstract
Cardiovascular diseases are among the leading causes of death and frequently result in local myocardial dysfunction. Among the numerous imaging modalities available to detect these dysfunctional regions, cardiac deformation imaging through tagged magnetic resonance imaging (t-MRI) has been an attractive approach. Nevertheless, fully automatic analysis of these data sets is still challenging. In this work, we present a fully automatic framework to estimate left ventricular myocardial deformation from t-MRI. This strategy performs automatic myocardial segmentation based on B-spline explicit active surfaces, which are initialized using an annular model. A non-rigid image-registration technique is then used to assess myocardial deformation. Three experiments were set up to validate the proposed framework using a clinical database of 75 patients. First, automatic segmentation accuracy was evaluated by comparing against manual delineations at one specific cardiac phase. The proposed solution showed an average perpendicular distance error of 2.35 ± 1.21 mm and 2.27 ± 1.02 mm for the endo- and epicardium, respectively. Second, starting from either manual or automatic segmentation, myocardial tracking was performed and the resulting strain curves were compared. It is shown that the automatic segmentation adds negligible differences during the strain-estimation stage, corroborating its accuracy. Finally, segmental strain was compared with scar tissue extent determined by delay-enhanced MRI. The results proved that both strain components were able to distinguish between normal and infarct regions. Overall, the proposed framework was shown to be accurate, robust, and attractive for clinical practice, as it overcomes several limitations of a manual analysis.
Collapse
Affiliation(s)
- Pedro Morais
- Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven-University of Leuven, Leuven, Belgium. ICVS/3B's-PT Government Associate Laboratory, Braga/Guimarães, Portugal. Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal
| | | | | | | | | | | |
Collapse
|
33
|
Morais P, Vilaça JL, Queirós S, Bourier F, Deisenhofer I, Tavares JMRS, D'hooge J. A competitive strategy for atrial and aortic tract segmentation based on deformable models. Med Image Anal 2017; 42:102-116. [PMID: 28780174 DOI: 10.1016/j.media.2017.07.007] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/31/2017] [Revised: 06/30/2017] [Accepted: 07/26/2017] [Indexed: 01/27/2023]
Abstract
Multiple strategies have previously been described for atrial region (i.e. atrial bodies and aortic tract) segmentation. Although these techniques have proven their accuracy, inadequate results in the mid atrial walls are common, restricting their application for specific cardiac interventions. In this work, we introduce a novel competitive strategy to perform atrial region segmentation with correct delineation of the thin mid walls, and integrated it into the B-spline Explicit Active Surfaces framework. A double-stage segmentation process is used, which starts with a fast contour growing followed by a refinement stage with local descriptors. Independent functions are used to define each region, being afterward combined to compete for the optimal boundary. The competition locally constrains the surface evolution, prevents overlaps and allows refinement to the walls. Three different scenarios were used to demonstrate the advantages of the proposed approach, through the evaluation of its segmentation accuracy, and its performance for heterogeneous mid walls. Both computed tomography and magnetic resonance imaging datasets were used, presenting results similar to the state-of-the-art methods for both atria and aorta. The competitive strategy showed its superior performance with statistically significant differences against the traditional free-evolution approach in cases with bad image quality or missed atrial/aortic walls. Moreover, only the competitive approach was able to accurately segment the atrial/aortic wall. Overall, the proposed strategy showed to be suitable for atrial region segmentation with a correct segmentation of the mid thin walls, demonstrating its added value with respect to the traditional techniques.
Collapse
Affiliation(s)
- Pedro Morais
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal; ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven - University of Leuven, Leuven, Belgium.
| | - João L Vilaça
- ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; DIGARC - Polytechnic Institute of Cávado and Ave, Barcelos, Portugal
| | - Sandro Queirós
- ICVS/3B's - PT Government Associate Laboratory, Braga/Guimarães, Portugal; Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven - University of Leuven, Leuven, Belgium; Algoritmi Center, School of Engineering, University of Minho, Guimarães, Portugal
| | - Felix Bourier
- Department of Electrophysiology, German Heart Center Munich, Technical University, Munich, Germany
| | - Isabel Deisenhofer
- Department of Electrophysiology, German Heart Center Munich, Technical University, Munich, Germany
| | - João Manuel R S Tavares
- Instituto de Ciência e Inovação em Engenharia Mecânica e Engenharia Industrial, Faculdade de Engenharia, Universidade do Porto, Porto, Portugal
| | - Jan D'hooge
- Lab on Cardiovascular Imaging & Dynamics, Department of Cardiovascular Sciences, KULeuven - University of Leuven, Leuven, Belgium
| |
Collapse
|
34
|
Gao G, Wan X, Yao S, Cui Z, Zhou C, Sun X. Reversible data hiding with contrast enhancement and tamper localization for medical images. Inf Sci (N Y) 2017. [DOI: 10.1016/j.ins.2017.01.009] [Citation(s) in RCA: 38] [Impact Index Per Article: 4.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
|
35
|
Pedrosa J, Barbosa D, Heyde B, Schnell F, Rosner A, Claus P, D'hooge J. Left Ventricular Myocardial Segmentation in 3-D Ultrasound Recordings: Effect of Different Endocardial and Epicardial Coupling Strategies. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2017; 64:525-536. [PMID: 27992332 DOI: 10.1109/tuffc.2016.2638080] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
Cardiac volume/function assessment remains a critical step in daily cardiology, and 3-D ultrasound plays an increasingly important role. Though development of automatic endocardial segmentation methods has received much attention, the same cannot be said about epicardial segmentation, in spite of the importance of full myocardial segmentation. In this paper, different ways of coupling the endocardial and epicardial segmentations are contrasted and compared with uncoupled segmentation. For this purpose, the B-spline explicit active surfaces framework was used; 27 3-D echocardiographic images were used to validate the different coupling strategies, which were compared with manual contouring of the endocardial and epicardial borders performed by an expert. It is shown that an independent segmentation of the endocardium followed by an epicardial segmentation coupled to the endocardium is the most advantageous. In this way, a framework for fully automatic 3-D myocardial segmentation is proposed using a novel coupling strategy.
Collapse
|
36
|
Rosado-Toro JA, Altbach MI, Rodríguez JJ. Dynamic Programming Using Polar Variance for Image Segmentation. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2016; 25:5857-5866. [PMID: 27723594 PMCID: PMC5382140 DOI: 10.1109/tip.2016.2615809] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.2] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/06/2023]
Abstract
When using polar dynamic programming (PDP) for image segmentation, the object size is one of the main features used. This is because if size is left unconstrained the final segmentation may include high-gradient regions that are not associated with the object. In this paper, we propose a new feature, polar variance, which allows the algorithm to segment the objects of different sizes without the need for training data. The polar variance is the variance in a polar region between a user-selected origin and a pixel we want to analyze. We also incorporate a new technique that allows PDP to segment complex shapes by finding low-gradient regions and growing them. The experimental analysis consisted on comparing our technique with different active contour segmentation techniques on a series of tests. The tests consisted on robustness to additive Gaussian noise, segmentation accuracy with different grayscale images and finally robustness to algorithm-specific parameters. Experimental results show that our technique performs favorably when compared with other segmentation techniques.
Collapse
Affiliation(s)
- José A. Rosado-Toro
- Electrical and Computer Engineering, University of Arizona, Tucson, AZ 85721 ()
| | - María I. Altbach
- Department of Medical Imaging, University of Arizona, Tucson, AZ 85724 ()
| | - Jeffrey J. Rodríguez
- Department of Electrical and Computer Engineering, University of Arizona, Tucson, AZ 85721 ()
| |
Collapse
|
37
|
Coron A, Mamou J, Saegusa-Beecroft E, Yamaguchi T, Yanagihara E, Machi J, Bridal SL, Feleppa EJ. Local Transverse-Slice-Based Level-Set Method for Segmentation of 3-D High-Frequency Ultrasonic Backscatter From Dissected Human Lymph Nodes. IEEE Trans Biomed Eng 2016; 64:1579-1591. [PMID: 28113305 DOI: 10.1109/tbme.2016.2614137] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/08/2022]
Abstract
OBJECTIVE To detect metastases in freshly excised human lymph nodes (LNs) using three-dimensional (3-D), high-frequency, quantitative ultrasound (QUS) methods, the LN parenchyma (LNP) must be segmented to preclude QUS analysis of data in regions outside the LNP and to compensate ultrasound attenuation effects due to overlying layers of LNP and residual perinodal fat (PNF). METHODS After restoring the saturated radio-frequency signals from PNF using an approach based on smoothing cubic splines, the three regions, i.e., LNP, PNF, and normal saline (NS), in the LN envelope data are segmented using a new, automatic, 3-D, three-phase, statistical transverseslice-based level-set (STS-LS) method that amends Lankton's method. Due to ultrasound attenuation and focusing effects, the speckle statistics of the envelope data vary with imaged depth. Thus, to mitigate depth-related inhomogeneity effects, the STS-LS method employs gamma probabilitydensity functions to locally model the speckle statistics within consecutive transverse slices. RESULTS Accurate results were obtained on simulated data. On a representative dataset of 54 LNs acquired from colorectal-cancer patients, the Dice similarity coefficient for LNP, PNF, and NS were 0.938 ± 0.025, 0.832 ± 0.086, and 0.968 ± 0.008, respectively, when compared to expert manual segmentation. CONCLUSION The STS-LS outperforms the established methods based on global and local statistics in our datasets and is capable of accurately handling the depth-dependent effects due to attenuation and focusing. SIGNIFICANCE This advance permits the automatic QUS-based cancer detection in the LNs. Furthermore, the STS-LS method could potentially be used in a wide range of ultrasound-imaging applications suffering from depth-dependent effects.
Collapse
|
38
|
Queiros S, Papachristidis A, Barbosa D, Theodoropoulos KC, Fonseca JC, Monaghan MJ, Vilaca JL, D'hooge J. Aortic Valve Tract Segmentation From 3D-TEE Using Shape-Based B-Spline Explicit Active Surfaces. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:2015-2025. [PMID: 27008664 DOI: 10.1109/tmi.2016.2544199] [Citation(s) in RCA: 9] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
A novel semi-automatic algorithm for aortic valve (AV) wall segmentation is presented for 3D transesophageal echocardiography (TEE) datasets. The proposed methodology uses a 3D cylindrical formulation of the B-spline Explicit Active Surfaces (BEAS) framework in a dual-stage energy evolution process, comprising a threshold-based and a localized region-based stage. Hereto, intensity and shape-based features are combined to accurately delineate the AV wall from the ascending aorta (AA) to the left ventricular outflow tract (LVOT). Shape-prior information is included using a profile-based statistical shape model (SSM), and embedded in BEAS through two novel regularization terms: one confining the segmented AV profiles to shapes seen in the SSM (hard regularization) and another penalizing according to the profile's degree of likelihood (soft regularization). The proposed energy functional takes thus advantage of the intensity data in regions with strong image content, while complementing it with shape knowledge in regions with nearly absent image data. The proposed algorithm has been validated in 20 3D-TEE datasets with both stenotic and non-stenotic valves. It was shown to be accurate, robust and computationally efficient, taking less than 1 second to segment the AV wall from the AA to the LVOT with an average accuracy of 0.78 mm. Semi-automatically extracted measurements at four relevant anatomical levels (LVOT, aortic annulus, sinuses of Valsalva and sinotubular junction) showed an excellent agreement with experts' ones, with a higher reproducibility than manually-extracted measures.
Collapse
|
39
|
Sindhwani N, Barbosa D, Alessandrini M, Heyde B, Dietz HP, D'Hooge J, Deprest J. Semi-automatic outlining of levator hiatus. ULTRASOUND IN OBSTETRICS & GYNECOLOGY : THE OFFICIAL JOURNAL OF THE INTERNATIONAL SOCIETY OF ULTRASOUND IN OBSTETRICS AND GYNECOLOGY 2016; 48:98-105. [PMID: 26434661 DOI: 10.1002/uog.15777] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.8] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 05/12/2015] [Revised: 09/14/2015] [Accepted: 09/18/2015] [Indexed: 06/05/2023]
Abstract
OBJECTIVE To create a semi-automated outlining tool for the levator hiatus, to reduce interobserver variability and and speed up analysis. METHODS The proposed automated hiatus segmentation (AHS) algorithm takes a C-plane image, in the plane of minimal hiatal dimensions, and manually defined vertical hiatal limits as input. The AHS then creates an initial outline by fitting predefined templates on an intensity-invariant edge map, which is further refined using the B-spline explicit active surfaces framework. The AHS was tested using 91 representative C-plane images. Reference hiatal outlines were obtained manually and compared with the AHS outlines by three independent observers. The mean absolute distance (MAD), Hausdorff distance and Dice and Jaccard coefficients were used to quantify segmentation accuracy. Each of these metrics was calculated both for computer-observer differences (COD) and for interobserver differences. The Williams index was used to test the null hypothesis that the automated method would agree with the operators at least as well as the operators agreed with each other. Agreement between the two methods was assessed using the intraclass correlation coefficient (ICC) and Bland-Altman plots. RESULTS The AHS contours matched well with the manual ones (median COD, 2.10 (interquartile range (IQR), 1.54) mm for MAD). The Williams index was greater than or close to 1 for all quality metrics, indicating that the algorithm performed at least as well as did the manual references in terms of interrater variability. The interobserver differences using each of the metrics were significantly lower, and a higher ICC was achieved (0.93), when obtaining outlines using the AHS compared with manually. The Bland-Altman plots showed negligible bias between the two methods. Using the AHS took a median time of 7.07 (IQR, 3.49) s, while manual outlining took 21.31 (IQR, 5.43) s, thus being almost three-fold faster. Using the AHS, in general, the hiatus could be outlined completely using only three points, two for initialization and one for manual adjustment. CONCLUSIONS We present a method for tracing the levator hiatal outline with minimal user input. The AHS is fast, robust and reliable and improves interrater agreement. Copyright © 2015 ISUOG. Published by John Wiley & Sons Ltd.
Collapse
Affiliation(s)
- N Sindhwani
- Department of Development and Regeneration, Cluster Organ Systems, Biomedical Sciences, KU Leuven, and Obstetrics and Gynaecology, University Hospitals Leuven, Leuven, Belgium
- Interdepartmental Center for Surgical Technologies, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - D Barbosa
- Laboratory on Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - M Alessandrini
- Laboratory on Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - B Heyde
- Laboratory on Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - H P Dietz
- Sydney Medical School Nepean, Nepean Hospital, Penrith, Australia
| | - J D'Hooge
- Laboratory on Cardiovascular Imaging and Dynamics, Department of Cardiovascular Sciences, Faculty of Medicine, KU Leuven, Leuven, Belgium
| | - J Deprest
- Department of Development and Regeneration, Cluster Organ Systems, Biomedical Sciences, KU Leuven, and Obstetrics and Gynaecology, University Hospitals Leuven, Leuven, Belgium
- Interdepartmental Center for Surgical Technologies, Faculty of Medicine, KU Leuven, Leuven, Belgium
| |
Collapse
|
40
|
Bernard O, Bosch JG, Heyde B, Alessandrini M, Barbosa D, Camarasu-Pop S, Cervenansky F, Valette S, Mirea O, Bernier M, Jodoin PM, Domingos JS, Stebbing RV, Keraudren K, Oktay O, Caballero J, Shi W, Rueckert D, Milletari F, Ahmadi SA, Smistad E, Lindseth F, van Stralen M, Wang C, Smedby O, Donal E, Monaghan M, Papachristidis A, Geleijnse ML, Galli E, D'hooge J. Standardized Evaluation System for Left Ventricular Segmentation Algorithms in 3D Echocardiography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:967-977. [PMID: 26625409 DOI: 10.1109/tmi.2015.2503890] [Citation(s) in RCA: 47] [Impact Index Per Article: 5.2] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Real-time 3D Echocardiography (RT3DE) has been proven to be an accurate tool for left ventricular (LV) volume assessment. However, identification of the LV endocardium remains a challenging task, mainly because of the low tissue/blood contrast of the images combined with typical artifacts. Several semi and fully automatic algorithms have been proposed for segmenting the endocardium in RT3DE data in order to extract relevant clinical indices, but a systematic and fair comparison between such methods has so far been impossible due to the lack of a publicly available common database. Here, we introduce a standardized evaluation framework to reliably evaluate and compare the performance of the algorithms developed to segment the LV border in RT3DE. A database consisting of 45 multivendor cardiac ultrasound recordings acquired at different centers with corresponding reference measurements from three experts are made available. The algorithms from nine research groups were quantitatively evaluated and compared using the proposed online platform. The results showed that the best methods produce promising results with respect to the experts' measurements for the extraction of clinical indices, and that they offer good segmentation precision in terms of mean distance error in the context of the experts' variability range. The platform remains open for new submissions.
Collapse
|
41
|
Almeida N, Friboulet D, Sarvari SI, Bernard O, Barbosa D, Samset E, Dhooge J. Left-Atrial Segmentation From 3-D Ultrasound Using B-Spline Explicit Active Surfaces With Scale Uncoupling. IEEE TRANSACTIONS ON ULTRASONICS, FERROELECTRICS, AND FREQUENCY CONTROL 2016; 63:212-221. [PMID: 26685231 DOI: 10.1109/tuffc.2015.2507638] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/05/2023]
Abstract
Segmentation of the left atrium (LA) of the heart allows quantification of LA volume dynamics which can give insight into cardiac function. However, very little attention has been given to LA segmentation from three-dimensional (3-D) ultrasound (US), most efforts being focused on the segmentation of the left ventricle (LV). The B-spline explicit active surfaces (BEAS) framework has been shown to be a very robust and efficient methodology to perform LV segmentation. In this study, we propose an extension of the BEAS framework, introducing B-splines with uncoupled scaling. This formulation improves the shape support for less regular and more variable structures, by giving independent control over smoothness and number of control points. Semiautomatic segmentation of the LA endocardium using this framework was tested in a setup requiring little user input, on 20 volumetric sequences of echocardiographic data from healthy subjects. The segmentation results were evaluated against manual reference delineations of the LA. Relevant LA morphological and functional parameters were derived from the segmented surfaces, in order to assess the performance of the proposed method on its clinical usage. The results showed that the modified BEAS framework is capable of accurate semiautomatic LA segmentation in 3-D transthoracic US, providing reliable quantification of the LA morphology and function.
Collapse
|
42
|
Garrido L, Guerrieri M, Igual L. Image Segmentation With Cage Active Contours. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2015; 24:5557-5566. [PMID: 26316128 DOI: 10.1109/tip.2015.2472298] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/04/2023]
Abstract
In this paper, we present a framework for image segmentation based on parametrized active contours. The evolving contour is parametrized according to a reduced set of control points that form a closed polygon and have a clear visual interpretation. The parametrization, called mean value coordinates, stems from the techniques used in computer graphics to animate virtual models. Our framework allows to easily formulate region-based energies to segment an image. In particular, we present three different local region-based energy terms: 1) the mean model; 2) the Gaussian model; 3) and the histogram model. We show the behavior of our method on synthetic and real images and compare the performance with state-of-the-art level set methods.
Collapse
|
43
|
Eker OF, Boudjeltia KZ, Jerez RAC, Le Bars E, Sanchez M, Bonafé A, Costalat V, Courbebaisse G. MR derived volumetric flow rate waveforms of internal carotid artery in patients treated for unruptured intracranial aneurysms by flow diversion technique. J Cereb Blood Flow Metab 2015; 35:2070-9. [PMID: 26264871 PMCID: PMC4671130 DOI: 10.1038/jcbfm.2015.176] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 02/10/2015] [Revised: 05/27/2015] [Accepted: 06/22/2015] [Indexed: 11/09/2022]
Abstract
Little is known about the hemodynamic disturbances induced by the cerebral aneurysms in the parent artery and the effect of flow diverter stents (FDS) on these latter. A better understanding of the aneurysm-parent vessel complex relationship may aid our understanding of this disease and to optimize its treatment. The ability of volumetric flow rate (VFR) waveform to reflect the arterial compliance modifications is well known. By analyzing the VFR waveform and the pulsatility in the parent vessel, this study aimed to test the hypotheses that (1) intracranial aneurysms might disrupt the blood flow of the parent vessel and (2) the treatment by FDS might have measurable corrective effect on these changes. Ten patients followed for unruptured intracranial aneurysms treated by FDS and ten healthy volunteers as control group were included in this study. Two-dimensional quantitative phase-contrast magnetic resonance imaging (MRI) was performed on each patient on the ICA artery upstream and downstream to the aneurysm, and on each volunteer at similar locations. The aneurysms altered significantly the parent vessel pulsatility and this effect was correlated to their volume. The aneurysms treatment by FDS allowed for the restoration of a normally modulated flow and pulsatility correction in the parent vessel.
Collapse
Affiliation(s)
- Omer F Eker
- Department of Interventional Neuroradiology, Gui de Chauliac Hospital, CHRU de Montpellier, Montpellier, France.,CREATIS Laboratory-INSA Lyon, Villeurbanne, France.,Laboratory of Experimental Medicine (ULB 222 Unit), CHU Charleroi, Hôpital Vésale, Montigny-le-Tilleul, Belgium
| | - Karim Zouaoui Boudjeltia
- Laboratory of Experimental Medicine (ULB 222 Unit), CHU Charleroi, Hôpital Vésale, Montigny-le-Tilleul, Belgium
| | | | - Emmanuelle Le Bars
- Department of Interventional Neuroradiology, Gui de Chauliac Hospital, CHRU de Montpellier, Montpellier, France
| | - Mathieu Sanchez
- Department of Interventional Neuroradiology, Gui de Chauliac Hospital, CHRU de Montpellier, Montpellier, France
| | - Alain Bonafé
- Department of Interventional Neuroradiology, Gui de Chauliac Hospital, CHRU de Montpellier, Montpellier, France
| | - Vincent Costalat
- Department of Interventional Neuroradiology, Gui de Chauliac Hospital, CHRU de Montpellier, Montpellier, France
| | | |
Collapse
|
44
|
Knackstedt C, Bekkers SC, Schummers G, Schreckenberg M, Muraru D, Badano LP, Franke A, Bavishi C, Omar AMS, Sengupta PP. Fully Automated Versus Standard Tracking of Left Ventricular Ejection Fraction and Longitudinal Strain. J Am Coll Cardiol 2015; 66:1456-66. [DOI: 10.1016/j.jacc.2015.07.052] [Citation(s) in RCA: 108] [Impact Index Per Article: 10.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Submit a Manuscript] [Subscribe] [Scholar Register] [Received: 04/03/2015] [Revised: 06/30/2015] [Accepted: 07/27/2015] [Indexed: 12/22/2022]
|
45
|
Ribeiro de Sousa D, Vallecilla C, Chodzynski K, Corredor Jerez R, Malaspinas O, Eker OF, Ouared R, Vanhamme L, Legrand A, Chopard B, Courbebaisse G, Zouaoui Boudjeltia K. Determination of a shear rate threshold for thrombus formation in intracranial aneurysms. J Neurointerv Surg 2015. [DOI: 10.1136/neurintsurg-2015-011737] [Citation(s) in RCA: 22] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/03/2022]
Abstract
BackgroundParticular intra-aneurysmal blood flow conditions, created naturally by the growth of an aneurysm or induced artificially by implantation of a flow diverter stent (FDS), can potentiate intra-aneurysmal thrombosis. The aim of this study was to identify hemodynamic indicators, relevant to this process, which could be used as a prediction of the success of a preventive endovascular treatment.MethodA cross sectional study on 21 patients was carried out to investigate the possible association between intra-aneurysmal spontaneous thrombus volume and the dome to neck aspect ratio (AR) of the aneurysm. The mechanistic link between these two parameters was further investigated through a Fourier analysis of the intra-aneurysmal shear rate (SR) obtained by computational fluid dynamics (CFD). This analysis was first applied to 10 additional patients (4 with and 6 without spontaneous thrombosis) and later to 3 patients whose intracranial aneurysms only thrombosed after FDS implantation.ResultsThe cross sectional study revealed an association between intra-aneurysmal spontaneous thrombus volume and the AR of the aneurysm (R2=0.67, p<0.001). Fourier analysis revealed that in cases where thrombosis occurred, the SR harmonics 0, 1, and 2 were always less than 25/s, 10/s, and 5/s, respectively, and always greater than these values where spontaneous thrombosis was not observed.ConclusionsOur study suggests the existence of an SR threshold below which thrombosis will occur. Therefore, by analyzing the SR on patient specific data with CFD techniques, it may be potentially possible to predict whether or the intra-aneurysmal flow conditions, after FDS implantation, will become prothrombotic.
Collapse
|
46
|
Jaouen V, González P, Stute S, Guilloteau D, Chalon S, Buvat I, Tauber C. Variational segmentation of vector-valued images with gradient vector flow. IEEE TRANSACTIONS ON IMAGE PROCESSING : A PUBLICATION OF THE IEEE SIGNAL PROCESSING SOCIETY 2014; 23:4773-4785. [PMID: 25203991 DOI: 10.1109/tip.2014.2353854] [Citation(s) in RCA: 10] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/03/2023]
Abstract
In this paper, we extend the gradient vector flow field for robust variational segmentation of vector-valued images. Rather than using scalar edge information, we define a vectorial edge map derived from a weighted local structure tensor of the image that enables the diffusion of the gradient vectors in accurate directions through the 4D gradient vector flow equation. To reduce the contribution of noise in the structure tensor, image channels are weighted according to a blind estimator of contrast. The method is applied to biological volume delineation in dynamic PET imaging, and validated on realistic Monte Carlo simulations of numerical phantoms as well as on real images.
Collapse
|
47
|
Queirós S, Barbosa D, Heyde B, Morais P, Vilaça JL, Friboulet D, Bernard O, D’hooge J. Fast automatic myocardial segmentation in 4D cine CMR datasets. Med Image Anal 2014; 18:1115-31. [DOI: 10.1016/j.media.2014.06.001] [Citation(s) in RCA: 59] [Impact Index Per Article: 5.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2013] [Revised: 05/05/2014] [Accepted: 06/06/2014] [Indexed: 10/25/2022]
|
48
|
A low-interaction automatic 3D liver segmentation method using computed tomography for selective internal radiation therapy. BIOMED RESEARCH INTERNATIONAL 2014; 2014:198015. [PMID: 25105118 PMCID: PMC4106113 DOI: 10.1155/2014/198015] [Citation(s) in RCA: 21] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 12/16/2013] [Revised: 05/31/2014] [Accepted: 06/10/2014] [Indexed: 12/23/2022]
Abstract
This study introduces a novel liver segmentation approach for estimating anatomic liver volumes towards selective internal radiation treatment (SIRT). The algorithm requires minimal human interaction since the initialization process to segment the entire liver in 3D relied on a single computed tomography (CT) slice. The algorithm integrates a localized contouring algorithm with a modified k-means method. The modified k-means segments each slice into five distinct regions belonging to different structures. The liver region is further segmented using localized contouring. The novelty of the algorithm is in the design of the initialization masks for region contouring to minimize human intervention. Intensity based region growing together with novel volume of interest (VOI) based corrections is used to accomplish the single slice initialization. The performance of the algorithm is evaluated using 34 liver CT scans. Statistical experiments were performed to determine consistency of segmentation and to assess user dependency on the initialization process. Volume estimations are compared to the manual gold standard. Results show an average accuracy of 97.22% for volumetric calculation with an average Dice coefficient of 0.92. Statistical tests show that the algorithm is highly consistent (P = 0.55) and independent of user initialization (P = 0.20 and Fleiss' Kappa = 0.77 ± 0.06).
Collapse
|
49
|
Viallon M, Spaltenstein J, de Bourguignon C, Vandroux C, Bernard O, Belle L, Clarysse P, Croisille P. CMRSegTools: an Osirix plugin for myocardial infarct sizing on DE-CMR images. J Cardiovasc Magn Reson 2014. [PMCID: PMC4044514 DOI: 10.1186/1532-429x-16-s1-p204] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/13/2022] Open
|
50
|
Real-time 3D interactive segmentation of echocardiographic data through user-based deformation of B-spline explicit active surfaces. Comput Med Imaging Graph 2013; 38:57-67. [PMID: 24332441 DOI: 10.1016/j.compmedimag.2013.10.002] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/07/2013] [Revised: 08/27/2013] [Accepted: 10/08/2013] [Indexed: 11/23/2022]
Abstract
Image segmentation is an ubiquitous task in medical image analysis, which is required to estimate morphological or functional properties of given anatomical targets. While automatic processing is highly desirable, image segmentation remains to date a supervised process in daily clinical practice. Indeed, challenging data often requires user interaction to capture the required level of anatomical detail. To optimize the analysis of 3D images, the user should be able to efficiently interact with the result of any segmentation algorithm to correct any possible disagreement. Building on a previously developed real-time 3D segmentation algorithm, we propose in the present work an extension towards an interactive application where user information can be used online to steer the segmentation result. This enables a synergistic collaboration between the operator and the underlying segmentation algorithm, thus contributing to higher segmentation accuracy, while keeping total analysis time competitive. To this end, we formalize the user interaction paradigm using a geometrical approach, where the user input is mapped to a non-cartesian space while this information is used to drive the boundary towards the position provided by the user. Additionally, we propose a shape regularization term which improves the interaction with the segmented surface, thereby making the interactive segmentation process less cumbersome. The resulting algorithm offers competitive performance both in terms of segmentation accuracy, as well as in terms of total analysis time. This contributes to a more efficient use of the existing segmentation tools in daily clinical practice. Furthermore, it compares favorably to state-of-the-art interactive segmentation software based on a 3D livewire-based algorithm.
Collapse
|