1
|
Pseudo-Label-Assisted Self-Organizing Maps for Brain Tissue Segmentation in Magnetic Resonance Imaging. J Digit Imaging 2022; 35:180-192. [PMID: 35018537 PMCID: PMC8921351 DOI: 10.1007/s10278-021-00557-9] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/23/2021] [Revised: 11/26/2021] [Accepted: 11/27/2021] [Indexed: 10/19/2022] Open
Abstract
Brain tissue segmentation in magnetic resonance imaging volumes is an important image processing step for analyzing the human brain. This paper presents a novel approach named Pseudo-Label Assisted Self-Organizing Map (PLA-SOM) that enhances the result produced by a base segmentation method. Using the output of a base method, PLA-SOM calculates pseudo-labels in order to keep inter-class separation and intra-class compactness in the training phase. For the mapping phase, PLA-SOM uses a novel fuzzy function that combines feature space learned by the SOM's prototypes, topological ordering from the map, and spatial information from a brain atlas. We assessed PLA-SOM performance on synthetic and real MRIs of the brain, obtained from the BrainWeb and the Internet Brain Image Repository datasets. The experimental results showed evidence of segmentation improvement achieved by the proposed method over six different base methods. The best segmentation improvements reported by PLA-SOM on synthetic brain scans are 11%, 6%, and 4% for the tissue classes cerebrospinal fluid, gray matter, and white matter, respectively. On real brain scans, PLA-SOM achieved segmentation enhancements of 15%, 5%, and 12% for cerebrospinal fluid, gray matter, and white matter, respectively.
Collapse
|
2
|
Segmentation of MRI brain scans using spatial constraints and 3D features. Med Biol Eng Comput 2020; 58:3101-3112. [PMID: 33155095 DOI: 10.1007/s11517-020-02270-1] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/24/2019] [Accepted: 09/08/2020] [Indexed: 10/23/2022]
Abstract
This paper presents a novel unsupervised algorithm for brain tissue segmentation in magnetic resonance imaging (MRI). The proposed algorithm, named Gardens2, adopts a clustering approach to segment voxels of a given MRI into three classes: cerebrospinal fluid (CSF), gray matter (GM), and white matter (WM). Using an overlapping criterion, 3D feature descriptors and prior atlas information, Gardens2 generates a segmentation mask per class in order to parcellate the brain tissues. We assessed our method using three neuroimaging datasets: BrainWeb, IBSR18, and IBSR20, the last two provided by the Internet Brain Segmentation Repository. Its performance was compared with eleven well established as well as newly proposed unsupervised segmentation methods. Overall, Gardens2 obtained better segmentation performance than the rest of the methods in two of the three databases and competitive results when its performance was measured by class. Graphical Abstract Brain tissue segmentation using 3D features and an adjusted atlas template.
Collapse
|
3
|
Koch LM, Rajchl M, Bai W, Baumgartner CF, Tong T, Passerat-Palmbach J, Aljabar P, Rueckert D, Koch LM, Rajchl M, Baumgartner CF, Passerat-Palmbach J, Aljabar P, Rueckert D, Bai W, Passerat-Palmbach J, Rajchl M, Tong T, Baumgartner CF, Koch LM, Rueckert D, Aljabar P. Multi-Atlas Segmentation Using Partially Annotated Data: Methods and Annotation Strategies. IEEE TRANSACTIONS ON PATTERN ANALYSIS AND MACHINE INTELLIGENCE 2018; 40:1683-1696. [PMID: 28841548 DOI: 10.1109/tpami.2017.2711020] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/07/2023]
Abstract
Multi-atlas segmentation is a widely used tool in medical image analysis, providing robust and accurate results by learning from annotated atlas datasets. However, the availability of fully annotated atlas images for training is limited due to the time required for the labelling task. Segmentation methods requiring only a proportion of each atlas image to be labelled could therefore reduce the workload on expert raters tasked with annotating atlas images. To address this issue, we first re-examine the labelling problem common in many existing approaches and formulate its solution in terms of a Markov Random Field energy minimisation problem on a graph connecting atlases and the target image. This provides a unifying framework for multi-atlas segmentation. We then show how modifications in the graph configuration of the proposed framework enable the use of partially annotated atlas images and investigate different partial annotation strategies. The proposed method was evaluated on two Magnetic Resonance Imaging (MRI) datasets for hippocampal and cardiac segmentation. Experiments were performed aimed at (1) recreating existing segmentation techniques with the proposed framework and (2) demonstrating the potential of employing sparsely annotated atlas data for multi-atlas segmentation.
Collapse
|
4
|
An Overview of Segmentation Algorithms for the Analysis of Anomalies on Medical Images. JOURNAL OF INTELLIGENT SYSTEMS 2018. [DOI: 10.1515/jisys-2017-0629] [Citation(s) in RCA: 13] [Impact Index Per Article: 2.2] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 12/14/2022] Open
Abstract
Abstract
Human disease identification from the scanned body parts helps medical practitioners make the right decision in lesser time. Image segmentation plays a vital role in automated diagnosis for the delineation of anatomical organs and anomalies. There are many variants of segmentation algorithms used by current researchers, whereas there is no universal algorithm for all medical images. This paper classifies some of the widely used medical image segmentation algorithms based on their evolution, and the features of each generation are also discussed. The comparative analysis of segmentation algorithms is done based on characteristics like spatial consideration, region continuity, computation complexity, selection of parameters, noise immunity, accuracy, and computation time. Finally, in this work, some of the typical segmentation algorithms are implemented on real-time datasets using Matlab 2010 software, and the outcome of this work will be an aid for the researchers in medical image processing.
Collapse
|
5
|
Huo J, Wu J, Cao J, Wang G. Supervoxel based method for multi-atlas segmentation of brain MR images. Neuroimage 2018; 175:201-214. [PMID: 29625235 DOI: 10.1016/j.neuroimage.2018.04.001] [Citation(s) in RCA: 22] [Impact Index Per Article: 3.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/19/2017] [Revised: 03/30/2018] [Accepted: 04/01/2018] [Indexed: 01/01/2023] Open
Abstract
Multi-atlas segmentation has been widely applied to the analysis of brain MR images. However, the state-of-the-art techniques in multi-atlas segmentation, including both patch-based and learning-based methods, are strongly dependent on the pairwise registration or exhibit huge spatial inconsistency. The paper proposes a new segmentation framework based on supervoxels to solve the existing challenges of previous methods. The supervoxel is an aggregation of voxels with similar attributes, which can be used to replace the voxel grid. By formulating the segmentation as a tissue labeling problem associated with a maximum-a-posteriori inference in Markov random field, the problem is solved via a graphical model with supervoxels being considered as the nodes. In addition, a dense labeling scheme is developed to refine the supervoxel labeling results, and the spatial consistency is incorporated in the proposed method. The proposed approach is robust to the pairwise registration errors and of high computational efficiency. Extensive experimental evaluations on three publically available brain MR datasets demonstrate the effectiveness and superior performance of the proposed approach.
Collapse
Affiliation(s)
- Jie Huo
- Department of ECE, University of Windsor, Windsor N9B 3P4, Canada.
| | - Jonathan Wu
- Department of ECE, University of Windsor, Windsor N9B 3P4, Canada; Institute of Information and Control, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Jiuwen Cao
- Institute of Information and Control, Hangzhou Dianzi University, Hangzhou 310018, China
| | - Guanghui Wang
- Department of EECS, University of Kansas, Lawrence, KS 66045, USA.
| |
Collapse
|
6
|
Xia W, Moore J, Chen ECS, Xu Y, Ginty O, Bainbridge D, Peters TM. Signal dropout correction-based ultrasound segmentation for diastolic mitral valve modeling. J Med Imaging (Bellingham) 2018; 5:021214. [PMID: 29487886 PMCID: PMC5806032 DOI: 10.1117/1.jmi.5.2.021214] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/28/2017] [Accepted: 01/04/2018] [Indexed: 11/14/2022] Open
Abstract
Three-dimensional ultrasound segmentation of mitral valve (MV) at diastole is helpful for duplicating geometry and pathology in a patient-specific dynamic phantom. The major challenge is the signal dropout at leaflet regions in transesophageal echocardiography image data. Conventional segmentation approaches suffer from missing sonographic data leading to inaccurate MV modeling at leaflet regions. This paper proposes a signal dropout correction-based ultrasound segmentation method for diastolic MV modeling. The proposed method combines signal dropout correction, image fusion, continuous max-flow segmentation, and active contour segmentation techniques. The signal dropout correction approach is developed to recover the missing segmentation information. Once the signal dropout regions of TEE image data are recovered, the MV model can be accurately duplicated. Compared with other methods in current literature, the proposed algorithm exhibits lower computational cost. The experimental results show that the proposed algorithm gives competitive results for diastolic MV modeling compared with conventional segmentation algorithms, evaluated in terms of accuracy and efficiency.
Collapse
Affiliation(s)
- Wenyao Xia
- Western University, Robarts Research Institute, Canada
- Western University, Department of Medical Biophysics, Canada
| | - John Moore
- Western University, Robarts Research Institute, Canada
| | - Elvis C. S. Chen
- Western University, Robarts Research Institute, Canada
- Western University, Department of Medical Biophysics, Canada
- Western University, Biomedical Engineering Graduate Program, Canada
| | - Yuanwei Xu
- Western University, Robarts Research Institute, Canada
| | - Olivia Ginty
- Western University, Robarts Research Institute, Canada
| | | | - Terry M. Peters
- Western University, Robarts Research Institute, Canada
- Western University, Department of Medical Biophysics, Canada
- Western University, Biomedical Engineering Graduate Program, Canada
| |
Collapse
|
7
|
Ma C, Luo G, Wang K. A Combined Random Forests and Active Contour Model Approach for Fully Automatic Segmentation of the Left Atrium in Volumetric MRI. BIOMED RESEARCH INTERNATIONAL 2017; 2017:8381094. [PMID: 28316992 PMCID: PMC5337796 DOI: 10.1155/2017/8381094] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 11/25/2016] [Revised: 01/08/2017] [Accepted: 01/23/2017] [Indexed: 11/30/2022]
Abstract
Segmentation of the left atrium (LA) from cardiac magnetic resonance imaging (MRI) datasets is of great importance for image guided atrial fibrillation ablation, LA fibrosis quantification, and cardiac biophysical modelling. However, automated LA segmentation from cardiac MRI is challenging due to limited image resolution, considerable variability in anatomical structures across subjects, and dynamic motion of the heart. In this work, we propose a combined random forests (RFs) and active contour model (ACM) approach for fully automatic segmentation of the LA from cardiac volumetric MRI. Specifically, we employ the RFs within an autocontext scheme to effectively integrate contextual and appearance information from multisource images together for LA shape inferring. The inferred shape is then incorporated into a volume-scalable ACM for further improving the segmentation accuracy. We validated the proposed method on the cardiac volumetric MRI datasets from the STACOM 2013 and HVSMR 2016 databases and showed that it outperforms other latest automated LA segmentation methods. Validation metrics, average Dice coefficient (DC) and average surface-to-surface distance (S2S), were computed as 0.9227 ± 0.0598 and 1.14 ± 1.205 mm, versus those of 0.6222-0.878 and 1.34-8.72 mm, obtained by other methods, respectively.
Collapse
Affiliation(s)
- Chao Ma
- Biocomputing Research Center, School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
| | - Gongning Luo
- Biocomputing Research Center, School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
| | - Kuanquan Wang
- Biocomputing Research Center, School of Computer Science and Technology, Harbin Institute of Technology, Harbin 150001, China
| |
Collapse
|
8
|
Baxter JSH, Rajchl M, McLeod AJ, Yuan J, Peters TM. Directed Acyclic Graph Continuous Max-Flow Image Segmentation for Unconstrained Label Orderings. Int J Comput Vis 2017. [DOI: 10.1007/s11263-017-0994-x] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
|
9
|
Rajchl M, Lee MCH, Oktay O, Kamnitsas K, Passerat-Palmbach J, Bai W, Damodaram M, Rutherford MA, Hajnal JV, Kainz B, Rueckert D. DeepCut: Object Segmentation From Bounding Box Annotations Using Convolutional Neural Networks. IEEE TRANSACTIONS ON MEDICAL IMAGING 2017; 36:674-683. [PMID: 27845654 PMCID: PMC7115996 DOI: 10.1109/tmi.2016.2621185] [Citation(s) in RCA: 129] [Impact Index Per Article: 18.4] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/20/2023]
Abstract
In this paper, we propose DeepCut, a method to obtain pixelwise object segmentations given an image dataset labelled weak annotations, in our case bounding boxes. It extends the approach of the well-known GrabCut [1] method to include machine learning by training a neural network classifier from bounding box annotations. We formulate the problem as an energy minimisation problem over a densely-connected conditional random field and iteratively update the training targets to obtain pixelwise object segmentations. Additionally, we propose variants of the DeepCut method and compare those to a naïve approach to CNN training under weak supervision. We test its applicability to solve brain and lung segmentation problems on a challenging fetal magnetic resonance dataset and obtain encouraging results in terms of accuracy.
Collapse
|
10
|
Baxter JSH, Inoue J, Drangova M, Peters TM. Shape complexes: the intersection of label orderings and star convexity constraints in continuous max-flow medical image segmentation. J Med Imaging (Bellingham) 2016; 3:044005. [PMID: 28018937 DOI: 10.1117/1.jmi.3.4.044005] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/02/2016] [Accepted: 11/28/2016] [Indexed: 11/14/2022] Open
Abstract
Optimization-based segmentation approaches deriving from discrete graph-cuts and continuous max-flow have become increasingly nuanced, allowing for topological and geometric constraints on the resulting segmentation while retaining global optimality. However, these two considerations, topological and geometric, have yet to be combined in a unified manner. The concept of "shape complexes," which combine geodesic star convexity with extendable continuous max-flow solvers, is presented. These shape complexes allow more complicated shapes to be created through the use of multiple labels and super-labels, with geodesic star convexity governed by a topological ordering. These problems can be optimized using extendable continuous max-flow solvers. Previous approaches required computationally expensive coordinate system warping, which are ill-defined and ambiguous in the general case. These shape complexes are demonstrated in a set of synthetic images as well as vessel segmentation in ultrasound, valve segmentation in ultrasound, and atrial wall segmentation from contrast-enhanced CT. Shape complexes represent an extendable tool alongside other continuous max-flow methods that may be suitable for a wide range of medical image segmentation problems.
Collapse
Affiliation(s)
- John S H Baxter
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Jiro Inoue
- Western University , Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Maria Drangova
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Terry M Peters
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| |
Collapse
|
11
|
Liu J, Hoffman J, Zhao J, Yao J, Lu L, Kim L, Turkbey EB, Summers RM. Mediastinal lymph node detection and station mapping on chest CT using spatial priors and random forest. Med Phys 2016; 43:4362. [PMID: 27370151 PMCID: PMC4920813 DOI: 10.1118/1.4954009] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/06/2015] [Revised: 05/26/2016] [Accepted: 06/02/2016] [Indexed: 12/25/2022] Open
Abstract
PURPOSE To develop an automated system for mediastinal lymph node detection and station mapping for chest CT. METHODS The contextual organs, trachea, lungs, and spine are first automatically identified to locate the region of interest (ROI) (mediastinum). The authors employ shape features derived from Hessian analysis, local object scale, and circular transformation that are computed per voxel in the ROI. Eight more anatomical structures are simultaneously segmented by multiatlas label fusion. Spatial priors are defined as the relative multidimensional distance vectors corresponding to each structure. Intensity, shape, and spatial prior features are integrated and parsed by a random forest classifier for lymph node detection. The detected candidates are then segmented by the following curve evolution process. Texture features are computed on the segmented lymph nodes and a support vector machine committee is used for final classification. For lymph node station labeling, based on the segmentation results of the above anatomical structures, the textual definitions of mediastinal lymph node map according to the International Association for the Study of Lung Cancer are converted into patient-specific color-coded CT image, where the lymph node station can be automatically assigned for each detected node. RESULTS The chest CT volumes from 70 patients with 316 enlarged mediastinal lymph nodes are used for validation. For lymph node detection, their system achieves 88% sensitivity at eight false positives per patient. For lymph node station labeling, 84.5% of lymph nodes are correctly assigned to their stations. CONCLUSIONS Multiple-channel shape, intensity, and spatial prior features aggregated by a random forest classifier improve mediastinal lymph node detection on chest CT. Using the location information of segmented anatomic structures from the multiatlas formulation enables accurate identification of lymph node stations.
Collapse
Affiliation(s)
- Jiamin Liu
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| | - Joanne Hoffman
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| | - Jocelyn Zhao
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| | - Jianhua Yao
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| | - Le Lu
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| | - Lauren Kim
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| | - Evrim B Turkbey
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| | - Ronald M Summers
- Imaging Biomarkers and Computer-aided Diagnosis Laboratory, Radiology and Imaging Sciences, National Institutes of Health Clinical Center Building, 10 Room 1C224 MSC 1182, Bethesda, Maryland 20892-1182
| |
Collapse
|
12
|
Baxter JSH, Rajchl M, Peters TM, Chen ECS. Optimization-based interactive segmentation interface for multiregion problems. J Med Imaging (Bellingham) 2016; 3:024003. [PMID: 27335892 DOI: 10.1117/1.jmi.3.2.024003] [Citation(s) in RCA: 4] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/10/2016] [Accepted: 05/26/2016] [Indexed: 11/14/2022] Open
Abstract
Interactive segmentation is becoming of increasing interest to the medical imaging community in that it combines the positive aspects of both manual and automated segmentation. However, general-purpose tools have been lacking in terms of segmenting multiple regions simultaneously with a high degree of coupling between groups of labels. Hierarchical max-flow segmentation has taken advantage of this coupling for individual applications, but until recently, these algorithms were constrained to a particular hierarchy and could not be considered general-purpose. In a generalized form, the hierarchy for any given segmentation problem is specified in run-time, allowing different hierarchies to be quickly explored. We present an interactive segmentation interface, which uses generalized hierarchical max-flow for optimization-based multiregion segmentation guided by user-defined seeds. Applications in cardiac and neonatal brain segmentation are given as example applications of its generality.
Collapse
Affiliation(s)
- John S H Baxter
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Martin Rajchl
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Imperial College London, Department of Computing, Exhibition Road, London SW7 2AZ, United Kingdom
| | - Terry M Peters
- Western University, Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada; Western University, Biomedical Engineering Graduate Program, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| | - Elvis C S Chen
- Western University , Robarts Research Institute, 1151 Richmond Street N., London, Ontario N6A 5B7, Canada
| |
Collapse
|
13
|
Wang K, Ma C. A robust statistics driven volume-scalable active contour for segmenting anatomical structures in volumetric medical images with complex conditions. Biomed Eng Online 2016; 15:39. [PMID: 27074891 PMCID: PMC4831199 DOI: 10.1186/s12938-016-0153-6] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/08/2015] [Accepted: 04/01/2016] [Indexed: 11/10/2022] Open
Abstract
BACKGROUND Accurate segmentation of anatomical structures in medical images is a critical step in the development of computer assisted intervention systems. However, complex image conditions, such as intensity inhomogeneity, noise and weak object boundary, often cause considerable difficulties in medical image segmentation. To cope with these difficulties, we propose a novel robust statistics driven volume-scalable active contour framework, to extract desired object boundary from magnetic resonance (MR) and computed tomography (CT) imagery in 3D. METHODS We define an energy functional in terms of the initial seeded labels and two fitting functions that are derived from object local robust statistics features. This energy is then incorporated into a level set scheme which drives the active contour evolving and converging at the desired position of the object boundary. Due to the local robust statistics and the volume scaling function in the energy fitting term, the object features in local volumes are learned adaptively to guide the motion of the contours, which thereby guarantees the capability of our method to cope with intensity inhomogeneity, noise and weak boundary. In addition, the initialization of active contour is simplified by select several seeds in the object and/or background to eliminate the sensitivity to initialization. RESULTS The proposed method was applied to extensive public available volumetric medical images with challenging image conditions. The segmentation results of various anatomical structures, such as white matter (WM), atrium, caudate nucleus and brain tumor, were evaluated quantitatively by comparing with the corresponding ground truths. It was found that the proposed method achieves consistent and coherent segmentation accuracy of 0.9246 ± 0.0068 for WM, 0.9043 ± 0.0131 for liver tumors, 0.8725 ± 0.0374 for caudate nucleus, 0.8802 ± 0.0595 for brain tumors, etc., measured by Dice similarity coefficients value for the overlap between the algorithm one and the ground truth. Further comparative experimental results showed desirable performances of the proposed method over several well-known segmentation methods in terms of accuracy and robustness. CONCLUSION We proposed an approach to accurate segment volumetric medical images with complex conditions. The accuracy of segmentation, robustness to noise and contour initialization were validated on the basis of extensive MR and CT volumes.
Collapse
Affiliation(s)
- Kuanquan Wang
- School of Computer Science and Technology, Biocomputing Research Center, Harbin Institute of Technology, Harbin, China.
| | - Chao Ma
- School of Computer Science and Technology, Biocomputing Research Center, Harbin Institute of Technology, Harbin, China
| |
Collapse
|
14
|
Liu M, Kitsch A, Miller S, Chau V, Poskitt K, Rousseau F, Shaw D, Studholme C. Patch-based augmentation of Expectation-Maximization for brain MRI tissue segmentation at arbitrary age after premature birth. Neuroimage 2016; 127:387-408. [PMID: 26702777 PMCID: PMC4755845 DOI: 10.1016/j.neuroimage.2015.12.009] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.6] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/04/2015] [Revised: 12/04/2015] [Accepted: 12/08/2015] [Indexed: 01/18/2023] Open
Abstract
Accurate automated tissue segmentation of premature neonatal magnetic resonance images is a crucial task for quantification of brain injury and its impact on early postnatal growth and later cognitive development. In such studies it is common for scans to be acquired shortly after birth or later during the hospital stay and therefore occur at arbitrary gestational ages during a period of rapid developmental change. It is important to be able to segment any of these scans with comparable accuracy. Previous work on brain tissue segmentation in premature neonates has focused on segmentation at specific ages. Here we look at solving the more general problem using adaptations of age specific atlas based methods and evaluate this using a unique manually traced database of high resolution images spanning 20 gestational weeks of development. We examine the complimentary strengths of age specific atlas-based Expectation-Maximization approaches and patch-based methods for this problem and explore the development of two new hybrid techniques, patch-based augmentation of Expectation-Maximization with weighted fusion and a spatial variability constrained patch search. The former approach seeks to combine the advantages of both atlas- and patch-based methods by learning from the performance of the two techniques across the brain anatomy at different developmental ages, while the latter technique aims to use anatomical variability maps learnt from atlas training data to locally constrain the patch-based search range. The proposed approaches were evaluated using leave-one-out cross-validation. Compared with the conventional age specific atlas-based segmentation and direct patch based segmentation, both new approaches demonstrate improved accuracy in the automated labeling of cortical gray matter, white matter, ventricles and sulcal cortical-spinal fluid regions, while maintaining comparable results in deep gray matter.
Collapse
Affiliation(s)
- Mengyuan Liu
- Biomedical Image Computing Group, Department of Pediatrics, Bioengineering and Radiology, University of Washington, HSB, NE Pacific St., Seattle, WA 98195, USA.
| | - Averi Kitsch
- Biomedical Image Computing Group, Department of Pediatrics, Bioengineering and Radiology, University of Washington, HSB, NE Pacific St., Seattle, WA 98195, USA
| | - Steven Miller
- Center for Brain and Mental Health, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada; Department of Pediatrics, University of Toronto, Toronto, ON M5S, Canada
| | - Vann Chau
- Center for Brain and Mental Health, The Hospital for Sick Children, Toronto, ON M5G 1X8, Canada; Department of Pediatrics, University of Toronto, Toronto, ON M5S, Canada
| | - Kenneth Poskitt
- Department of Pediatrics, University of British Columbia, Vancouver, BC V5Z 4H4, Canada
| | - Francois Rousseau
- Institut Mines Télécom, Télécom Bretagne, Latim INSERM U1101, Brest, France
| | - Dennis Shaw
- Department of Radiology, Seattle Children's Hospital, Seattle, WA 98105, USA
| | - Colin Studholme
- Biomedical Image Computing Group, Department of Pediatrics, Bioengineering and Radiology, University of Washington, HSB, NE Pacific St., Seattle, WA 98195, USA
| |
Collapse
|
15
|
Pagnozzi AM, Gal Y, Boyd RN, Fiori S, Fripp J, Rose S, Dowson N. The need for improved brain lesion segmentation techniques for children with cerebral palsy: A review. Int J Dev Neurosci 2015; 47:229-46. [DOI: 10.1016/j.ijdevneu.2015.08.004] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.2] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/14/2015] [Revised: 08/24/2015] [Accepted: 08/24/2015] [Indexed: 01/18/2023] Open
Affiliation(s)
- Alex M. Pagnozzi
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
- The University of QueenslandSchool of MedicineSt. LuciaBrisbaneAustralia
| | - Yaniv Gal
- The University of QueenslandCentre for Medical Diagnostic Technologies in QueenslandSt. LuciaBrisbaneAustralia
| | - Roslyn N. Boyd
- The University of QueenslandQueensland Cerebral Palsy and Rehabilitation Research CentreSchool of MedicineBrisbaneAustralia
| | - Simona Fiori
- Department of Developmental NeuroscienceStella Maris Scientific InstitutePisaItaly
| | - Jurgen Fripp
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
| | - Stephen Rose
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
| | - Nicholas Dowson
- CSIRO Digital Productivity and Services FlagshipThe Australian e‐Health Research CentreBrisbaneAustralia
| |
Collapse
|