1
|
Li Y, Cui J, Sheng Y, Liang X, Wang J, Chang EIC, Xu Y. Whole brain segmentation with full volume neural network. Comput Med Imaging Graph 2021; 93:101991. [PMID: 34634548 DOI: 10.1016/j.compmedimag.2021.101991] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/10/2021] [Revised: 06/13/2021] [Accepted: 09/06/2021] [Indexed: 10/20/2022]
Abstract
Whole brain segmentation is an important neuroimaging task that segments the whole brain volume into anatomically labeled regions-of-interest. Convolutional neural networks have demonstrated good performance in this task. Existing solutions, usually segment the brain image by classifying the voxels, or labeling the slices or the sub-volumes separately. Their representation learning is based on parts of the whole volume whereas their labeling result is produced by aggregation of partial segmentation. Learning and inference with incomplete information could lead to sub-optimal final segmentation result. To address these issues, we propose to adopt a full volume framework, which feeds the full volume brain image into the segmentation network and directly outputs the segmentation result for the whole brain volume. The framework makes use of complete information in each volume and can be implemented easily. An effective instance in this framework is given subsequently. We adopt the 3D high-resolution network (HRNet) for learning spatially fine-grained representations and the mixed precision training scheme for memory-efficient training. Extensive experiment results on a publicly available 3D MRI brain dataset show that our proposed model advances the state-of-the-art methods in terms of segmentation performance.
Collapse
Affiliation(s)
- Yeshu Li
- Department of Computer Science, University of Illinois at Chicago, Chicago, IL 60607, United States.
| | - Jonathan Cui
- Vacaville Christian Schools, Vacaville, CA 95687, United States.
| | - Yilun Sheng
- Institute for Interdisciplinary Information Sciences, Tsinghua University, Beijing 100084, China; Microsoft Research, Beijing 100080, China.
| | - Xiao Liang
- High School Affiliated to Renmin University of China, Beijing 100080, China.
| | | | | | - Yan Xu
- School of Biological Science and Medical Engineering and Beijing Advanced Innovation Centre for Biomedical Engineering, Beihang University, Beijing 100191, China; Microsoft Research, Beijing 100080, China.
| |
Collapse
|
2
|
Computerized Detection of Normal and Abnormal Tissues from Brain MRI. ARCHIVES OF NEUROSCIENCE 2019. [DOI: 10.5812/ans.84581] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/16/2022]
|
3
|
A fast stochastic framework for automatic MR brain images segmentation. PLoS One 2017; 12:e0187391. [PMID: 29136034 PMCID: PMC5685492 DOI: 10.1371/journal.pone.0187391] [Citation(s) in RCA: 8] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/19/2017] [Accepted: 10/19/2017] [Indexed: 12/05/2022] Open
Abstract
This paper introduces a new framework for the segmentation of different brain structures (white matter, gray matter, and cerebrospinal fluid) from 3D MR brain images at different life stages. The proposed segmentation framework is based on a shape prior built using a subset of co-aligned training images that is adapted during the segmentation process based on first- and second-order visual appearance characteristics of MR images. These characteristics are described using voxel-wise image intensities and their spatial interaction features. To more accurately model the empirical grey level distribution of the brain signals, we use a linear combination of discrete Gaussians (LCDG) model having positive and negative components. To accurately account for the large inhomogeneity in infant MRIs, a higher-order Markov-Gibbs Random Field (MGRF) spatial interaction model that integrates third- and fourth- order families with a traditional second-order model is proposed. The proposed approach was tested and evaluated on 102 3D MR brain scans using three metrics: the Dice coefficient, the 95-percentile modified Hausdorff distance, and the absolute brain volume difference. Experimental results show better segmentation of MR brain images compared to current open source segmentation tools.
Collapse
|
4
|
|
5
|
Wang Q, Li Q, Zhou M, Sun Z, Liu H, Wang Y. A hyperspectral vessel image registration method for blood oxygenation mapping. PLoS One 2017; 12:e0178499. [PMID: 28570589 PMCID: PMC5453521 DOI: 10.1371/journal.pone.0178499] [Citation(s) in RCA: 3] [Impact Index Per Article: 0.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2017] [Accepted: 05/14/2017] [Indexed: 11/19/2022] Open
Abstract
Blood oxygenation mapping by the means of optical oximetry is of significant importance in clinical trials. This paper uses hyperspectral imaging technology to obtain in vivo images for blood oxygenation detection. The experiment involves dorsal skin fold window chamber preparation which was built on adult (8-10 weeks of age) female BALB/c nu/nu mice and in vivo image acquisition which was performed by hyperspectral imaging system. To get the accurate spatial and spectral information of targets, an automatic registration scheme is proposed. An adaptive feature detection method which combines the local threshold method and the level-set filter is presented to extract target vessels. A reliable feature matching algorithm with the correlative information inherent in hyperspectral images is used to kick out the outliers. Then, the registration images are used for blood oxygenation mapping. Registration evaluation results show that most of the false matches are removed and the smooth and concentrated spectra are obtained. This intensity invariant feature detection with outliers-removing feature matching proves to be effective in hyperspectral vessel image registration. Therefore, in vivo hyperspectral imaging system by the assistance of the proposed registration scheme provides a technique for blood oxygenation research.
Collapse
Affiliation(s)
- Qian Wang
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China
| | - Qingli Li
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China
| | - Mei Zhou
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China
| | - Zhen Sun
- Jinling Hosp, Dept of Tangshan branch/sanatorium, Nanjing University, Sch. Med., Nanjing, China
| | - Hongying Liu
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China
| | - Yiting Wang
- Shanghai Key Laboratory of Multidimensional Information Processing, East China Normal University, Shanghai, China
| |
Collapse
|
6
|
Nitzken MJ, Casanova MF, Gimelfarb G, Inanc T, Zurada JM, El-Baz A. Shape analysis of the human brain: a brief survey. IEEE J Biomed Health Inform 2015; 18:1337-54. [PMID: 25014938 DOI: 10.1109/jbhi.2014.2298139] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/10/2022]
Abstract
The survey outlines and compares popular computational techniques for quantitative description of shapes of major structural parts of the human brain, including medial axis and skeletal analysis, geodesic distances, Procrustes analysis, deformable models, spherical harmonics, and deformation morphometry, as well as other less widely used techniques. Their advantages, drawbacks, and emerging trends, as well as results of applications, in particular, for computer-aided diagnostics, are discussed.
Collapse
|
7
|
MRI segmentation of the human brain: challenges, methods, and applications. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:450341. [PMID: 25945121 PMCID: PMC4402572 DOI: 10.1155/2015/450341] [Citation(s) in RCA: 245] [Impact Index Per Article: 24.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/27/2014] [Revised: 09/11/2014] [Accepted: 10/01/2014] [Indexed: 12/25/2022]
Abstract
Image segmentation is one of the most important tasks in medical image analysis and is often the first and the most critical step in many clinical applications. In brain MRI analysis, image segmentation is commonly used for measuring and visualizing the brain's anatomical structures, for analyzing brain changes, for delineating pathological regions, and for surgical planning and image-guided interventions. In the last few decades, various segmentation techniques of different accuracy and degree of complexity have been developed and reported in the literature. In this paper we review the most popular methods commonly used for brain MRI segmentation. We highlight differences between them and discuss their capabilities, advantages, and limitations. To address the complexity and challenges of the brain MRI segmentation problem, we first introduce the basic concepts of image segmentation. Then, we explain different MRI preprocessing steps including image registration, bias field correction, and removal of nonbrain tissue. Finally, after reviewing different brain MRI segmentation methods, we discuss the validation problem in brain MRI segmentation.
Collapse
|
8
|
Soher BJ, Wu WE, Tal A, Storey P, Zhang K, Babb JS, Lui YW, Gonen O. Automated whole-brain N-acetylaspartate proton MRS quantification. NMR IN BIOMEDICINE 2014; 27:1275-84. [PMID: 25196714 PMCID: PMC4212831 DOI: 10.1002/nbm.3185] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Received: 01/15/2014] [Revised: 07/16/2014] [Accepted: 07/18/2014] [Indexed: 06/03/2023]
Abstract
Concentration of the neuronal marker, N-acetylaspartate (NAA), a quantitative metric for the health and density of neurons, is currently obtained by integration of the manually defined peak in whole-head proton ((1) H)-MRS. Our goal was to develop a full spectral modeling approach for the automatic estimation of the whole-brain NAA concentration (WBNAA) and to compare the performance of this approach with a manual frequency-range peak integration approach previously employed. MRI and whole-head (1) H-MRS from 18 healthy young adults were examined. Non-localized, whole-head (1) H-MRS obtained at 3 T yielded the NAA peak area through both manually defined frequency-range integration and the new, full spectral simulation. The NAA peak area was converted into an absolute amount with phantom replacement and normalized for brain volume (segmented from T1 -weighted MRI) to yield WBNAA. A paired-sample t test was used to compare the means of the WBNAA paradigms and a likelihood ratio test used to compare their coefficients of variation. While the between-subject WBNAA means were nearly identical (12.8 ± 2.5 mm for integration, 12.8 ± 1.4 mm for spectral modeling), the latter's standard deviation was significantly smaller (by ~50%, p = 0.026). The within-subject variability was 11.7% (±1.3 mm) for integration versus 7.0% (±0.8 mm) for spectral modeling, i.e., a 40% improvement. The (quantifiable) quality of the modeling approach was high, as reflected by Cramer-Rao lower bounds below 0.1% and vanishingly small (experimental - fitted) residuals. Modeling of the whole-head (1) H-MRS increases WBNAA quantification reliability by reducing its variability, its susceptibility to operator bias and baseline roll, and by providing quality-control feedback. Together, these enhance the usefulness of the technique for monitoring the diffuse progression and treatment response of neurological disorders.
Collapse
Affiliation(s)
- Brian J. Soher
- Department of Radiology, Duke University Medical Center, Durham NC, 27710, USA
| | - William E. Wu
- Department of Radiology, New York University School of Medicine, New York, NY 10016, USA
| | - Assaf Tal
- Department of Radiology, New York University School of Medicine, New York, NY 10016, USA
| | - Pippa Storey
- Department of Radiology, New York University School of Medicine, New York, NY 10016, USA
| | - Ke Zhang
- Department of Radiology, New York University School of Medicine, New York, NY 10016, USA
| | - James. S. Babb
- Department of Radiology, New York University School of Medicine, New York, NY 10016, USA
| | - Yvonne W. Lui
- Department of Radiology, New York University School of Medicine, New York, NY 10016, USA
| | - Oded Gonen
- Department of Radiology, New York University School of Medicine, New York, NY 10016, USA
| |
Collapse
|
9
|
Changyang Li, Xiuying Wang, Eberl S, Fulham M, Yong Yin, Jinhu Chen, Feng DD. A Likelihood and Local Constraint Level Set Model for Liver Tumor Segmentation from CT Volumes. IEEE Trans Biomed Eng 2013; 60:2967-77. [DOI: 10.1109/tbme.2013.2267212] [Citation(s) in RCA: 82] [Impact Index Per Article: 6.8] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/09/2022]
|
10
|
Srinivasan A, Sundaram S. Applications of deformable models for in-dopth analysis and feature extraction from medical images—A review. PATTERN RECOGNITION AND IMAGE ANALYSIS 2013. [DOI: 10.1134/s1054661813020132] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.5] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 11/23/2022]
|
11
|
Zhai YR, Zhong J, Yan R, Li K, Zeng D. A novel method of obtaining 3D images of detached retina. COMPUTER METHODS AND PROGRAMS IN BIOMEDICINE 2012; 108:665-668. [PMID: 22153784 DOI: 10.1016/j.cmpb.2011.11.007] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Received: 07/18/2011] [Revised: 10/19/2011] [Accepted: 11/20/2011] [Indexed: 05/31/2023]
Abstract
We describe a new method of obtaining three-dimensional (3D) images of detached retina. Twelve-slice photos of the partial retina were obtained according to the twelve positions on a clock face. Twelve sections were then cut from these photos and joined together. Each sector was resized to match nearby sectors and the complete retinal picture was then created. A sphere mapping algorithm was used to map the two-dimensional (2D) picture to a sphere, which was then used to simulate the actual eyeball. Finally, a 3D image of the entire retina with a clearly visible detached section was created by the Visualization Toolkit (VTK).
Collapse
Affiliation(s)
- Yi-ran Zhai
- Key Laboratory for Neuro Information of Ministry of Education, School of Life Science and Technology, University of Electronic Science and Technology of China, and The Ophthalmology Department of Sichuan Province People's Hospital, Chengdu 610054, People's Republic of China.
| | | | | | | | | |
Collapse
|
12
|
Wang H, Das SR, Suh JW, Altinay M, Pluta J, Craige C, Avants B, Yushkevich PA. A learning-based wrapper method to correct systematic errors in automatic image segmentation: consistently improved performance in hippocampus, cortex and brain segmentation. Neuroimage 2011; 55:968-85. [PMID: 21237273 DOI: 10.1016/j.neuroimage.2011.01.006] [Citation(s) in RCA: 130] [Impact Index Per Article: 9.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/13/2010] [Revised: 12/30/2010] [Accepted: 01/05/2011] [Indexed: 11/15/2022] Open
Abstract
We propose a simple but generally applicable approach to improving the accuracy of automatic image segmentation algorithms relative to manual segmentations. The approach is based on the hypothesis that a large fraction of the errors produced by automatic segmentation are systematic, i.e., occur consistently from subject to subject, and serves as a wrapper method around a given host segmentation method. The wrapper method attempts to learn the intensity, spatial and contextual patterns associated with systematic segmentation errors produced by the host method on training data for which manual segmentations are available. The method then attempts to correct such errors in segmentations produced by the host method on new images. One practical use of the proposed wrapper method is to adapt existing segmentation tools, without explicit modification, to imaging data and segmentation protocols that are different from those on which the tools were trained and tuned. An open-source implementation of the proposed wrapper method is provided, and can be applied to a wide range of image segmentation problems. The wrapper method is evaluated with four host brain MRI segmentation methods: hippocampus segmentation using FreeSurfer (Fischl et al., 2002); hippocampus segmentation using multi-atlas label fusion (Artaechevarria et al., 2009); brain extraction using BET (Smith, 2002); and brain tissue segmentation using FAST (Zhang et al., 2001). The wrapper method generates 72%, 14%, 29% and 21% fewer erroneously segmented voxels than the respective host segmentation methods. In the hippocampus segmentation experiment with multi-atlas label fusion as the host method, the average Dice overlap between reference segmentations and segmentations produced by the wrapper method is 0.908 for normal controls and 0.893 for patients with mild cognitive impairment. Average Dice overlaps of 0.964, 0.905 and 0.951 are obtained for brain extraction, white matter segmentation and gray matter segmentation, respectively.
Collapse
Affiliation(s)
- Hongzhi Wang
- Penn Image Computing and Science Laboratory, Department of Radiology, University of Pennsylvania, Philadelphia, PA, USA.
| | | | | | | | | | | | | | | |
Collapse
|
13
|
Farzan A, Rahman Ramli A, Mashohor S, Mahmud R. Fuzzy modeling of brain tissues in Bayesian segmentation of brain MR images. 2010 IEEE EMBS CONFERENCE ON BIOMEDICAL ENGINEERING AND SCIENCES (IECBES) 2010. [DOI: 10.1109/iecbes.2010.5742203] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 09/01/2023]
|
14
|
Weiner MW, Aisen PS, Jack CR, Jagust WJ, Trojanowski JQ, Shaw L, Saykin AJ, Morris JC, Cairns N, Beckett LA, Toga A, Green R, Walter S, Soares H, Snyder P, Siemers E, Potter W, Cole PE, Schmidt M. The Alzheimer's disease neuroimaging initiative: progress report and future plans. Alzheimers Dement 2010; 6:202-11.e7. [PMID: 20451868 PMCID: PMC2927112 DOI: 10.1016/j.jalz.2010.03.007] [Citation(s) in RCA: 390] [Impact Index Per Article: 26.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/27/2010] [Accepted: 03/03/2010] [Indexed: 01/18/2023]
Abstract
The Alzheimer's Disease Neuroimaging Initiative (ADNI) beginning in October 2004, is a 6-year research project that studies changes of cognition, function, brain structure and function, and biomarkers in elderly controls, subjects with mild cognitive impairment, and subjects with Alzheimer's disease (AD). A major goal is to determine and validate MRI, PET images, and cerebrospinal fluid (CSF)/blood biomarkers as predictors and outcomes for use in clinical trials of AD treatments. Structural MRI, FDG PET, C-11 Pittsburgh compound B (PIB) PET, CSF measurements of amyloid beta (Abeta) and species of tau, with clinical/cognitive measurements were performed on elderly controls, subjects with mild cognitive impairment, and subjects with AD. Structural MRI shows high rates of brain atrophy, and has high statistical power for determining treatment effects. FDG PET, C-11 Pittsburgh compound B PET, and CSF measurements of Abeta and tau were significant predictors of cognitive decline and brain atrophy. All data are available at UCLA/LONI/ADNI, without embargo. ADNI-like projects started in Australia, Europe, Japan, and Korea. ADNI provides significant new information concerning the progression of AD.
Collapse
Affiliation(s)
- Michael W Weiner
- Center for Imaging of Neurodegenerative Diseases, San Francisco VA Medical Center, San Francisco, CA, USA.
| | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|