1
|
Zhao L, Asis-Cruz JD, Feng X, Wu Y, Kapse K, Largent A, Quistorff J, Lopez C, Wu D, Qing K, Meyer C, Limperopoulos C. Automated 3D Fetal Brain Segmentation Using an Optimized Deep Learning Approach. AJNR Am J Neuroradiol 2022; 43:448-454. [PMID: 35177547 PMCID: PMC8910820 DOI: 10.3174/ajnr.a7419] [Citation(s) in RCA: 22] [Impact Index Per Article: 7.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/25/2021] [Accepted: 12/06/2021] [Indexed: 01/01/2023]
Abstract
BACKGROUND AND PURPOSE MR imaging provides critical information about fetal brain growth and development. Currently, morphologic analysis primarily relies on manual segmentation, which is time-intensive and has limited repeatability. This work aimed to develop a deep learning-based automatic fetal brain segmentation method that provides improved accuracy and robustness compared with atlas-based methods. MATERIALS AND METHODS A total of 106 fetal MR imaging studies were acquired prospectively from fetuses between 23 and 39 weeks of gestation. We trained a deep learning model on the MR imaging scans of 65 healthy fetuses and compared its performance with a 4D atlas-based segmentation method using the Wilcoxon signed-rank test. The trained model was also evaluated on data from 41 fetuses diagnosed with congenital heart disease. RESULTS The proposed method showed high consistency with the manual segmentation, with an average Dice score of 0.897. It also demonstrated significantly improved performance (P < .001) based on the Dice score and 95% Hausdorff distance in all brain regions compared with the atlas-based method. The performance of the proposed method was consistent across gestational ages. The segmentations of the brains of fetuses with high-risk congenital heart disease were also highly consistent with the manual segmentation, though the Dice score was 7% lower than that of healthy fetuses. CONCLUSIONS The proposed deep learning method provides an efficient and reliable approach for fetal brain segmentation, which outperformed segmentation based on a 4D atlas and has been used in clinical and research settings.
Collapse
Affiliation(s)
- L Zhao
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
- Department of Biomedical Engineering (L.Z., D.W.), Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering & Instrument Science, Zhejiang University, China
| | - J D Asis-Cruz
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
| | - X Feng
- Department of Biomedical Engineering (X.F., C.M.), University of Virginia, Charlottesville, Virginia
| | - Y Wu
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
| | - K Kapse
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
| | - A Largent
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
| | - J Quistorff
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
| | - C Lopez
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
| | - D Wu
- Department of Biomedical Engineering (L.Z., D.W.), Key Laboratory for Biomedical Engineering of Ministry of Education, College of Biomedical Engineering & Instrument Science, Zhejiang University, China
| | - K Qing
- Department of Radiation Oncology (K.Q.), City of Hope National Center, Duarte, California
| | - C Meyer
- Department of Biomedical Engineering (X.F., C.M.), University of Virginia, Charlottesville, Virginia
| | - C Limperopoulos
- From the Department of Diagnostic Imaging and Radiology (L.Z., J.D.A.-C., Y.W., K.K., A.L., J.Q., C. Lopez, C. Limperopoulos), Developing Brain Institute, Children's National, Washington, DC
| |
Collapse
|
2
|
Wang L, Li G, Adeli E, Liu M, Wu Z, Meng Y, Lin W, Shen D. Anatomy-guided joint tissue segmentation and topological correction for 6-month infant brain MRI with risk of autism. Hum Brain Mapp 2018; 39:2609-2623. [PMID: 29516625 PMCID: PMC5951769 DOI: 10.1002/hbm.24027] [Citation(s) in RCA: 15] [Impact Index Per Article: 2.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2017] [Revised: 02/01/2018] [Accepted: 02/19/2018] [Indexed: 01/14/2023] Open
Abstract
Tissue segmentation of infant brain MRIs with risk of autism is critically important for characterizing early brain development and identifying biomarkers. However, it is challenging due to low tissue contrast caused by inherent ongoing myelination and maturation. In particular, at around 6 months of age, the voxel intensities in both gray matter and white matter are within similar ranges, thus leading to the lowest image contrast in the first postnatal year. Previous studies typically employed intensity images and tentatively estimated tissue probabilities to train a sequence of classifiers for tissue segmentation. However, the important prior knowledge of brain anatomy is largely ignored during the segmentation. Consequently, the segmentation accuracy is still limited and topological errors frequently exist, which will significantly degrade the performance of subsequent analyses. Although topological errors could be partially handled by retrospective topological correction methods, their results may still be anatomically incorrect. To address these challenges, in this article, we propose an anatomy-guided joint tissue segmentation and topological correction framework for isointense infant MRI. Particularly, we adopt a signed distance map with respect to the outer cortical surface as anatomical prior knowledge, and incorporate such prior information into the proposed framework to guide segmentation in ambiguous regions. Experimental results on the subjects acquired from National Database for Autism Research demonstrate the effectiveness to topological errors and also some levels of robustness to motion. Comparisons with the state-of-the-art methods further demonstrate the advantages of the proposed method in terms of both segmentation accuracy and topological correctness.
Collapse
Affiliation(s)
- Li Wang
- IDEA Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
| | - Gang Li
- IDEA Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
| | - Ehsan Adeli
- IDEA Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
| | - Mingxia Liu
- IDEA Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
| | - Zhengwang Wu
- IDEA Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
| | - Yu Meng
- IDEA Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
- Department of Computer ScienceUniversity of North Carolina at Chapel HillNorth Carolina
| | - Weili Lin
- MRI Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
| | - Dinggang Shen
- IDEA Lab, Department of Radiology and BRICUniversity of North Carolina at Chapel HillNorth Carolina
- Department of Brain and Cognitive EngineeringKorea UniversitySeoul02841Republic of Korea
| |
Collapse
|
3
|
Makropoulos A, Counsell SJ, Rueckert D. A review on automatic fetal and neonatal brain MRI segmentation. Neuroimage 2018; 170:231-248. [DOI: 10.1016/j.neuroimage.2017.06.074] [Citation(s) in RCA: 100] [Impact Index Per Article: 14.3] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2016] [Revised: 03/06/2017] [Accepted: 06/26/2017] [Indexed: 01/18/2023] Open
|
4
|
Computational neuroanatomy of baby brains: A review. Neuroimage 2018; 185:906-925. [PMID: 29574033 DOI: 10.1016/j.neuroimage.2018.03.042] [Citation(s) in RCA: 116] [Impact Index Per Article: 16.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/15/2017] [Revised: 02/23/2018] [Accepted: 03/19/2018] [Indexed: 12/12/2022] Open
Abstract
The first postnatal years are an exceptionally dynamic and critical period of structural, functional and connectivity development of the human brain. The increasing availability of non-invasive infant brain MR images provides unprecedented opportunities for accurate and reliable charting of dynamic early brain developmental trajectories in understanding normative and aberrant growth. However, infant brain MR images typically exhibit reduced tissue contrast (especially around 6 months of age), large within-tissue intensity variations, and regionally-heterogeneous, dynamic changes, in comparison with adult brain MR images. Consequently, the existing computational tools developed typically for adult brains are not suitable for infant brain MR image processing. To address these challenges, many infant-tailored computational methods have been proposed for computational neuroanatomy of infant brains. In this review paper, we provide a comprehensive review of the state-of-the-art computational methods for infant brain MRI processing and analysis, which have advanced our understanding of early postnatal brain development. We also summarize publically available infant-dedicated resources, including MRI datasets, computational tools, grand challenges, and brain atlases. Finally, we discuss the limitations in current research and suggest potential future research directions.
Collapse
|
5
|
Hou Y, Park SH, Wang Q, Zhang J, Zong X, Lin W, Shen D. Enhancement of Perivascular Spaces in 7 T MR Image using Haar Transform of Non-local Cubes and Block-matching Filtering. Sci Rep 2017; 7:8569. [PMID: 28819140 PMCID: PMC5561084 DOI: 10.1038/s41598-017-09336-5] [Citation(s) in RCA: 24] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/05/2017] [Accepted: 07/17/2017] [Indexed: 11/09/2022] Open
Abstract
Perivascular spaces (PVSs) in brain have a close relationship with typical neurological diseases. The quantitative studies of PVSs are meaningful but usually difficult, due to their thin and weak signals and also background noise in the 7 T brain magnetic resonance images (MRI). To clearly distinguish the PVSs in the 7 T MRI, we propose a novel PVS enhancement method based on the Haar transform of non-local cubes. Specifically, we extract a certain number of cubes from a small neighbor to form a cube group, and then perform Haar transform on each cube group. The Haar transform coefficients are processed using a nonlinear function to amplify the weak signals relevant to the PVSs and to suppress the noise. The enhanced image is reconstructed using the inverse Haar transform of the processed coefficients. Finally, we perform a block-matching 4D filtering on the enhanced image to further remove any remaining noise, and thus obtain an enhanced and denoised 7 T MRI for PVS segmentation. We apply two existing methods to complete PVS segmentation, i.e., (1) vesselness-thresholding and (2) random forest classification. The experimental results show that the PVS segmentation performances can be significantly improved by using the enhanced and denoised 7 T MRI.
Collapse
Affiliation(s)
- Yingkun Hou
- School of Information Science and Technology, Taishan University, Taian, 271000, China.,Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Sang Hyun Park
- Department of Robotics Engineering, Daegu Gyeongbuk Institute of Science and Technology, Daegu, 42988, South Korea
| | - Qian Wang
- Med-X Research Institute, School of Biomedical Engineering, Shanghai Jiao Tong University, Shanghai, 200030, China
| | - Jun Zhang
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Xiaopeng Zong
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Weili Lin
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA
| | - Dinggang Shen
- Department of Radiology and Biomedical Research Imaging Center, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, USA. .,Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, South Korea.
| |
Collapse
|
6
|
Dong P, Wang L, Lin W, Shen D, Wu G. Scalable Joint Segmentation and Registration Framework for Infant Brain Images. Neurocomputing 2017; 229:54-62. [PMID: 29416227 PMCID: PMC5798494 DOI: 10.1016/j.neucom.2016.05.107] [Citation(s) in RCA: 7] [Impact Index Per Article: 0.9] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 10/20/2022]
Abstract
The first year of life is the most dynamic and perhaps the most critical phase of postnatal brain development. The ability to accurately measure structure changes is critical in early brain development study, which highly relies on the performances of image segmentation and registration techniques. However, either infant image segmentation or registration, if deployed independently, encounters much more challenges than segmentation/registration of adult brains due to dynamic appearance change with rapid brain development. In fact, image segmentation and registration of infant images can assists each other to overcome the above challenges by using the growth trajectories (i.e., temporal correspondences) learned from a large set of training subjects with complete longitudinal data. Specifically, a one-year-old image with ground-truth tissue segmentation can be first set as the reference domain. Then, to register the infant image of a new subject at earlier age, we can estimate its tissue probability maps, i.e., with sparse patch-based multi-atlas label fusion technique, where only the training images at the respective age are considered as atlases since they have similar image appearance. Next, these probability maps can be fused as a good initialization to guide the level set segmentation. Thus, image registration between the new infant image and the reference image is free of difficulty of appearance changes, by establishing correspondences upon the reasonably segmented images. Importantly, the segmentation of new infant image can be further enhanced by propagating the much more reliable label fusion heuristics at the reference domain to the corresponding location of the new infant image via the learned growth trajectories, which brings image segmentation and registration to assist each other. It is worth noting that our joint segmentation and registration framework is also flexible to handle the registration of any two infant images even with significant age gap in the first year of life, by linking their joint segmentation and registration through the reference domain. Thus, our proposed joint segmentation and registration method is scalable to various registration tasks in early brain development studies. Promising segmentation and registration results have been achieved for infant brain MR images aged from 2-week-old to 1-year-old, indicating the applicability of our method in early brain development study.
Collapse
Affiliation(s)
- Pei Dong
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
- Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| | - Guorong Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| |
Collapse
|
7
|
Benkarim OM, Sanroma G, Zimmer VA, Muñoz-Moreno E, Hahner N, Eixarch E, Camara O, González Ballester MA, Piella G. Toward the automatic quantification of in utero brain development in 3D structural MRI: A review. Hum Brain Mapp 2017; 38:2772-2787. [PMID: 28195417 DOI: 10.1002/hbm.23536] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2016] [Revised: 01/13/2017] [Accepted: 01/25/2017] [Indexed: 11/08/2022] Open
Abstract
Investigating the human brain in utero is important for researchers and clinicians seeking to understand early neurodevelopmental processes. With the advent of fast magnetic resonance imaging (MRI) techniques and the development of motion correction algorithms to obtain high-quality 3D images of the fetal brain, it is now possible to gain more insight into the ongoing maturational processes in the brain. In this article, we present a review of the major building blocks of the pipeline toward performing quantitative analysis of in vivo MRI of the developing brain and its potential applications in clinical settings. The review focuses on T1- and T2-weighted modalities, and covers state of the art methodologies involved in each step of the pipeline, in particular, 3D volume reconstruction, spatio-temporal modeling of the developing brain, segmentation, quantification techniques, and clinical applications. Hum Brain Mapp 38:2772-2787, 2017. © 2017 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
| | | | | | - Emma Muñoz-Moreno
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Deu), IDIBAPS, University of Barcelona, Spain.,Experimental 7T MRI Unit, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Nadine Hahner
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Deu), IDIBAPS, University of Barcelona, Spain
| | - Elisenda Eixarch
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Deu), IDIBAPS, University of Barcelona, Spain
| | - Oscar Camara
- DTIC, Universitat Pompeu Fabra, Barcelona, Spain
| | | | - Gemma Piella
- DTIC, Universitat Pompeu Fabra, Barcelona, Spain
| |
Collapse
|
8
|
Zhang Y, Shi F, Wu G, Wang L, Yap PT, Shen D. Consistent Spatial-Temporal Longitudinal Atlas Construction for Developing Infant Brains. IEEE TRANSACTIONS ON MEDICAL IMAGING 2016; 35:2568-2577. [PMID: 27392345 PMCID: PMC6537598 DOI: 10.1109/tmi.2016.2587628] [Citation(s) in RCA: 27] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
Brain atlases are an essential component in understanding the dynamic cerebral development, especially for the early postnatal period. However, longitudinal atlases are rare for infants, and the existing ones are generally limited by their fuzzy appearance. Moreover, since longitudinal atlas construction is typically performed independently over time, the constructed atlases often fail to preserve temporal consistency. This problem is further aggravated for infant images since they typically have low spatial resolution and insufficient tissue contrast. In this paper, we propose a novel framework for consistent spatial-temporal construction of longitudinal atlases for developing infant brain MR images. Specifically, for preserving structural details, the atlas construction is performed in spatial-temporal wavelet domain simultaneously. This is achieved by a patch-based combination of results from each frequency subband. Compared with the existing infant longitudinal atlases, our experimental results indicate that our approach is able to produce longitudinal atlases with richer structural details and also better longitudinal consistency, thus leading to higher performance when used for spatial normalization of a group of infant brain images.
Collapse
Affiliation(s)
- Yuyao Zhang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
| | - Feng Shi
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
| | - Guorong Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
| | - Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599 USA
| | | |
Collapse
|
9
|
Park SH, Zong X, Gao Y, Lin W, Shen D. Segmentation of perivascular spaces in 7T MR image using auto-context model with orientation-normalized features. Neuroimage 2016; 134:223-235. [PMID: 27046107 DOI: 10.1016/j.neuroimage.2016.03.076] [Citation(s) in RCA: 34] [Impact Index Per Article: 3.8] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2015] [Revised: 03/19/2016] [Accepted: 03/29/2016] [Indexed: 10/22/2022] Open
Abstract
Quantitative study of perivascular spaces (PVSs) in brain magnetic resonance (MR) images is important for understanding the brain lymphatic system and its relationship with neurological diseases. One of the major challenges is the accurate extraction of PVSs that have very thin tubular structures with various directions in three-dimensional (3D) MR images. In this paper, we propose a learning-based PVS segmentation method to address this challenge. Specifically, we first determine a region of interest (ROI) by using the anatomical brain structure and the vesselness information derived from eigenvalues of image derivatives. Then, in the ROI, we extract a number of randomized Haar features which are normalized with respect to the principal directions of the underlying image derivatives. The classifier is trained by the random forest model that can effectively learn both discriminative features and classifier parameters to maximize the information gain. Finally, a sequential learning strategy is used to further enforce various contextual patterns around the thin tubular structures into the classifier. For evaluation, we apply our proposed method to the 7T brain MR images scanned from 17 healthy subjects aged from 25 to 37. The performance is measured by voxel-wise segmentation accuracy, cluster-wise classification accuracy, and similarity of geometric properties, such as volume, length, and diameter distributions between the predicted and the true PVSs. Moreover, the accuracies are also evaluated on the simulation images with motion artifacts and lacunes to demonstrate the potential of our method in segmenting PVSs from elderly and patient populations. The experimental results show that our proposed method outperforms all existing PVS segmentation methods.
Collapse
Affiliation(s)
- Sang Hyun Park
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Xiaopeng Zong
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Yaozong Gao
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; Department of Computer Science, University of North Carolina at Chapel Hill, NC, USA
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul 02841, Republic of Korea
| |
Collapse
|
10
|
Beare RJ, Chen J, Kelly CE, Alexopoulos D, Smyser CD, Rogers CE, Loh WY, Matthews LG, Cheong JLY, Spittle AJ, Anderson PJ, Doyle LW, Inder TE, Seal ML, Thompson DK. Neonatal Brain Tissue Classification with Morphological Adaptation and Unified Segmentation. Front Neuroinform 2016; 10:12. [PMID: 27065840 PMCID: PMC4809890 DOI: 10.3389/fninf.2016.00012] [Citation(s) in RCA: 77] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/22/2015] [Accepted: 03/07/2016] [Indexed: 11/24/2022] Open
Abstract
Measuring the distribution of brain tissue types (tissue classification) in neonates is necessary for studying typical and atypical brain development, such as that associated with preterm birth, and may provide biomarkers for neurodevelopmental outcomes. Compared with magnetic resonance images of adults, neonatal images present specific challenges that require the development of specialized, population-specific methods. This paper introduces MANTiS (Morphologically Adaptive Neonatal Tissue Segmentation), which extends the unified segmentation approach to tissue classification implemented in Statistical Parametric Mapping (SPM) software to neonates. MANTiS utilizes a combination of unified segmentation, template adaptation via morphological segmentation tools and topological filtering, to segment the neonatal brain into eight tissue classes: cortical gray matter, white matter, deep nuclear gray matter, cerebellum, brainstem, cerebrospinal fluid (CSF), hippocampus and amygdala. We evaluated the performance of MANTiS using two independent datasets. The first dataset, provided by the NeoBrainS12 challenge, consisted of coronal T2-weighted images of preterm infants (born ≤30 weeks' gestation) acquired at 30 weeks' corrected gestational age (n = 5), coronal T2-weighted images of preterm infants acquired at 40 weeks' corrected gestational age (n = 5) and axial T2-weighted images of preterm infants acquired at 40 weeks' corrected gestational age (n = 5). The second dataset, provided by the Washington University NeuroDevelopmental Research (WUNDeR) group, consisted of T2-weighted images of preterm infants (born <30 weeks' gestation) acquired shortly after birth (n = 12), preterm infants acquired at term-equivalent age (n = 12), and healthy term-born infants (born ≥38 weeks' gestation) acquired within the first 9 days of life (n = 12). For the NeoBrainS12 dataset, mean Dice scores comparing MANTiS with manual segmentations were all above 0.7, except for the cortical gray matter for coronal images acquired at 30 weeks. This demonstrates that MANTiS' performance is competitive with existing techniques. For the WUNDeR dataset, mean Dice scores comparing MANTiS with manually edited segmentations demonstrated good agreement, where all scores were above 0.75, except for the hippocampus and amygdala. The results show that MANTiS is able to segment neonatal brain tissues well, even in images that have brain abnormalities common in preterm infants. MANTiS is available for download as an SPM toolbox from http://developmentalimagingmcri.github.io/mantis.
Collapse
Affiliation(s)
- Richard J Beare
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Department of Medicine, Monash Medical Centre, Monash UniversityMelbourne, VIC, Australia
| | - Jian Chen
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Department of Medicine, Monash Medical Centre, Monash UniversityMelbourne, VIC, Australia
| | - Claire E Kelly
- Murdoch Childrens Research Institute, The Royal Children's Hospital Melbourne, VIC, Australia
| | - Dimitrios Alexopoulos
- Department of Neurology, Washington University School of Medicine St. Louis, MO, USA
| | - Christopher D Smyser
- Department of Neurology, Washington University School of Medicine St. Louis, MO, USA
| | - Cynthia E Rogers
- Department of Psychiatry, Washington University School of Medicine St. Louis, MO, USA
| | - Wai Y Loh
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Florey Institute of Neuroscience and Mental HealthMelbourne, VIC, Australia
| | - Lillian G Matthews
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Department of Paediatrics, University of MelbourneMelbourne, VIC, Australia; Royal Women's HospitalMelbourne, VIC, Australia
| | - Jeanie L Y Cheong
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Royal Women's HospitalMelbourne, VIC, Australia; Department of Obstetrics and Gynaecology, University of MelbourneMelbourne, VIC, Australia
| | - Alicia J Spittle
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Royal Women's HospitalMelbourne, VIC, Australia; Department of Physiotherapy, University of MelbourneMelbourne, VIC, Australia
| | - Peter J Anderson
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Department of Paediatrics, University of MelbourneMelbourne, VIC, Australia
| | - Lex W Doyle
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Department of Paediatrics, University of MelbourneMelbourne, VIC, Australia; Royal Women's HospitalMelbourne, VIC, Australia; Department of Obstetrics and Gynaecology, University of MelbourneMelbourne, VIC, Australia
| | - Terrie E Inder
- Department of Pediatric Newborn Medicine, Harvard Medical School, Brigham and Women's Hospital Boston, MA, USA
| | - Marc L Seal
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Department of Paediatrics, University of MelbourneMelbourne, VIC, Australia
| | - Deanne K Thompson
- Murdoch Childrens Research Institute, The Royal Children's HospitalMelbourne, VIC, Australia; Florey Institute of Neuroscience and Mental HealthMelbourne, VIC, Australia; Department of Paediatrics, University of MelbourneMelbourne, VIC, Australia
| |
Collapse
|
11
|
Zhang Y, Shi F, Yap PT, Shen D. Detail-preserving construction of neonatal brain atlases in space-frequency domain. Hum Brain Mapp 2016; 37:2133-50. [PMID: 26987787 DOI: 10.1002/hbm.23160] [Citation(s) in RCA: 13] [Impact Index Per Article: 1.4] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 10/30/2015] [Revised: 01/24/2016] [Accepted: 02/17/2016] [Indexed: 11/11/2022] Open
Abstract
Brain atlases are commonly utilized in neuroimaging studies. However, most brain atlases are fuzzy and lack structural details, especially in the cortical regions. This is mainly caused by the image averaging process involved in atlas construction, which often smoothes out high-frequency contents that capture fine anatomical details. Brain atlas construction for neonatal images is even more challenging due to insufficient spatial resolution and low tissue contrast. In this paper, we propose a novel framework for detail-preserving construction of population-representative atlases. Our approach combines spatial and frequency information to better preserve image details. This is achieved by performing atlas construction in the space-frequency domain given by wavelet transform. In particular, sparse patch-based atlas construction is performed in all frequency subbands, and the results are combined to give a final atlas. For enhancing anatomical details, tissue probability maps are also used to guide atlas construction. Experimental results show that our approach can produce atlases with greater structural details than existing atlases. Hum Brain Mapp 37:2133-2150, 2016. © 2016 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
- Yuyao Zhang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Feng Shi
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC 27599, USA.,Department of Brain and Cognitive Engineering, Korea University, Seoul, 02841, Republic of Korea
| |
Collapse
|
12
|
Wu G, Peng X, Ying S, Wang Q, Yap PT, Shen D, Shen D. eHUGS: Enhanced Hierarchical Unbiased Graph Shrinkage for Efficient Groupwise Registration. PLoS One 2016; 11:e0146870. [PMID: 26800361 PMCID: PMC4723358 DOI: 10.1371/journal.pone.0146870] [Citation(s) in RCA: 5] [Impact Index Per Article: 0.6] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/31/2015] [Accepted: 12/25/2015] [Indexed: 12/03/2022] Open
Abstract
Effective and efficient spatial normalization of a large population of brain images is critical for many clinical and research studies, but it is technically very challenging. A commonly used approach is to choose a certain image as the template and then align all other images in the population to this template by applying pairwise registration. To avoid the potential bias induced by the inappropriate template selection, groupwise registration methods have been proposed to simultaneously register all images to a latent common space. However, current groupwise registration methods do not make full use of image distribution information for more accurate registration. In this paper, we present a novel groupwise registration method that harnesses the image distribution information by capturing the image distribution manifold using a hierarchical graph with its nodes representing the individual images. More specifically, a low-level graph describes the image distribution in each subgroup, and a high-level graph encodes the relationship between representative images of subgroups. Given the graph representation, we can register all images to the common space by dynamically shrinking the graph on the image manifold. The topology of the entire image distribution is always maintained during graph shrinkage. Evaluations on two datasets, one for 80 elderly individuals and one for 285 infants, indicate that our method can yield promising results.
Collapse
Affiliation(s)
- Guorong Wu
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, United States of America
| | - Xuewei Peng
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, United States of America
- Department of Electrical & Computer Engineering, Texas A&M University, College Station, TX, 77843, United States of America
| | - Shihui Ying
- Department of Mathematics, School of Science, Shanghai University, Shanghai, 200444, China
| | - Qian Wang
- Med-X Research Institute, Shanghai Jiao Tong University, Shanghai, 200240, China
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, United States of America
| | - Dan Shen
- Department of Mathematics and Statistics, University of South Florida, Tampa, FL, 33620, United States of America
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC, 27599, United States of America
- Department of Brain and Cognitive Engineering, Korea University, Seoul, Republic of Korea
- * E-mail:
| |
Collapse
|
13
|
Neonatal brain MRI segmentation: A review. Comput Biol Med 2015; 64:163-78. [DOI: 10.1016/j.compbiomed.2015.06.016] [Citation(s) in RCA: 44] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/01/2015] [Revised: 06/06/2015] [Accepted: 06/18/2015] [Indexed: 11/20/2022]
|
14
|
Guo T, Winterburn JL, Pipitone J, Duerden EG, Park MTM, Chau V, Poskitt KJ, Grunau RE, Synnes A, Miller SP, Mallar Chakravarty M. Automatic segmentation of the hippocampus for preterm neonates from early-in-life to term-equivalent age. NEUROIMAGE-CLINICAL 2015; 9:176-93. [PMID: 26740912 PMCID: PMC4561668 DOI: 10.1016/j.nicl.2015.07.019] [Citation(s) in RCA: 27] [Impact Index Per Article: 2.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 02/09/2015] [Revised: 07/15/2015] [Accepted: 07/16/2015] [Indexed: 11/26/2022]
Abstract
Introduction The hippocampus, a medial temporal lobe structure central to learning and memory, is particularly vulnerable in preterm-born neonates. To date, segmentation of the hippocampus for preterm-born neonates has not yet been performed early-in-life (shortly after birth when clinically stable). The present study focuses on the development and validation of an automatic segmentation protocol that is based on the MAGeT-Brain (Multiple Automatically Generated Templates) algorithm to delineate the hippocampi of preterm neonates on their brain MRIs acquired at not only term-equivalent age but also early-in-life. Methods First, we present a three-step manual segmentation protocol to delineate the hippocampus for preterm neonates and apply this protocol on 22 early-in-life and 22 term images. These manual segmentations are considered the gold standard in assessing the automatic segmentations. MAGeT-Brain, automatic hippocampal segmentation pipeline, requires only a small number of input atlases and reduces the registration and resampling errors by employing an intermediate template library. We assess the segmentation accuracy of MAGeT-Brain in three validation studies, evaluate the hippocampal growth from early-in-life to term-equivalent age, and study the effect of preterm birth on the hippocampal volume. The first experiment thoroughly validates MAGeT-Brain segmentation in three sets of 10-fold Monte Carlo cross-validation (MCCV) analyses with 187 different groups of input atlases and templates. The second experiment segments the neonatal hippocampi on 168 early-in-life and 154 term images and evaluates the hippocampal growth rate of 125 infants from early-in-life to term-equivalent age. The third experiment analyzes the effect of gestational age (GA) at birth on the average hippocampal volume at early-in-life and term-equivalent age using linear regression. Results The final segmentations demonstrate that MAGeT-Brain consistently provides accurate segmentations in comparison to manually derived gold standards (mean Dice's Kappa > 0.79 and Euclidean distance <1.3 mm between centroids). Using this method, we demonstrate that the average volume of the hippocampus is significantly different (p < 0.0001) in early-in-life (621.8 mm3) and term-equivalent age (958.8 mm3). Using these differences, we generalize the hippocampal growth rate to 38.3 ± 11.7 mm3/week and 40.5 ± 12.9 mm3/week for the left and right hippocampi respectively. Not surprisingly, younger gestational age at birth is associated with smaller volumes of the hippocampi (p = 0.001). Conclusions MAGeT-Brain is capable of segmenting hippocampi accurately in preterm neonates, even at early-in-life. Hippocampal asymmetry with a larger right side is demonstrated on early-in-life images, suggesting that this phenomenon has its onset in the 3rd trimester of gestation. Hippocampal volume assessed at the time of early-in-life and term-equivalent age is linearly associated with GA at birth, whereby smaller volumes are associated with earlier birth. We develop a MAGeT-Brain based automatic protocol to segment hippocampus in preterm neonates. MAGeT-Brain can accurately segment hippocampus in preterm neonates, even at early-in-life. Hippocampal asymmetry with a larger right side is demonstrated on early-in-life images. Smaller hippocampal volumes are associated with earlier birth in preterm neonates.
Collapse
Affiliation(s)
- Ting Guo
- Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, ON, Canada; Department of Paediatrics, The Hospital for Sick Children and the University of Toronto, Toronto, ON, Canada
| | - Julie L Winterburn
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada; Kimel Family Translational Imaging, Genetics Research Laboratory, Research Imaging Centre, Centre for Addiction and Mental Health, Toronto, Canada
| | - Jon Pipitone
- Institute of Medical Science, University of Toronto, Toronto, ON, Canada; Kimel Family Translational Imaging, Genetics Research Laboratory, Research Imaging Centre, Centre for Addiction and Mental Health, Toronto, Canada
| | - Emma G Duerden
- Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, ON, Canada; Department of Paediatrics, The Hospital for Sick Children and the University of Toronto, Toronto, ON, Canada
| | - Min Tae M Park
- Schulich School of Medicine and Dentistry, Western University, London, ON, Canada; Cerebral Imaging Centre, Douglas Mental Health Research Institute, Verdun, QC, Canada
| | - Vann Chau
- Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, ON, Canada; Department of Paediatrics, The Hospital for Sick Children and the University of Toronto, Toronto, ON, Canada
| | - Kenneth J Poskitt
- Department of Pediatrics, University of British Columbia and Child and Family Research Institute, Vancouver, BC, Canada
| | - Ruth E Grunau
- Department of Pediatrics, University of British Columbia and Child and Family Research Institute, Vancouver, BC, Canada
| | - Anne Synnes
- Department of Pediatrics, University of British Columbia and Child and Family Research Institute, Vancouver, BC, Canada
| | - Steven P Miller
- Neurosciences and Mental Health, The Hospital for Sick Children Research Institute, Toronto, ON, Canada; Department of Paediatrics, The Hospital for Sick Children and the University of Toronto, Toronto, ON, Canada
| | - M Mallar Chakravarty
- Institute of Biomedical Engineering, University of Toronto, Toronto, ON, Canada; Cerebral Imaging Centre, Douglas Mental Health Research Institute, Verdun, QC, Canada; Department of Psychiatry, McGill University, Montreal, QC, Canada
| |
Collapse
|
15
|
MRI segmentation of the human brain: challenges, methods, and applications. COMPUTATIONAL AND MATHEMATICAL METHODS IN MEDICINE 2015; 2015:450341. [PMID: 25945121 PMCID: PMC4402572 DOI: 10.1155/2015/450341] [Citation(s) in RCA: 245] [Impact Index Per Article: 24.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Subscribe] [Scholar Register] [Received: 06/27/2014] [Revised: 09/11/2014] [Accepted: 10/01/2014] [Indexed: 12/25/2022]
Abstract
Image segmentation is one of the most important tasks in medical image analysis and is often the first and the most critical step in many clinical applications. In brain MRI analysis, image segmentation is commonly used for measuring and visualizing the brain's anatomical structures, for analyzing brain changes, for delineating pathological regions, and for surgical planning and image-guided interventions. In the last few decades, various segmentation techniques of different accuracy and degree of complexity have been developed and reported in the literature. In this paper we review the most popular methods commonly used for brain MRI segmentation. We highlight differences between them and discuss their capabilities, advantages, and limitations. To address the complexity and challenges of the brain MRI segmentation problem, we first introduce the basic concepts of image segmentation. Then, we explain different MRI preprocessing steps including image registration, bias field correction, and removal of nonbrain tissue. Finally, after reviewing different brain MRI segmentation methods, we discuss the validation problem in brain MRI segmentation.
Collapse
|
16
|
Wang L, Gao Y, Shi F, Li G, Gilmore JH, Lin W, Shen D. LINKS: learning-based multi-source IntegratioN frameworK for Segmentation of infant brain images. Neuroimage 2014; 108:160-72. [PMID: 25541188 DOI: 10.1016/j.neuroimage.2014.12.042] [Citation(s) in RCA: 151] [Impact Index Per Article: 13.7] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/22/2014] [Revised: 10/28/2014] [Accepted: 12/01/2014] [Indexed: 01/21/2023] Open
Abstract
Segmentation of infant brain MR images is challenging due to insufficient image quality, severe partial volume effect, and ongoing maturation and myelination processes. In the first year of life, the image contrast between white and gray matters of the infant brain undergoes dramatic changes. In particular, the image contrast is inverted around 6-8months of age, and the white and gray matter tissues are isointense in both T1- and T2-weighted MR images and thus exhibit the extremely low tissue contrast, which poses significant challenges for automated segmentation. Most previous studies used multi-atlas label fusion strategy, which has the limitation of equally treating the different available image modalities and is often computationally expensive. To cope with these limitations, in this paper, we propose a novel learning-based multi-source integration framework for segmentation of infant brain images. Specifically, we employ the random forest technique to effectively integrate features from multi-source images together for tissue segmentation. Here, the multi-source images include initially only the multi-modality (T1, T2 and FA) images and later also the iteratively estimated and refined tissue probability maps of gray matter, white matter, and cerebrospinal fluid. Experimental results on 119 infants show that the proposed method achieves better performance than other state-of-the-art automated segmentation methods. Further validation was performed on the MICCAI grand challenge and the proposed method was ranked top among all competing methods. Moreover, to alleviate the possible anatomical errors, our method can also be combined with an anatomically-constrained multi-atlas labeling approach for further improving the segmentation accuracy.
Collapse
Affiliation(s)
- Li Wang
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Yaozong Gao
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; Department of Computer Science, University of North Carolina at Chapel Hill, NC, USA
| | - Feng Shi
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Gang Li
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - John H Gilmore
- Department of Psychiatry, University of North Carolina at Chapel Hill, NC, USA
| | - Weili Lin
- MRI Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Dinggang Shen
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul, Republic of Korea.
| |
Collapse
|
17
|
Wang L, Shi F, Gao Y, Li G, Gilmore JH, Lin W, Shen D. Integration of sparse multi-modality representation and anatomical constraint for isointense infant brain MR image segmentation. Neuroimage 2014; 89:152-64. [PMID: 24291615 PMCID: PMC3944142 DOI: 10.1016/j.neuroimage.2013.11.040] [Citation(s) in RCA: 61] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/14/2013] [Revised: 10/21/2013] [Accepted: 11/18/2013] [Indexed: 01/18/2023] Open
Abstract
Segmentation of infant brain MR images is challenging due to poor spatial resolution, severe partial volume effect, and the ongoing maturation and myelination processes. During the first year of life, the brain image contrast between white and gray matters undergoes dramatic changes. In particular, the image contrast inverses around 6-8months of age, where the white and gray matter tissues are isointense in T1 and T2 weighted images and hence exhibit the extremely low tissue contrast, posing significant challenges for automated segmentation. In this paper, we propose a general framework that adopts sparse representation to fuse the multi-modality image information and further incorporate the anatomical constraints for brain tissue segmentation. Specifically, we first derive an initial segmentation from a library of aligned images with ground-truth segmentations by using sparse representation in a patch-based fashion for the multi-modality T1, T2 and FA images. The segmentation result is further iteratively refined by integration of the anatomical constraint. The proposed method was evaluated on 22 infant brain MR images acquired at around 6months of age by using a leave-one-out cross-validation, as well as other 10 unseen testing subjects. Our method achieved a high accuracy for the Dice ratios that measure the volume overlap between automated and manual segmentations, i.e., 0.889±0.008 for white matter and 0.870±0.006 for gray matter.
Collapse
Affiliation(s)
- Li Wang
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Feng Shi
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Yaozong Gao
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; Department of Computer Science, University of North Carolina at Chapel Hill, NC, USA
| | - Gang Li
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - John H Gilmore
- Department of Psychiatry, University of North Carolina at Chapel Hill, NC, USA
| | - Weili Lin
- MRI Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA
| | - Dinggang Shen
- IDEA Lab, Department of Radiology and BRIC, University of North Carolina at Chapel Hill, NC, USA; Department of Brain and Cognitive Engineering, Korea University, Seoul, Korea.
| |
Collapse
|
18
|
Shi F, Wang L, Wu G, Li G, Gilmore JH, Lin W, Shen D. Neonatal atlas construction using sparse representation. Hum Brain Mapp 2014; 35:4663-77. [PMID: 24638883 DOI: 10.1002/hbm.22502] [Citation(s) in RCA: 33] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/06/2013] [Revised: 02/11/2014] [Accepted: 02/18/2014] [Indexed: 11/05/2022] Open
Abstract
Atlas construction generally includes first an image registration step to normalize all images into a common space and then an atlas building step to fuse the information from all the aligned images. Although numerous atlas construction studies have been performed to improve the accuracy of the image registration step, unweighted or simply weighted average is often used in the atlas building step. In this article, we propose a novel patch-based sparse representation method for atlas construction after all images have been registered into the common space. By taking advantage of local sparse representation, more anatomical details can be recovered in the built atlas. To make the anatomical structures spatially smooth in the atlas, the anatomical feature constraints on group structure of representations and also the overlapping of neighboring patches are imposed to ensure the anatomical consistency between neighboring patches. The proposed method has been applied to 73 neonatal MR images with poor spatial resolution and low tissue contrast, for constructing a neonatal brain atlas with sharp anatomical details. Experimental results demonstrate that the proposed method can significantly enhance the quality of the constructed atlas by discovering more anatomical details especially in the highly convoluted cortical regions. The resulting atlas demonstrates superior performance of our atlas when applied to spatially normalizing three different neonatal datasets, compared with other start-of-the-art neonatal brain atlases.
Collapse
Affiliation(s)
- Feng Shi
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, North Carolina
| | | | | | | | | | | | | |
Collapse
|
19
|
Despotovic I, Cherian PJ, De Vos M, Hallez H, Deburchgraeve W, Govaert P, Lequin M, Visser GH, Swarte RM, Vansteenkiste E, Van Huffel S, Philips W. Relationship of EEG sources of neonatal seizures to acute perinatal brain lesions seen on MRI: a pilot study. Hum Brain Mapp 2013; 34:2402-17. [PMID: 22522744 PMCID: PMC6870156 DOI: 10.1002/hbm.22076] [Citation(s) in RCA: 23] [Impact Index Per Article: 1.9] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/07/2011] [Revised: 02/10/2012] [Accepted: 02/13/2012] [Indexed: 11/12/2022] Open
Abstract
Even though it is known that neonatal seizures are associated with acute brain lesions, the relationship of electroencephalographic (EEG) seizures to acute perinatal brain lesions visible on magnetic resonance imaging (MRI) has not been objectively studied. EEG source localization is successfully used for this purpose in adults, but it has not been sufficiently explored in neonates. Therefore, we developed an integrated method for ictal EEG dipole source localization based on a realistic head model to investigate the utility of EEG source imaging in neonates with postasphyxial seizures. We describe here our method and compare the dipole seizure localization results with acute perinatal lesions seen on brain MRI in 10 full-term infants with neonatal encephalopathy. Through experimental studies, we also explore the sensitivity of our method to the electrode positioning errors and the variations in neonatal skull geometry and conductivity. The localization results of 45 focal seizures from 10 neonates are compared with the visual analysis of EEG and MRI data, scored by expert physicians. In 9 of 10 neonates, dipole locations showed good relationship with MRI lesions and clinical data. Our experimental results also suggest that the variations in the used values for skull conductivity or thickness have little effect on the dipole localization, whereas inaccurate electrode positioning can reduce the accuracy of source estimates. The performance of our fused method indicates that ictal EEG source imaging is feasible in neonates and with further validation studies, this technique can become a useful diagnostic tool.
Collapse
Affiliation(s)
- Ivana Despotovic
- MEDISIP-IPI-IBBT, Ghent University, Sint-Pietersnieuwstraat 41, 9000 Ghent, Belgium
| | | | | | | | | | | | | | | | | | | | | | | |
Collapse
|
20
|
Segmentation of neonatal brain MR images using patch-driven level sets. Neuroimage 2013; 84:141-58. [PMID: 23968736 DOI: 10.1016/j.neuroimage.2013.08.008] [Citation(s) in RCA: 103] [Impact Index Per Article: 8.6] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/25/2013] [Revised: 07/18/2013] [Accepted: 08/07/2013] [Indexed: 01/18/2023] Open
Abstract
The segmentation of neonatal brain MR image into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF), is challenging due to the low spatial resolution, severe partial volume effect, high image noise, and dynamic myelination and maturation processes. Atlas-based methods have been widely used for guiding neonatal brain segmentation. Existing brain atlases were generally constructed by equally averaging all the aligned template images from a population. However, such population-based atlases might not be representative of a testing subject in the regions with high inter-subject variability and thus often lead to a low capability in guiding segmentation in those regions. Recently, patch-based sparse representation techniques have been proposed to effectively select the most relevant elements from a large group of candidates, which can be used to generate a subject-specific representation with rich local anatomical details for guiding the segmentation. Accordingly, in this paper, we propose a novel patch-driven level set method for the segmentation of neonatal brain MR images by taking advantage of sparse representation techniques. Specifically, we first build a subject-specific atlas from a library of aligned, manually segmented images by using sparse representation in a patch-based fashion. Then, the spatial consistency in the probability maps from the subject-specific atlas is further enforced by considering the similarities of a patch with its neighboring patches. Finally, the probability maps are integrated into a coupled level set framework for more accurate segmentation. The proposed method has been extensively evaluated on 20 training subjects using leave-one-out cross validation, and also on 132 additional testing subjects. Our method achieved a high accuracy of 0.919±0.008 for white matter and 0.901±0.005 for gray matter, respectively, measured by Dice ratio for the overlap between the automated and manual segmentations in the cortical region.
Collapse
|
21
|
Despotović I, Vansteenkiste E, Philips W. A realistic volume conductor model of the neonatal head: methods, challenges and applications. ANNUAL INTERNATIONAL CONFERENCE OF THE IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. IEEE ENGINEERING IN MEDICINE AND BIOLOGY SOCIETY. ANNUAL INTERNATIONAL CONFERENCE 2013; 2013:3303-3306. [PMID: 24110434 DOI: 10.1109/embc.2013.6610247] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 06/02/2023]
Abstract
Developing a realistic volume conductor head model is an important step towards a non-invasive investigation of neuro-electrical activity in the brain. For adults, different volume conductor head models have been designed and successfully used for electroencephalography (EEG) source analysis. However, creating appropriate neonatal volume conductor head model for EEG source analysis is a challenging task mainly due to insufficient knowledge of head tissue conductivities and complex anatomy of the developing newborn brain. In this work, we present a pipeline for modeling a realistic volume conductor model of the neonatal head, where we address the modeling challenges and propose our solutions. We also discuss the use of our realistic volume conductor head model for neonatal EEG source analysis.
Collapse
|
22
|
Wang L, Shi F, Yap PT, Gilmore JH, Lin W, Shen D. 4D multi-modality tissue segmentation of serial infant images. PLoS One 2012; 7:e44596. [PMID: 23049751 PMCID: PMC3458067 DOI: 10.1371/journal.pone.0044596] [Citation(s) in RCA: 57] [Impact Index Per Article: 4.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 05/24/2012] [Accepted: 08/03/2012] [Indexed: 11/18/2022] Open
Abstract
Accurate and consistent segmentation of infant brain MR images plays an important role in quantifying patterns of early brain development, especially in longitudinal studies. However, due to rapid maturation and myelination of brain tissues in the first year of life, the intensity contrast of gray and white matter undergoes dramatic changes. In fact, the contrast inverse around 6-8 months of age, when the white and gray matter tissues are isointense and hence exhibit the lowest contrast, posing significant challenges for segmentation algorithms. In this paper, we propose a longitudinally guided level set method to segment serial infant brain MR images acquired from 2 weeks up to 1.5 years of age, including the isointense images. At each single-time-point, the proposed method makes optimal use of T1, T2 and the diffusion-weighted images for complimentary tissue distribution information to address the difficulty caused by the low contrast. Moreover, longitudinally consistent term, which constrains the distance across the serial images within a biologically reasonable range, is employed to obtain temporally consistent segmentation results. Application of our method on 28 longitudinal infant subjects, each with 5 longitudinal scans, shows that the automated segmentations from the proposed method match the manual ground-truth with much higher Dice Ratios than other single-modality, single-time-point based methods and the longitudinal but voxel-wise based methods. The software of the proposed method is publicly available in NITRC (http://www.nitrc.org/projects/ibeat).
Collapse
Affiliation(s)
- Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Feng Shi
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Pew-Thian Yap
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - John H. Gilmore
- Department of Psychiatry, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Weili Lin
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
| | - Dinggang Shen
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, North Carolina, United States of America
- * E-mail:
| |
Collapse
|
23
|
Gui L, Lisowski R, Faundez T, Hüppi PS, Lazeyras F, Kocher M. Morphology-driven automatic segmentation of MR images of the neonatal brain. Med Image Anal 2012; 16:1565-79. [PMID: 22921305 DOI: 10.1016/j.media.2012.07.006] [Citation(s) in RCA: 71] [Impact Index Per Article: 5.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/06/2012] [Revised: 07/06/2012] [Accepted: 07/16/2012] [Indexed: 02/05/2023]
Abstract
The segmentation of MR images of the neonatal brain is an essential step in the study and evaluation of infant brain development. State-of-the-art methods for adult brain MRI segmentation are not applicable to the neonatal brain, due to large differences in structure and tissue properties between newborn and adult brains. Existing newborn brain MRI segmentation methods either rely on manual interaction or require the use of atlases or templates, which unavoidably introduces a bias of the results towards the population that was used to derive the atlases. We propose a different approach for the segmentation of neonatal brain MRI, based on the infusion of high-level brain morphology knowledge, regarding relative tissue location, connectivity and structure. Our method does not require manual interaction, or the use of an atlas, and the generality of its priors makes it applicable to different neonatal populations, while avoiding atlas-related bias. The proposed algorithm segments the brain both globally (intracranial cavity, cerebellum, brainstem and the two hemispheres) and at tissue level (cortical and subcortical gray matter, myelinated and unmyelinated white matter, and cerebrospinal fluid). We validate our algorithm through visual inspection by medical experts, as well as by quantitative comparisons that demonstrate good agreement with expert manual segmentations. The algorithm's robustness is verified by testing on variable quality images acquired on different machines, and on subjects with variable anatomy (enlarged ventricles, preterm- vs. term-born).
Collapse
Affiliation(s)
- Laura Gui
- Division of Development and Growth, Department of Pediatrics, University of Geneva, Geneva, Switzerland.
| | | | | | | | | | | |
Collapse
|
24
|
Leroy F, Mangin JF, Rousseau F, Glasel H, Hertz-Pannier L, Dubois J, Dehaene-Lambertz G. Atlas-free surface reconstruction of the cortical grey-white interface in infants. PLoS One 2011; 6:e27128. [PMID: 22110604 PMCID: PMC3217936 DOI: 10.1371/journal.pone.0027128] [Citation(s) in RCA: 48] [Impact Index Per Article: 3.4] [Reference Citation Analysis] [Abstract] [MESH Headings] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/26/2010] [Accepted: 10/11/2011] [Indexed: 12/16/2022] Open
Abstract
Background The segmentation of the cortical interface between grey and white matter in magnetic resonance images (MRI) is highly challenging during the first post-natal year. First, the heterogeneous brain maturation creates important intensity fluctuations across regions. Second, the cortical ribbon is highly folded creating complex shapes. Finally, the low tissue contrast and partial volume effects hamper cortex edge detection in parts of the brain. Methods and Findings We present an atlas-free method for segmenting the grey-white matter interface of infant brains in T2-weighted (T2w) images. We used a broad characterization of tissue using features based not only on local contrast but also on geometric properties. Furthermore, inaccuracies in localization were reduced by the convergence of two evolving surfaces located on each side of the inner cortical surface. Our method has been applied to eleven brains of one- to four-month-old infants. Both quantitative validations against manual segmentations and sulcal landmarks demonstrated good performance for infants younger than two months old. Inaccuracies in surface reconstruction increased with age in specific brain regions where the tissue contrast decreased with maturation, such as in the central region. Conclusions We presented a new segmentation method which achieved good to very good performance at the grey-white matter interface depending on the infant age. This method should reduce manual intervention and could be applied to pathological brains since it does not require any brain atlas.
Collapse
Affiliation(s)
- François Leroy
- INSERM, Cognitive Neuroimaging Unit, Gif sur Yvette, France.
| | | | | | | | | | | | | |
Collapse
|
25
|
Yap PT, Gilmore JH, Lin W, Shen D. PopTract: population-based tractography. IEEE TRANSACTIONS ON MEDICAL IMAGING 2011; 30:1829-40. [PMID: 21571607 PMCID: PMC4855297 DOI: 10.1109/tmi.2011.2154385] [Citation(s) in RCA: 16] [Impact Index Per Article: 1.1] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/22/2023]
Abstract
White matter fiber tractography plays a key role in the in vivo understanding of brain circuitry. For tract-based comparison of a population of images, a common approach is to first generate an atlas by averaging, after spatial normalization, all images in the population, and then perform tractography using the constructed atlas. The reconstructed fiber trajectories form a common geometry onto which diffusion properties of each individual subject can be projected based on the corresponding locations in the subject native space. However, in the case of high angular resolution diffusion imaging (HARDI), where modeling fiber crossings is an important goal, the above-mentioned averaging method for generating an atlas results in significant error in the estimation of local fiber orientations and causes a major loss of fiber crossings. These limitatitons have significant impact on the accuracy of the reconstructed fiber trajectories and jeopardize subsequent tract-based analysis. As a remedy, we present in this paper a more effective means of performing tractography at a population level. Our method entails determining a bipolar Watson distribution at each voxel location based on information given by all images in the population, giving us not only the local principal orientations of the fiber pathways, but also confidence levels of how reliable these orientations are across subjects. The distribution field is then fed as an input to a probabilistic tractography framework for reconstructing a set of fiber trajectories that are consistent across all images in the population. We observe that the proposed method, called PopTract, results in significantly better preservation of fiber crossings, and hence yields better trajectory reconstruction in the atlas space.
Collapse
Affiliation(s)
- Pew-Thian Yap
- Department of Radiology and Biomedical Research Imaging Center (BRIC), University of North Carolina, Chapel Hill, NC 27599, USA
| | | | | | | |
Collapse
|
26
|
Wang L, Shi F, Lin W, Gilmore JH, Shen D. Automatic segmentation of neonatal images using convex optimization and coupled level sets. Neuroimage 2011; 58:805-17. [PMID: 21763443 DOI: 10.1016/j.neuroimage.2011.06.064] [Citation(s) in RCA: 84] [Impact Index Per Article: 6.0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 02/07/2011] [Revised: 06/21/2011] [Accepted: 06/23/2011] [Indexed: 10/18/2022] Open
Abstract
Accurate segmentation of neonatal brain MR images remains challenging mainly due to their poor spatial resolution, inverted contrast between white matter and gray matter, and high intensity inhomogeneity. Most existing methods for neonatal brain segmentation are atlas-based and voxel-wise. Although active contour/surface models with geometric information constraint have been successfully applied to adult brain segmentation, they are not fully explored in the neonatal image segmentation. In this paper, we propose a novel neonatal image segmentation method by combining local intensity information, atlas spatial prior, and cortical thickness constraint in a single level-set framework. Besides, we also provide a robust and reliable tissue surface initialization for the proposed method by using a convex optimization technique. Thus, tissue segmentation, as well as inner and outer cortical surface reconstruction, can be obtained simultaneously. The proposed method has been tested on a large neonatal dataset, and the validation on 10 neonatal brain images (with manual segmentations) shows very promising results.
Collapse
Affiliation(s)
- Li Wang
- Department of Radiology and BRIC, University of North Carolina at Chapel Hill, Chapel Hill, NC 27599, USA
| | | | | | | | | |
Collapse
|