1
|
Peng Y, Xu Y, Wang M, Zhang H, Xie J. The nnU-Net based method for automatic segmenting fetal brain tissues. Health Inf Sci Syst 2023; 11:17. [PMID: 36998806 PMCID: PMC10043149 DOI: 10.1007/s13755-023-00220-3] [Citation(s) in RCA: 6] [Impact Index Per Article: 3.0] [Reference Citation Analysis] [Abstract] [Key Words] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 12/24/2022] [Accepted: 03/09/2023] [Indexed: 04/01/2023] Open
Abstract
The magnetic resonance (MR) images of fetuses make it possible for doctors to detect out pathological fetal brains in early stages. Brain tissue segmentation is prerequisite for making brain morphology and volume analyses. nnU-Net is an automatic segmentation method based on deep learning. It can adaptively configure itself, so as to adapt to a specific task via preprocessing, network architecture, training, and post-processing. Therefore, we adapt nnU-Net to segment seven types of fetal brain tissues, including external cerebrospinal fluid, gray matter, white matter, ventricle, cerebellum, deep gray matter, and brainstem. With regard to the characteristics of the FeTA 2021 data, some adjustments are made to the original nnU-Net, so that it can segment seven types of fetal brain tissues precisely as far as possible. The average segmentation results on FeTA 2021 training data demonstrate that our advanced nnU-Net is superior to the peers including SegNet, CoTr, AC U-Net and ResUnet. Its average segmentation results are 0.842, 11.759 and 0.957 in terms of Dice, HD95 and VS criteria. Moreover, the experimental results on FeTA 2021 test data further demonstrate that our advanced nnU-Net has obtained good segmentation performance of 0.774, 14.699 and 0.875 in terms of Dice, HD95 and VS, ranked the third in FeTA 2021 challenge. Our advanced nnU-Net realized the task for segmenting the fetal brain tissues using MR images of different gestational ages, which can help doctors to make correct and seasonable diagnoses.
Collapse
Affiliation(s)
- Ying Peng
- School of Computer Science, Shaanxi Normal University, West Chang’an Avenue, Chang’an District, Xi’an, 710119 Shaanxi People’s Republic of China
| | - Yandi Xu
- School of Medicine, Tulane University, 1430 Tulane Ave, New Orleans, LA 70112 USA
| | - Mingzhao Wang
- School of Computer Science, Shaanxi Normal University, West Chang’an Avenue, Chang’an District, Xi’an, 710119 Shaanxi People’s Republic of China
| | - Huiquan Zhang
- School of Computer Science, Shaanxi Normal University, West Chang’an Avenue, Chang’an District, Xi’an, 710119 Shaanxi People’s Republic of China
| | - Juanying Xie
- School of Computer Science, Shaanxi Normal University, West Chang’an Avenue, Chang’an District, Xi’an, 710119 Shaanxi People’s Republic of China
| |
Collapse
|
2
|
Dou H, Karimi D, Rollins CK, Ortinau CM, Vasung L, Velasco-Annis C, Ouaalam A, Yang X, Ni D, Gholipour A. A Deep Attentive Convolutional Neural Network for Automatic Cortical Plate Segmentation in Fetal MRI. IEEE TRANSACTIONS ON MEDICAL IMAGING 2021; 40:1123-1133. [PMID: 33351755 PMCID: PMC8016740 DOI: 10.1109/tmi.2020.3046579] [Citation(s) in RCA: 9] [Impact Index Per Article: 2.3] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/03/2023]
Abstract
Fetal cortical plate segmentation is essential in quantitative analysis of fetal brain maturation and cortical folding. Manual segmentation of the cortical plate, or manual refinement of automatic segmentations is tedious and time-consuming. Automatic segmentation of the cortical plate, on the other hand, is challenged by the relatively low resolution of the reconstructed fetal brain MRI scans compared to the thin structure of the cortical plate, partial voluming, and the wide range of variations in the morphology of the cortical plate as the brain matures during gestation. To reduce the burden of manual refinement of segmentations, we have developed a new and powerful deep learning segmentation method. Our method exploits new deep attentive modules with mixed kernel convolutions within a fully convolutional neural network architecture that utilizes deep supervision and residual connections. We evaluated our method quantitatively based on several performance measures and expert evaluations. Results show that our method outperforms several state-of-the-art deep models for segmentation, as well as a state-of-the-art multi-atlas segmentation technique. We achieved average Dice similarity coefficient of 0.87, average Hausdorff distance of 0.96 mm, and average symmetric surface difference of 0.28 mm on reconstructed fetal brain MRI scans of fetuses scanned in the gestational age range of 16 to 39 weeks (28.6± 5.3). With a computation time of less than 1 minute per fetal brain, our method can facilitate and accelerate large-scale studies on normal and altered fetal brain cortical maturation and folding.
Collapse
|
3
|
Pishghadam M, Kazemi K, Nekooei S, Seilanian-Toosi F, Hoseini-Ghahfarokhi M, Zabizadeh M, Fatemi A. A new approach to automatic fetal brain extraction from MRI using a variational level set method. Med Phys 2019; 46:4983-4991. [PMID: 31419312 DOI: 10.1002/mp.13766] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/13/2019] [Revised: 07/30/2019] [Accepted: 07/31/2019] [Indexed: 11/11/2022] Open
Abstract
BACKGROUND AND PURPOSE Appropriate images extracted from the MRI of mothers' wombs can be of great help in the medical diagnosis of fetal abnormalities. As maternal tissue may appear in such images, affecting visualization of myelination of the fetal brain, it is not possible to use methods routinely used for extraction of adult brains for fetal brains. The aim of the present study was to use a variational level set approach to extract fetal brain from T2-weighted MR images of the womb. METHODS Coronal T2-weighted images were acquired using fast MRI protocols (to avoid artifacts). The database includes 105 MR images from eight subjects. After correcting the inhomogeneity of the images, the fetal eyes were located, and from that information, the location of the fetus brain was automatically determined. Then, the variational level set was used for fetus brain extraction. The results were analyzed by a clinical specialist (radiologist) and the similarity (Dice and Jaccard coefficients), sensitivity and specificity were calculated. RESULTS AND CONCLUSIONS The means of the statistical analysis for the Dice and Jaccard coefficients, sensitivity and specificity, were 99.56%, 96.89%, 95.71%, and 97.96%, respectively. Thus, extraction of fetal brain from MR images was confirmed, both statistically and visually through cross-validation.
Collapse
Affiliation(s)
- Morteza Pishghadam
- Faculty of Medicine, North Khorasan University of Medical Sciences, Bojnurd, Iran
| | - Kamran Kazemi
- Department of Electrical and Electronics Engineering, Shiraz University of Technology, Shiraz, Iran
| | - Sirous Nekooei
- Department of Radiology, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Farrokh Seilanian-Toosi
- Department of Radiology, Faculty of Medicine, Mashhad University of Medical Sciences, Mashhad, Iran
| | - Mojtaba Hoseini-Ghahfarokhi
- Department of Medical Physics, Faculty of Medicine, Ahvaz Jundishapur University of Medical Sciences, Ahvaz, Iran
| | - Mansour Zabizadeh
- Department of Radiology and Nuclear Medicine, School of Para Medical Sciences, Kermanshah University of Medical Sciences, Kermanshah, Iran
| | - Ali Fatemi
- Department of Radiation Oncology and Radiology, University of Mississippi Medical Center (UMMC), Jackson, MS, USA
| |
Collapse
|
4
|
Benkarim OM, Sanroma G, Zimmer VA, Muñoz-Moreno E, Hahner N, Eixarch E, Camara O, González Ballester MA, Piella G. Toward the automatic quantification of in utero brain development in 3D structural MRI: A review. Hum Brain Mapp 2017; 38:2772-2787. [PMID: 28195417 DOI: 10.1002/hbm.23536] [Citation(s) in RCA: 25] [Impact Index Per Article: 3.1] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 09/21/2016] [Revised: 01/13/2017] [Accepted: 01/25/2017] [Indexed: 11/08/2022] Open
Abstract
Investigating the human brain in utero is important for researchers and clinicians seeking to understand early neurodevelopmental processes. With the advent of fast magnetic resonance imaging (MRI) techniques and the development of motion correction algorithms to obtain high-quality 3D images of the fetal brain, it is now possible to gain more insight into the ongoing maturational processes in the brain. In this article, we present a review of the major building blocks of the pipeline toward performing quantitative analysis of in vivo MRI of the developing brain and its potential applications in clinical settings. The review focuses on T1- and T2-weighted modalities, and covers state of the art methodologies involved in each step of the pipeline, in particular, 3D volume reconstruction, spatio-temporal modeling of the developing brain, segmentation, quantification techniques, and clinical applications. Hum Brain Mapp 38:2772-2787, 2017. © 2017 Wiley Periodicals, Inc.
Collapse
Affiliation(s)
| | | | | | - Emma Muñoz-Moreno
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Deu), IDIBAPS, University of Barcelona, Spain.,Experimental 7T MRI Unit, Institut d'Investigacions Biomèdiques August Pi i Sunyer (IDIBAPS), Barcelona, Spain
| | - Nadine Hahner
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Deu), IDIBAPS, University of Barcelona, Spain
| | - Elisenda Eixarch
- Fetal i+D Fetal Medicine Research Center, BCNatal - Barcelona Center for Maternal-Fetal and Neonatal Medicine (Hospital Clínic and Hospital Sant Joan de Deu), IDIBAPS, University of Barcelona, Spain
| | - Oscar Camara
- DTIC, Universitat Pompeu Fabra, Barcelona, Spain
| | | | - Gemma Piella
- DTIC, Universitat Pompeu Fabra, Barcelona, Spain
| |
Collapse
|
5
|
Levman J, Takahashi E. Multivariate Analyses Applied to Healthy Neurodevelopment in Fetal, Neonatal, and Pediatric MRI. Front Neuroanat 2016; 9:163. [PMID: 26834576 PMCID: PMC4720794 DOI: 10.3389/fnana.2015.00163] [Citation(s) in RCA: 6] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 07/24/2015] [Accepted: 12/04/2015] [Indexed: 11/13/2022] Open
Abstract
Multivariate analysis (MVA) is a class of statistical and pattern recognition techniques that involve the processing of data that contains multiple measurements per sample. MVA can be used to address a wide variety of neurological medical imaging related challenges including the evaluation of healthy brain development, the automated analysis of brain tissues and structures through image segmentation, evaluating the effects of genetic and environmental factors on brain development, evaluating sensory stimulation's relationship with functional brain activity and much more. Compared to adult imaging, pediatric, neonatal and fetal imaging have attracted less attention from MVA researchers, however, recent years have seen remarkable MVA research growth in pre-adult populations. This paper presents the results of a systematic review of the literature focusing on MVA applied to healthy subjects in fetal, neonatal and pediatric magnetic resonance imaging (MRI) of the brain. While the results of this review demonstrate considerable interest from the scientific community in applications of MVA technologies in brain MRI, the field is still young and significant research growth will continue into the future.
Collapse
Affiliation(s)
- Jacob Levman
- Division of Newborn Medicine, Department of Medicine, Boston Children's Hospital, Harvard Medical SchoolBoston, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General HospitalCharlestown, MA, USA
| | - Emi Takahashi
- Division of Newborn Medicine, Department of Medicine, Boston Children's Hospital, Harvard Medical SchoolBoston, MA, USA; Athinoula A. Martinos Center for Biomedical Imaging, Massachusetts General HospitalCharlestown, MA, USA
| |
Collapse
|
6
|
Studholme C, Rousseau F. Quantifying and modelling tissue maturation in the living human fetal brain. Int J Dev Neurosci 2014; 32:3-10. [PMID: 23831076 PMCID: PMC4396985 DOI: 10.1016/j.ijdevneu.2013.06.006] [Citation(s) in RCA: 11] [Impact Index Per Article: 1.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 11/01/2012] [Revised: 05/08/2013] [Accepted: 06/13/2013] [Indexed: 01/16/2023] Open
Abstract
Recent advances in medical imaging are beginning to allow us to quantify brain tissue maturation in the growing human brain prior to normal term age, and are beginning to shed new light on early human brain growth. These advances compliment the work already done in cellular level imaging in animal and post mortem studies of brain development. The opportunities for collaborative research that bridges the gap between macroscopic and microscopic windows on the developing brain are significant. The aim of this paper is to provide a review of the current research into MR imaging of the living fetal brain with the aim of motivating improved interfaces between the two fields. The review begins with a description of faster MRI techniques that are capable of freezing motion of the fetal head during the acquisition of a slice, and how these have been combined with advanced post-processing algorithms to build 3D images from motion scattered slices. Such rich data has motivated the development of techniques to automatically label developing tissue zones within MRI data allowing their quantification in 3D and 4D within the normally growing fetal brain. These methods have provided the basis for later work that has created the first maps of tissue growth rate and cortical folding in normally developing brains in-utero. These measurements provide valuable findings that compliment those derived from post-mortem anatomy, and additionally allow for the possibility of larger population studies of the influence of maternal environmental and genes on early brain development.
Collapse
Affiliation(s)
- Colin Studholme
- BICG, Departments of Pediatrics, Bioengineering, Radiology, University of Washington, Seattle, USA.
| | | |
Collapse
|
7
|
Habas PA, Kim K, Rousseau F, Glenn OA, Barkovich AJ, Studholme C. Atlas-based segmentation of developing tissues in the human brain with quantitative validation in young fetuses. Hum Brain Mapp 2011; 31:1348-58. [PMID: 20108226 DOI: 10.1002/hbm.20935] [Citation(s) in RCA: 71] [Impact Index Per Article: 5.1] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/06/2022] Open
Abstract
Imaging of the human fetus using magnetic resonance (MR) is an essential tool for quantitative studies of normal as well as abnormal brain development in utero. However, because of fundamental differences in tissue types, tissue properties and tissue distribution between the fetal and adult brain, automated tissue segmentation techniques developed for adult brain anatomy are unsuitable for this data. In this paper, we describe methodology for automatic atlas-based segmentation of individual tissue types in motion-corrected 3D volumes reconstructed from clinical MR scans of the fetal brain. To generate anatomically correct automatic segmentations, we create a set of accurate manual delineations and build an in utero 3D statistical atlas of tissue distribution incorporating developing gray and white matter as well as transient tissue types such as the germinal matrix. The probabilistic atlas is associated with an unbiased average shape and intensity template for registration of new subject images to the space of the atlas. Quantitative whole brain 3D validation of tissue labeling performed on a set of 14 fetal MR scans (20.57-22.86 weeks gestational age) demonstrates that this atlas-based EM segmentation approach achieves consistently high DSC performance for the main tissue types in the fetal brain. This work indicates that reliable measures of brain development can be automatically derived from clinical MR imaging and opens up possibility of further 3D volumetric and morphometric studies with multiple fetal subjects.
Collapse
Affiliation(s)
- Piotr A Habas
- Biomedical Image Computing Group, Department of Radiology and Biomedical Imaging, University of California San Francisco, San Francisco, California 94143, USA.
| | | | | | | | | | | |
Collapse
|
8
|
Kim K, Habas PA, Rousseau F, Glenn OA, Barkovich AJ, Studholme C. Intersection based motion correction of multislice MRI for 3-D in utero fetal brain image formation. IEEE TRANSACTIONS ON MEDICAL IMAGING 2010; 29:146-58. [PMID: 19744911 PMCID: PMC3328314 DOI: 10.1109/tmi.2009.2030679] [Citation(s) in RCA: 121] [Impact Index Per Article: 8.1] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Subscribe] [Scholar Register] [Indexed: 05/24/2023]
Abstract
In recent years, postprocessing of fast multislice magnetic resonance imaging (MRI) to correct fetal motion has provided the first true 3-D MR images of the developing human brain in utero. Early approaches have used reconstruction based algorithms, employing a two-step iterative process, where slices from the acquired data are realigned to an approximate 3-D reconstruction of the fetal brain, which is then refined further using the improved slice alignment. This two step slice-to-volume process, although powerful, is computationally expensive in needing a 3-D reconstruction, and is limited in its ability to recover subvoxel alignment. Here, we describe an alternative approach which we term slice intersection motion correction (SIMC), that seeks to directly co-align multiple slice stacks by considering the matching structure along all intersecting slice pairs in all orthogonally planned slices that are acquired in clinical imaging studies. A collective update scheme for all slices is then derived, to simultaneously drive slices into a consistent match along their lines of intersection. We then describe a 3-D reconstruction algorithm that, using the final motion corrected slice locations, suppresses through-plane partial volume effects to provide a single high isotropic resolution 3-D image. The method is tested on simulated data with known motions and is applied to retrospectively reconstruct 3-D images from a range of clinically acquired imaging studies. The quantitative evaluation of the registration accuracy for the simulated data sets demonstrated a significant improvement over previous approaches. An initial application of the technique to studying clinical pathology is included, where the proposed method recovered up to 15 mm of translation and 30 degrees of rotation for individual slices, and produced full 3-D reconstructions containing clinically useful additional information not visible in the original 2-D slices.
Collapse
Affiliation(s)
- Kio Kim
- Department of Radiology and Biomedical Imaging, University of California San Francisco CA, 94143 USA. (Website: http://radiology.ucsf.edu/bicg)
| | - Piotr A. Habas
- Department of Radiology and Biomedical Imaging, University of California San Francisco CA, 94143 USA. (Website: http://radiology.ucsf.edu/bicg)
| | | | - Orit A. Glenn
- Department of Radiology and Biomedical Imaging, University of California San Francisco CA, 94143 USA. (Website: http://radiology.ucsf.edu/bicg)
| | - Anthony J. Barkovich
- Department of Radiology and Biomedical Imaging, University of California San Francisco CA, 94143 USA. (Website: http://radiology.ucsf.edu/bicg)
| | - Colin Studholme
- Department of Radiology and Biomedical Imaging, University of California San Francisco CA, 94143 USA (Website: http://radiology.ucsf.edu/bicg)
| |
Collapse
|
9
|
Abstract
Fetal MRI is clinically performed to evaluate the brain in cases where an abnormality is detected by prenatal sonography. These most commonly include ventriculomegaly, abnormalities of the corpus callosum, and abnormalities of the posterior fossa. Fetal MRI is also increasingly performed to evaluate fetuses who have normal brain findings on prenatal sonogram but who are at increased risk for neurodevelopmental abnormalities, such as complicated monochorionic twin pregnancies. This paper will briefly discuss the common clinical conditions imaged by fetal MRI as well as recent advances in fetal MRI research.
Collapse
|