Toward the automatic quantification of in utero brain development in 3D structural MRI: A review

Comprehensive analysis of synthetic learning applied to neonatal brain MRI segmentation

Brain segmentation from neonatal MRI images is a very challenging task due to large changes in the shape of cerebral structures and variations in signal intensities reflecting the gestational process. In this context, there is a clear need for segmentation techniques that are robust to variations in image contrast and to the spatial configuration of anatomical structures. In this work, we evaluate the potential of synthetic learning, a contrast-independent model trained using synthetic images generated from the ground truth labels of very few subjects. We base our experiments on the dataset released by the developmental Human Connectome Project, for which high-quality images are available for more than 700 babies aged between 26 and 45 weeks postconception. First, we confirm the impressive performance of a standard UNet trained on a few volumes, but also confirm that such models learn intensity-related features specific to the training domain. We then confirm the robustness of the synthetic learning approach to variations in image contrast. However, we observe a clear influence of the age of the baby on the predictions. We improve the performance of this model by enriching the synthetic training set with realistic motion artifacts and over-segmentation of the white matter. Based on extensive visual assessment, we argue that the better performance of the model trained on real T2w data may be due to systematic errors in the ground truth. We propose an original experiment allowing us to show that learning from real data will reproduce any systematic bias affecting the training set, while synthetic models can avoid this limitation. Overall, our experiments confirm that synthetic learning is an effective solution for segmenting neonatal brain MRI. Our adapted synthetic learning approach combines key features that will be instrumental for large multisite studies and clinical applications.

A joint brain extraction and image quality assessment framework for fetal brain MRI slices

Brain extraction and image quality assessment are two fundamental steps in fetal brain magnetic resonance imaging (MRI) 3D reconstruction and quantification. However, the randomness of fetal position and orientation, the variability of fetal brain morphology, maternal organs around the fetus, and the scarcity of data samples, all add excessive noise and impose a great challenge to automated brain extraction and quality assessment of fetal MRI slices. Conventionally, brain extraction and quality assessment are typically performed independently. However, both of them focus on the brain image representation, so they can be jointly optimized to ensure the network learns more effective features and avoid overfitting. To this end, we propose a novel two-stage dual-task deep learning framework with a brain localization stage and a dual-task stage for joint brain extraction and quality assessment of fetal MRI slices. Specifically, the dual-task module compactly contains a feature extraction module, a quality assessment head and a segmentation head with feature fusion for simultaneous brain extraction and quality assessment. Besides, a transformer architecture is introduced into the feature extraction module and the segmentation head. We utilize a multi-step training strategy to guarantee a stable and successful training of all modules. Finally, we validate our method by a 5-fold cross-validation and ablation study on a dataset with fetal brain MRI slices in different qualities, and perform a cross-dataset validation in addition. Experiments show that the proposed framework achieves very promising performance.

An automatic pipeline for atlas-based fetal and neonatal brain segmentation and analysis

BACKGROUND AND OBJECTIVE

The automatic segmentation of perinatal brain structures in magnetic resonance imaging (MRI) is of utmost importance for the study of brain growth and related complications. While different methods exist for adult and pediatric MRI data, there is a lack for automatic tools for the analysis of perinatal imaging.

METHODS

In this work, a new pipeline for fetal and neonatal segmentation has been developed. We also report the creation of two new fetal atlases, and their use within the pipeline for atlas-based segmentation, based on novel registration methods. The pipeline is also able to extract cortical and pial surfaces and compute features, such as curvature, local gyrification index, sulcal depth, and thickness.

RESULTS

Results show that the introduction of the new templates together with our segmentation strategy leads to accurate results when compared to expert annotations, as well as better performances when compared to a reference pipeline (developing Human Connectome Project (dHCP)), for both early and late-onset fetal brains.

CONCLUSIONS

These findings show the potential of the presented atlases and the whole pipeline for application in both fetal, neonatal, and longitudinal studies, which could lead to dramatic improvements in the understanding of perinatal brain development.

A review of image processing methods for fetal head and brain analysis in ultrasound images

BACKGROUND AND OBJECTIVE

Examination of head shape and brain during the fetal period is paramount to evaluate head growth, predict neurodevelopment, and to diagnose fetal abnormalities. Prenatal ultrasound is the most used imaging modality to perform this evaluation. However, manual interpretation of these images is challenging and thus, image processing methods to aid this task have been proposed in the literature. This article aims to present a review of these state-of-the-art methods.

METHODS

In this work, it is intended to analyze and categorize the different image processing methods to evaluate fetal head and brain in ultrasound imaging. For that, a total of 109 articles published since 2010 were analyzed. Different applications are covered in this review, namely analysis of head shape and inner structures of the brain, standard clinical planes identification, fetal development analysis, and methods for image processing enhancement.

RESULTS

For each application, the reviewed techniques are categorized according to their theoretical approach, and the more suitable image processing methods to accurately analyze the head and brain are identified. Furthermore, future research needs are discussed. Finally, topics whose research is lacking in the literature are outlined, along with new fields of applications.

CONCLUSIONS

A multitude of image processing methods has been proposed for fetal head and brain analysis. Summarily, techniques from different categories showed their potential to improve clinical practice. Nevertheless, further research must be conducted to potentiate the current methods, especially for 3D imaging analysis and acquisition and for abnormality detection.

Cortical development coupling between surface area and sulcal depth on macaque brains

Postnatal development of cerebral cortex is associated with a variety of neuronal processes and is thus critical to development of brain function and cognition. Longitudinal changes of cortical morphology and topology, such as postnatal cortical thinning and flattening have been widely studied. However, thorough and systematic investigation of such cortical change, including how to quantify it from multiple spatial directions and how to relate it to surface topology, is rarely found. In this work, based on a longitudinal macaque neuroimaging dataset, we quantified local changes in gyral white matter's surface area and sulcal depth during early development. We also investigated how these two metrics are coupled and how this coupling is linked to cortical surface topology, underlying white matter, and positions of functional areas. Semi-parametric generalized additive models were adopted to quantify the longitudinal changes of surface area (A) and sulcal depth (D), and the coupling patterns between them. This resulted in four classes of regions, according to how they change compared with global change throughout early development: slower surface area change and slower sulcal depth change (slowA_slowD), slower surface area change and faster sulcal depth change (slowA_fastD), faster surface area change and slower sulcal depth change (fastA_slowD), and faster surface area change and faster sulcal depth change (fastA_fastD). We found that cortex-related metrics, including folding pattern and cortical thickness, vary along slowA_fastD-fastA_slowD axis, and structural connection-related metrics vary along fastA_fastD-slowA_slowD axis, with which brain functional sites align better. It is also found that cortical landmarks, including sulcal pits and gyral hinges, spatially reside on the borders of the four patterns. These findings shed new lights on the relationship between cortex development, surface topology, axonal wiring pattern and brain functions.

Automated Brain Masking of Fetal Functional MRI with Open Data

Fetal resting-state functional magnetic resonance imaging (rs-fMRI) has emerged as a critical new approach for characterizing brain development before birth. Despite the rapid and widespread growth of this approach, at present, we lack neuroimaging processing pipelines suited to address the unique challenges inherent in this data type. Here, we solve the most challenging processing step, rapid and accurate isolation of the fetal brain from surrounding tissue across thousands of non-stationary 3D brain volumes. Leveraging our library of 1,241 manually traced fetal fMRI images from 207 fetuses, we trained a Convolutional Neural Network (CNN) that achieved excellent performance across two held-out test sets from separate scanners and populations. Furthermore, we unite the auto-masking model with additional fMRI preprocessing steps from existing software and provide insight into our adaptation of each step. This work represents an initial advancement towards a fully comprehensive, open-source workflow, with openly shared code and data, for fetal functional MRI data preprocessing.

Longitudinal Chinese Population Structural Fetal Brain Atlases Construction: toward precise fetal brain segmentation

In magnetic resonance imaging (MRI) studies of fetal brain development, structural brain atlases usually serve as essential references for the fetal population. Individual images are spatially normalized into a common or standard atlas space to extract regional information on volumetric or morphological brain variations. However, the existing fetal brain atlases are mostly based on MR images obtained from Caucasian populations and thus are not ideal for the characterization of the brains of the Chinese population due to neuroanatomical differences related to genetic factors. In this paper, we use an unbiased template construction algorithm to create a set of age-specific Chinese fetal atlases between 21-35 weeks of gestation from 115 normally developing fetal brains. Based on the 4D spatiotemporal atlas, the morphologically developmental patterns, e.g., cortical thickness, sulcal and gyral patterns, were quantified from in utero MRI. Additionally, after applying the Chinese fetal atlases and Caucasian fetal atlases to an independent Chinese pediatric dataset, we find that the Chinese fetal atlases result in significantly higher accuracy than the Caucasian fetal atlases in guiding brain tissue segmentation. These results suggest that the Chinese fetal brain atlases are necessary for quantitative analysis of the typical and atypical development of the Chinese fetal population in the future.

Learning Spatiotemporal Probabilistic Atlas of Fetal Brains with Anatomically Constrained Registration Network

Brain atlases are of fundamental importance for analyzing the dynamic neurodevelopment in fetal brain studies. Since the brain size, shape, and anatomical structures change rapidly during the prenatal period, it is essential to construct a spatiotemporal (4D) atlas equipped with tissue probability maps, which can preserve sharper early brain folding patterns for accurately characterizing dynamic changes in fetal brains and provide tissue prior informations for related tasks, e.g., segmentation, registration, and parcellation. In this work, we propose a novel unsupervised age-conditional learning framework to build temporally continuous fetal brain atlases by incorporating tissue segmentation maps, which outperforms previous traditional atlas construction methods in three aspects. First, our framework enables learning age-conditional deformable templates by leveraging the entire collection. Second, we leverage reliable brain tissue segmentation maps in addition to the low-contrast noisy intensity images to enhance the alignment of individual images. Third, a novel loss function is designed to enforce the similarity between the learned tissue probability map on the atlas and each subject tissue segmentation map after registration, thereby providing extra anatomical consistency supervision for atlas building. Our 4D temporally-continuous fetal brain atlases are constructed based on 82 healthy fetuses from 22 to 32 gestational weeks. Compared with the atlases built by the state-of-the-art algorithms, our atlases preserve more structural details and sharper folding patterns. Together with the learned tissue probability maps, our 4D fetal atlases provide a valuable reference for spatial normalization and analysis of fetal brain development.

Effect of MRI acquisition acceleration via compressed sensing and parallel imaging on brain volumetry

Objectives

To investigate the effect of compressed SENSE (CS), an acceleration technique combining parallel imaging and compressed sensing, on potential bias and precision of brain volumetry and evaluate it in the context of normative brain volumetry.

Materials and methods

In total, 171 scans from scan-rescan experiments on three healthy subjects were analyzed. Each subject received 3D-T1-weighted brain MRI scans at increasing degrees of acceleration (CS-factor = 1/4/8/12/16/20/32). Single-scan acquisition times ranged from 00:41 min (CS-factor = 32) to 21:52 min (CS-factor = 1). Brain segmentation and volumetry was performed using two different software tools: md.brain, a proprietary software based on voxel-based morphometry, and FreeSurfer, an open-source software based on surface-based morphometry. Four sub-volumes were analyzed: brain parenchyma (BP), total gray matter, total white matter, and cerebrospinal fluid (CSF). Coefficient of variation (CoV) of the repeated measurements as a measure of intra-subject reliability was calculated. Intraclass correlation coefficient (ICC) with regard to increasing CS-factor was calculated as another measure of reliability. Noise-to-contrast ratio as a measure of image quality was calculated for each dataset to analyze the association between acceleration factor, noise and volumetric brain measurements.

Results

For all sub-volumes, there is a systematic bias proportional to the CS-factor which is dependent on the utilized software and subvolume. Measured volumes deviated significantly from the reference standard (CS-factor = 1), e.g. ranging from 1 to 13% for BP. The CS-induced systematic bias is driven by increased image noise. Except for CSF, reliability of brain volumetry remains high, demonstrated by low CoV (< 1% for CS-factor up to 20) and good to excellent ICC for CS-factor up to 12.

Conclusion

CS-acceleration has a systematic biasing effect on volumetric brain measurements.

Supplementary Information

The online version contains supplementary material available at 10.1007/s10334-020-00906-9.

Age-specific structural fetal brain atlases construction and cortical development quantification for chinese population

In magnetic resonance imaging (MRI) studies of fetal brain development, structural brain atlases usually serve as essential references for the fetal population. Individual images are usually normalized into a common or standard space for analysis. However, the existing fetal brain atlases are mostly based on MR images obtained from Caucasian populations and thus are not ideal for the characterization of the fetal Chinese population due to neuroanatomical differences related to genetic factors. In this paper, we use an unbiased template construction algorithm to create a set of age-specific Chinese fetal atlases between 21-35 weeks of gestation from 115 normal fetal brains. Based on the 4D spatiotemporal atlas, the morphological development patterns, e.g., cortical thickness, cortical surface area, sulcal and gyral patterns, were quantified. The fetal brain abnormalities were detected when referencing the age-specific template. Additionally, a direct comparison of the Chinese fetal atlases and Caucasian fetal atlases reveals dramatic anatomical differences, mainly in the medial frontal and temporal regions. After applying the Chinese and Caucasian fetal atlases separately to an independent Chinese fetal brain dataset, we find that the Chinese fetal atlases result in significantly higher accuracy than the Caucasian fetal atlases in guiding brain tissue segmentation. These results suggest that the Chinese fetal brain atlases are necessary for quantitative analysis of the typical and atypical development of the Chinese fetal population in the future. The atlases with their parcellations are now publicly available at https://github.com/DeepBMI/FBA-Chinese.

Three-Dimensional Volumetric Magnetic Resonance Imaging Detects Early Alterations of the Brain Growth in Fetuses With Congenital Heart Disease

BACKGROUND

Several published studies have shown alterations of brain development in third-trimester fetuses with congenital heart disease (CHD). However, little is known about the timing and pattern of altered brain development in fetuses with CHD.

PURPOSE

To investigate the changes in the volume of intracranial structures in fetuses with CHD by three-dimensional (3D) volumetric magnetic resonance imaging (MRI) in the earlier stages of pregnancy (median gestational age [GA], 26 weeks).

STUDY TYPE

Retrospective.

POPULATION

Forty women carrying a fetus with CHD (including 20 fetuses with GA <26 weeks) and 120 pregnant women carrying a healthy fetus (including 50 fetuses with GA <26 weeks).

FIELD STRENGTH/SEQUENCE

Two-dimensional single-shot turbo spin echo sequence at 1.5 -T.

ASSESSMENT

Three-dimensional volumetric parameters from slice-to-volume registered images, including cortical gray matter volume (GMV), subcortical brain tissue volume (SBV), intracranial cavity volume (ICV), lateral ventricles volume (VV), cerebellum, brainstem, and extra-cerebrospinal fluid (e-CSF) were quantified by manual segmentation from one primary and two secondary observers.

STATISTICAL TESTS

Volumes were presented graphically with quadratic curve fitting. Scatterplots were produced mapping volumes against GA in normal and CHD fetuses. For GA <26 weeks, Z scores were calculated and Student's t-tests were conducted to compare volumes between the normal and CHD fetuses.

RESULTS

In fetuses with CHD GMV, SBV, cerebellum, and brainstem were significantly reduced (all P < 0.05) in early stages of pregnancy (GA <26 weeks), with differences becoming progressively greater with increasing GA. Compared with normal fetuses, e-CSF, e-CSF to ICV ratio, and VV were higher in fetuses with CHD (all P < 0.05). However, ICV volume and the GMV to SBV ratio were not significantly reduced in the CHD group (P = 0.94 and P = 0.13, respectively) during the middle gestation (GA <26 weeks).

DATA CONCLUSION

There appear to be alterations of brain development trajectory in CHD fetuses that can be detected by 3D volumetric MRI in the earlier stages of pregnancy.

LEVEL OF EVIDENCE

4 TECHNICAL EFFICACY: Stage 3.

A novel approach to multiple anatomical shape analysis: Application to fetal ventriculomegaly

Fetal ventriculomegaly (VM) is a condition in which one or both lateral ventricles are enlarged, and is diagnosed as an atrial diameter larger than 10 mm. Evidence of altered cortical folding associated with VM has been shown in the literature. However, existing works use a single scalar value such as diagnosis or lateral ventricular volume to characterize VM and study its relationship with alterations in cortical folding, thus failing to reveal the spatially-heterogeneous associations. In this work, we propose a novel approach to identify fine-grained associations between cortical folding and ventricular enlargement by leveraging the vertex-wise correlations between their growth patterns in terms of area expansion and curvature. Our approach comprises three steps. In the first step, we define a joint graph Laplacian matrix using cortex-to-ventricle correlations. The joint Laplacian is built based on multiple cortical features. Next, we propose a spectral embedding of the cortex-to-ventricle graph into a common underlying space where its nodes are projected according to the joint ventricle-cortex growth patterns. In this low-dimensional joint ventricle-cortex space, associated growth patterns lie close to each other. In the final step, we perform hierarchical clustering in the joint embedded space to identify associated sub-regions between cortex and ventricle. Using a dataset of 25 healthy fetuses and 23 fetuses with isolated non-severe VM within the age range of 26-29 gestational weeks, our approach reveals clinically relevant and heterogeneous regional associations. Cortical regions forming these associations are further validated using statistical analysis, revealing regions with altered folding that are significantly associated with ventricular dilation.

Mapping hemispheric asymmetries of the macaque cerebral cortex during early brain development

Studying cortical hemispheric asymmetries during the dynamic early postnatal stages in macaque monkeys (with close phylogenetic relationship to humans) would increase our limited understanding on the possible origins, developmental trajectories, and evolutional mechanisms of brain asymmetries in nonhuman primates, but remains a blind spot to the community. Via cortical surface-based morphometry, we comprehensively analyze hemispheric structural asymmetries in 134 longitudinal MRI scans from birth to 20 months of age from 32 healthy macaque monkeys. We reveal that most clusters of hemispheric asymmetries of cortical properties, such as surface area, cortical thickness, sulcal depth, and vertex positions, expand in the first 4 months of life, and evolve only moderately thereafter. Prominent hemispheric asymmetries are found at the inferior frontal gyrus, precentral gyrus, posterior temporal cortex, superior temporal gyrus (STG), superior temporal sulcus (STS), and cingulate cortex. Specifically, the left planum temporale and left STG consistently have larger area and thicker cortices than those on the right hemisphere, while the right STS, right cingulate cortex, and right anterior insula are consistently deeper than the left ones, partially consistent with the findings in human infants and adults. Our results thus provide a valuable reference in studying early brain development and evolution.

Fetal cortical surface atlas parcellation based on growth patterns

Defining anatomically and functionally meaningful parcellation maps on cortical surface atlases is of great importance in surface-based neuroimaging analysis. The conventional cortical parcellation maps are typically defined based on anatomical cortical folding landmarks in adult surface atlases. However, they are not suitable for fetal brain studies, due to dramatic differences in brain size, shape, and properties between adults and fetuses. To address this issue, we propose a novel data-driven method for parcellation of fetal cortical surface atlases into distinct regions based on the dynamic "growth patterns" of cortical properties (e.g., surface area) from a population of fetuses. Our motivation is that the growth patterns of cortical properties indicate the underlying rapid changes of microstructures, which determine the molecular and functional principles of the cortex. Thus, growth patterns are well suitable for defining distinct cortical regions in development, structure, and function. To comprehensively capture the similarities of cortical growth patterns among vertices, we construct two complementary similarity matrices. One is directly based on the growth trajectories of vertices, and the other is based on the correlation profiles of vertices' growth trajectories in relation to a set of reference points. Then, we nonlinearly fuse these two similarity matrices into a single one, which can better capture both their common and complementary information than by simply averaging them. Finally, based on this fused similarity matrix, we perform spectral clustering to divide the fetal cortical surface atlases into distinct regions. By applying our method on 25 normal fetuses from 26 to 29 gestational weeks, we construct age-specific fetal cortical surface atlases equipped with biologically meaningful parcellation maps based on cortical growth patterns. Importantly, our generated parcellation maps reveal spatially contiguous, hierarchical and bilaterally relatively symmetric patterns of fetal cortical surface development.

A framework for multi-component analysis of diffusion MRI data over the neonatal period

We describe a framework for creating a time-resolved group average template of the developing brain using advanced multi-shell high angular resolution diffusion imaging data, for use in group voxel or fixel-wise analysis, atlas-building, and related applications. This relies on the recently proposed multi-shell multi-tissue constrained spherical deconvolution (MSMT-CSD) technique. We decompose the signal into one isotropic component and two anisotropic components, with response functions estimated from cerebrospinal fluid and white matter in the youngest and oldest participant groups, respectively. We build an orientationally-resolved template of those tissue components from data acquired from 113 babies between 33 and 44 weeks postmenstrual age, imaged as part of the Developing Human Connectome Project. These data were split into weekly groups, and registered to the corresponding group average templates using a previously-proposed non-linear diffeomorphic registration framework, designed to align orientation density functions (ODF). This framework was extended to allow the use of the multiple contrasts provided by the multi-tissue decomposition, and shown to provide superior alignment. Finally, the weekly templates were registered to the same common template to facilitate investigations into the evolution of the different components as a function of age. The resulting multi-tissue atlas provides insights into brain development and accompanying changes in microstructure, and forms the basis for future longitudinal investigations into healthy and pathological white matter maturation.

Segmentation and classification in MRI and US fetal imaging: Recent trends and future prospects

Fetal imaging is a burgeoning topic. New advancements in both magnetic resonance imaging and (3D) ultrasound currently allow doctors to diagnose fetal structural abnormalities such as those involved in twin-to-twin transfusion syndrome, gestational diabetes mellitus, pulmonary sequestration and hypoplasia, congenital heart disease, diaphragmatic hernia, ventriculomegaly, etc. Considering the continued breakthroughs in utero image analysis and (3D) reconstruction models, it is now possible to gain more insight into the ongoing development of the fetus. Best prenatal diagnosis performances rely on the conscious preparation of the clinicians in terms of fetal anatomy knowledge. Therefore, fetal imaging will likely span and increase its prevalence in the forthcoming years. This review covers state-of-the-art segmentation and classification methodologies for the whole fetus and, more specifically, the fetal brain, lungs, liver, heart and placenta in magnetic resonance imaging and (3D) ultrasound for the first time. Potential applications of the aforementioned methods into clinical settings are also inspected. Finally, improvements in existing approaches as well as most promising avenues to new areas of research are briefly outlined.

An iterative multi-atlas patch-based approach for cortex segmentation from neonatal MRI

Brain structure analysis in the newborn is a major health issue. This is especially the case for preterm neonates, in order to obtain predictive information related to the child development. In particular, the cortex is a structure of interest, that can be observed in magnetic resonance imaging (MRI). However, neonatal MRI data present specific properties that make them challenging to process. In this context, multi-atlas approaches constitute an efficient strategy, taking advantage of images processed beforehand. The method proposed in this article relies on such a multi-atlas strategy. More precisely, it uses two paradigms: first, a non-local model based on patches; second, an iterative optimization scheme. Coupling both concepts allows us to consider patches related not only to the image information, but also to the current segmentation. This strategy is compared to other multi-atlas methods proposed in the literature. Experiments on dHCP datasets show that the proposed approach provides robust cortex segmentation results.

Revealing Regional Associations of Cortical Folding Alterations with In Utero Ventricular Dilation Using Joint Spectral Embedding

Fetal ventriculomegaly (VM) is a condition with dilation of one or both lateral ventricles, and is diagnosed as an atrial diameter larger than 10 mm. Evidence of altered cortical folding associated with VM has been shown in the literature. However, existing studies use a holistic approach (i.e., ventricle as a whole) based on diagnosis or ventricular volume, thus failing to reveal the spatially-heterogeneous association patterns between cortex and ventricle. To address this issue, we develop a novel method to identify spatially fine-scaled association maps between cortical development and VM by leveraging vertex-wise correlations between the growth patterns of both ventricular and cortical surfaces in terms of area expansion and curvature information. Our approach comprises multiple steps. In the first step, we define a joint graph Laplacian matrix using cortex-to-ventricle correlations. Next, we propose a spectral embedding of the cortex-to-ventricle graph into a common underlying space where their joint growth patterns are projected. More importantly, in the joint ventricle-cortex space, the vertices of associated regions from both cortical and ventricular surfaces would lie close to each other. In the final step, we perform clustering in the joint embedded space to identify associated sub-regions between cortex and ventricle. Using a dataset of 25 healthy fetuses and 23 fetuses with isolated non-severe VM within the age range of 26-29 gestational weeks, our results show that the proposed approach is able to reveal clinically relevant and meaningful regional associations.

Learning to combine complementary segmentation methods for fetal and 6-month infant brain MRI segmentation

Segmentation of brain structures during the pre-natal and early post-natal periods is the first step for subsequent analysis of brain development. Segmentation techniques can be roughly divided into two families. The first, which we denote as registration-based techniques, rely on initial estimates derived by registration to one (or several) templates. The second family, denoted as learning-based techniques, relate imaging (and spatial) features to their corresponding anatomical labels. Each approach has its own qualities and both are complementary to each other. In this paper, we explore two ensembling strategies, namely, stacking and cascading to combine the strengths of both families. We present experiments on segmentation of 6-month infant brains and a cohort of fetuses with isolated non-severe ventriculomegaly (INSVM). INSVM is diagnosed when ventricles are mildly enlarged and no other anomalies are apparent. Prognosis is difficult based solely on the degree of ventricular enlargement. In order to find markers for a more reliable prognosis, we use the resulting segmentations to find abnormalities in the cortical folding of INSVM fetuses. Segmentation results show that either combination strategy outperform all of the individual methods, thus demonstrating the capability of learning systematic combinations that lead to an overall improvement. In particular, the cascading strategy outperforms the ensembling one, the former one obtaining top 5, 7 and 13 results (out of 21 teams) in the segmentation of white matter, gray matter and cerebro-spinal fluid in the iSeg2017 MICCAI Segmentation Challenge. The resulting segmentations reveal that INSVM fetuses have a less convoluted cortex. This points to cortical folding abnormalities as potential markers of later neurodevelopmental outcomes.

FETAL CORTICAL PARCELLATION BASED ON GROWTH PATTERNS

Dividing the human cerebral cortex into structurally and functionally distinct regions is important in many neuroimaging studies. Although many parcellations have been created for adults, they are not applicable for fetal studies, due to dramatic differences in brain size, shape and folding between adults and fetuses, as well as dynamic growth of fetal brains. To address this issue, we propose a novel method to divide a population of fetal cortical surfaces into distinct regions based on the dynamic growth patterns of cortical properties, which indicate the underlying changes of microstructures. As microstructures determine the molecular organization and functional principles of the cortex, growth patterns enable an accurate definition of distinct regions in development, microstructure, and function. To comprehensively capture the similarities of cortical growth patterns among vertices, we construct two complementary similarity matrices. One is directly based on the growth trajectories of vertices and the other is based on the correlation profiles of vertices' growth trajectories in relation to those of reference points. Then, we nonlinearly fuse these two similarity matrices into a single one, which can better captures both their common and complementary information than by simply averaging them. Finally, based on this fused matrix, we perform spectral clustering to divide fetal cortical surfaces into distinct regions. We have applied our method on 25 normal fetuses from 26 to 29 gestational weeks and generated biologically meaningful parcellations.

Computational neuroanatomy of baby brains: A review

The first postnatal years are an exceptionally dynamic and critical period of structural, functional and connectivity development of the human brain. The increasing availability of non-invasive infant brain MR images provides unprecedented opportunities for accurate and reliable charting of dynamic early brain developmental trajectories in understanding normative and aberrant growth. However, infant brain MR images typically exhibit reduced tissue contrast (especially around 6 months of age), large within-tissue intensity variations, and regionally-heterogeneous, dynamic changes, in comparison with adult brain MR images. Consequently, the existing computational tools developed typically for adult brains are not suitable for infant brain MR image processing. To address these challenges, many infant-tailored computational methods have been proposed for computational neuroanatomy of infant brains. In this review paper, we provide a comprehensive review of the state-of-the-art computational methods for infant brain MRI processing and analysis, which have advanced our understanding of early postnatal brain development. We also summarize publically available infant-dedicated resources, including MRI datasets, computational tools, grand challenges, and brain atlases. Finally, we discuss the limitations in current research and suggest potential future research directions.

Learning non-linear patch embeddings with neural networks for label fusion

In brain structural segmentation, multi-atlas strategies are increasingly being used over single-atlas strategies because of their ability to fit a wider anatomical variability. Patch-based label fusion (PBLF) is a type of such multi-atlas approaches that labels each target point as a weighted combination of neighboring atlas labels, where atlas points with higher local similarity to the target contribute more strongly to label fusion. PBLF can be potentially improved by increasing the discriminative capabilities of the local image similarity measurements. We propose a framework to compute patch embeddings using neural networks so as to increase discriminative abilities of similarity-based weighted voting in PBLF. As particular cases, our framework includes embeddings with different complexities, namely, a simple scaling, an affine transformation, and non-linear transformations. We compare our method with state-of-the-art alternatives in whole hippocampus and hippocampal subfields segmentation experiments using publicly available datasets. Results show that even the simplest versions of our method outperform standard PBLF, thus evidencing the benefits of discriminative learning. More complex transformation models tended to achieve better results than simpler ones, obtaining a considerable increase in average Dice score compared to standard PBLF.

Cortical folding alterations in fetuses with isolated non-severe ventriculomegaly

Neuroimaging of brain diseases plays a crucial role in understanding brain abnormalities and early diagnosis. Of great importance is the study of brain abnormalities in utero and the assessment of deviations in case of maldevelopment. In this work, brain magnetic resonance images from 23 isolated non-severe ventriculomegaly (INSVM) fetuses and 25 healthy controls between 26 and 29 gestational weeks were used to identify INSVM-related cortical folding deviations from normative development. Since these alterations may reflect abnormal neurodevelopment, our working hypothesis is that markers of cortical folding can provide cues to improve the prediction of later neurodevelopmental problems in INSVM subjects. We analyzed the relationship of ventricular enlargement with cortical folding alterations in a regional basis using several curvature-based measures describing the folding of each cortical region. Statistical analysis (global and hemispheric) and sparse linear regression approaches were then used to find the cortical regions whose folding is associated with ventricular dilation. Results from both approaches were in great accordance, showing a significant cortical folding decrease in the insula, posterior part of the temporal lobe and occipital lobe. Moreover, compared to the global analysis, stronger ipsilateral associations of ventricular enlargement with reduced cortical folding were encountered by the hemispheric analysis. Our findings confirm and extend previous studies by identifying various cortical regions and emphasizing ipsilateral effects of ventricular enlargement in altered folding. This suggests that INSVM is an indicator of altered cortical development, and moreover, cortical regions with reduced folding constitute potential prognostic biomarkers to be used in follow-up studies to decipher the outcome of INSVM fetuses.