Automatic segmentation of newborn brain MRI

Age-specific optimization of the T2-weighted MRI contrast in infant and toddler brain

PURPOSE

In 0-2-year-old brains, the T2-weighted (T2w) contrast between white matter (WM) and gray matter (GM) is weaker compared with that in adult brains and rapidly changes with age. This study aims to design variable-flip-angle (VFA) trains in 3D fast spin-echo sequence that adapt to the dynamically changing relaxation times to improve the contrast in the T2w images of the developing brains.

METHODS

T1 and T2 relaxation times in 0-2-year-old brains were measured, and several age groups were defined according to the age-dependent pattern of T2 values. Based on the static pseudo-steady-state theory and the extended phase graph algorithm, VFA trains were designed for each age group to maximize WM/GM contrast, constrained by the maximum specific absorption rate and overall signal intensity. The optimized VFA trains were compared with the default one used for adult brains based on the relative contrast between WM and GM. Dice coefficient was used to demonstrate the advantage of contrast-improved images as inputs for automatic tissue segmentation in infant brains.

RESULTS

The 0-2-year-old pool was divided into groups of 0-8 months, 8-12 months, and 12-24 months. The optimal VFA trains were tested in each age group in comparison with the default sequence. Quantitative analyses demonstrated improved relative contrasts in infant and toddler brains by 1.5-2.3-fold at different ages. The Dice coefficient for contrast-optimized images was improved compared with default images (p < 0.001).

CONCLUSION

An effective strategy was proposed to improve the 3D T2w contrast in 0-2-year-old brains.

VINNA for neonates: Orientation independence through latent augmentations

A robust, fast, and accurate segmentation of neonatal brain images is highly desired to better understand and detect changes during development and disease, specifically considering the rise in imaging studies for this cohort. Yet, the limited availability of ground truth datasets, lack of standardized acquisition protocols, and wide variations of head positioning in the scanner pose challenges for method development. A few automated image analysis pipelines exist for newborn brain Magnetic Resonance Image (MRI) segmentation, but they often rely on time-consuming non-linear spatial registration procedures and require resampling to a common resolution, subject to loss of information due to interpolation and down-sampling. Without registration and image resampling, variations with respect to head positions and voxel resolutions have to be addressed differently. In deep learning, external augmentations such as rotation, translation, and scaling are traditionally used to artificially expand the representation of spatial variability, which subsequently increases both the training dataset size and robustness. However, these transformations in the image space still require resampling, reducing accuracy specifically in the context of label interpolation. We recently introduced the concept of resolution-independence with the Voxel-size Independent Neural Network framework, VINN. Here, we extend this concept by additionally shifting all rigid-transforms into the network architecture with a four degree of freedom (4-DOF) transform module, enabling resolution-aware internal augmentations (VINNA) for deep learning. In this work, we show that VINNA (i) significantly outperforms state-of-the-art external augmentation approaches, (ii) effectively addresses the head variations present specifically in newborn datasets, and (iii) retains high segmentation accuracy across a range of resolutions (0.5-1.0 mm). Furthermore, the 4-DOF transform module together with internal augmentations is a powerful, general approach to implement spatial augmentation without requiring image or label interpolation. The specific network application to newborns will be made publicly available as VINNA4neonates.

Deep learning techniques for isointense infant brain tissue segmentation: a systematic literature review

Introduction

To improve comprehension of initial brain growth in wellness along with sickness, it is essential to precisely segment child brain magnetic resonance imaging (MRI) into white matter (WM) and gray matter (GM), along with cerebrospinal fluid (CSF). Nonetheless, in the isointense phase (6-8 months of age), the inborn myelination and development activities, WM along with GM display alike stages of intensity in both T1-weighted and T2-weighted MRI, making tissue segmentation extremely difficult.

Methods

The comprehensive review of studies related to isointense brain MRI segmentation approaches is highlighted in this publication. The main aim and contribution of this study is to aid researchers by providing a thorough review to make their search for isointense brain MRI segmentation easier. The systematic literature review is performed from four points of reference: (1) review of studies concerning isointense brain MRI segmentation; (2) research contribution and future works and limitations; (3) frequently applied evaluation metrics and datasets; (4) findings of this studies.

Results and discussion

The systemic review is performed on studies that were published in the period of 2012 to 2022. A total of 19 primary studies of isointense brain MRI segmentation were selected to report the research question stated in this review.

The past, current, and future of neonatal intensive care units with artificial intelligence: a systematic review

Machine learning and deep learning are two subsets of artificial intelligence that involve teaching computers to learn and make decisions from any sort of data. Most recent developments in artificial intelligence are coming from deep learning, which has proven revolutionary in almost all fields, from computer vision to health sciences. The effects of deep learning in medicine have changed the conventional ways of clinical application significantly. Although some sub-fields of medicine, such as pediatrics, have been relatively slow in receiving the critical benefits of deep learning, related research in pediatrics has started to accumulate to a significant level, too. Hence, in this paper, we review recently developed machine learning and deep learning-based solutions for neonatology applications. We systematically evaluate the roles of both classical machine learning and deep learning in neonatology applications, define the methodologies, including algorithmic developments, and describe the remaining challenges in the assessment of neonatal diseases by using PRISMA 2020 guidelines. To date, the primary areas of focus in neonatology regarding AI applications have included survival analysis, neuroimaging, analysis of vital parameters and biosignals, and retinopathy of prematurity diagnosis. We have categorically summarized 106 research articles from 1996 to 2022 and discussed their pros and cons, respectively. In this systematic review, we aimed to further enhance the comprehensiveness of the study. We also discuss possible directions for new AI models and the future of neonatology with the rising power of AI, suggesting roadmaps for the integration of AI into neonatal intensive care units.

Image data and computational grids for computing brain shift and solving the electrocorticography forward problem

This article describes the dataset applied in the research reported in NeuroImage article "Patient-specific solution of the electrocorticography forward problem in deforming brain" [1] that is available for download from the Zenodo data repository (https://zenodo.org/record/7687631) [2]. Preoperative structural and diffusion-weighted magnetic resonance (MR) and postoperative computed tomography (CT) images of a 12-year-old female epilepsy patient under evaluation for surgical intervention were obtained retrospectively from Boston Children's Hospital. We used these images to conduct the analysis at The University of Western Australia's Intelligent Systems for Medicine Laboratory using SlicerCBM [3], our open-source software extension for the 3D Slicer medical imaging platform. As part of the analysis, we processed the images to extract the patient-specific brain geometry; created computational grids, including a tetrahedral grid for the meshless solution of the biomechanical model and a regular hexahedral grid for the finite element solution of the electrocorticography forward problem; predicted the postoperative MRI and DTI that correspond to the brain configuration deformed by the placement of subdural electrodes using biomechanics-based image warping; and solved the patient-specific electrocorticography forward problem to compute the electric potential distribution within the patient's head using the original preoperative and predicted postoperative image data. The well-established and open-source file formats used in this dataset, including Nearly Raw Raster Data (NRRD) files for images, STL files for surface geometry, and Visualization Toolkit (VTK) files for computational grids, allow other research groups to easily reuse the data presented herein to solve the electrocorticography forward problem accounting for the brain shift caused by implantation of subdural grid electrodes.

Patient-specific solution of the electrocorticography forward problem in deforming brain

Invasive intracranial electroencephalography (iEEG), or electrocorticography (ECoG), measures electric potential directly on the surface of the brain and can be used to inform treatment planning for epilepsy surgery. Combined with numerical modeling it can further improve accuracy of epilepsy surgery planning. Accurate solution of the iEEG forward problem, which is a crucial prerequisite for solving the iEEG inverse problemin epilepsy seizure onset zone localization, requires accurate representation of the patient's brain geometry and tissue electrical conductivity after implantation of electrodes. However, implantation of subdural grid electrodes causes the brain to deform, which invalidates preoperatively acquired image data. Moreover, postoperative magnetic resonance imaging (MRI) is incompatible with implanted electrodes and computed tomography (CT) has insufficient range of soft tissue contrast, which precludes both MRI and CT from being used to obtain the deformed postoperative geometry. In this paper, we present a biomechanics-based image warping procedure using preoperative MRI for tissue classification and postoperative CT for locating implanted electrodes to perform non-rigid registration of the preoperative image data to the postoperative configuration. We solve the iEEG forward problem on the predicted postoperative geometry using the finite element method (FEM) which accounts for patient-specific inhomogeneity and anisotropy of tissue conductivity. Results for the simulation of a current source in the brain show large differences in electric potential predicted by the models based on the original images and the deformed images corresponding to the brain geometry deformed by placement of invasive electrodes. Computation of the lead field matrix (useful for solution of the iEEG inverse problem) also showed significant differences between the different models. The results suggest that rapid and accurate solution of the forward problem in a deformed brain for a given patient is achievable.

Segmentation of Infant Brain Using Nonnegative Matrix Factorization

This study develops an atlas-based automated framework for segmenting infants’ brains from magnetic resonance imaging (MRI). For the accurate segmentation of different structures of an infant’s brain at the isointense age (6–12 months), our framework integrates features of diffusion tensor imaging (DTI) (e.g., the fractional anisotropy (FA)). A brain diffusion tensor (DT) image and its region map are considered samples of a Markov–Gibbs random field (MGRF) that jointly models visual appearance, shape, and spatial homogeneity of a goal structure. The visual appearance is modeled with an empirical distribution of the probability of the DTI features, fused by their nonnegative matrix factorization (NMF) and allocation to data clusters. Projecting an initial high-dimensional feature space onto a low-dimensional space of the significant fused features with the NMF allows for better separation of the goal structure and its background. The cluster centers in the latter space are determined at the training stage by the K-means clustering. In order to adapt to large infant brain inhomogeneities and segment the brain images more accurately, appearance descriptors of both the first-order and second-order are taken into account in the fused NMF feature space. Additionally, a second-order MGRF model is used to describe the appearance based on the voxel intensities and their pairwise spatial dependencies. An adaptive shape prior that is spatially variant is constructed from a training set of co-aligned images, forming an atlas database. Moreover, the spatial homogeneity of the shape is described with a spatially uniform 3D MGRF of the second-order for region labels. In vivo experiments on nine infant datasets showed promising results in terms of the accuracy, which was computed using three metrics: the 95-percentile modified Hausdorff distance (MHD), the Dice similarity coefficient (DSC), and the absolute volume difference (AVD). Both the quantitative and visual assessments confirm that integrating the proposed NMF-fused DTI feature and intensity MGRF models of visual appearance, the adaptive shape prior, and the shape homogeneity MGRF model is promising in segmenting the infant brain DTI.

Dear reviewers: Responses to common reviewer critiques about infant neuroimaging studies

The field of adult neuroimaging relies on well-established principles in research design, imaging sequences, processing pipelines, as well as safety and data collection protocols. The field of infant magnetic resonance imaging, by comparison, is a young field with tremendous scientific potential but continuously evolving standards. The present article aims to initiate a constructive dialog between researchers who grapple with the challenges and inherent limitations of a nascent field and reviewers who evaluate their work. We address 20 questions that researchers commonly receive from research ethics boards, grant, and manuscript reviewers related to infant neuroimaging data collection, safety protocols, study planning, imaging sequences, decisions related to software and hardware, and data processing and sharing, while acknowledging both the accomplishments of the field and areas of much needed future advancements. This article reflects the cumulative knowledge of experts in the FIT'NG community and can act as a resource for both researchers and reviewers alike seeking a deeper understanding of the standards and tradeoffs involved in infant neuroimaging.

Fast and High-Resolution Neonatal Brain MRI Through Super-Resolution Reconstruction From Acquisitions With Variable Slice Selection Direction

The brain of neonates is small in comparison to adults. Imaging at typical resolutions such as one cubic mm incurs more partial voluming artifacts in a neonate than in an adult. The interpretation and analysis of MRI of the neonatal brain benefit from a reduction in partial volume averaging that can be achieved with high spatial resolution. Unfortunately, direct acquisition of high spatial resolution MRI is slow, which increases the potential for motion artifact, and suffers from reduced signal-to-noise ratio. The purpose of this study is thus that using super-resolution reconstruction in conjunction with fast imaging protocols to construct neonatal brain MRI images at a suitable signal-to-noise ratio and with higher spatial resolution than can be practically obtained by direct Fourier encoding. We achieved high quality brain MRI at a spatial resolution of isotropic 0.4 mm with 6 min of imaging time, using super-resolution reconstruction from three short duration scans with variable directions of slice selection. Motion compensation was achieved by aligning the three short duration scans together. We applied this technique to 20 newborns and assessed the quality of the images we reconstructed. Experiments show that our approach to super-resolution reconstruction achieved considerable improvement in spatial resolution and signal-to-noise ratio, while, in parallel, substantially reduced scan times, as compared to direct high-resolution acquisitions. The experimental results demonstrate that our approach allowed for fast and high-quality neonatal brain MRI for both scientific research and clinical studies.

Learning U-Net Based Multi-Scale Features in Encoding-Decoding for MR Image Brain Tissue Segmentation

Accurate brain tissue segmentation of MRI is vital to diagnosis aiding, treatment planning, and neurologic condition monitoring. As an excellent convolutional neural network (CNN), U-Net is widely used in MR image segmentation as it usually generates high-precision features. However, the performance of U-Net is considerably restricted due to the variable shapes of the segmented targets in MRI and the information loss of down-sampling and up-sampling operations. Therefore, we propose a novel network by introducing spatial and channel dimensions-based multi-scale feature information extractors into its encoding-decoding framework, which is helpful in extracting rich multi-scale features while highlighting the details of higher-level features in the encoding part, and recovering the corresponding localization to a higher resolution layer in the decoding part. Concretely, we propose two information extractors, multi-branch pooling, called MP, in the encoding part, and multi-branch dense prediction, called MDP, in the decoding part, to extract multi-scale features. Additionally, we designed a new multi-branch output structure with MDP in the decoding part to form more accurate edge-preserving predicting maps by integrating the dense adjacent prediction features at different scales. Finally, the proposed method is tested on datasets MRbrainS13, IBSR18, and ISeg2017. We find that the proposed network performs higher accuracy in segmenting MRI brain tissues and it is better than the leading method of 2018 at the segmentation of GM and CSF. Therefore, it can be a useful tool for diagnostic applications, such as brain MRI segmentation and diagnosing.

Structural Changes in the Cortico-Ponto-Cerebellar Axis at Birth are Associated with Abnormal Neurological Outcomes in Childhood

White matter lesions in hypoxic-ischemic encephalopathy (HIE) are considered to be the important substrate of frequent neurological consequences in preterm infants. The aim of the study was to analyze volumes and tractographic parameters of the cortico-ponto-cerebellar axis to assess alterations in the periventricular fiber system and crossroads, corticopontine and corticospinal pathways and prospective transsynaptic changes of the cerebellum.Term infants (control), premature infants without (normotypic) and with perinatal HIE (HIE) underwent brain magnetic resonance imaging at term-equivalent age (TEA) and at 2 years. Cerebrum, cerebellum, brainstem divisions and ventrodorsal compartments volumetric analysis were performed, as well as fractional anisotropy (FA) and apparent diffusion coefficient (ADC) of corticopontine, corticospinal pathways and middle cerebellar peduncles. Amiel-Tison scale at TEA and the Hempel test at 2 years were assessed.Cerebellum, brainstem and its compartments volumes were decreased in normotypic and HIE groups at TEA, while at 2 years volumes were significantly reduced in the HIE group, accompanied by decreased volume and FA and increased ADC of corticopontine and corticospinal pathways. Negative association of the brainstem, cerebellum, mesencephalon, pons, corticopontine volumes and corticospinal pathway FA at TEA with the neurological score at 2 years. Cerebellum and pons volumes presented as potential prognostic indicators of neurological outcomes.Our findings agree that these pathways, as a part of the periventricular fiber system and crossroads, exhibit lesion-induced reaction and vulnerability in HIE. Structural differences between normotypic and HIE group at the 2 years suggest a different developmental structural plasticity.

Multi-Site Infant Brain Segmentation Algorithms: The iSeg-2019 Challenge

To better understand early brain development in health and disorder, it is critical to accurately segment infant brain magnetic resonance (MR) images into white matter (WM), gray matter (GM), and cerebrospinal fluid (CSF). Deep learning-based methods have achieved state-of-the-art performance; h owever, one of the major limitations is that the learning-based methods may suffer from the multi-site issue, that is, the models trained on a dataset from one site may not be applicable to the datasets acquired from other sites with different imaging protocols/scanners. To promote methodological development in the community, the iSeg-2019 challenge (http://iseg2019.web.unc.edu) provides a set of 6-month infant subjects from multiple sites with different protocols/scanners for the participating methods. T raining/validation subjects are from UNC (MAP) and testing subjects are from UNC/UMN (BCP), Stanford University, and Emory University. By the time of writing, there are 30 automatic segmentation methods participated in the iSeg-2019. In this article, 8 top-ranked methods were reviewed by detailing their pipelines/implementations, presenting experimental results, and evaluating performance across different sites in terms of whole brain, regions of interest, and gyral landmark curves. We further pointed out their limitations and possible directions for addressing the multi-site issue. We find that multi-site consistency is still an open issue. We hope that the multi-site dataset in the iSeg-2019 and this review article will attract more researchers to address the challenging and critical multi-site issue in practice.

A Deep Attentive Convolutional Neural Network for Automatic Cortical Plate Segmentation in Fetal MRI

Fetal cortical plate segmentation is essential in quantitative analysis of fetal brain maturation and cortical folding. Manual segmentation of the cortical plate, or manual refinement of automatic segmentations is tedious and time-consuming. Automatic segmentation of the cortical plate, on the other hand, is challenged by the relatively low resolution of the reconstructed fetal brain MRI scans compared to the thin structure of the cortical plate, partial voluming, and the wide range of variations in the morphology of the cortical plate as the brain matures during gestation. To reduce the burden of manual refinement of segmentations, we have developed a new and powerful deep learning segmentation method. Our method exploits new deep attentive modules with mixed kernel convolutions within a fully convolutional neural network architecture that utilizes deep supervision and residual connections. We evaluated our method quantitatively based on several performance measures and expert evaluations. Results show that our method outperforms several state-of-the-art deep models for segmentation, as well as a state-of-the-art multi-atlas segmentation technique. We achieved average Dice similarity coefficient of 0.87, average Hausdorff distance of 0.96 mm, and average symmetric surface difference of 0.28 mm on reconstructed fetal brain MRI scans of fetuses scanned in the gestational age range of 16 to 39 weeks (28.6± 5.3). With a computation time of less than 1 minute per fetal brain, our method can facilitate and accelerate large-scale studies on normal and altered fetal brain cortical maturation and folding.

Robust Cortical Thickness Morphometry of Neonatal Brain and Systematic Evaluation Using Multi-Site MRI Datasets

The human brain grows the most dramatically during the perinatal and early post-natal periods, during which pre-term birth or perinatal injury that may alter brain structure and lead to developmental anomalies. Thus, characterizing cortical thickness of developing brains remains an important goal. However, this task is often complicated by inaccurate cortical surface extraction due to small-size brains. Here, we propose a novel complex framework for the reconstruction of neonatal WM and pial surfaces, accounting for large partial volumes due to small-size brains. The proposed approach relies only on T1-weighted images unlike previous T2-weighted image-based approaches while only T1-weighted images are sometimes available under the different clinical/research setting. Deep neural networks are first introduced to the neonatal magnetic resonance imaging (MRI) pipeline to address the mis-segmentation of brain tissues. Furthermore, this pipeline enhances cortical boundary delineation using combined models of the cerebrospinal fluid (CSF)/GM boundary detection with edge gradient information and a new skeletonization of sulcal folding where no CSF voxels are seen due to the limited resolution. We also proposed a systematic evaluation using three independent datasets comprising 736 pre-term and 97 term neonates. Qualitative assessment for reconstructed cortical surfaces shows that 86.9% are rated as accurate across the three site datasets. In addition, our landmark-based evaluation shows that the mean displacement of the cortical surfaces from the true boundaries was less than a voxel size (0.532 ± 0.035 mm). Evaluating the proposed pipeline (namely NEOCIVET 2.0) shows the robustness and reproducibility across different sites and different age-groups. The mean cortical thickness measured positively correlated with post-menstrual age (PMA) at scan (p < 0.0001); Cingulate cortical areas grew the most rapidly whereas the inferior temporal cortex grew the least rapidly. The range of the cortical thickness measured was biologically congruent (1.3 mm at 28 weeks of PMA to 1.8 mm at term equivalent). Cortical thickness measured on T1 MRI using NEOCIVET 2.0 was compared with that on T2 using the established dHCP pipeline. It was difficult to conclude that either T1 or T2 imaging is more ideal to construct cortical surfaces. NEOCIVET 2.0 has been open to the public through CBRAIN (https://mcin-cnim.ca/technology/cbrain/), a web-based platform for processing brain imaging data.

Infant FreeSurfer: An automated segmentation and surface extraction pipeline for T1-weighted neuroimaging data of infants 0-2 years

The development of automated tools for brain morphometric analysis in infants has lagged significantly behind analogous tools for adults. This gap reflects the greater challenges in this domain due to: 1) a smaller-scaled region of interest, 2) increased motion corruption, 3) regional changes in geometry due to heterochronous growth, and 4) regional variations in contrast properties corresponding to ongoing myelination and other maturation processes. Nevertheless, there is a great need for automated image-processing tools to quantify differences between infant groups and other individuals, because aberrant cortical morphologic measurements (including volume, thickness, surface area, and curvature) have been associated with neuropsychiatric, neurologic, and developmental disorders in children. In this paper we present an automated segmentation and surface extraction pipeline designed to accommodate clinical MRI studies of infant brains in a population 0-2 year-olds. The algorithm relies on a single channel of T1-weighted MR images to achieve automated segmentation of cortical and subcortical brain areas, producing volumes of subcortical structures and surface models of the cerebral cortex. We evaluated the algorithm both qualitatively and quantitatively using manually labeled datasets, relevant comparator software solutions cited in the literature, and expert evaluations. The computational tools and atlases described in this paper will be distributed to the research community as part of the FreeSurfer image analysis package.

Developmental score of the infant brain: characterizing diffusion MRI in term- and preterm-born infants

Large-scale longitudinal neuroimaging studies of the infant brain allow us to map the spatiotemporal development of the brain in its early phase. While the postmenstrual age (PMA) is commonly used as a time index to analyze longitudinal MRI data, the nonlinear relationship between PMA and MRI data imposes challenges for downstream analyses. We propose a mathematical model that provides a Developmental Score (DevS) as a data-driven time index to characterize the brain development based on MRI features. 319 diffusion tensor imaging (DTI) datasets were collected from 87 term-born and 66 preterm-born infants at multiple visits, which were automatically segmented based on the JHU neonatal atlas. The mean diffusivity (MD) and fractional anisotropy (FA) in 126 brain parcels were used in the model to derive DevS. We demonstrate that transforming the time index from PMA to DevS improves the linearity of the longitudinal changes in MD and FA in both gray and white matter structures. More importantly, regional developmental differences in DTI metrics between preterm- and term-born infants were identified more clearly using DevS, e.g. 79 structures showed significantly different regression patterns in MD between preterm- and term-born infants, compared to only 27 structures that showed group differences using PMA as the index. Therefore, the DevS model facilitates linear analyses of DTI metrics in the infant brain, and provides a useful tool to characterize altered brain development due to preterm-birth.

Brain tissue volumes at term-equivalent age are associated with early motor behavior in very preterm infants

Preterm birth is associated with a wide range of adverse developmental outcomes, including sensory, motor, cognitive and language impairments, and behavioral or attention problems. Subtle motor deficits that might emerge in premature infants with no evident or with mild brain injury encompass qualitative and quantitative aspects of motor behavior. This prospective cohort study provided an evaluation of the relationship between brain tissue volumes revealed by magnetic resonance imaging (MRI) at term-equivalent age and motor behavior in infancy in very preterm infants (total number = 40; mean gestational age = 28 weeks + 4 days; mean birth weight = 1190 g) without evident or with mild brain injury. Infants were recruited at birth and assessed at 12 months corrected age using the tool for qualitative and quantitative assessment of motor behavior, infant motor profile. The brain tissue was segmented first using advanced segmentation techniques and the volumes were measured by summing the volumes of all voxels belonging to a particular tissue class. The associations between volumetric brain MRI measures with motor behavior were explored using linear regression analyses. Results showed that larger total brain volumes were associated with higher motor score. Similar relationships were documented for parietal lobe, deep gray matter, and cerebellum volumes. Volumetric quantitative data of brain structures may serve as biomarkers for subtle motor deficits described in very preterm born infants without or with mild brain lesions apparent on MRI.

Rhesus Macaque Brain Developmental Trajectory: A Longitudinal Analysis Using Tensor-Based Structural Morphometry and Diffusion Tensor Imaging

The typical developmental trajectory of brain structure among nonhuman primates (NHPs) remains poorly understood. In this study, we characterized the normative trajectory of developmental change among a cohort of rhesus monkeys (n = 28), ranging in age from 2 to 22 months, using structural MRI datasets that were longitudinally acquired every 3-4 months. We hypothesized that NHP-specific transient intracranial volume decreases reported during late infancy would be part of the typical developmental process, which is driven by volumetric contraction of gray matter in primary functional areas. To this end, we performed multiscale analyses from the whole brain to voxel level, characterizing regional heterogeneity, hemispheric asymmetry, and sexual dimorphism in developmental patterns. The longitudinal trajectory of brain development was explained by three different regional volumetric growth patterns (exponentially decreasing, undulating, and linearly increasing), which resulted in developmental brain volume curves with transient brain volumetric decreases. White matter (WM) fractional anisotropy increased with age, corresponding to WM volume increases, while mean diffusivity (MD) showed biphasic patterns. The longitudinal trajectory of brain development in young rhesus monkeys follows typical maturation patterns seen in humans, but regional volumetric and MD changes are more dynamic in rhesus monkeys compared with humans, with marked decreases followed by "rebound-like" increases.

Impacts of skull stripping on construction of three-dimensional T1-weighted imaging-based brain structural network in full-term neonates

BACKGROUND

Skull stripping remains a challenge for neonatal brain MR image analysis. However, little is known about the accuracy of how skull stripping affects the neonatal brain tissue segmentation and subsequent network construction. This paper therefore aimed to clarify this issue by comparing two automatic (FMRIB Software Library's Brain Extraction Tool, BET; Infant Brain Extraction and Analysis Toolbox, iBEAT) and a semiautomatic (iBEAT with manual correction) processes in constructing 3D T1-weighted imaging (T1WI)-based brain structural network.

METHODS

Twenty-two full-term neonates (gestational age, 37-42 weeks; boys/girls, 13/9) without abnormalities on MRI who underwent brain 3D T1WI were retrospectively recruited. Two automatic (BET and iBEAT) and a semiautomatic preprocessing (iBEAT with manual correction) workflows were separately used to perform the skull stripping. Brain tissue segmentation and volume calculation were performed by a Johns Hopkins atlas-based method. Sixty-four gray matter regions were selected as nodes; volume covariance network and its properties (clustering coefficient, C_p; characteristic path length, L_p; local efficiency, E_local; global efficiency, E_global) were calculated by GRETNA. Analysis of variance (ANOVA) was used to compare the differences in the calculated volume between three workflows.

RESULTS

There were significant differences in volumes of 50 brain regions between the three workflows (P < 0.05). Three neonatal brain structural networks presented small-world topology. The semiautomatic workflow showed remarkably decreased C_p, increased L_p, decreased E_local, and decreased E_global, in contrast to the two automatic ones.

CONCLUSIONS

Imperfect skull stripping indeed affected the accuracy of brain structural network in full-term neonates.

Using Deep Convolutional Neural Networks for Neonatal Brain Image Segmentation

INTRODUCTION

Deep learning neural networks are especially potent at dealing with structured data, such as images and volumes. Both modified LiviaNET and HyperDense-Net performed well at a prior competition segmenting 6-month-old infant magnetic resonance images, but neonatal cerebral tissue type identification is challenging given its uniquely inverted tissue contrasts. The current study aims to evaluate the two architectures to segment neonatal brain tissue types at term equivalent age.

METHODS

Both networks were retrained over 24 pairs of neonatal T1 and T2 data from the Developing Human Connectome Project public data set and validated on another eight pairs against ground truth. We then reported the best-performing model from training and its performance by computing the Dice similarity coefficient (DSC) for each tissue type against eight test subjects.

RESULTS

During the testing phase, among the segmentation approaches tested, the dual-modality HyperDense-Net achieved the best statistically significantly test mean DSC values, obtaining 0.94/0.95/0.92 for the tissue types and took 80 h to train and 10 min to segment, including preprocessing. The single-modality LiviaNET was better at processing T2-weighted images than processing T1-weighted images across all tissue types, achieving mean DSC values of 0.90/0.90/0.88 for gray matter, white matter, and cerebrospinal fluid, respectively, while requiring 30 h to train and 8 min to segment each brain, including preprocessing.

DISCUSSION

Our evaluation demonstrates that both neural networks can segment neonatal brains, achieving previously reported performance. Both networks will be continuously retrained over an increasingly larger repertoire of neonatal brain data and be made available through the Canadian Neonatal Brain Platform to better serve the neonatal brain imaging research community.

Role of deep learning in infant brain MRI analysis

Deep learning algorithms and in particular convolutional networks have shown tremendous success in medical image analysis applications, though relatively few methods have been applied to infant MRI data due numerous inherent challenges such as inhomogenous tissue appearance across the image, considerable image intensity variability across the first year of life, and a low signal to noise setting. This paper presents methods addressing these challenges in two selected applications, specifically infant brain tissue segmentation at the isointense stage and presymptomatic disease prediction in neurodevelopmental disorders. Corresponding methods are reviewed and compared, and open issues are identified, namely low data size restrictions, class imbalance problems, and lack of interpretation of the resulting deep learning solutions. We discuss how existing solutions can be adapted to approach these issues as well as how generative models seem to be a particularly strong contender to address them.

Deep CNN ensembles and suggestive annotations for infant brain MRI segmentation

Precise 3D segmentation of infant brain tissues is an essential step towards comprehensive volumetric studies and quantitative analysis of early brain development. However, computing such segmentations is very challenging, especially for 6-month infant brain, due to the poor image quality, among other difficulties inherent to infant brain MRI, e.g., the isointense contrast between white and gray matter and the severe partial volume effect due to small brain sizes. This study investigates the problem with an ensemble of semi-dense fully convolutional neural networks (CNNs), which employs T1-weighted and T2-weighted MR images as input. We demonstrate that the ensemble agreement is highly correlated with the segmentation errors. Therefore, our method provides measures that can guide local user corrections. To the best of our knowledge, this work is the first ensemble of 3D CNNs for suggesting annotations within images. Our quasi-dense architecture allows the efficient propagation of gradients during training, while limiting the number of parameters, requiring one order of magnitude less parameters than popular medical image segmentation networks such as 3D U-Net (Çiçek, et al.). We also investigated the impact that early or late fusions of multiple image modalities might have on the performances of deep architectures. We report evaluations of our method on the public data of the MICCAI iSEG-2017 Challenge on 6-month infant brain MRI segmentation, and show very competitive results among 21 teams, ranking first or second in most metrics.

TRActs constrained by UnderLying INfant anatomy (TRACULInA): An automated probabilistic tractography tool with anatomical priors for use in the newborn brain

The ongoing myelination of white-matter fiber bundles plays a significant role in brain development. However, reliable and consistent identification of these bundles from infant brain MRIs is often challenging due to inherently low diffusion anisotropy, as well as motion and other artifacts. In this paper we introduce a new tool for automated probabilistic tractography specifically designed for newborn infants. Our tool incorporates prior information about the anatomical neighborhood of white-matter pathways from a training data set. In our experiments, we evaluate this tool on data from both full-term and prematurely born infants and demonstrate that it can reconstruct known white-matter tracts in both groups robustly, even in the presence of differences between the training set and study subjects. Additionally, we evaluate it on a publicly available large data set of healthy term infants (UNC Early Brain Development Program). This paves the way for performing a host of sophisticated analyses in newborns that we have previously implemented for the adult brain, such as pointwise analysis along tracts and longitudinal analysis, in both health and disease.

Automated Ventricular System Segmentation in Paediatric Patients Treated for Hydrocephalus Using Deep Learning Methods

Hydrocephalus is a common neurological condition that can have traumatic ramifications and can be lethal without treatment. Nowadays, during therapy radiologists have to spend a vast amount of time assessing the volume of cerebrospinal fluid (CSF) by manual segmentation on Computed Tomography (CT) images. Further, some of the segmentations are prone to radiologist bias and high intraobserver variability. To improve this, researchers are exploring methods to automate the process, which would enable faster and more unbiased results. In this study, we propose the application of U-Net convolutional neural network in order to automatically segment CT brain scans for location of CSF. U-Net is a neural network that has proven to be successful for various interdisciplinary segmentation tasks. We optimised training using state of the art methods, including “1cycle” learning rate policy, transfer learning, generalized dice loss function, mixed float precision, self-attention, and data augmentation. Even though the study was performed using a limited amount of data (80 CT images), our experiment has shown near human-level performance. We managed to achieve a 0.917 mean dice score with 0.0352 standard deviation on cross validation across the training data and a 0.9506 mean dice score on a separate test set. To our knowledge, these results are better than any known method for CSF segmentation in hydrocephalic patients, and thus, it is promising for potential practical applications.

Age-specific optimization of T1-weighted brain MRI throughout infancy

The infant brain undergoes drastic morphological and functional development during the first year of life. Three-dimensional T1-weighted Magnetic Resonance Imaging (3D T1w-MRI) is a major tool to characterize the brain anatomy, which however, manifests inherently low and rapidly changing contrast between white matter (WM) and gray matter (GM) in the infant brains (0-12 month-old). Despite the prior efforts made to maximize tissue contrast in the neonatal brains (≤1 months), optimization of imaging methods in the rest of the infancy (1-12 months) is not fully addressed, while brains in the latter period exhibit even more challenging contrast. Here, we performed a systematic investigation to improve the contrast between cortical GM and subcortical WM throughout the infancy. We first performed simultaneous T1 and proton density mapping in a normally developing infant cohort at 3T (n = 57). Based on the evolution of T1 relaxation times, we defined three age groups and simulated the relative tissue contrast between WM and GM in each group. Age-specific imaging strategies were proposed according to the Bloch simulation: inversion time (TI) around 800 ms for the 0-3 month-old group, dual TI at 500 ms and 700 ms for the 3-7 month-old group, and TI around 700 ms for 7-12 month-old group, using a centrically encoded 3D-MPRAGE sequence at 3T. Experimental results with varying TIs in each group confirmed improved contrast at the proposed optimal TIs, even in 3-7 month-old infants who had nearly isointense contrast. We further demonstrated the advantage of improved relative contrast in segmenting the neonatal brains using a multi-atlas segmentation method. The proposed age-specific optimization strategies can be easily adapted to routine clinical examinations, and the improved image contrast would facilitate quantitative analysis of the infant brain development.

HyperDense-Net: A Hyper-Densely Connected CNN for Multi-Modal Image Segmentation

Recently, dense connections have attracted substantial attention in computer vision because they facilitate gradient flow and implicit deep supervision during training. Particularly, DenseNet that connects each layer to every other layer in a feed-forward fashion and has shown impressive performances in natural image classification tasks. We propose HyperDenseNet, a 3-D fully convolutional neural network that extends the definition of dense connectivity to multi-modal segmentation problems. Each imaging modality has a path, and dense connections occur not only between the pairs of layers within the same path but also between those across different paths. This contrasts with the existing multi-modal CNN approaches, in which modeling several modalities relies entirely on a single joint layer (or level of abstraction) for fusion, typically either at the input or at the output of the network. Therefore, the proposed network has total freedom to learn more complex combinations between the modalities, within and in-between all the levels of abstraction, which increases significantly the learning representation. We report extensive evaluations over two different and highly competitive multi-modal brain tissue segmentation challenges, iSEG 2017 and MRBrainS 2013, with the former focusing on six month infant data and the latter on adult images. HyperDenseNet yielded significant improvements over many state-of-the-art segmentation networks, ranking at the top on both benchmarks. We further provide a comprehensive experimental analysis of features re-use, which confirms the importance of hyper-dense connections in multi-modal representation learning. Our code is publicly available.

3-D Fully Convolutional Networks for Multimodal Isointense Infant Brain Image Segmentation

Accurate segmentation of infant brain images into different regions of interest is one of the most important fundamental steps in studying early brain development. In the isointense phase (approximately 6-8 months of age), white matter and gray matter exhibit similar levels of intensities in magnetic resonance (MR) images, due to the ongoing myelination and maturation. This results in extremely low tissue contrast and thus makes tissue segmentation very challenging. Existing methods for tissue segmentation in this isointense phase usually employ patch-based sparse labeling on single modality. To address the challenge, we propose a novel 3-D multimodal fully convolutional network (FCN) architecture for segmentation of isointense phase brain MR images. Specifically, we extend the conventional FCN architectures from 2-D to 3-D, and, rather than directly using FCN, we intuitively integrate coarse (naturally high-resolution) and dense (highly semantic) feature maps to better model tiny tissue regions, in addition, we further propose a transformation module to better connect the aggregating layers; we also propose a fusion module to better serve the fusion of feature maps. We compare the performance of our approach with several baseline and state-of-the-art methods on two sets of isointense phase brain images. The comparison results show that our proposed 3-D multimodal FCN model outperforms all previous methods by a large margin in terms of segmentation accuracy. In addition, the proposed framework also achieves faster segmentation results compared to all other methods. Our experiments further demonstrate that: 1) carefully integrating coarse and dense feature maps can considerably improve the segmentation performance; 2) batch normalization can speed up the convergence of the networks, especially when hierarchical feature aggregations occur; and 3) integrating multimodal information can further boost the segmentation performance.

Age-specific gray and white matter DTI atlas for human brain at 33, 36 and 39 postmenstrual weeks

During the 3rd trimester, dramatic structural changes take place in the human brain, underlying the neural circuit formation. The survival rate of premature infants has increased significantly in recent years. The large morphological differences of the preterm brain at 33 or 36 postmenstrual weeks (PMW) from the brain at 40PMW (full term) make it necessary to establish age-specific atlases for preterm brains. In this study, with high quality (1.5 × 1.5 × 1.6 mm3 imaging resolution) diffusion tensor imaging (DTI) data obtained from 84 healthy preterm and term-born neonates, we established age-specific preterm and term-born brain templates and atlases at 33, 36 and 39PMW. Age-specific DTI templates include a single-subject template, a population-averaged template with linear transformation and a population-averaged template with nonlinear transformation. Each of the age-specific DTI atlases includes comprehensive labeling of 126 major gray matter (GM) and white matter (WM) structures, specifically 52 cerebral cortical structures, 40 cerebral WM structures, 22 brainstem and cerebellar structures and 12 subcortical GM structures. From 33 to 39 PMW, dramatic morphological changes of delineated individual neural structures such as ganglionic eminence and uncinate fasciculus were revealed. The evaluation based on measurements of Dice ratio and L1 error suggested reliable and reproducible automated labels from the age-matched atlases compared to labels from manual delineation. Applying these atlases to automatically and effectively delineate microstructural changes of major WM tracts during the 3rd trimester was demonstrated. The established age-specific DTI templates and atlases of 33, 36 and 39 PMW brains may be used for not only understanding normal functional and structural maturational processes but also detecting biomarkers of neural disorders in the preterm brains.

Individual variation in longitudinal postnatal development of the primate brain

Quantifying individual variation in postnatal brain development can provide insight into cognitive diversity within a population and the aetiology of common neuropsychiatric and neurodevelopmental disorders. Non-invasive studies of the non-human primate can aid understanding of human brain development, facilitating longitudinal analysis during early postnatal development when comparative human populations are difficult to sample. In this study, we perform analysis of a longitudinal MRI dataset of 32 macaques, each with up to five magnetic resonance imaging (MRI) scans acquired between 3 and 36 months of age. Using nonlinear mixed effects model we derive growth trajectories for whole brain, cortical and subcortical grey matter, cerebral white matter and cerebellar volume. We then test the association between individual variation in postnatal tissue volumes and birth weight. We report nonlinear growth models for all tissue compartments, as well as significant variation in total intracranial volume between individuals. We also demonstrate that regional subcortical grey matter varies both in total volume and rate of change between individuals and is associated with differences in birth weight. This supports evidence that birth weight may act as a marker of subsequent brain development and highlights the importance of longitudinal MRI analysis in developmental studies.

An iterative multi-atlas patch-based approach for cortex segmentation from neonatal MRI

Brain structure analysis in the newborn is a major health issue. This is especially the case for preterm neonates, in order to obtain predictive information related to the child development. In particular, the cortex is a structure of interest, that can be observed in magnetic resonance imaging (MRI). However, neonatal MRI data present specific properties that make them challenging to process. In this context, multi-atlas approaches constitute an efficient strategy, taking advantage of images processed beforehand. The method proposed in this article relies on such a multi-atlas strategy. More precisely, it uses two paradigms: first, a non-local model based on patches; second, an iterative optimization scheme. Coupling both concepts allows us to consider patches related not only to the image information, but also to the current segmentation. This strategy is compared to other multi-atlas methods proposed in the literature. Experiments on dHCP datasets show that the proposed approach provides robust cortex segmentation results.

Anatomy-guided joint tissue segmentation and topological correction for 6-month infant brain MRI with risk of autism

Tissue segmentation of infant brain MRIs with risk of autism is critically important for characterizing early brain development and identifying biomarkers. However, it is challenging due to low tissue contrast caused by inherent ongoing myelination and maturation. In particular, at around 6 months of age, the voxel intensities in both gray matter and white matter are within similar ranges, thus leading to the lowest image contrast in the first postnatal year. Previous studies typically employed intensity images and tentatively estimated tissue probabilities to train a sequence of classifiers for tissue segmentation. However, the important prior knowledge of brain anatomy is largely ignored during the segmentation. Consequently, the segmentation accuracy is still limited and topological errors frequently exist, which will significantly degrade the performance of subsequent analyses. Although topological errors could be partially handled by retrospective topological correction methods, their results may still be anatomically incorrect. To address these challenges, in this article, we propose an anatomy-guided joint tissue segmentation and topological correction framework for isointense infant MRI. Particularly, we adopt a signed distance map with respect to the outer cortical surface as anatomical prior knowledge, and incorporate such prior information into the proposed framework to guide segmentation in ambiguous regions. Experimental results on the subjects acquired from National Database for Autism Research demonstrate the effectiveness to topological errors and also some levels of robustness to motion. Comparisons with the state-of-the-art methods further demonstrate the advantages of the proposed method in terms of both segmentation accuracy and topological correctness.

The neonatal brain in critical congenital heart disease: Insights and future directions

Neurodevelopmental outcomes are impaired in survivors of critical congenital heart disease (CHD) in several developmental domains including motor, cognitive and sensory outcomes. These deficits can extend into the adolescent and early adulthood years. The cause of these neurodevelopmental impairments is multi-factorial and includes patient specific risk factors, cardiac anatomy and physiology as well as brain changes seen on MRI. Advances in imaging techniques have identified delayed brain development in the neonate with critical CHD as well as acquired brain injury. These abnormalities are seen even before corrective neonatal cardiac surgery. This review focuses on describing brain changes seen on MRI in neonates with CHD, risk factors for these changes and the association with neurodevelopmental outcome. There is an emerging focus on the impact of cardiovascular physiology on brain health and the complex heart-brain interplay that influences ultimate neurodevelopmental outcome in these patients.

The challenge of cerebral magnetic resonance imaging in neonates: A new method using mathematical morphology for the segmentation of structures including diffuse excessive high signal intensities

Preterm birth is a multifactorial condition associated with increased morbidity and mortality. Diffuse excessive high signal intensity (DEHSI) has been recently described on T2-weighted MR sequences in this population and thought to be associated with neuropathologies. To date, no robust and reproducible method to assess the presence of white matter hyperintensities has been developed, perhaps explaining the current controversy over their prognostic value. The aim of this paper is to propose a new semi-automated framework to detect DEHSI on neonatal brain MR images having a particular pattern due to the physiological lack of complete myelination of the white matter. A novel method for semi- automatic segmentation of neonatal brain structures and DEHSI, based on mathematical morphology and on max-tree representations of the images is thus described. It is a mandatory first step to identify and clinically assess homogeneous cohorts of neonates for DEHSI and/or volume of any other segmented structures. Implemented in a user-friendly interface, the method makes it straightforward to select relevant markers of structures to be segmented, and if needed, apply eventually manual corrections. This method responds to the increasing need for providing medical experts with semi-automatic tools for image analysis, and overcomes the limitations of visual analysis alone, prone to subjectivity and variability. Experimental results demonstrate that the method is accurate, with excellent reproducibility and with very few manual corrections needed. Although the method was intended initially for images acquired at 1.5T, which corresponds to the usual clinical practice, preliminary results on images acquired at 3T suggest that the proposed approach can be generalized.

A Label-fusion-aided Convolutional Neural Network for Isointense Infant Brain Tissue Segmentation

The extremely low tissue contrast in white matter during an infant's isointense stage (6-8 months) of brain development presents major difficulty when segmenting brain image regions for analysis. We sought to develop a label-fusion-aided deep-learning approach for automatically segmenting isointense infant brain images into white matter, gray matter and cerebrospinal fluid using T1- and T2-weighted magnetic resonance images. A key idea of our approach is to apply the fully convolutional neural network (FCNN) to individual brain regions determined by a traditional registration-based segmentation method instead of training a single model for the whole brain. This provides more refined segmentation results by capturing more region-specific features. We show that this method outperforms traditional joint label fusion and FCNN-only methods in terms of Dice coefficients using the dataset from iSEG MICCAI Grand Challenge 2017.

Computational neuroanatomy of baby brains: A review

The first postnatal years are an exceptionally dynamic and critical period of structural, functional and connectivity development of the human brain. The increasing availability of non-invasive infant brain MR images provides unprecedented opportunities for accurate and reliable charting of dynamic early brain developmental trajectories in understanding normative and aberrant growth. However, infant brain MR images typically exhibit reduced tissue contrast (especially around 6 months of age), large within-tissue intensity variations, and regionally-heterogeneous, dynamic changes, in comparison with adult brain MR images. Consequently, the existing computational tools developed typically for adult brains are not suitable for infant brain MR image processing. To address these challenges, many infant-tailored computational methods have been proposed for computational neuroanatomy of infant brains. In this review paper, we provide a comprehensive review of the state-of-the-art computational methods for infant brain MRI processing and analysis, which have advanced our understanding of early postnatal brain development. We also summarize publically available infant-dedicated resources, including MRI datasets, computational tools, grand challenges, and brain atlases. Finally, we discuss the limitations in current research and suggest potential future research directions.

The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction

The Developing Human Connectome Project (dHCP) seeks to create the first 4-dimensional connectome of early life. Understanding this connectome in detail may provide insights into normal as well as abnormal patterns of brain development. Following established best practices adopted by the WU-MINN Human Connectome Project (HCP), and pioneered by FreeSurfer, the project utilises cortical surface-based processing pipelines. In this paper, we propose a fully automated processing pipeline for the structural Magnetic Resonance Imaging (MRI) of the developing neonatal brain. This proposed pipeline consists of a refined framework for cortical and sub-cortical volume segmentation, cortical surface extraction, and cortical surface inflation, which has been specifically designed to address considerable differences between adult and neonatal brains, as imaged using MRI. Using the proposed pipeline our results demonstrate that images collected from 465 subjects ranging from 28 to 45 weeks post-menstrual age (PMA) can be processed fully automatically; generating cortical surface models that are topologically correct, and correspond well with manual evaluations of tissue boundaries in 85% of cases. Results improve on state-of-the-art neonatal tissue segmentation models and significant errors were found in only 2% of cases, where these corresponded to subjects with high motion. Downstream, these surfaces will enhance comparisons of functional and diffusion MRI datasets, supporting the modelling of emerging patterns of brain connectivity.

The developing human connectome project: A minimal processing pipeline for neonatal cortical surface reconstruction

The Developing Human Connectome Project (dHCP) seeks to create the first 4-dimensional connectome of early life. Understanding this connectome in detail may provide insights into normal as well as abnormal patterns of brain development. Following established best practices adopted by the WU-MINN Human Connectome Project (HCP), and pioneered by FreeSurfer, the project utilises cortical surface-based processing pipelines. In this paper, we propose a fully automated processing pipeline for the structural Magnetic Resonance Imaging (MRI) of the developing neonatal brain. This proposed pipeline consists of a refined framework for cortical and sub-cortical volume segmentation, cortical surface extraction, and cortical surface inflation, which has been specifically designed to address considerable differences between adult and neonatal brains, as imaged using MRI. Using the proposed pipeline our results demonstrate that images collected from 465 subjects ranging from 28 to 45 weeks post-menstrual age (PMA) can be processed fully automatically; generating cortical surface models that are topologically correct, and correspond well with manual evaluations of tissue boundaries in 85% of cases. Results improve on state-of-the-art neonatal tissue segmentation models and significant errors were found in only 2% of cases, where these corresponded to subjects with high motion. Downstream, these surfaces will enhance comparisons of functional and diffusion MRI datasets, supporting the modelling of emerging patterns of brain connectivity.

Learning Based Segmentation of CT Brain Images: Application to Postoperative Hydrocephalic Scans

OBJECTIVE

Hydrocephalus is a medical condition in which there is an abnormal accumulation of cerebrospinal fluid (CSF) in the brain. Segmentation of brain imagery into brain tissue and CSF [before and after surgery, i.e., preoperative (pre-op) versus postoperative (post-op)] plays a crucial role in evaluating surgical treatment. Segmentation of pre-op images is often a relatively straightforward problem and has been well researched. However, segmenting post-op computational tomographic (CT) scans becomes more challenging due to distorted anatomy and subdural hematoma collections pressing on the brain. Most intensity- and feature-based segmentation methods fail to separate subdurals from brain and CSF as subdural geometry varies greatly across different patients and their intensity varies with time. We combat this problem by a learning approach that treats segmentation as supervised classification at the pixel level, i.e., a training set of CT scans with labeled pixel identities is employed.

METHODS

Our contributions include: 1) a dictionary learning framework that learns class (segment) specific dictionaries that can efficiently represent test samples from the same class while poorly represent corresponding samples from other classes; 2) quantification of associated computation and memory footprint; and 3) a customized training and test procedure for segmenting post-op hydrocephalic CT images.

RESULTS

Experiments performed on infant CT brain images acquired from the CURE Children's Hospital of Uganda reveal the success of our method against the state-of-the-art alternatives. We also demonstrate that the proposed algorithm is computationally less burdensome and exhibits a graceful degradation against a number of training samples, enhancing its deployment potential.

A fast stochastic framework for automatic MR brain images segmentation

This paper introduces a new framework for the segmentation of different brain structures (white matter, gray matter, and cerebrospinal fluid) from 3D MR brain images at different life stages. The proposed segmentation framework is based on a shape prior built using a subset of co-aligned training images that is adapted during the segmentation process based on first- and second-order visual appearance characteristics of MR images. These characteristics are described using voxel-wise image intensities and their spatial interaction features. To more accurately model the empirical grey level distribution of the brain signals, we use a linear combination of discrete Gaussians (LCDG) model having positive and negative components. To accurately account for the large inhomogeneity in infant MRIs, a higher-order Markov-Gibbs Random Field (MGRF) spatial interaction model that integrates third- and fourth- order families with a traditional second-order model is proposed. The proposed approach was tested and evaluated on 102 3D MR brain scans using three metrics: the Dice coefficient, the 95-percentile modified Hausdorff distance, and the absolute brain volume difference. Experimental results show better segmentation of MR brain images compared to current open source segmentation tools.

The association between cardiac physiology, acquired brain injury, and postnatal brain growth in critical congenital heart disease

OBJECTIVE

To assess the trajectory of perioperative brain growth in relationship to cardiac diagnosis and acquired brain injuries.

METHODS

This was a cohort study of term neonates with hypoplastic left heart syndrome (HLHS) and d-transposition of the great arteries (d-TGA). Subjects underwent magnetic resonance imaging of the brain pre- and postoperatively to determine the severity of brain injury and total and regional brain volumes by the use of automated morphometry. Comparisons were made by cardiac lesion and injury status.

RESULTS

A total of 79 subjects were included (49, d-TGA; 30, HLHS). Subjects with HLHS had more postoperative brain injury (55.6% vs 30.4%, P = .03) and more severe brain injury (moderate-to-severe white matter [WM] injury, P = .01). Total and regional perioperative brain growth was not different by brain injury status (either pre- or postoperative). However, subjects with moderate-to-severe WM injury had a slower rate of brain growth in WM and gray matter compared with those with no injury. Subjects with HLHS had a slower rate of growth globally and in WM and deep gray matter as compared with d-TGA (total brain volume: 12 cm³/wk vs 7 cm³; WM: 2.1 cm³/wk vs 0.6 cm³; deep gray matter: 1.5 cm³/wk vs 0.7 cm³; P < .001), after we adjusted for gestational age at scan and the presence of brain injury. This difference remained after excluding subjects with moderate-to-severe WM injury.

CONCLUSIONS

Neonates with HLHS have a slower rate of global and regional brain growth compared with d-TGA, likely related to inherent physiologic differences postoperatively. These findings demonstrate the complex interplay between cardiac lesion, brain injury, and brain growth.

Regional volumetric assessment of the brain in moderately preterm infants (30-35 gestational weeks) scanned at term-equivalent age on magnetic resonance imaging

BACKGROUND

Early volume analyses of the infantile brain may help predict neurodevelopmental outcome. However, brain volumes are not well understood in moderately preterm infants at term-equivalent age (TEA).

AIM

This study retrospectively investigated the relationship between regional brain volumes and infant gestational age (GA) at birth in moderately preterm infants (30-35weeks' GA) on magnetic resonance imaging (MRI) at TEA.

METHODS

Forty infants scanned at TEA were enrolled. Regional brain volumes were estimated by manual segmentation on MRI, and their relationship with GA at birth was assessed.

RESULTS

The regional volumes of the cerebral hemispheres and deep gray matter were larger (Spearman ρ=0.40, P=0.01, and Spearman ρ=0.48, P<0.01, respectively), and volumes of the lateral ventricles were smaller (Spearman ρ=-0.32, P=0.04) in infants born at a later GA. The volumes of the cerebral hemispheres of the infants born at 30weeks' GA were significantly smaller than those born at 33 and 35weeks' GA (P<0.05). No associations were found between the volume of the cerebellum and brainstem, and GA at birth (Spearman ρ=0.24, P=0.13, and Spearman ρ=0.24, P=0.14, respectively).

CONCLUSIONS

The volumes of the cerebral hemispheres at TEA may be smaller in infants born at 30weeks' GA, whereas those of the cerebellum and brainstem may not be correlated with GA among moderately preterm infants.

LATEST: Local AdapTivE and Sequential Training for Tissue Segmentation of Isointense Infant Brain MR Images

Accurate segmentation of isointense infant (~6 months of age) brain MRIs is of great importance, however, a very challenging task, due to extremely low tissue contrast caused by ongoing myelination processes. In this work, we propose a novel learning method based on Local AdapTivE and Sequential Training (LATEST) for segmentation. Specifically, random forest technique is employed to train a local classifier (a single decision tree) for each voxel in the common space based on the neighboring training samples from atlases. Then, for each given voxel, all trained nearby individual classifiers (decision trees) are grouped together to form a forest. Moreover, the estimated probabilities are further used as additional source images to train the next set of local classifiers for refining tissue classification. By iteratively training the subsequent classifiers based on the updated tissue probability maps, a sequence of local classifiers can be built for accurate tissue segmentation.

Deep Learning in Medical Image Analysis

This review covers computer-assisted analysis of images in the field of medical imaging. Recent advances in machine learning, especially with regard to deep learning, are helping to identify, classify, and quantify patterns in medical images. At the core of these advances is the ability to exploit hierarchical feature representations learned solely from data, instead of features designed by hand according to domain-specific knowledge. Deep learning is rapidly becoming the state of the art, leading to enhanced performance in various medical applications. We introduce the fundamentals of deep learning methods and review their successes in image registration, detection of anatomical and cellular structures, tissue segmentation, computer-aided disease diagnosis and prognosis, and so on. We conclude by discussing research issues and suggesting future directions for further improvement.

Using clinically acquired MRI to construct age-specific ADC atlases: Quantifying spatiotemporal ADC changes from birth to 6-year old

Diffusion imaging is critical for detecting acute brain injury. However, normal apparent diffusion coefficient (ADC) maps change rapidly in early childhood, making abnormality detection difficult. In this article, we explored clinical PACS and electronic healthcare records (EHR) to create age-specific ADC atlases for clinical radiology reference. Using the EHR and three rounds of multiexpert reviews, we found ADC maps from 201 children 0-6 years of age scanned between 2006 and 2013 who had brain MRIs with no reported abnormalities and normal clinical evaluations 2+ years later. These images were grouped in 10 age bins, densely sampling the first 1 year of life (5 bins, including neonates and 4 quarters) and representing the 1-6 year age range (an age bin per year). Unbiased group-wise registration was used to construct ADC atlases for 10 age bins. We used the atlases to quantify (a) cross-sectional normative ADC variations; (b) spatiotemporal heterogeneous ADC changes; and (c) spatiotemporal heterogeneous volumetric changes. The quantified age-specific whole-brain and region-wise ADC values were compared to those from age-matched individual subjects in our study and in multiple existing independent studies. The significance of this study is that we have shown that clinically acquired images can be used to construct normative age-specific atlases. These first of their kind age-specific normative ADC atlases quantitatively characterize changes of myelination-related water diffusion in the first 6 years of life. The quantified voxel-wise spatiotemporal ADC variations provide standard references to assist radiologists toward more objective interpretation of abnormalities in clinical images. Our atlases are available at https://www.nitrc.org/projects/mgh_adcatlases. Hum Brain Mapp 38:3052-3068, 2017. © 2017 Wiley Periodicals, Inc.

Toward the automatic quantification of in utero brain development in 3D structural MRI: A review

Investigating the human brain in utero is important for researchers and clinicians seeking to understand early neurodevelopmental processes. With the advent of fast magnetic resonance imaging (MRI) techniques and the development of motion correction algorithms to obtain high-quality 3D images of the fetal brain, it is now possible to gain more insight into the ongoing maturational processes in the brain. In this article, we present a review of the major building blocks of the pipeline toward performing quantitative analysis of in vivo MRI of the developing brain and its potential applications in clinical settings. The review focuses on T1- and T2-weighted modalities, and covers state of the art methodologies involved in each step of the pipeline, in particular, 3D volume reconstruction, spatio-temporal modeling of the developing brain, segmentation, quantification techniques, and clinical applications. Hum Brain Mapp 38:2772-2787, 2017. © 2017 Wiley Periodicals, Inc.

SEGMA: An Automatic SEGMentation Approach for Human Brain MRI Using Sliding Window and Random Forests

Quantitative volumes from brain magnetic resonance imaging (MRI) acquired across the life course may be useful for investigating long term effects of risk and resilience factors for brain development and healthy aging, and for understanding early life determinants of adult brain structure. Therefore, there is an increasing need for automated segmentation tools that can be applied to images acquired at different life stages. We developed an automatic segmentation method for human brain MRI, where a sliding window approach and a multi-class random forest classifier were applied to high-dimensional feature vectors for accurate segmentation. The method performed well on brain MRI data acquired from 179 individuals, analyzed in three age groups: newborns (38–42 weeks gestational age), children and adolescents (4–17 years) and adults (35–71 years). As the method can learn from partially labeled datasets, it can be used to segment large-scale datasets efficiently. It could also be applied to different populations and imaging modalities across the life course.

Texture analysis of the developing human brain using customization of a knowledge-based system

Background: Pattern recognition software originally designed for geospatial and other technical applications could be trained by physicians and used as texture-analysis tools for evidence-based practice, in order to improve diagnostic imaging examination during pregnancy.Methods: Various machine-learning techniques and customized datasets were assessed for training of an integrable knowledge-based system (KBS), to determine a hypothetical methodology for texture classification of closely-related anatomical structures in fetal brain magnetic resonance (MR) images. Samples were manually categorized according to the magnetic field of the MRI scanner (i.e. 1.5-tesla (1.5T), 3-tesla (3T)), rotational planes (i.e. coronal, sagittal and axial), and signal weighting (i.e. spin-lattice, spin-spin, relaxation, proton density). In the machine-learning sessions, the operator manually selected relevant regions of interest (ROI) in 1.5/3T MR images. Semi-automatic procedures in MaZda/B11 were performed to determine optimal parameter sets for ROI classification. Four classes were defined: ventricles, thalamus, grey matter, and white matter. Various textures analysis methods were tested. The KBS performed automatic data pre-processing and semi-automatic classification of ROIs.Results: After testing 3456 ROIs, statistical binary classification revealed that combination of reduction techniques with linear discriminant algorithms (LDA) or nonlinear discriminant algorithms (NDA) yielded the best scoring in terms of sensitivity (both 100%, 95% CI: 99.79-100), specificity (both 100%, 95% CI: 99.79-100) and Fisher coefficient (≈E+4, ≈E+5, respectively). Conclusions: LDA and NDA in MaZda can be useful data mining tools for screening a population of interest subjected to a clinical test.