FRNET: FLATTENED RESIDUAL NETWORK FOR INFANT MRI SKULL STRIPPING

A foundation model for enhancing magnetic resonance images and downstream segmentation, registration and diagnostic tasks

In structural magnetic resonance (MR) imaging, motion artefacts, low resolution, imaging noise and variability in acquisition protocols frequently degrade image quality and confound downstream analyses. Here we report a foundation model for the motion correction, resolution enhancement, denoising and harmonization of MR images. Specifically, we trained a tissue-classification neural network to predict tissue labels, which are then leveraged by a 'tissue-aware' enhancement network to generate high-quality MR images. We validated the model's effectiveness on a large and diverse dataset comprising 2,448 deliberately corrupted images and 10,963 images spanning a wide age range (from foetuses to elderly individuals) acquired using a variety of clinical scanners across 19 public datasets. The model consistently outperformed state-of-the-art algorithms in improving the quality of MR images, handling pathological brains with multiple sclerosis or gliomas, generating 7-T-like images from 3 T scans and harmonizing images acquired from different scanners. The high-quality, high-resolution and harmonized images generated by the model can be used to enhance the performance of models for tissue segmentation, registration, diagnosis and other downstream tasks.

Automated neonatal nnU-Net brain MRI extractor trained on a large multi-institutional dataset

Brain extraction, or skull-stripping, is an essential data preprocessing step for machine learning approaches to brain MRI analysis. Currently, there are limited extraction algorithms for the neonatal brain. We aim to adapt an established deep learning algorithm for the automatic segmentation of neonatal brains from MRI, trained on a large multi-institutional dataset for improved generalizability across image acquisition parameters. Our model, ANUBEX (automated neonatal nnU-Net brain MRI extractor), was designed using nnU-Net and was trained on a subset of participants (N = 433) enrolled in the High-dose Erythropoietin for Asphyxia and Encephalopathy (HEAL) study. We compared the performance of our model to five publicly available models (BET, BSE, CABINET, iBEATv2, ROBEX) across conventional and machine learning methods, tested on two public datasets (NIH and dHCP). We found that our model had a significantly higher Dice score on the aggregate of both data sets and comparable or significantly higher Dice scores on the NIH (low-resolution) and dHCP (high-resolution) datasets independently. ANUBEX performs similarly when trained on sequence-agnostic or motion-degraded MRI, but slightly worse on preterm brains. In conclusion, we created an automatic deep learning-based neonatal brain extraction algorithm that demonstrates accurate performance with both high- and low-resolution MRIs with fast computation time.

Mapping Genetic Topography of Cortical Thickness and Surface Area in Neonatal Brains

Adult twin neuroimaging studies have revealed that cortical thickness (CT) and surface area (SA) are differentially influenced by genetic information, leading to their spatially distinct genetic patterning and topography. However, the postnatal origins of the genetic topography of CT and SA remain unclear, given the dramatic cortical development from neonates to adults. To fill this critical gap, this study unprecedentedly explored how genetic information differentially regulates the spatial topography of CT and SA in the neonatal brain by leveraging brain magnetic resonance (MR) images from 202 twin neonates with minimal influence by the complicated postnatal environmental factors. We capitalized on infant-dedicated computational tools and a data-driven spectral clustering method to parcellate the cerebral cortex into a set of distinct regions purely according to the genetic correlation of cortical vertices in terms of CT and SA, respectively, and accordingly created the first genetically informed cortical parcellation maps of neonatal brains. Both genetic parcellation maps exhibit bilaterally symmetric and hierarchical patterns, but distinct spatial layouts. For CT, regions with closer genetic relationships demonstrate an anterior-posterior (A-P) division, while for SA, regions with greater genetic proximity are typically within the same lobe. Certain genetically informed regions exhibit strong similarities between neonates and adults, with the most striking similarities in the medial surface in terms of SA, despite their overall substantial differences in genetic parcellation maps. These results greatly advance our understanding of the development of genetic influences on the spatial patterning of cortical morphology.SIGNIFICANCE STATEMENT Genetic influences on cortical thickness (CT) and surface area (SA) are complex and could evolve throughout the lifespan. However, studies revealing distinct genetic topography of CT and SA have been limited to adults. Using brain structural magnetic resonance (MR) images of twins, we unprecedentedly discovered the distinct genetically-informed parcellation maps of CT and SA in neonatal brains, respectively. Each genetic parcellation map comprises a distinct spatial layout of cortical regions, where vertices within the same region share high genetic correlation. These genetic parcellation maps of CT and SA of neonates largely differ from those of adults, despite their highly remarkable similarities in the medial cortex of SA. These discoveries provide important insights into the genetic organization of the early cerebral cortex development.

Fine-grained functional parcellation maps of the infant cerebral cortex

Resting-state functional MRI (rs-fMRI) is widely used to examine the dynamic brain functional development of infants, but these studies typically require precise cortical parcellation maps, which cannot be directly borrowed from adult-based functional parcellation maps due to the substantial differences in functional brain organization between infants and adults. Creating infant-specific cortical parcellation maps is thus highly desired but remains challenging due to difficulties in acquiring and processing infant brain MRIs. In this study, we leveraged 1064 high-resolution longitudinal rs-fMRIs from 197 typically developing infants and toddlers from birth to 24 months who participated in the Baby Connectome Project to develop the first set of infant-specific, fine-grained, surface-based cortical functional parcellation maps. To establish meaningful cortical functional correspondence across individuals, we performed cortical co-registration using both the cortical folding geometric features and the local gradient of functional connectivity (FC). Then we generated both age-related and age-independent cortical parcellation maps with over 800 fine-grained parcels during infancy based on aligned and averaged local gradient maps of FC across individuals. These parcellation maps reveal complex functional developmental patterns, such as changes in local gradient, network size, and local efficiency, especially during the first 9 postnatal months. Our generated fine-grained infant cortical functional parcellation maps are publicly available at https://www.nitrc.org/projects/infantsurfatlas/ for advancing the pediatric neuroimaging field.

Four-dimensional mapping of dynamic longitudinal brain subcortical development and early learning functions in infants

Brain subcortical structures are paramount in many cognitive functions and their aberrations during infancy are predisposed to various neurodevelopmental and neuropsychiatric disorders, making it highly essential to characterize the early subcortical normative growth patterns. This study investigates the volumetric development and surface area expansion of six subcortical structures and their associations with Mullen scales of early learning by leveraging 513 high-resolution longitudinal MRI scans within the first two postnatal years. Results show that (1) each subcortical structure (except for the amygdala with an approximately linear increase) undergoes rapid nonlinear volumetric growth after birth, which slows down at a structure-specific age with bilaterally similar developmental patterns; (2) Subcortical local area expansion reveals structure-specific and spatiotemporally heterogeneous patterns; (3) Positive associations between thalamus and both receptive and expressive languages and between caudate and putamen and fine motor are revealed. This study advances our understanding of the dynamic early subcortical developmental patterns.

Multifaceted atlases of the human brain in its infancy

Brain atlases are spatial references for integrating, processing, and analyzing brain features gathered from different individuals, sources, and scales. Here we introduce a collection of joint surface-volume atlases that chart postnatal development of the human brain in a spatiotemporally dense manner from two weeks to two years of age. Our month-specific atlases chart normative patterns and capture key traits of early brain development and are therefore conducive to identifying aberrations from normal developmental trajectories. These atlases will enhance our understanding of early structural and functional development by facilitating the mapping of diverse features of the infant brain to a common reference frame for precise multifaceted quantification of cortical and subcortical changes.

Path Signature Neural Network of Cortical Features for Prediction of Infant Cognitive Scores

Studies have shown that there is a tight connection between cognition skills and brain morphology during infancy. Nonetheless, it is still a great challenge to predict individual cognitive scores using their brain morphological features, considering issues like the excessive feature dimension, small sample size and missing data. Due to the limited data, a compact but expressive feature set is desirable as it can reduce the dimension and avoid the potential overfitting issue. Therefore, we pioneer the path signature method to further explore the essential hidden dynamic patterns of longitudinal cortical features. To form a hierarchical and more informative temporal representation, in this work, a novel cortical feature based path signature neural network (CF-PSNet) is proposed with stacked differentiable temporal path signature layers for prediction of individual cognitive scores. By introducing the existence embedding in path generation, we can improve the robustness against the missing data. Benefiting from the global temporal receptive field of CF-PSNet, characteristics consisted in the existing data can be fully leveraged. Further, as there is no need for the whole brain to work for a certain cognitive ability, a top K selection module is used to select the most influential brain regions, decreasing the model size and the risk of overfitting. Extensive experiments are conducted on an in-house longitudinal infant dataset within 9 time points. By comparing with several recent algorithms, we illustrate the state-of-the-art performance of our CF-PSNet (i.e., root mean square error of 0.027 with the time latency of 518 milliseconds for each sample).

Developmental abnormalities of structural covariance networks of cortical thickness and surface area in autistic infants within the first 2 years

Converging evidence supports that a collection of brain regions is functionally or anatomically abnormal in autistic subjects. Structural covariance networks (SCNs) representing patterns of coordinated regional maturation are widely used to study abnormalities associated with neurodisorders. However, the possible developmental changes of SCNs in autistic individuals during the first 2 postnatal years, which features dynamic development and can potentially serve as biomarkers, remain unexplored. To fill this gap, for the first time, SCNs of cortical thickness and surface area were constructed and investigated in infants at high familial risk for autism and typically developing infants in this study. Group differences of SCNs emerge at 12 months of age in surface area. By 24 months of age, the autism group shows significantly increased integration, decreased segregation, and decreased small-worldness, compared with controls. The SCNs of surface area are deteriorated and shifted toward randomness in autistic infants. The abnormal brain regions changed during development, and the group differences of the left lateral occipital cortex become more prominent with age. These results indicate that autism has more significant influences on coordinated development of surface area than that of cortical thickness and the occipital cortex maybe an important biomarker of autism during infancy.

State-of-the-Art Traditional to the Machine- and Deep-Learning-Based Skull Stripping Techniques, Models, and Algorithms

Several neuroimaging processing applications consider skull stripping as a crucial pre-processing step. Due to complex anatomical brain structure and intensity variations in brain magnetic resonance imaging (MRI), an appropriate skull stripping is an important part. The process of skull stripping basically deals with the removal of the skull region for clinical analysis in brain segmentation tasks, and its accuracy and efficiency are quite crucial for diagnostic purposes. It requires more accurate and detailed methods for differentiating brain regions and the skull regions and is considered as a challenging task. This paper is focused on the transition of the conventional to the machine- and deep-learning-based automated skull stripping methods for brain MRI images. It is observed in this study that deep learning approaches have outperformed conventional and machine learning techniques in many ways, but they have their limitations. It also includes the comparative analysis of the current state-of-the-art skull stripping methods, a critical discussion of some challenges, model of quantifying parameters, and future work directions.