Topological correction of infant white matter surfaces using anatomically constrained convolutional neural network

Revealing Fine-grained Genetically Informed Cortical Parcellation Maps of Neonates Based on Multi-view Spectral Clustering

Genetic factors have been proven to be one of the major determinants in shaping the neonatal cerebral cortex. Previous research has demonstrated distinct genetic influences on the spatial patterns of cortical thickness (CT) and surface area (SA) in neonates, leading to their unique genetically informed parcellation maps. However, these parcellation maps were derived at coarse scales and only reliant on single cortical properties, making them unable to comprehensively characterize the fine-grained genetically regulated patterns of the neonatal cerebral cortex. To fill this knowledge gap, by combining genetic correlations of multiple cortical properties (CT and SA) based on 202 twin neonates' brain magnetic resonance (MR) images, we performed multi-view spectral clustering and revealed the first joint, fine-grained, genetically informed parcellation map of the neonatal cerebral cortex. The discovered parcellation maps comprehensively reflect genetically regulated detailed patterns of the neonatal brain.

Weakly Supervised Cerebellar Cortical Surface Parcellation with Self-Visual Representation Learning

The cerebellum (i.e., little brain) plays an important role in motion and balances control abilities, despite its much smaller size and deeper sulci compared to the cerebrum. Previous cerebellum studies mainly relied on and focused on conventional volumetric analysis, which ignores the extremely deep and highly convoluted nature of the cerebellar cortex. To better reveal localized functional and structural changes, we propose cortical surface-based analysis of the cerebellar cortex. Specifically, we first reconstruct the cerebellar cortical surfaces to represent and characterize the highly folded cerebellar cortex in a geometrically accurate and topologically correct manner. Then, we propose a novel method to automatically parcellate the cerebellar cortical surface into anatomically meaningful regions by a weakly supervised graph convolutional neural network. Instead of relying on registration or requiring mapping the cerebellar surface to a sphere, which are either inaccurate or have large geometric distortions due to the deep cerebellar sulci, our learning-based model directly deals with the original cerebellar cortical surface by decomposing this challenging task into two steps. First, we learn the effective representation of the cerebellar cortical surface patches with a contrastive self-learning framework. Then, we map the learned representations to parcellation labels. We have validated our method using data from the Baby Connectome Project and the experimental results demonstrate its superior effectiveness and accuracy, compared to existing methods.

Mapping Genetic Topography of Cortical Thickness and Surface Area in Neonatal Brains

Adult twin neuroimaging studies have revealed that cortical thickness (CT) and surface area (SA) are differentially influenced by genetic information, leading to their spatially distinct genetic patterning and topography. However, the postnatal origins of the genetic topography of CT and SA remain unclear, given the dramatic cortical development from neonates to adults. To fill this critical gap, this study unprecedentedly explored how genetic information differentially regulates the spatial topography of CT and SA in the neonatal brain by leveraging brain magnetic resonance (MR) images from 202 twin neonates with minimal influence by the complicated postnatal environmental factors. We capitalized on infant-dedicated computational tools and a data-driven spectral clustering method to parcellate the cerebral cortex into a set of distinct regions purely according to the genetic correlation of cortical vertices in terms of CT and SA, respectively, and accordingly created the first genetically informed cortical parcellation maps of neonatal brains. Both genetic parcellation maps exhibit bilaterally symmetric and hierarchical patterns, but distinct spatial layouts. For CT, regions with closer genetic relationships demonstrate an anterior-posterior (A-P) division, while for SA, regions with greater genetic proximity are typically within the same lobe. Certain genetically informed regions exhibit strong similarities between neonates and adults, with the most striking similarities in the medial surface in terms of SA, despite their overall substantial differences in genetic parcellation maps. These results greatly advance our understanding of the development of genetic influences on the spatial patterning of cortical morphology.SIGNIFICANCE STATEMENT Genetic influences on cortical thickness (CT) and surface area (SA) are complex and could evolve throughout the lifespan. However, studies revealing distinct genetic topography of CT and SA have been limited to adults. Using brain structural magnetic resonance (MR) images of twins, we unprecedentedly discovered the distinct genetically-informed parcellation maps of CT and SA in neonatal brains, respectively. Each genetic parcellation map comprises a distinct spatial layout of cortical regions, where vertices within the same region share high genetic correlation. These genetic parcellation maps of CT and SA of neonates largely differ from those of adults, despite their highly remarkable similarities in the medial cortex of SA. These discoveries provide important insights into the genetic organization of the early cerebral cortex development.

Fine-grained functional parcellation maps of the infant cerebral cortex

Resting-state functional MRI (rs-fMRI) is widely used to examine the dynamic brain functional development of infants, but these studies typically require precise cortical parcellation maps, which cannot be directly borrowed from adult-based functional parcellation maps due to the substantial differences in functional brain organization between infants and adults. Creating infant-specific cortical parcellation maps is thus highly desired but remains challenging due to difficulties in acquiring and processing infant brain MRIs. In this study, we leveraged 1064 high-resolution longitudinal rs-fMRIs from 197 typically developing infants and toddlers from birth to 24 months who participated in the Baby Connectome Project to develop the first set of infant-specific, fine-grained, surface-based cortical functional parcellation maps. To establish meaningful cortical functional correspondence across individuals, we performed cortical co-registration using both the cortical folding geometric features and the local gradient of functional connectivity (FC). Then we generated both age-related and age-independent cortical parcellation maps with over 800 fine-grained parcels during infancy based on aligned and averaged local gradient maps of FC across individuals. These parcellation maps reveal complex functional developmental patterns, such as changes in local gradient, network size, and local efficiency, especially during the first 9 postnatal months. Our generated fine-grained infant cortical functional parcellation maps are publicly available at https://www.nitrc.org/projects/infantsurfatlas/ for advancing the pediatric neuroimaging field.

iBEAT V2.0: a multisite-applicable, deep learning-based pipeline for infant cerebral cortical surface reconstruction

The human cerebral cortex undergoes dramatic and critical development during early postnatal stages. Benefiting from advances in neuroimaging, many infant brain magnetic resonance imaging (MRI) datasets have been collected from multiple imaging sites with different scanners and imaging protocols for the investigation of normal and abnormal early brain development. However, it is extremely challenging to precisely process and quantify infant brain development with these multisite imaging data because infant brain MRI scans exhibit (a) extremely low and dynamic tissue contrast caused by ongoing myelination and maturation and (b) inter-site data heterogeneity resulting from the use of diverse imaging protocols/scanners. Consequently, existing computational tools and pipelines typically perform poorly on infant MRI data. To address these challenges, we propose a robust, multisite-applicable, infant-tailored computational pipeline that leverages powerful deep learning techniques. The main functionality of the proposed pipeline includes preprocessing, brain skull stripping, tissue segmentation, topology correction, cortical surface reconstruction and measurement. Our pipeline can handle both T1w and T2w structural infant brain MR images well in a wide age range (from birth to 6 years of age) and is effective for different imaging protocols/scanners, despite being trained only on the data from the Baby Connectome Project. Extensive comparisons with existing methods on multisite, multimodal and multi-age datasets demonstrate superior effectiveness, accuracy and robustness of our pipeline. We have maintained a website, iBEAT Cloud, for users to process their images with our pipeline ( http://www.ibeat.cloud ), which has successfully processed over 16,000 infant MRI scans from more than 100 institutions with various imaging protocols/scanners.

Gyral peaks: Novel gyral landmarks in developing macaque brains

Cerebral cortex development undergoes a variety of processes, which provide valuable information for the study of the developmental mechanism of cortical folding as well as its relationship to brain structural architectures and brain functions. Despite the variability in the anatomy-function relationship on the higher-order cortex, recent studies have succeeded in identifying typical cortical landmarks, such as sulcal pits, that bestow specific functional and cognitive patterns and remain invariant across subjects and ages with their invariance being related to a gene-mediated proto-map. Inspired by the success of these studies, we aim in this study at defining and identifying novel cortical landmarks, termed gyral peaks, which are the local highest foci on gyri. By analyzing data from 156 MRI scans of 32 macaque monkeys with the age spanned from 0 to 36 months, we identified 39 and 37 gyral peaks on the left and right hemispheres, respectively. Our investigation suggests that these gyral peaks are spatially consistent across individuals and relatively stable within the age range of this dataset. Moreover, compared with other gyri, gyral peaks have a thicker cortex, higher mean curvature, more pronounced hub-like features in structural connective networks, and are closer to the borders of structural connectivity-based cortical parcellations. The spatial distribution of gyral peaks was shown to correlate with that of other cortical landmarks, including sulcal pits. These results provide insights into the spatial arrangement and temporal development of gyral peaks as well as their relation to brain structure and function.

Spherical Transformer on Cortical Surfaces

Motivated by the recent great success of attention modeling in computer vision, it is highly desired to extend the Transformer architecture from the conventional Euclidean space to non-Euclidean spaces. Given the intrinsic spherical topology of brain cortical surfaces in neuroimaging, in this study, we propose a novel Spherical Transformer, an effective general-purpose backbone using the self-attention mechanism for analysis of cortical surface data represented by triangular meshes. By mapping the cortical surface onto a sphere and splitting it uniformly into overlapping spherical surface patches, we encode the long-range dependency within each patch by the self-attention operation and formulate the cross-patch feature transmission via overlapping regions. By limiting the self-attention computation to local patches, our proposed Spherical Transformer preserves detailed contextual information and enjoys great efficiency with linear computational complexity with respect to the patch size. Moreover, to better process longitudinal cortical surfaces, which are increasingly popular in neuroimaging studies, we unprecedentedly propose the spatiotemporal self-attention operation to jointly extract the spatial context and dynamic developmental patterns within a single layer, thus further enlarging the expressive power of the generated representation. To comprehensively evaluate the performance of our Spherical Transformer, we validate it on a surface-level prediction task and a vertex-level dense prediction task, respectively, i.e., the cognition prediction and cortical thickness map development prediction, which are important in early brain development mapping. Both applications demonstrate the competitive performance of our Spherical Transformer in comparison with the state-of-the-art methods.

Path Signature Neural Network of Cortical Features for Prediction of Infant Cognitive Scores

Studies have shown that there is a tight connection between cognition skills and brain morphology during infancy. Nonetheless, it is still a great challenge to predict individual cognitive scores using their brain morphological features, considering issues like the excessive feature dimension, small sample size and missing data. Due to the limited data, a compact but expressive feature set is desirable as it can reduce the dimension and avoid the potential overfitting issue. Therefore, we pioneer the path signature method to further explore the essential hidden dynamic patterns of longitudinal cortical features. To form a hierarchical and more informative temporal representation, in this work, a novel cortical feature based path signature neural network (CF-PSNet) is proposed with stacked differentiable temporal path signature layers for prediction of individual cognitive scores. By introducing the existence embedding in path generation, we can improve the robustness against the missing data. Benefiting from the global temporal receptive field of CF-PSNet, characteristics consisted in the existing data can be fully leveraged. Further, as there is no need for the whole brain to work for a certain cognitive ability, a top K selection module is used to select the most influential brain regions, decreasing the model size and the risk of overfitting. Extensive experiments are conducted on an in-house longitudinal infant dataset within 9 time points. By comparing with several recent algorithms, we illustrate the state-of-the-art performance of our CF-PSNet (i.e., root mean square error of 0.027 with the time latency of 518 milliseconds for each sample).

Developmental abnormalities of structural covariance networks of cortical thickness and surface area in autistic infants within the first 2 years

Converging evidence supports that a collection of brain regions is functionally or anatomically abnormal in autistic subjects. Structural covariance networks (SCNs) representing patterns of coordinated regional maturation are widely used to study abnormalities associated with neurodisorders. However, the possible developmental changes of SCNs in autistic individuals during the first 2 postnatal years, which features dynamic development and can potentially serve as biomarkers, remain unexplored. To fill this gap, for the first time, SCNs of cortical thickness and surface area were constructed and investigated in infants at high familial risk for autism and typically developing infants in this study. Group differences of SCNs emerge at 12 months of age in surface area. By 24 months of age, the autism group shows significantly increased integration, decreased segregation, and decreased small-worldness, compared with controls. The SCNs of surface area are deteriorated and shifted toward randomness in autistic infants. The abnormal brain regions changed during development, and the group differences of the left lateral occipital cortex become more prominent with age. These results indicate that autism has more significant influences on coordinated development of surface area than that of cortical thickness and the occipital cortex maybe an important biomarker of autism during infancy.

Cortical development coupling between surface area and sulcal depth on macaque brains

Postnatal development of cerebral cortex is associated with a variety of neuronal processes and is thus critical to development of brain function and cognition. Longitudinal changes of cortical morphology and topology, such as postnatal cortical thinning and flattening have been widely studied. However, thorough and systematic investigation of such cortical change, including how to quantify it from multiple spatial directions and how to relate it to surface topology, is rarely found. In this work, based on a longitudinal macaque neuroimaging dataset, we quantified local changes in gyral white matter's surface area and sulcal depth during early development. We also investigated how these two metrics are coupled and how this coupling is linked to cortical surface topology, underlying white matter, and positions of functional areas. Semi-parametric generalized additive models were adopted to quantify the longitudinal changes of surface area (A) and sulcal depth (D), and the coupling patterns between them. This resulted in four classes of regions, according to how they change compared with global change throughout early development: slower surface area change and slower sulcal depth change (slowA_slowD), slower surface area change and faster sulcal depth change (slowA_fastD), faster surface area change and slower sulcal depth change (fastA_slowD), and faster surface area change and faster sulcal depth change (fastA_fastD). We found that cortex-related metrics, including folding pattern and cortical thickness, vary along slowA_fastD-fastA_slowD axis, and structural connection-related metrics vary along fastA_fastD-slowA_slowD axis, with which brain functional sites align better. It is also found that cortical landmarks, including sulcal pits and gyral hinges, spatially reside on the borders of the four patterns. These findings shed new lights on the relationship between cortex development, surface topology, axonal wiring pattern and brain functions.

A Deep Network for Joint Registration and Parcellation of Cortical Surfaces

Cortical surface registration and parcellation are two essential steps in neuroimaging analysis. Conventionally, they are performed independently as two tasks, ignoring the inherent connections of these two closely-related tasks. Essentially, both tasks rely on meaningful cortical feature representations, so they can be jointly optimized by learning shared useful cortical features. To this end, we propose a deep learning framework for joint cortical surface registration and parcellation. Specifically, our approach leverages the spherical topology of cortical surfaces and uses a spherical network as the shared encoder to first learn shared features for both tasks. Then we train two task-specific decoders for registration and parcellation, respectively. We further exploit the more explicit connection between them by incorporating the novel parcellation map similarity loss to enforce the boundary consistency of regions, thereby providing extra supervision for the registration task. Conversely, parcellation network training also benefits from the registration, which provides a large amount of augmented data by warping one surface with manual parcellation map to another surface, especially when only few manually-labeled surfaces are available. Experiments on a dataset with more than 600 cortical surfaces show that our approach achieves large improvements on both parcellation and registration accuracy (over separately trained networks) and enables training high-quality parcellation and registration models using much fewer labeled data.

Learning 4D Infant Cortical Surface Atlas with Unsupervised Spherical Networks

Spatiotemporal (4D) cortical surface atlas during infancy plays an important role for surface-based visualization, normalization and analysis of the dynamic early brain development. Conventional atlas construction methods typically rely on classical group-wise registration on sub-populations and ignore longitudinal constraints, thus having three main issues: 1) constructing templates at discrete time points; 2) resulting in longitudinal inconsistency among different age's atlases; and 3) taking extremely long runtime. To address these issues, in this paper, we propose a fast unsupervised learning-based surface atlas construction framework incorporating longitudinal constraints to enforce the within-subject temporal correspondence in the atlas space. To well handle the difficulties of learning large deformations, we propose a multi-level multimodal spherical registration network to perform cortical surface registration in a coarse-to-fine manner. Thus, only small deformations need to be estimated at each resolution level using the registration network, which further improves registration accuracy and atlas quality. Our constructed 4D infant cortical surface atlas based on 625 longitudinal scans from 291 infants is temporally continuous, in contrast to the state-of-the-art UNC 4D Infant Surface Atlas, which only provides the atlases at a few discrete sparse time points. By evaluating the intra- and inter-subject spatial normalization accuracy after alignment onto the atlas, our atlas demonstrates more detailed and fine-grained cortical patterns, thus leading to higher accuracy in surface registration.

S3Reg: Superfast Spherical Surface Registration Based on Deep Learning

Cortical surface registration is an essential step and prerequisite for surface-based neuroimaging analysis. It aligns cortical surfaces across individuals and time points to establish cross-sectional and longitudinal cortical correspondences to facilitate neuroimaging studies. Though achieving good performance, available methods are either time consuming or not flexible to extend to multiple or high dimensional features. Considering the explosive availability of large-scale and multimodal brain MRI data, fast surface registration methods that can flexibly handle multimodal features are desired. In this study, we develop a Superfast Spherical Surface Registration (S3Reg) framework for the cerebral cortex. Leveraging an end-to-end unsupervised learning strategy, S3Reg offers great flexibility in the choice of input feature sets and output similarity measures for registration, and meanwhile reduces the registration time significantly. Specifically, we exploit the powerful learning capability of spherical Convolutional Neural Network (CNN) to directly learn the deformation fields in spherical space and implement diffeomorphic design with "scaling and squaring" layers to guarantee topology-preserving deformations. To handle the polar-distortion issue, we construct a novel spherical CNN model using three orthogonal Spherical U-Nets. Experiments are performed on two different datasets to align both adult and infant multimodal cortical features. Results demonstrate that our S3Reg shows superior or comparable performance with state-of-the-art methods, while improving the registration time from 1 min to 10 sec.

Can Deep Learning Hit a Moving Target? A Scoping Review of Its Role to Study Neurological Disorders in Children

Neurological disorders dramatically impact patients of any age population, their families, and societies. Pediatrics are among vulnerable age populations who differently experience the devastating consequences of neurological conditions, such as attention-deficit hyperactivity disorders (ADHD), autism spectrum disorders (ASD), cerebral palsy, concussion, and epilepsy. System-level understanding of these neurological disorders, particularly from the brain networks' dynamic perspective, has led to the significant trend of recent scientific investigations. While a dramatic maturation in the network science application domain is evident, leading to a better understanding of neurological disorders, such rapid utilization for studying pediatric neurological disorders falls behind that of the adult population. Aside from the specific technological needs and constraints in studying neurological disorders in children, the concept of development introduces uncertainty and further complexity topping the existing neurologically driven processes caused by disorders. To unravel these complexities, indebted to the availability of high-dimensional data and computing capabilities, approaches based on machine learning have rapidly emerged a new trend to understand pathways better, accurately diagnose, and better manage the disorders. Deep learning has recently gained an ever-increasing role in the era of health and medical investigations. Thanks to its relatively more minor dependency on feature exploration and engineering, deep learning may overcome the challenges mentioned earlier in studying neurological disorders in children. The current scoping review aims to explore challenges concerning pediatric brain development studies under the constraints of neurological disorders and offer an insight into the potential role of deep learning methodology on such a task with varying and uncertain nature. Along with pinpointing recent advancements, possible research directions are highlighted where deep learning approaches can assist in computationally targeting neurological disorder-related processes and translating them into windows of opportunities for interventions in diagnosis, treatment, and management of neurological disorders in children.

Disentangled Intensive Triplet Autoencoder for Infant Functional Connectome Fingerprinting

Functional connectome "fingerprint" is a highly characterized brain pattern that distinguishes one individual from others. Although its existence has been demonstrated in adults, an unanswered but fundamental question is whether such individualized pattern emerges since infancy. This problem is barely investigated despites its importance in identifying the origin of the intrinsic connectome patterns that mirror distinct behavioral phenotypes. However, addressing this knowledge gap is challenging because the conventional methods are only applicable to developed brains with subtle longitudinal changes and typically fail on the dramatically developing infant brains. To tackle this challenge, we invent a novel model, namely, disentangled intensive triplet autoencoder (DI-TAE). First, we introduce the triplet autoencoder to embed the original connectivity into a latent space with higher discriminative capability among infant individuals. Then, a disentanglement strategy is proposed to separate the latent variables into identity-code, age-code, and noise-code, which not only restrains the interference from age-related developmental variance, but also captures the identity-related invariance. Next, a cross-reconstruction loss and an intensive triplet loss are designed to guarantee the effectiveness of the disentanglement and enhance the inter-subject dissimilarity for better discrimination. Finally, a variance-guided bootstrap aggregating is developed for DI-TAE to further improve the performance of identification. DI-TAE is validated on three longitudinal resting-state fMRI datasets with 394 infant scans aged 16 to 874 days. Our proposed model outperforms other state-of-the-art methods by increasing the identification rate by more than 50%, and for the first time suggests the plausible existence of brain functional connectome "fingerprint" since early infancy.

Anatomical Attention Guided Deep Networks for ROI Segmentation of Brain MR Images

Brain region-of-interest (ROI) segmentation based on structural magnetic resonance imaging (MRI) scans is an essential step for many computer-aid medical image analysis applications. Due to low intensity contrast around ROI boundary and large inter-subject variance, it has been remaining a challenging task to effectively segment brain ROIs from structural MR images. Even though several deep learning methods for brain MR image segmentation have been developed, most of them do not incorporate shape priors to take advantage of the regularity of brain structures, thus leading to sub-optimal performance. To address this issue, we propose an anatomical attention guided deep learning framework for brain ROI segmentation of structural MR images, containing two subnetworks. The first one is a segmentation subnetwork, used to simultaneously extract discriminative image representation and segment ROIs for each input MR image. The second one is an anatomical attention subnetwork, designed to capture the anatomical structure information of the brain from a set of labeled atlases. To utilize the anatomical attention knowledge learned from atlases, we develop an anatomical gate architecture to fuse feature maps derived from a set of atlas label maps and those from the to-be-segmented image for brain ROI segmentation. In this way, the anatomical prior learned from atlases can be explicitly employed to guide the segmentation process for performance improvement. Within this framework, we develop two anatomical attention guided segmentation models, denoted as anatomical gated fully convolutional network (AG-FCN) and anatomical gated U-Net (AG-UNet), respectively. Experimental results on both ADNI and LONI-LPBA40 datasets suggest that the proposed AG-FCN and AG-UNet methods achieve superior performance in ROI segmentation of brain MR images, compared with several state-of-the-art methods.

Individual identification and individual variability analysis based on cortical folding features in developing infant singletons and twins

Studying the early dynamic development of cortical folding with remarkable individual variability is critical for understanding normal early brain development and related neurodevelopmental disorders. This study focuses on the fingerprinting capability and the individual variability of cortical folding during early brain development. Specifically, we aim to explore (a) whether the developing neonatal cortical folding is unique enough to be considered as a "fingerprint" that can reliably identify an individual within a cohort of infants; (b) which cortical regions manifest more individual variability and thus contribute more for infant identification; (c) whether the infant twins can be distinguished by cortical folding. Hence, for the first time, we conduct infant individual identification and individual variability analysis involving twins based on the developing cortical folding features (mean curvature, average convexity, and sulcal depth) in 472 neonates with 1,141 longitudinal MRI scans. Experimental results show that the infant individual identification achieves 100% accuracy when using the neonatal cortical folding features to predict the identities of 1- and 2-year-olds. Besides, we observe high identification capability in the high-order association cortices (i.e., prefrontal, lateral temporal, and inferior parietal regions) and two unimodal cortices (i.e., precentral gyrus and lateral occipital cortex), which largely overlap with the regions encoding remarkable individual variability in cortical folding during the first 2 years. For twins study, we show that even for monozygotic twins with identical genes and similar developmental environments, their cortical folding features are unique enough for accurate individual identification; and in some high-order association cortices, the differences between monozygotic twin pairs are significantly lower than those between dizygotic twins. This study thus provides important insights into individual identification and individual variability based on cortical folding during infancy.