Spherical demons: fast diffeomorphic landmark-free surface registration

S3Reg: Superfast Spherical Surface Registration Based on Deep Learning

Cortical surface registration is an essential step and prerequisite for surface-based neuroimaging analysis. It aligns cortical surfaces across individuals and time points to establish cross-sectional and longitudinal cortical correspondences to facilitate neuroimaging studies. Though achieving good performance, available methods are either time consuming or not flexible to extend to multiple or high dimensional features. Considering the explosive availability of large-scale and multimodal brain MRI data, fast surface registration methods that can flexibly handle multimodal features are desired. In this study, we develop a Superfast Spherical Surface Registration (S3Reg) framework for the cerebral cortex. Leveraging an end-to-end unsupervised learning strategy, S3Reg offers great flexibility in the choice of input feature sets and output similarity measures for registration, and meanwhile reduces the registration time significantly. Specifically, we exploit the powerful learning capability of spherical Convolutional Neural Network (CNN) to directly learn the deformation fields in spherical space and implement diffeomorphic design with "scaling and squaring" layers to guarantee topology-preserving deformations. To handle the polar-distortion issue, we construct a novel spherical CNN model using three orthogonal Spherical U-Nets. Experiments are performed on two different datasets to align both adult and infant multimodal cortical features. Results demonstrate that our S3Reg shows superior or comparable performance with state-of-the-art methods, while improving the registration time from 1 min to 10 sec.

Enhanced detection of cortical atrophy in Alzheimer's disease using structural MRI with anatomically constrained longitudinal registration

Cortical atrophy is a defining feature of Alzheimer's disease (AD), often detectable before symptoms arise. In surface-based analyses, studies have commonly focused on cortical thinning while overlooking the impact of loss in surface area. To capture the impact of both cortical thinning and surface area loss, we used anatomically constrained Multimodal Surface Matching (aMSM), a recently developed tool for mapping change in surface area. We examined cortical atrophy over 2 years in cognitively normal subjects and subjects with diagnoses of stable mild cognitive impairment, mild cognitive impairment that converted to AD, and AD. Magnetic resonance imaging scans were segmented and registered to a common atlas using previously described techniques (FreeSurfer and ciftify), then longitudinally registered with aMSM. Changes in cortical thickness, surface area, and volume were mapped within each diagnostic group, and groups were compared statistically. Changes in thickness and surface area detected atrophy at similar levels of significance, though regions of atrophy somewhat differed. Furthermore, we found that surface area maps offered greater consistency across scanners (3.0 vs. 1.5 T). Comparisons to the FreeSurfer longitudinal pipeline and parcellation-based (region-of-interest) analysis suggest that aMSM may allow more robust detection of atrophy, particularly in earlier disease stages and using smaller sample sizes.

Disease Burden Affects Aging Brain Function

BACKGROUND

Most older adults live with multiple chronic disease conditions, yet the effect of multiple diseases on brain function remains unclear.

METHODS

We examine the relationship between disease multimorbidity and brain activity using regional cerebral blood flow (rCBF) 15O-water PET scans from 97 cognitively normal participants (mean baseline age 76.5) in the Baltimore Longitudinal Study of Aging (BLSA). Multimorbidity index scores, generated from the presence of 13 health conditions, were correlated with PET data at baseline and in longitudinal change (n=74) over 5.05 (2.74 SD) years.

RESULTS

At baseline, voxel-based analysis showed that higher multimorbidity scores were associated with lower relative activity in orbitofrontal, superior frontal, temporal pole and parahippocampal regions, and greater activity in lateral temporal, occipital and cerebellar regions. Examination of the individual health conditions comprising the index score showed hypertension and chronic kidney disease individually contributed to the overall multimorbidity pattern of altered activity. Longitudinally, both increases and decreases in activity were seen in relation to increasing multimorbidity over time. These associations were identified in orbitofrontal, lateral temporal, brainstem, and cerebellar areas.

CONCLUSION

Together, these results show that greater multimorbidity is associated with widespread areas of altered brain activity, supporting a link between health and changes in aging brain function.

Bayesian Fully Convolutional Networks for Brain Image Registration

The purpose of medical image registration is to find geometric transformations that align two medical images so that the corresponding voxels on two images are spatially consistent. Nonrigid medical image registration is a key step in medical image processing, such as image comparison, data fusion, target recognition, and pathological change analysis. Existing registration methods only consider registration accuracy but largely neglect the uncertainty of registration results. In this work, a method based on the Bayesian fully convolutional neural network is proposed for nonrigid medical image registration. The proposed method can generate a geometric uncertainty map to calculate the uncertainty of registration results. This uncertainty can be interpreted as a confidence interval, which is essential for judging whether the source data are abnormal. Moreover, the proposed method introduces group normalization, which is conducive to the network convergence of the Bayesian neural network. Some representative learning-based image registration methods are compared with the proposed method on different image datasets. Experimental results show that the registration accuracy of the proposed method is better than that of the methods, and its antifolding performance is comparable to that of fast image registration and VoxelMorph. Furthermore, the proposed method can evaluate the uncertainty of registration results.

The maturation and cognitive relevance of structural brain network organization from early infancy to childhood

The interactions of brain regions with other regions at the network level likely provide the infrastructure necessary for cognitive processes to develop. Specifically, it has been theorized that in infancy brain networks become more modular, or segregated, to support early cognitive specialization, before integration across networks increases to support the emergence of higher-order cognition. The present study examined the maturation of structural covariance networks (SCNs) derived from longitudinal cortical thickness data collected between infancy and childhood (0–6 years). We assessed modularity as a measure of network segregation and global efficiency as a measure of network integration. At the group level, we observed trajectories of increasing modularity and decreasing global efficiency between early infancy and six years. We further examined subject-based maturational coupling networks (sbMCNs) in a subset of this cohort with cognitive outcome data at 8–10 years, which allowed us to relate the network organization of longitudinal cortical thickness maturation to cognitive outcomes in middle childhood. We found that lower global efficiency of sbMCNs throughout early development (across the first year) related to greater motor learning at 8–10 years. Together, these results provide novel evidence characterizing the maturation of brain network segregation and integration across the first six years of life, and suggest that specific trajectories of brain network maturation contribute to later cognitive outcomes.

Labeling lateral prefrontal sulci using spherical data augmentation and context-aware training

The inference of cortical sulcal labels often focuses on deep (primary and secondary) sulcal regions, whereas shallow (tertiary) sulcal regions are largely overlooked in the literature due to the scarcity of manual/well-defined annotations and their large neuroanatomical variability. In this paper, we present an automated framework for regional labeling of both primary/secondary and tertiary sulci of the dorsal portion of lateral prefrontal cortex (LPFC) using spherical convolutional neural networks. We propose two core components that enhance the inference of sulcal labels to overcome such large neuroanatomical variability: (1) surface data augmentation and (2) context-aware training. (1) To take into account neuroanatomical variability, we synthesize training data from the proposed feature space that embeds intermediate deformation trajectories of spherical data in a rigid to non-rigid fashion, which bridges an augmentation gap in conventional rotation data augmentation. (2) Moreover, we design a two-stage training process to improve labeling accuracy of tertiary sulci by informing the biological associations in neuroanatomy: inference of primary/secondary sulci and then their spatial likelihood to guide the definition of tertiary sulci. In the experiments, we evaluate our method on 13 deep and shallow sulci of human LPFC in two independent data sets with different age ranges: pediatric (N=60) and adult (N=36) cohorts. We compare the proposed method with a conventional multi-atlas approach and spherical convolutional neural networks without/with rotation data augmentation. In both cohorts, the proposed data augmentation improves labeling accuracy of deep and shallow sulci over the baselines, and the proposed context-aware training offers further improvement in the labeling of shallow sulci over the proposed data augmentation. We share our tools with the field and discuss applications of our results for understanding neuroanatomical-functional organization of LPFC and the rest of cortex (https://github.com/ilwoolyu/SphericalLabeling).

Spherical Deformable U-Net: Application to Cortical Surface Parcellation and Development Prediction

Convolutional Neural Networks (CNNs) have achieved overwhelming success in learning-related problems for 2D/3D images in the Euclidean space. However, unlike in the Euclidean space, the shapes of many structures in medical imaging have an inherent spherical topology in a manifold space, e.g., the convoluted brain cortical surfaces represented by triangular meshes. There is no consistent neighborhood definition and thus no straightforward convolution/pooling operations for such cortical surface data. In this paper, leveraging the regular and hierarchical geometric structure of the resampled spherical cortical surfaces, we create the 1-ring filter on spherical cortical triangular meshes and accordingly develop convolution/pooling operations for constructing Spherical U-Net for cortical surface data. However, the regular nature of the 1-ring filter makes it inherently limited to model fixed geometric transformations. To further enhance the transformation modeling capability of Spherical U-Net, we introduce the deformable convolution and deformable pooling to cortical surface data and accordingly propose the Spherical Deformable U-Net (SDU-Net). Specifically, spherical offsets are learned to freely deform the 1-ring filter on the sphere to adaptively localize cortical structures with different sizes and shapes. We then apply the SDU-Net to two challenging and scientifically important tasks in neuroimaging: cortical surface parcellation and cortical attribute map prediction. Both applications validate the competitive performance of our approach in accuracy and computational efficiency in comparison with state-of-the-art methods.

Validation of Group-wise Registration for Surface-based Functional MRI Analysis

Resting-state functional MRI (rsfMRI) provides important information for studying and mapping the activities and functions of the brain. Conventionally, rsfMRIs are often registered to structural images in the Euclidean space without considering cortical surface geometry. Meanwhile, a surface-based representation offers a relaxed coordinate chart, but this still requires surface registration for group-wise data analysis. In this work, we investigate the performance of two existing surface registration methods in a surface-based rsfMRI analysis framework: FreeSurfer and Hierarchical Spherical Deformation (HSD). To minimize registration bias, we establish shape correspondence using both methods in a group-wise manner that estimates the unbiased average of a given cohort. To evaluate their performance, we focus on neuroanatomical alignment as well as the amount of distortion that can potentially bias surface tessellation for secondary level rsfMRI data analyses. In the pilot analysis, we examine a single timepoint of imaging data from 100 subjects out of an aging cohort. Overall, HSD establishes improved shape correspondence with reduced mean curvature deviation (10.94% less on average per subject, paired t-test: p <10-10) and reduced registration distortion (FreeSurfer: average 41.91% distortion per subject, HSD: 18.63%, paired t-test: p <10-10). Furthermore, HSD introduces less distortion than FreeSurfer in the areas identified in the individual components that were extracted by surface-based independent component analysis (ICA) after spatial smoothing and time series normalization. Consequently, we show that FreeSurfer capture individual components with globally similar but locally different patterns in ICA in visual inspection.

Establishing Surface Correspondence for Post-surgical Cortical Thickness Changes in Temporal Lobe Epilepsy

In pre- and post-surgical surface shape analysis, establishing shape correspondence is necessary to investigate the postoperative surface changes. However, structural absence after the operation accompanies focal non-rigid changes, which leads to challenges in existing surface registration methods. In this paper, we present a fully automatic particle-based method to establish surface correspondence that can handle partial structural abnormality in the temporal lobe resection. Our method optimizes the coordinates of points which are modeled as particles on surfaces in a hierarchical way to reduce a chance of being trapped in a local minimum during the optimization. In the experiments, we evaluate the effectiveness of our method in comparison with conventional spherical registration (FreeSurfer) on two scenarios: cortical thickness changes in healthy controls within a short scan-rescan time window and patients with temporal lobe resection. The post-surgical scan is acquired at least 1 year after the presurgical scan. In region of interest-wise (ROI-wise) analysis, no changes on cortical thickness are found in both methods on the healthy control group. In patients, since there is no ground truth available, we instead investigated the disagreement between our method and FreeSurfer. We see poorly matched ROIs and large cortical thickness changes using FreeSurfer. On the contrary, our method shows well-matched ROIs and subtle cortical thickness changes. This suggests that the proposed method can establish a stable shape correspondence, which is not fully captured in a conventional spherical registration.

Performance-aware programming for intraoperative intensity-based image registration on graphics processing units

Purpose

Intensity-based image registration has been proven essential in many applications accredited to its unparalleled ability to resolve image misalignments. However, long registration time for image realignment prohibits its use in intra-operative navigation systems. There has been much work on accelerating the registration process by improving the algorithm’s robustness, but the innate computation required by the registration algorithm has been unresolved.

Methods

Intensity-based registration methods involve operations with high arithmetic load and memory access demand, which supposes to be reduced by graphics processing units (GPUs). Although GPUs are widespread and affordable, there is a lack of open-source GPU implementations optimized for non-rigid image registration. This paper demonstrates performance-aware programming techniques, which involves systematic exploitation of GPU features, by implementing the diffeomorphic log-demons algorithm.

Results

By resolving the pinpointed computation bottlenecks on GPU, our implementation of diffeomorphic log-demons on Nvidia GTX Titan X GPU has achieved ~ 95 times speed-up compared to the CPU and registered a 1.3-M voxel image in 286 ms. Even for large 37-M voxel images, our implementation is able to register in 8.56 s, which attained ~ 258 times speed-up. Our solution involves effective employment of GPU computation units, memory, and data bandwidth to resolve computation bottlenecks.

Conclusion

The computation bottlenecks in diffeomorphic log-demons are pinpointed, analyzed, and resolved using various GPU performance-aware programming techniques. The proposed fast computation on basic image operations not only enhances the computation of diffeomorphic log-demons, but is also potentially extended to speed up many other intensity-based approaches. Our implementation is open-source on GitHub at https://bit.ly/2PYZxQz.

A gyrification analysis approach based on Laplace Beltrami eigenfunction level sets

An accurate measure of the complexity of patterns of cortical folding or gyrification is necessary for understanding normal brain development and neurodevelopmental disorders. Conventional gyrification indices (GIs) are calculated based on surface curvature (curvature-based GI) or an outer hull surface of the cortex (outer surface-based GI). The latter is dependent on the definition of the outer hull surface and a corresponding function between surfaces. In the present study, we propose the Laplace Beltrami-based gyrification index (LB-GI). This is a new curvature-based local GI computed using the first three Laplace Beltrami eigenfunction level sets. As with outer surface-based GI methods, this method is based on the hypothesis that gyrification stems from a flat surface during development. However, instead of quantifying gyrification with reference to corresponding points on an outer hull surface, LB-GI quantifies the gyrification at each point on the cortical surface with reference to their surrounding gyral points, overcoming several shortcomings of existing methods. The LB-GI was applied to investigate the cortical maturation profile of the human brain from preschool to early adulthood using the PING database. The results revealed more detail in patterns of cortical folding than conventional curvature-based methods, especially on frontal and posterior tips of the brain, such as the frontal pole, lateral occipital, lateral cuneus, and lingual. Negative associations of cortical folding with age were observed at cortical regions, including bilateral lingual, lateral occipital, precentral gyrus, postcentral gyrus, and superior frontal gyrus. The results also indicated positive significant associations between age and the LB-GI of bilateral insula, the medial orbitofrontal, frontal pole and rostral anterior cingulate regions. It is anticipated that the LB-GI will be advantageous in providing further insights in the understanding of brain development and degeneration in large clinical neuroimaging studies.

Subject-specific segregation of functional territories based on deep phenotyping

Functional magnetic resonance imaging (fMRI) has opened the possibility to investigate how brain activity is modulated by behavior. Most studies so far are bound to one single task, in which functional responses to a handful of contrasts are analyzed and reported as a group average brain map. Contrariwise, recent data-collection efforts have started to target a systematic spatial representation of multiple mental functions. In this paper, we leverage the Individual Brain Charting (IBC) dataset-a high-resolution task-fMRI dataset acquired in a fixed environment-in order to study the feasibility of individual mapping. First, we verify that the IBC brain maps reproduce those obtained from previous, large-scale datasets using the same tasks. Second, we confirm that the elementary spatial components, inferred across all tasks, are consistently mapped within and, to a lesser extent, across participants. Third, we demonstrate the relevance of the topographic information of the individual contrast maps, showing that contrasts from one task can be predicted by contrasts from other tasks. At last, we showcase the benefit of contrast accumulation for the fine functional characterization of brain regions within a prespecified network. To this end, we analyze the cognitive profile of functional territories pertaining to the language network and prove that these profiles generalize across participants.

Cortical surface registration using unsupervised learning

Non-rigid cortical registration is an important and challenging task due to the geometric complexity of the human cortex and the high degree of inter-subject variability. A conventional solution is to use a spherical representation of surface properties and perform registration by aligning cortical folding patterns in that space. This strategy produces accurate spatial alignment, but often requires high computational cost. Recently, convolutional neural networks (CNNs) have demonstrated the potential to dramatically speed up volumetric registration. However, due to distortions introduced by projecting a sphere to a 2D plane, a direct application of recent learning-based methods to surfaces yields poor results. In this study, we present SphereMorph, a diffeomorphic registration framework for cortical surfaces using deep networks that addresses these issues. SphereMorph uses a UNet-style network associated with a spherical kernel to learn the displacement field and warps the sphere using a modified spatial transformer layer. We propose a resampling weight in computing the data fitting loss to account for distortions introduced by polar projection, and demonstrate the performance of our proposed method on two tasks, including cortical parcellation and group-wise functional area alignment. The experiments show that the proposed SphereMorph is capable of modeling the geometric registration problem in a CNN framework and demonstrate superior registration accuracy and computational efficiency. The source code of SphereMorph will be released to the public upon acceptance of this manuscript at https://github.com/voxelmorph/spheremorph.

Unsupervised Learning for Spherical Surface Registration

Current spherical surface registration methods achieve good performance on alignment and spatial normalization of cortical surfaces across individuals in neuroimaging analysis. However, they are computationally intensive, since they have to optimize an objective function independently for each pair of surfaces. In this paper, we present a fast learning-based algorithm that makes use of the recent development in spherical Convolutional Neural Networks (CNNs) for spherical cortical surface registration. Given a set of surface pairs without supervised information such as ground truth deformation fields or anatomical landmarks, we formulate the registration as a parametric function and learn its parameters by enforcing the feature similarity between one surface and the other one warped by the estimated deformation field using the function. Then, given a new pair of surfaces, we can quickly infer the spherical deformation field registering one surface to the other one. We model this parametric function using three orthogonal Spherical U-Nets and use spherical transform layers to warp the spherical surfaces, while imposing smoothness constraints on the deformation field. All the layers in the network are well-defined and differentiable, thus the parameters can be effectively learned. We show that our method achieves accurate cortical alignment results on 102 subjects, comparable to two state-of-the-art methods: Spherical Demons and MSM, while runs much faster.

A novel approach to multiple anatomical shape analysis: Application to fetal ventriculomegaly

Fetal ventriculomegaly (VM) is a condition in which one or both lateral ventricles are enlarged, and is diagnosed as an atrial diameter larger than 10 mm. Evidence of altered cortical folding associated with VM has been shown in the literature. However, existing works use a single scalar value such as diagnosis or lateral ventricular volume to characterize VM and study its relationship with alterations in cortical folding, thus failing to reveal the spatially-heterogeneous associations. In this work, we propose a novel approach to identify fine-grained associations between cortical folding and ventricular enlargement by leveraging the vertex-wise correlations between their growth patterns in terms of area expansion and curvature. Our approach comprises three steps. In the first step, we define a joint graph Laplacian matrix using cortex-to-ventricle correlations. The joint Laplacian is built based on multiple cortical features. Next, we propose a spectral embedding of the cortex-to-ventricle graph into a common underlying space where its nodes are projected according to the joint ventricle-cortex growth patterns. In this low-dimensional joint ventricle-cortex space, associated growth patterns lie close to each other. In the final step, we perform hierarchical clustering in the joint embedded space to identify associated sub-regions between cortex and ventricle. Using a dataset of 25 healthy fetuses and 23 fetuses with isolated non-severe VM within the age range of 26-29 gestational weeks, our approach reveals clinically relevant and heterogeneous regional associations. Cortical regions forming these associations are further validated using statistical analysis, revealing regions with altered folding that are significantly associated with ventricular dilation.

Improved tagged cardiac MRI myocardium strain analysis by leveraging cine segmentation

BACKGROUND AND OBJECTIVES

Tagged MR images provide an effective way for regional analysis of the myocardium strain. A reliable myocardium strain analysis requires both correct segmentation and accurate motion tracking of the myocardium during the cardiac cycle. While many algorithms have been proposed for accurate tracking of the myocardium in tagged MR images, little focus has been placed on ensuring correct segmentation of the tagged myocardium during the cardiac cycle. Myocardial strain analysis is usually done by segmenting the myocardium in end-diastole, generating a mesh from the segmentation, propagating the mesh through the cardiac cycle using the output deformation field from motion tracking, and measuring strain on the deforming mesh. Due to the imposed tag strips on the anatomy, identification of the myocardium boundaries is challenging in tagged MR images. As a result, there is no guarantee that the propagated mesh is annotating the myocardium accurately through the cardiac cycle. Moreover, clinical studies indicate that incorrect myocardium annotation can result in overestimation of myocardial strains.

METHODS

We introduce a method to improve reliability of strain analysis by proposing a mesh which correctly segments the myocardium in tagged MRI by leveraging the available cine MRI segmentation. In particular, we generate a series of mesh proposals using the cine MRI segmentation and find the propagated mesh proposal which gives the most accurate full-cycle myocardium segmentation.

RESULTS

The mesh selection algorithm was tested on 22 2D MRI scans of diseased and healthy hearts. The proposed algorithm provided more accurate whole-cycle myocardium segmentation compared to the propagated end-diastolic mesh. Regional myocardium strain was measured for 10 3D MRI scans of healthy volunteers using the proposed mesh and the end-diastolic mesh. The measured strain using the proposed mesh was more similar to the expected myocardium strain for a healthy heart than the measured strain using the end-diastolic mesh.

CONCLUSION

The proposed approach provides accurate whole-cycle tagged myocardium segmentation and more reliable myocardium strain analysis.

Individual identification and individual variability analysis based on cortical folding features in developing infant singletons and twins

Studying the early dynamic development of cortical folding with remarkable individual variability is critical for understanding normal early brain development and related neurodevelopmental disorders. This study focuses on the fingerprinting capability and the individual variability of cortical folding during early brain development. Specifically, we aim to explore (a) whether the developing neonatal cortical folding is unique enough to be considered as a "fingerprint" that can reliably identify an individual within a cohort of infants; (b) which cortical regions manifest more individual variability and thus contribute more for infant identification; (c) whether the infant twins can be distinguished by cortical folding. Hence, for the first time, we conduct infant individual identification and individual variability analysis involving twins based on the developing cortical folding features (mean curvature, average convexity, and sulcal depth) in 472 neonates with 1,141 longitudinal MRI scans. Experimental results show that the infant individual identification achieves 100% accuracy when using the neonatal cortical folding features to predict the identities of 1- and 2-year-olds. Besides, we observe high identification capability in the high-order association cortices (i.e., prefrontal, lateral temporal, and inferior parietal regions) and two unimodal cortices (i.e., precentral gyrus and lateral occipital cortex), which largely overlap with the regions encoding remarkable individual variability in cortical folding during the first 2 years. For twins study, we show that even for monozygotic twins with identical genes and similar developmental environments, their cortical folding features are unique enough for accurate individual identification; and in some high-order association cortices, the differences between monozygotic twin pairs are significantly lower than those between dizygotic twins. This study thus provides important insights into individual identification and individual variability based on cortical folding during infancy.

Surface-constrained volumetric registration for the early developing brain

The T1-weighted and T2-weighted MRI contrasts of the infant brain evolve drastically during the first year of life. This poses significant challenges to inter- and intra-subject registration, which is key to subsequent statistical analyses. Existing registration methods that do not consider temporal contrast changes are ineffective for infant brain MRI data. To address this problem, we present in this paper a method for deformable registration of infant brain MRI. The key advantage of our method is threefold: (i) To deal with appearance changes, registration is performed based on segmented tissue maps instead of image intensity. Segmentation is performed by using an infant-centric algorithm previously developed by our group. (ii) Registration is carried out with respect to both cortical surfaces and volumetric tissue maps, thus allowing precise alignment of both cortical and subcortical structures. (iii) A dynamic elasticity model is utilized to allow large non-linear deformation. Experimental results in comparison with well-established registration methods indicate that our method yields superior accuracy in both cortical and subcortical alignment.

Surface-Volume Consistent Construction of Longitudinal Atlases for the Early Developing Brain

Infant brain atlases are essential for characterizing structural changes in the developing brain. Volumetric and cortical atlases are typically constructed independently, potentially causing discrepancies between tissue boundaries and cortical surfaces. In this paper, we present a method for surface-volume consistent construction of longitudinal brain atlases of infants from 2 weeks to 12 months of age. We first construct the 12-month atlas via groupwise surface-constrained volumetric registration. The longitudinal displacements of each subject with respect to different time points are then transported parallelly to the 12-month atlas space. The 12-month cortico-volumetric atlas is finally warped temporally to each month prior to the 12th month using the transported displacements. Experimental results indicate that the longitudinal atlases generated are consistent in terms of tissue boundaries and cortical surfaces, hence allowing joint surface-volume analysis to be performed in a common space.

Hierarchical spherical deformation for cortical surface registration

We present hierarchical spherical deformation for a group-wise shape correspondence to address template selection bias and to minimize registration distortion. In this work, we aim at a continuous and smooth deformation field to guide accurate cortical surface registration. In conventional spherical registration methods, a global rigid alignment and local deformation are independently performed. Motivated by the composition of precession and intrinsic rotation, we simultaneously optimize global rigid rotation and non-rigid local deformation by utilizing spherical harmonics interpolation of local composite rotations in a single framework. To this end, we indirectly encode local displacements by such local composite rotations as functions of spherical locations. Furthermore, we introduce an additional regularization term to the spherical deformation, which maximizes its rigidity while reducing registration distortion. To improve surface registration performance, we employ the second order approximation of the energy function that enables fast convergence of the optimization. In the experiments, we validate our method on healthy normal subjects with manual cortical surface parcellation in registration accuracy and distortion. We show an improved shape correspondence with high accuracy in cortical surface parcellation and significantly low registration distortion in surface area and edge length. In addition to validation, we discuss parameter tuning, optimization, and implementation design with potential acceleration.

Revealing Developmental Regionalization of Infant Cerebral Cortex Based on Multiple Cortical Properties

The human brain develops dynamically and regionally heterogeneously during the first two postnatal years. Cortical developmental regionalization, i.e., the landscape of cortical heterogeneity in development, reflects the organization of underlying microstructures, which are closely related to the functional principles of the cortex. Therefore, prospecting early cortical developmental regionalization can provide neurobiologically meaningful units for precise region localization, which will advance our understanding on brain development in this critical period. However, due to the absence of dedicated computational tools and large-scale datasets, our knowledge on early cortical developmental regionalization still remains intact. To fill both the methodological and knowledge gaps, we propose to explore the cortical developmental regionalization using a novel method based on nonnegative matrix factorization (NMF), due to its ability in analyzing complex high-dimensional data by representing data using several bases in a data-driven way. Specifically, a novel multi-view NMF (MV-NMF) method is proposed, in which multiple distinct and complementary cortical properties (i.e., multiple views) are jointly considered to provide comprehensive observation of cortical regionalization process. To ensure the sparsity of the discovered regions, an orthogonal constraint defined in Stiefel manifold is imposed in our MV-NMF method. Meanwhile, a graph-induced constraint is also included to improve the compactness of the discovered regions. Capitalizing on an unprecedentedly large dataset with 1,560 longitudinal MRI scans from 887 infants, we delineate the first neurobiologically meaningful representation of early cortical regionalization, providing a valuable reference for brain development studies.

Mapping hemispheric asymmetries of the macaque cerebral cortex during early brain development

Studying cortical hemispheric asymmetries during the dynamic early postnatal stages in macaque monkeys (with close phylogenetic relationship to humans) would increase our limited understanding on the possible origins, developmental trajectories, and evolutional mechanisms of brain asymmetries in nonhuman primates, but remains a blind spot to the community. Via cortical surface-based morphometry, we comprehensively analyze hemispheric structural asymmetries in 134 longitudinal MRI scans from birth to 20 months of age from 32 healthy macaque monkeys. We reveal that most clusters of hemispheric asymmetries of cortical properties, such as surface area, cortical thickness, sulcal depth, and vertex positions, expand in the first 4 months of life, and evolve only moderately thereafter. Prominent hemispheric asymmetries are found at the inferior frontal gyrus, precentral gyrus, posterior temporal cortex, superior temporal gyrus (STG), superior temporal sulcus (STS), and cingulate cortex. Specifically, the left planum temporale and left STG consistently have larger area and thicker cortices than those on the right hemisphere, while the right STS, right cingulate cortex, and right anterior insula are consistently deeper than the left ones, partially consistent with the findings in human infants and adults. Our results thus provide a valuable reference in studying early brain development and evolution.

The Cerebral Cortex is Bisectionally Segregated into Two Fundamentally Different Functional Units of Gyri and Sulci

The human cerebral cortex is highly folded into diverse gyri and sulci. Accumulating evidences suggest that gyri and sulci exhibit anatomical, morphological, and connectional differences. Inspired by these evidences, we performed a series of experiments to explore the frequency-specific differences between gyral and sulcal neural activities from resting-state and task-based functional magnetic resonance imaging (fMRI) data. Specifically, we designed a convolutional neural network (CNN) based classifier, which can differentiate gyral and sulcal fMRI signals with reasonable accuracies. Further investigations of learned CNN models imply that sulcal fMRI signals are more diverse and more high frequency than gyral signals, suggesting that gyri and sulci truly play different functional roles. These differences are significantly associated with axonal fiber wiring and cortical thickness patterns, suggesting that these differences might be deeply rooted in their structural and cellular underpinnings. Further wavelet entropy analyses demonstrated the validity of CNN-based findings. In general, our collective observations support a new concept that the cerebral cortex is bisectionally segregated into 2 functionally different units of gyri and sulci.

Direct electrophysiological mapping of human pitch-related processing in auditory cortex

This work sought correlates of pitch perception, defined by neural activity above the lower limit of pitch (LLP), in auditory cortical neural ensembles, and examined their topographical distribution. Local field potentials (LFPs) were recorded in eight patients undergoing invasive recordings for pharmaco-resistant epilepsy. Stimuli consisted of bursts of broadband noise followed by regular interval noise (RIN). RIN was presented at rates below and above the LLP to distinguish responses related to the regularity of the stimulus and the presence of pitch itself. LFPs were recorded from human cortical homologues of auditory core, belt, and parabelt regions using multicontact depth electrodes implanted in Heschl's gyrus (HG) and Planum Temporale (PT), and subdural grid electrodes implanted over lateral superior temporal gyrus (STG). Evoked responses corresponding to the temporal regularity of the stimulus were assessed using autocorrelation of the evoked responses, and occurred for stimuli below and above the LLP. Induced responses throughout the high gamma range (60-200 Hz) were present for pitch values above the LLP, with onset latencies of approximately 70 ms. Mapping of the induced responses onto a common brain space demonstrated variability in the topographical distribution of high gamma responses across subjects. Induced responses were present throughout the length of HG and on PT, which is consistent with previous functional neuroimaging studies. Moreover, in each subject, a region within lateral STG showed robust induced responses at pitch-evoking stimulus rates. This work suggests a distributed representation of pitch processing in neural ensembles in human homologues of core and non-core auditory cortex.

CONSTRUCTION OF 4D NEONATAL CORTICAL SURFACE ATLASES USING WASSERSTEIN DISTANCE

Spatiotemporal (4D) neonatal cortical surface atlases with densely sampled ages are important tools for understanding the dynamic early brain development. Conventionally, after non-linear co-registration, surface atlases were constructed by simple Euclidean average of cortical attributes across different subjects, which leads to blurred folding patterns and therefore hampers the reliability and accuracy when registering new subjects onto the atlases. To better preserve the sharpness and clarity of cortical folding patterns on surface atlases, we propose to compute the Wasserstein barycenter, which represents a geometrically faithful population mean under the Wasserstein distance metric, for the construction of 4D neonatal surface atlases. The Wasserstein distance considers two distributions as heaps of sand, and quantifies their distance as the least cost to move all sand particles from one distribution to reshape it into the other. In our case, comparing to the direct vertex-wise Euclidean average, the Wasserstein distance takes into account the alignment of spatial distribution of cortical attributes, thus is robust to potential registration errors during atlas building. Using this method, we constructed 4D neonatal cortical surface atlases at each week, from 39 to 44 postmenstrual weeks, based on a large-scale dataset with 764 subjects. Our 4D atlases show sharper and more geometrically faithful cortical folding patterns than the atlases built by the state-of-the-art method, thus leading to boosted accuracy for spatial normalization and facilitating early brain development studies.

CHARTING DEVELOPMENT-BASED JOINT PARCELLATION MAPS OF HUMAN AND MACAQUE BRAINS DURING INFANCY

Comparative characterization of early brain development between human and macaque using neuroimaging data is crucial to understand the mechanisms of brain development and evolution. To this end, joint cortical parcellation maps of human and macaque infant brains with corresponding regions are highly desirable, since they provide basic cortical parcels for both region-based and network-based studies of two closely-related species. To address this issue, we propose to leverage developmental patterns of cortical properties of both human and macaque infants for creating joint parcellation maps with inter-species comparability. The motivation is that the developmental patterns of cortical properties indicate underlying rapid changes of microstructures, which determine the molecular and functional principles of the cortex. Thus, developmental patterns are well suitable for defining distinct cortical regions in both structures and functions. To comprehensively capture the similarities of developmental patterns of vertices on cortical surfaces, for each species, we first construct two complementary similarity matrices: a low-order matrix and a high-order matrix. Then, we non-linearly fuse these four matrices together as a single matrix in a hierarchical manner, thus capturing the common and complementary information of both human and macaque infants. Finally, based on the fused similarity matrix, we apply the spectral clustering to derive the joint parcellation maps. By applying our method to 210 longitudinal human infant MRI scans and 140 longitudinal macaque infant MRI scans, we generate the first biologically-meaningful joint parcellation maps of human and macaque infants.

Spatial Topography of Individual-Specific Cortical Networks Predicts Human Cognition, Personality, and Emotion

Resting-state functional magnetic resonance imaging (rs-fMRI) offers the opportunity to delineate individual-specific brain networks. A major question is whether individual-specific network topography (i.e., location and spatial arrangement) is behaviorally relevant. Here, we propose a multi-session hierarchical Bayesian model (MS-HBM) for estimating individual-specific cortical networks and investigate whether individual-specific network topography can predict human behavior. The multiple layers of the MS-HBM explicitly differentiate intra-subject (within-subject) from inter-subject (between-subject) network variability. By ignoring intra-subject variability, previous network mappings might confuse intra-subject variability for inter-subject differences. Compared with other approaches, MS-HBM parcellations generalized better to new rs-fMRI and task-fMRI data from the same subjects. More specifically, MS-HBM parcellations estimated from a single rs-fMRI session (10 min) showed comparable generalizability as parcellations estimated by 2 state-of-the-art methods using 5 sessions (50 min). We also showed that behavioral phenotypes across cognition, personality, and emotion could be predicted by individual-specific network topography with modest accuracy, comparable to previous reports predicting phenotypes based on connectivity strength. Network topography estimated by MS-HBM was more effective for behavioral prediction than network size, as well as network topography estimated by other parcellation approaches. Thus, similar to connectivity strength, individual-specific network topography might also serve as a fingerprint of human behavior.

Improved gray matter surface based spatial statistics in neuroimaging studies

Neuroimaging often involves acquiring high-resolution anatomical images along with other low-resolution image modalities, like diffusion and functional magnetic resonance imaging. Performing gray matter statistics with low-resolution image modalities is a challenge due to registration artifacts and partial volume effects. Gray matter surface based spatial statistics (GS-BSS) has been shown to provide higher sensitivity using gray matter surfaces compared to that of skeletonization approach of gray matter based spatial statistics which is adapted from tract based spatial statistics in diffusion studies. In this study, we improve upon GS-BSS incorporating neurite orientation dispersion and density imaging (NODDI) based search (denoted N-GSBSS) by 1) enhancing metrics mapping from native space, 2) incorporating maximum orientation dispersion index (ODI) search along surface normal, and 3) proposing applicability to other modalities, such as functional MRI (fMRI). We evaluated the performance of N-GSBSS against three baseline pipelines: volume-based registration, FreeSurfer's surface registration and ciftify pipeline for fMRI and simulation studies. First, qualitative mean ODI results are shown for N-GSBSS with and without NODDI based search in comparison with ciftify pipeline. Second, we conducted one-sample t-tests on working memory activations in fMRI to show that the proposed method can aid in the analysis of low resolution fMRI data. Finally we performed a sensitivity test in a simulation study by varying percentage change of intensity values within a region of interest in gray matter probability maps. N-GSBSS showed higher sensitivity in the simulation test compared to the other methods capturing difference between the groups starting at 10% change in the intensity values. The computational time of N-GSBSS is 68 times faster than that of traditional surface-based or 86 times faster than that of ciftify pipeline analysis.

Construction of 4D infant cortical surface atlases with sharp folding patterns via spherical patch-based group-wise sparse representation

4D (spatial + temporal) infant cortical surface atlases covering dense time points are highly needed for understanding dynamic early brain development. In this article, we construct a set of 4D infant cortical surface atlases with longitudinally consistent and sharp cortical attribute patterns at 11 time points in the first six postnatal years, that is, at 1, 3, 6, 9, 12, 18, 24, 36, 48, 60, and 72 months of age, which is targeted for better normalization of the dynamic changing early brain cortical surfaces. To ensure longitudinal consistency and unbiasedness, we adopt a two-stage group-wise surface registration. To preserve sharp cortical attribute patterns on the atlas, instead of simply averaging over the coregistered cortical surfaces, we leverage a spherical patch-based sparse representation using the augmented dictionary to overcome the potential registration errors. Our atlases provide not only geometric attributes of the cortical folding, but also cortical thickness and myelin content. Therefore, to address the consistency across different cortical attributes on the atlas, instead of sparsely representing each attribute independently, we jointly represent all cortical attributes with a group-wise sparsity constraint. In addition, to further facilitate region-based analysis using our atlases, we have also provided two widely used parcellations, that is, FreeSurfer parcellation and multimodal parcellation, on our 4D infant cortical surface atlases. Compared to cortical surface atlases constructed with other methods, our cortical surface atlases preserve sharper cortical folding attribute patterns, thus leading to better accuracy in registration of individual infant cortical surfaces to the atlas.

Fetal cortical surface atlas parcellation based on growth patterns

Defining anatomically and functionally meaningful parcellation maps on cortical surface atlases is of great importance in surface-based neuroimaging analysis. The conventional cortical parcellation maps are typically defined based on anatomical cortical folding landmarks in adult surface atlases. However, they are not suitable for fetal brain studies, due to dramatic differences in brain size, shape, and properties between adults and fetuses. To address this issue, we propose a novel data-driven method for parcellation of fetal cortical surface atlases into distinct regions based on the dynamic "growth patterns" of cortical properties (e.g., surface area) from a population of fetuses. Our motivation is that the growth patterns of cortical properties indicate the underlying rapid changes of microstructures, which determine the molecular and functional principles of the cortex. Thus, growth patterns are well suitable for defining distinct cortical regions in development, structure, and function. To comprehensively capture the similarities of cortical growth patterns among vertices, we construct two complementary similarity matrices. One is directly based on the growth trajectories of vertices, and the other is based on the correlation profiles of vertices' growth trajectories in relation to a set of reference points. Then, we nonlinearly fuse these two similarity matrices into a single one, which can better capture both their common and complementary information than by simply averaging them. Finally, based on this fused similarity matrix, we perform spectral clustering to divide the fetal cortical surface atlases into distinct regions. By applying our method on 25 normal fetuses from 26 to 29 gestational weeks, we construct age-specific fetal cortical surface atlases equipped with biologically meaningful parcellation maps based on cortical growth patterns. Importantly, our generated parcellation maps reveal spatially contiguous, hierarchical and bilaterally relatively symmetric patterns of fetal cortical surface development.

Joint Analysis of Cortical Area and Thickness as a Replacement for the Analysis of the Volume of the Cerebral Cortex

Cortical surface area is an increasingly used brain morphology metric that is ontogenetically and phylogenetically distinct from cortical thickness and offers a separate index of neurodevelopment and disease. However, the various existing methods for assessment of cortical surface area from magnetic resonance images have never been systematically compared. We show that the surface area method implemented in FreeSurfer corresponds closely to the exact, but computationally more demanding, mass-conservative (pycnophylactic) method, provided that images are smoothed. Thus, the data produced by this method can be interpreted as estimates of cortical surface area, as opposed to areal expansion. In addition, focusing on the joint analysis of thickness and area, we compare an improved, analytic method for measuring cortical volume to a permutation-based nonparametric combination (NPC) method. We use the methods to analyze area, thickness and volume in young adults born preterm with very low birth weight, and show that NPC analysis is a more sensitive option for studying joint effects on area and thickness, giving equal weight to variation in both of these 2 morphological features.

CORTICAL FOLDINGPRINTS FOR INFANT IDENTIFICATION

Cortical folding of the adult brain is highly convoluted and encodes inter-subject variable characteristics. Recent studies suggest that it is useful for individual identification in adults. However, little is known about whether the infant cortical folding, which undergoes dynamic postnatal development, can be used for individual identification. To fill this gap, we propose to explore cortical folding patterns for infant subject identification. This study thus aims to address two important questions in neuroscience: 1) whether the infant cortical folding is unique for individual identification; and 2) considering the region-specific inter-subject variability, which cortical regions are more distinct and reliable for infant identification. To this end, we propose a novel discriminative descriptor of regional cortical folding based on multi-scale analysis of curvature maps via spherical wavelets, called FoldingPrint. Experiments are carried out on a large longitudinal dataset with 1,141 MRI scans from 472 infants. Despite the dramatic development in the first two years, successful identification of 1-year-olds and 2-year-olds using their neonatal cortical folding (with accuracy > 98%) indicates the effectiveness of the proposed method. Moreover, we reveal that regions with high identification accuracy and large inter-subject variability mainly distribute in high-order association cortices.

Performing group-level functional image analyses based on homologous functional regions mapped in individuals

Functional MRI (fMRI) studies have traditionally relied on intersubject normalization based on global brain morphology, which cannot establish proper functional correspondence between subjects due to substantial intersubject variability in functional organization. Here, we reliably identified a set of discrete, homologous functional regions in individuals to improve intersubject alignment of fMRI data. These functional regions demonstrated marked intersubject variability in size, position, and connectivity. We found that previously reported intersubject variability in functional connectivity maps could be partially explained by variability in size and position of the functional regions. Importantly, individual differences in network topography are associated with individual differences in task-evoked activations, suggesting that these individually specified regions may serve as the "localizer" to improve the alignment of task-fMRI data. We demonstrated that aligning task-fMRI data using the regions derived from resting state fMRI may lead to increased statistical power of task-fMRI analyses. In addition, resting state functional connectivity among these homologous regions is able to capture the idiosyncrasies of subjects and better predict fluid intelligence (gF) than connectivity measures derived from group-level brain atlases. Critically, we showed that not only the connectivity but also the size and position of functional regions are related to human behavior. Collectively, these findings suggest that identifying homologous functional regions across individuals can benefit a wide range of studies in the investigation of connectivity, task activation, and brain-behavior associations.

Hierarchical Rough-to-Fine Model for Infant Age Prediction Based on Cortical Features

Prediction of the chronological age based on neuroimaging data is important for brain development analysis and brain disease diagnosis. Although many researches have been conducted for age prediction of older children and adults, little work has been dedicated to infants. To this end, this paper focuses on predicting infant age from birth to 2-year old using brain MR images, as well as identifying some related biomarkers. However, brain development during infancy is too rapid and heterogeneous to be accurately modeled by the conventional regression models. To address this issue, a two-stage prediction method is proposed. Specifically, our method first roughly predicts the age range of an infant and then finely predicts the accurate chronological age based on a learned, age-group-specific regression model. Combining this two-stage prediction method with another complementary one-stage prediction method, a hierarchical rough-to-fine (HRtoF) model is built. HRtoF effectively splits the rapid and heterogeneous changes during a long time period into several short time ranges and further mines the discrimination capability of cortical features, thus reaching high accuracy in infant age prediction. Taking 8 types of cortical morphometric features from structural MRI as predictors, the effectiveness of our proposed HRtoF model is validated using an infant dataset including 50 healthy subjects with 251 longitudinal MRI scans from 14 to 797 days. Comparing with five state-of-the-art regression methods, HRtoF model reduces the mean absolute error of the prediction from >48 days to 32.1 days. The correlation coefficient of the predicted age and the chronological age reaches 0.963. Moreover, based on HRtoF, the relative contributions of the eight types of cortical features for age prediction are also studied.

Exploring folding patterns of infant cerebral cortex based on multi-view curvature features: Methods and applications

The highly convoluted cortical folding of the human brain is intriguingly complex and variable across individuals. Exploring the underlying representative patterns of cortical folding is of great importance for many neuroimaging studies. At term birth, all major cortical folds are established and are minimally affected by the complicated postnatal environments; hence, neonates are the ideal candidates for exploring early postnatal cortical folding patterns, which yet remain largely unexplored. In this paper, we propose a novel method for exploring the representative regional folding patterns of infant brains. Specifically, first, multi-view curvature features are constructed to comprehensively characterize the complex characteristics of cortical folding. Second, for each view of curvature features, a similarity matrix is computed to measure the similarity of cortical folding in a specific region between any pair of subjects. Next, a similarity network fusion method is adopted to nonlinearly and adaptively fuse all the similarity matrices into a single one for retaining both shared and complementary similarity information of the multiple characteristics of cortical folding. Finally, based on the fused similarity matrix and a hierarchical affinity propagation clustering approach, all subjects are automatically grouped into several clusters to obtain the representative folding patterns. To show the applications, we have applied the proposed method to a large-scale dataset with 595 normal neonates and discovered representative folding patterns in several cortical regions, i.e., the superior temporal gyrus (STG), inferior frontal gyrus (IFG), precuneus, and cingulate cortex. Meanwhile, we have revealed sex difference in STG, IFG, and cingulate cortex, as well as hemispheric asymmetries in STG and cingulate cortex in terms of cortical folding patterns. Moreover, we have also validated the proposed method on a public adult dataset, i.e., the Human Connectome Project (HCP), and revealed that certain major cortical folding patterns of adults are largely established at term birth.

A computational method for longitudinal mapping of orientation-specific expansion of cortical surface in infants

The cortical surface of the human brain expands dynamically and regionally heterogeneously during the first postnatal year. As all primary and secondary cortical folds as well as many tertiary cortical folds are well established at term birth, the cortical surface area expansion during this stage is largely driven by the increase of surface area in two orthogonal orientations in the tangent plane: 1) the expansion parallel to the folding orientation (i.e., increasing the lengths of folds) and 2) the expansion perpendicular to the folding orientation (i.e., increasing the depths of folds). This information would help us better understand the mechanisms of cortical development and provide important insights into neurodevelopmental disorders, but still remains largely unknown due to lack of dedicated computational methods. To address this issue, we propose a novel method for longitudinal mapping of orientation-specific expansion of cortical surface area in these two orthogonal orientations during early infancy. First, to derive the two orientation fields perpendicular and parallel to cortical folds, we propose to adaptively and smoothly fuse the gradient field of sulcal depth and also the maximum principal direction field, by leveraging their region-specific reliability. Specifically, we formulate this task as a discrete labeling problem, in which each vertex is assigned to an orientation label, and solve it by graph cuts. Then, based on the computed longitudinal deformation of the cortical surface, we estimate the Jacobian matrix at each vertex by solving a least-squares problem and derive its corresponding stretch tensor. Finally, to obtain the orientation-specific cortical surface expansion, we project the stretch tensor into the two orthogonal orientations separately. We have applied the proposed method to 30 healthy infants, and for the first time we revealed the orientation-specific longitudinal cortical surface expansion maps during the first postnatal year.

Symplectomorphic registration with phase space regularization by entropy spectrum pathways

PURPOSE

The ability to register image data to a common coordinate system is a critical feature of virtually all imaging studies. However, in spite of the abundance of literature on the subject and the existence of several variants of registration algorithms, their practical utility remains problematic, as commonly acknowledged even by developers of these methods.

METHODS

A new registration method is presented that utilizes a Hamiltonian formalism and constructs registration as a sequence of symplectomorphic maps in conjunction with a novel phase space regularization. For validation of the framework a panel of deformations expressed in analytical form is developed that includes deformations based on known physical processes in MRI and reproduces various distortions and artifacts typically present in images collected using these different MRI modalities.

RESULTS

The method is demonstrated on the three different magnetic resonance imaging (MRI) modalities by mapping between high resolution anatomical (HRA) volumes, medium resolution diffusion weighted MRI (DW-MRI) and HRA volumes, and low resolution functional MRI (fMRI) and HRA volumes.

CONCLUSIONS

The method has shown an excellent performance and the panel of deformations was instrumental to quantify its repeatability and reproducibility in comparison to several available alternative approaches.

Registration-Free Infant Cortical Surface Parcellation using Deep Convolutional Neural Networks

Automatic parcellation of infant cortical surfaces into anatomical regions of interest (ROIs) is of great importance in brain structural and functional analysis. Conventional cortical surface parcellation methods suffer from two main issues: 1) Cortical surface registration is needed for establishing the atlas-to-individual correspondences; 2) The mapping from cortical shape to the parcellation labels requires designing of specific hand-crafted features. To address these issues, in this paper, we propose a novel cortical surface parcellation method, which is free of surface registration and designing of hand-crafted features, based on deep convolutional neural network (DCNN). Our main idea is to formulate surface parcellation as a patch-wise classification problem. Briefly, we use DCNN to train a classifier, whose inputs are the local cortical surface patches with multi-channel cortical shape descriptors such as mean curvature, sulcal depth, and average convexity; while the outputs are the parcellation label probabilities of cortical vertices. To enable effective convolutional operation on the surface data, we project each spherical surface patch onto its intrinsic tangent plane by a geodesic-distance-preserving mapping. Then, after classification, we further adopt the graph cuts method to improve spatial consistency of the parcellation. We have validated our method based on 90 neonatal cortical surfaces with manual parcellations, showing superior accuracy and efficiency of our proposed method.

Discovering cortical sulcal folding patterns in neonates using large-scale dataset

The folding of the human cerebral cortex is highly complex and variable across individuals, but certain common major patterns of cortical folding do exist. Mining such common patterns of cortical folding is of great importance in understanding the inter-individual variability of cortical folding and their relationship with cognitive functions and brain disorders. As primary cortical folds are mainly genetically influenced and are well established at term birth, neonates with minimal exposure to the complicated postnatal environmental influences are ideal candidates for mining the major patterns of cortical folding. In this paper, we propose a sulcal-pit-based method to discover the major sulcal patterns of cortical folding. In our method, first, the sulcal pattern is characterized by the spatial distribution of sulcal pits, which are the locally deepest points in cortical sulci. Since deep sulcal pits are genetically related, relatively consistent across individuals, and also stable during brain development, they are well suited for representing and characterizing the sulcal patterns. Then, the similarity between the distributions of sulcal pits is measured from the spatial, geometrical, and topological points of view. Next, a comprehensive similarity matrix is constructed for the whole dataset by adaptively fusing these measurements together, thus capturing both their common and complementary information. Finally, leveraging the similarity matrix, a hierarchical affinity propagation algorithm is used to group similar sulcal folding patterns together. The proposed method has been applied to 677 neonatal brains, and revealed multiple distinct and meaningful sulcal patterns in the central sulcus, superior temporal sulcus, and cingulate sulcus.

Local-Global Parcellation of the Human Cerebral Cortex from Intrinsic Functional Connectivity MRI

A central goal in systems neuroscience is the parcellation of the cerebral cortex into discrete neurobiological "atoms". Resting-state functional magnetic resonance imaging (rs-fMRI) offers the possibility of in vivo human cortical parcellation. Almost all previous parcellations relied on 1 of 2 approaches. The local gradient approach detects abrupt transitions in functional connectivity patterns. These transitions potentially reflect cortical areal boundaries defined by histology or visuotopic fMRI. By contrast, the global similarity approach clusters similar functional connectivity patterns regardless of spatial proximity, resulting in parcels with homogeneous (similar) rs-fMRI signals. Here, we propose a gradient-weighted Markov Random Field (gwMRF) model integrating local gradient and global similarity approaches. Using task-fMRI and rs-fMRI across diverse acquisition protocols, we found gwMRF parcellations to be more homogeneous than 4 previously published parcellations. Furthermore, gwMRF parcellations agreed with the boundaries of certain cortical areas defined using histology and visuotopic fMRI. Some parcels captured subareal (somatotopic and visuotopic) features that likely reflect distinct computational units within known cortical areas. These results suggest that gwMRF parcellations reveal neurobiologically meaningful features of brain organization and are potentially useful for future applications requiring dimensionality reduction of voxel-wise fMRI data. Multiresolution parcellations generated from 1489 participants are publicly available (https://github.com/ThomasYeoLab/CBIG/tree/master/stable_projects/brain_parcellation/Schaefer2018_LocalGlobal).

Hierarchical Spherical Deformation for Shape Correspondence

We present novel spherical deformation for a landmark-free shape correspondence in a group-wise manner. In this work, we aim at both addressing template selection bias and minimizing registration distortion in a single framework. The proposed spherical deformation yields a non-rigid deformation field without referring to any particular spherical coordinate system. Specifically, we extend a rigid rotation represented by well-known Euler angles to general non-rigid local deformation via spatial-varying Euler angles. The proposed method employs spherical harmonics interpolation of the local displacements to simultaneously solve rigid and non-rigid local deformation during the optimization. This consequently leads to a continuous, smooth, and hierarchical representation of the deformation field that minimizes registration distortion. In addition, the proposed method is group-wise registration that requires no specific template to establish a shape correspondence. In the experiments, we show an improved shape correspondence with high accuracy in cortical surface parcellation as well as significantly low registration distortion in surface area and edge length compared to the existing registration methods while achieving fast registration in 3 mins per subject.

Parcellating Cerebral Cortex: How Invasive Animal Studies Inform Noninvasive Mapmaking in Humans

The cerebral cortex in mammals contains a mosaic of cortical areas that differ in function, architecture, connectivity, and/or topographic organization. A combination of local connectivity (within-area microcircuitry) and long-distance (between-area) connectivity enables each area to perform a unique set of computations. Some areas also have characteristic within-area mesoscale organization, reflecting specialized representations of distinct types of information. Cortical areas interact with one another to form functional networks that mediate behavior, and each area may be a part of multiple, partially overlapping networks. Given their importance to the understanding of brain organization, mapping cortical areas across species is a major objective of systems neuroscience and has been a century-long challenge. Here, we review recent progress in multi-modal mapping of mouse and nonhuman primate cortex, mainly using invasive experimental methods. These studies also provide a neuroanatomical foundation for mapping human cerebral cortex using noninvasive neuroimaging, including a new map of human cortical areas that we generated using a semiautomated analysis of high-quality, multimodal neuroimaging data. We contrast our semiautomated approach to human multimodal cortical mapping with various extant fully automated human brain parcellations that are based on only a single imaging modality and offer suggestions on how to best advance the noninvasive brain parcellation field. We discuss the limitations as well as the strengths of current noninvasive methods of mapping brain function, architecture, connectivity, and topography and of current approaches to mapping the brain's functional networks.

Exploring 3-hinge gyral folding patterns among HCP Q3 868 human subjects

Comparison and integration of neuroimaging data from different brains and populations are fundamental in neuroscience. Over the past decades, the neuroimaging field has largely depended on image registration to compare and integrate neuroimaging data from individuals in a common reference space, with a basic assumption that the brains are similar. However, the intrinsic neuroanatomical complexity and huge interindividual cortical folding variation remain underexplored. Here we focus on a specific cortical convolution pattern, termed 3-hinge gyral folding, which is the conjunction of gyri from multiple orientations and has unique and consistent anatomically, structurally, and functionally connective patterns across subjects. By developing a novel shape descriptor and a two-stage clustering pipeline, we devise an automatic method to identify 3-hinges in the Human Connectome Project Q3 868 human brains, and further parameterize the complexity of such a pattern and quantify its regularity and variation in terms of 3-hinge number, position, and morphology. Our results not only exhibit the huge interindividual variations, but also reveal regular relationship between gyral hinges and other factors, such as their locations and cortical morphologies. It is found that "line-shape" cortices have relatively more consistent 3-hinge shape pattern distributions, and certain types of 3-hinge patterns favor particular cortical morphologies. In addition, more 3-hinges are found on "line-shape" cortices while their numbers vary more across subjects than those on "non-line-shape" cortices. This study adds new insights into a better understanding of the regularity and variability of human brain anatomy, and their functional aspects.

The impact of traditional neuroimaging methods on the spatial localization of cortical areas

Localizing human brain functions is a long-standing goal in systems neuroscience. Toward this goal, neuroimaging studies have traditionally used volume-based smoothing, registered data to volume-based standard spaces, and reported results relative to volume-based parcellations. A novel 360-area surface-based cortical parcellation was recently generated using multimodal data from the Human Connectome Project, and a volume-based version of this parcellation has frequently been requested for use with traditional volume-based analyses. However, given the major methodological differences between traditional volumetric and Human Connectome Project-style processing, the utility and interpretability of such an altered parcellation must first be established. By starting from automatically generated individual-subject parcellations and processing them with different methodological approaches, we show that traditional processing steps, especially volume-based smoothing and registration, substantially degrade cortical area localization compared with surface-based approaches. We also show that surface-based registration using features closely tied to cortical areas, rather than to folding patterns alone, improves the alignment of areas, and that the benefits of high-resolution acquisitions are largely unexploited by traditional volume-based methods. Quantitatively, we show that the most common version of the traditional approach has spatial localization that is only 35% as good as the best surface-based method as assessed using two objective measures (peak areal probabilities and "captured area fraction" for maximum probability maps). Finally, we demonstrate that substantial challenges exist when attempting to accurately represent volume-based group analysis results on the surface, which has important implications for the interpretability of studies, both past and future, that use these volume-based methods.

Construction of a neonatal cortical surface atlas using Multimodal Surface Matching in the Developing Human Connectome Project

We propose a method for constructing a spatio-temporal cortical surface atlas of neonatal brains aged between 36 and 44 weeks of post-menstrual age (PMA) at the time of scan. The data were acquired as part of the Developing Human Connectome Project (dHCP), and the constructed surface atlases are publicly available. The method is based on a spherical registration approach: Multimodal Surface Matching (MSM), using cortical folding for driving the alignment. Templates have been generated for the anatomical cortical surface and for the cortical feature maps: sulcal depth, curvature, thickness, T1w/T2w myelin maps and cortical regions. To achieve this, cortical surfaces from 270 infants were first projected onto the sphere. Templates were then generated in two stages: first, a reference space was initialised via affine alignment to a group average adult template. Following this, templates were iteratively refined through repeated alignment of individuals to the template space until the variability of the average feature sets converged. Finally, bias towards the adult reference was removed by applying the inverse of the average affine transformations on the template and de-drifting the template. We used temporal adaptive kernel regression to produce age-dependant atlases for 9 weeks (36-44 weeks PMA). The generated templates capture expected patterns of cortical development including an increase in gyrification as well as an increase in thickness and T1w/T2w myelination with increasing age.

CONSTRUCTION OF SPATIOTEMPORAL INFANT CORTICAL SURFACE ATLAS OF RHESUS MACAQUE

As a widely used animal model in MR imaging studies, rhesus macaque helps to better understand both normal and abnormal neural development in the human brain. However, the available adult macaque brain atlases are not well suitable for study of brain development at the early postnatal stage, since this stage undergoes dramatic changes in brain appearances and structures. Building age matched atlases for this critical period is thus highly desirable yet still lacking. In this paper, we construct the first spatiotemporal (4D) cortical surface atlases for rhesus macaques from 2 weeks to 24 months, using 138 longitudinal MRI scans from 32 healthy rhesus monkeys. Specifically, we first perform intra-subject cortical surface registration to obtain within-subject mean cortical surfaces. Then, we perform inter-subject registration of within-subject mean surfaces to obtain unbiased and longitudinally-consistent 4D cortical surface atlases. Based on our 4D rhesus monkey atlases, we further chart the first developmental-trajectories-based parcellation maps using the local surface area and spectral clustering algorithm. Our 4D macaque surface atlases and parcellation maps will greatly facilitate early brain development studies of macaques.

FETAL CORTICAL PARCELLATION BASED ON GROWTH PATTERNS

Dividing the human cerebral cortex into structurally and functionally distinct regions is important in many neuroimaging studies. Although many parcellations have been created for adults, they are not applicable for fetal studies, due to dramatic differences in brain size, shape and folding between adults and fetuses, as well as dynamic growth of fetal brains. To address this issue, we propose a novel method to divide a population of fetal cortical surfaces into distinct regions based on the dynamic growth patterns of cortical properties, which indicate the underlying changes of microstructures. As microstructures determine the molecular organization and functional principles of the cortex, growth patterns enable an accurate definition of distinct regions in development, microstructure, and function. To comprehensively capture the similarities of cortical growth patterns among vertices, we construct two complementary similarity matrices. One is directly based on the growth trajectories of vertices and the other is based on the correlation profiles of vertices' growth trajectories in relation to those of reference points. Then, we nonlinearly fuse these two similarity matrices into a single one, which can better captures both their common and complementary information than by simply averaging them. Finally, based on this fused matrix, we perform spectral clustering to divide fetal cortical surfaces into distinct regions. We have applied our method on 25 normal fetuses from 26 to 29 gestational weeks and generated biologically meaningful parcellations.