Automated sulcal segmentation using watersheds on the cortical surface

Species -shared and -unique gyral peaks on human and macaque brains

Cortical folding is an important feature of primate brains that plays a crucial role in various cognitive and behavioral processes. Extensive research has revealed both similarities and differences in folding morphology and brain function among primates including macaque and human. The folding morphology is the basis of brain function, making cross-species studies on folding morphology important for understanding brain function and species evolution. However, prior studies on cross-species folding morphology mainly focused on partial regions of the cortex instead of the entire brain. Previously, our research defined a whole-brain landmark based on folding morphology: the gyral peak. It was found to exist stably across individuals and ages in both human and macaque brains. Shared and unique gyral peaks in human and macaque are identified in this study, and their similarities and differences in spatial distribution, anatomical morphology, and functional connectivity were also dicussed.

Species -Shared and -Unique Gyral Peaks on Human and Macaque Brains

Cortical folding is an important feature of primate brains that plays a crucial role in various cognitive and behavioral processes. Extensive research has revealed both similarities and differences in folding morphology and brain function among primates including macaque and human. The folding morphology is the basis of brain function, making cross-species studies on folding morphology important for understanding brain function and species evolution. However, prior studies on cross-species folding morphology mainly focused on partial regions of the cortex instead of the entire brain. Previously, we defined a whole-brain landmark based on folding morphology: the gyral peak. It was found to exist stably across individuals and ages in both human and macaque brains. In this study, we identified shared and unique gyral peaks in human and macaque, and investigated the similarities and differences in the spatial distribution, anatomical morphology, and functional connectivity of them.

Genetic Influence on Gyral Peaks

Genetic mechanisms have been hypothesized to be a major determinant in the formation of cortical folding. Although there is an increasing number of studies examining the heritability of cortical folding, most of them focus on sulcal pits rather than gyral peaks. Gyral peaks, which reflect the highest local foci on gyri and are consistent across individuals, remain unstudied in terms of heritability. To address this knowledge gap, we used high-resolution data from the Human Connectome Project (HCP) to perform classical twin analysis and estimate the heritability of gyral peaks across various brain regions. Our results showed that the heritability of gyral peaks was heterogeneous across different cortical regions, but relatively symmetric between hemispheres. We also found that pits and peaks are different in a variety of anatomic and functional measures. Further, we explored the relationship between the levels of heritability and the formation of cortical folding by utilizing the evolutionary timeline of gyrification. Our findings indicate that the heritability estimates of both gyral peaks and sulcal pits decrease linearly with the evolution timeline of gyrification. This suggests that the cortical folds which formed earlier during gyrification are subject to stronger genetic influences than the later ones. Moreover, the pits and peaks coupled by their time of appearance are also positively correlated in respect of their heritability estimates. These results fill the knowledge gap regarding genetic influences on gyral peaks and significantly advance our understanding of how genetic factors shape the formation of cortical folding. The comparison between peaks and pits suggests that peaks are not a simple morphological mirror of pits but could help complete the understanding of folding patterns.

Gyral peaks and patterns in human brains

Cortical folding patterns are related to brain function, cognition, and behavior. Since the relationship has not been fully explained on a coarse scale, many efforts have been devoted to the identification of finer grained cortical landmarks, such as sulcal pits and gyral peaks, which were found to remain invariant across subjects and ages and the invariance may be related to gene mediated proto-map. However, gyral peaks were only investigated on macaque monkey brains, but not on human brains where the investigation is challenged due to high inter-individual variabilities. To this end, in this work, we successfully identified 96 gyral peaks both on the left and right hemispheres of human brains, respectively. These peaks are spatially consistent across individuals. Higher or sharper peaks are more consistent across subjects. Both structural and functional graph metrics of peaks are significantly different from other cortical regions, and more importantly, these nodal graph metrics are anti-correlated with the spatial consistency metrics within peaks. In addition, the distribution of peaks and various cortical anatomical, structural/functional connective features show hemispheric symmetry. These findings provide new clues to understanding the cortical landmarks, as well as their relationship with brain functions, cognition, behavior in both healthy and aberrant brains.

ABLE: Automated Brain Lines Extraction Based on Laplacian Surface Collapse

The archetypical folded shape of the human cortex has been a long-standing topic for neuroscientific research. Nevertheless, the accurate neuroanatomical segmentation of sulci remains a challenge. Part of the problem is the uncertainty of where a sulcus transitions into a gyrus and vice versa. This problem can be avoided by focusing on sulcal fundi and gyral crowns, which represent the topological opposites of cortical folding. We present Automated Brain Lines Extraction (ABLE), a method based on Laplacian surface collapse to reliably segment sulcal fundi and gyral crown lines. ABLE is built to work on standard FreeSurfer outputs and eludes the delineation of anastomotic sulci while maintaining sulcal fundi lines that traverse the regions with the highest depth and curvature. First, it segments the cortex into gyral and sulcal surfaces; then, each surface is spatially filtered. A Laplacian-collapse-based algorithm is applied to obtain a thinned representation of the surfaces. This surface is then used for careful detection of the endpoints of the lines. Finally, sulcal fundi and gyral crown lines are obtained by eroding the surfaces while preserving the connectivity between the endpoints. The method is validated by comparing ABLE with three other sulcal extraction methods using the Human Connectome Project (HCP) test-retest database to assess the reproducibility of the different tools. The results confirm ABLE as a reliable method for obtaining sulcal lines with an accurate representation of the sulcal topology while ignoring anastomotic branches and the overestimation of the sulcal fundi lines. ABLE is publicly available via https://github.com/HGGM-LIM/ABLE .

Ensemble learning for the detection of pli-de-passages in the superior temporal sulcus

The surface of the cerebral cortex is very convoluted, with a large number of folds, the cortical sulci. These folds are extremely variable from one individual to another, and this large variability is a problem for many applications in neuroscience and brain imaging. In particular, sulcal geometry (shape) and sulcal topology (branches, number of pieces) are very variable. "Plis de passages" (PPs) or "annectant gyri" can explain part of the topological variability, namely why sulci have a variable number of pieces across subjects. The concept of PPs was first introduced by Gratiolet (1854) to describe transverse gyri that interconnect both sides of a sulcus, that are frequently buried in the depth of sulci, and that are sometimes apparent on the cortical surface, hence seemingly interrupting the course of sulci and separating them in several pieces. Nevertheless, the difficulty of identifying PPs and the lack of systematic methods to automatically detect them has limited their use. However, based on a recent characterization of PPs in the superior temporal sulcus, we present here a method to automatically detect PPs in the superior temporal sulcus. Local morphology within the sulcus is characterized using cortical surface profiling, and the three-dimensional PP recognition problem is performed as a two-dimensional image classification problem with class-imbalance. This is solved by using an ensemble support vector machine model (EnsSVM) with a rebalancing strategy. Cross validation and quantitative experimental results on an external dataset show the effectiveness and robustness of our approach.

Gyral peaks: Novel gyral landmarks in developing macaque brains

Cerebral cortex development undergoes a variety of processes, which provide valuable information for the study of the developmental mechanism of cortical folding as well as its relationship to brain structural architectures and brain functions. Despite the variability in the anatomy-function relationship on the higher-order cortex, recent studies have succeeded in identifying typical cortical landmarks, such as sulcal pits, that bestow specific functional and cognitive patterns and remain invariant across subjects and ages with their invariance being related to a gene-mediated proto-map. Inspired by the success of these studies, we aim in this study at defining and identifying novel cortical landmarks, termed gyral peaks, which are the local highest foci on gyri. By analyzing data from 156 MRI scans of 32 macaque monkeys with the age spanned from 0 to 36 months, we identified 39 and 37 gyral peaks on the left and right hemispheres, respectively. Our investigation suggests that these gyral peaks are spatially consistent across individuals and relatively stable within the age range of this dataset. Moreover, compared with other gyri, gyral peaks have a thicker cortex, higher mean curvature, more pronounced hub-like features in structural connective networks, and are closer to the borders of structural connectivity-based cortical parcellations. The spatial distribution of gyral peaks was shown to correlate with that of other cortical landmarks, including sulcal pits. These results provide insights into the spatial arrangement and temporal development of gyral peaks as well as their relation to brain structure and function.

Quantification of sulcal emergence timing and its variability in early fetal life: Hemispheric asymmetry and sex difference

Human fetal brains show regionally different temporal patterns of sulcal emergence following a regular timeline, which may be associated with spatiotemporal patterns of gene expression among cortical regions. This study aims to quantify the timing of sulcal emergence and its temporal variability across typically developing fetuses by fitting a logistic curve to presence or absence of sulcus. We found that the sulcal emergence started from the central to the temporo-parieto-occipital lobes and frontal lobe, and the temporal variability of emergence in most of the sulci was similar between 1 and 2 weeks. Small variability (< 1 week) was found in the left central and postcentral sulci and larger variability (>2 weeks) was shown in the bilateral occipitotemporal and left superior temporal sulci. The temporal variability showed a positive correlation with the emergence timing that may be associated with differential contributions between genetic and environmental factors. Our statistical analysis revealed that the right superior temporal sulcus emerged earlier than the left. Female fetuses showed a trend of earlier sulcal emergence in the right superior temporal sulcus, lower temporal variability in the right intraparietal sulcus, and higher variability in the right precentral sulcus compared to male fetuses. Our quantitative and statistical approach quantified the temporal patterns of sulcal emergence in detail that can be a reference for assessing the normality of developing fetal gyrification.

On the definition, construction, and presentation of the human cerebral sulci: A morphology-based approach

Although the term sulcus is known for almost four centuries, its formal, precise, consistent, constructive, and quantitative definition is practically lacking. As the cerebral sulci (and gyri) are vital in cortical anatomy which, in turn, is central in neuroeducation and neuroimage processing, a new sulcus definition is needed. The contribution of this work is threefold, namely to (1) propose a new, morphology-based definition of the term sulcus (and consequently that of gyrus), (2) formulate a constructive method for sulcus calculation, and (3) provide a novel way for the presentation of sulci. The sulcus is defined here as a volumetric region on the cortical mantle between adjacent gyri separated from them at the levels of their gyral white matter crest lines. Consequently, the sulcal inner surface is demarcated by the crest lines of the gyral white matter of its adjacent gyri. Correspondingly, the gyrus is defined as a volumetric region on the cortical mantle separated from its adjacent sulci at the level of its gyral white matter crest line. This volumetric sulcus definition is conceptually simple, anatomy-based, educationally friendly, quantitative, and constructive. Considering the sulcus as a volumetric object is a major differentiation from other works. Based on the introduced sulcus definition, a method for volumetric sulcus construction is proposed in two, conceptually straightforward, steps, namely, sulcal intersection formation followed by its propagation which steps are to be repeated for every sulcal segment. These sulcal and gyral constructions can be automated by applying existing methods and public tools. As a volumetric sulcus forms an imprint into the white matter, this enables prominent sulcus presentation. Since this type of presentation is novel yet unfamiliar to the reader, also a dual surface presentation was proposed here by employing the spatially co-registered white matter and cortical surfaces. The results were presented as dual surface labeled sulci on eight standard orthogonal views, anterior, left lateral, posterior, right lateral, superior, inferior, medial left, and medial right by using a 3D brain atlas. Moreover, additional 108 labeled images were created with sulcus-oriented views for 27 individual left and right sulci forming 54 dual white matter-cortical surface images strengthening in this way the educational value of the proposed approach. These images were included for public use in the NOWinBRAIN neuroimage repository with over 7700 3D images available at www.nowinbrain.org. The results demonstrated the superiority of white matter surface sulci presentation over the standard cortical surface and cross-sectional presentations in terms of sulcal course, continuity, size, shape, width, depth, side branches, and pattern. To my best knowledge, this is the first work ever presenting the labeling of sulci on all cerebral white matter surfaces as well as on dual white matter-cortical surfaces. Additionally to neuroeducation, three other applications of the proposed approach were discussed, sulcal reference maps, sulcus quantification in terms of new parameters introduced here (sulcal volume, wall skewness, and the number of white matter basins), and an atlas-assisted tool for exploration and studying of cerebral sulci and gyri .

Cortical thickness systematically varies with curvature and depth in healthy human brains

Cortical thickness varies throughout the cortex in a systematic way. However, it is challenging to investigate the patterns of cortical thickness due to the intricate geometry of the cortex. The cortex has a folded nature both in radial and tangential directions which forms not only gyri and sulci but also tangential folds and intersections. In this article, cortical curvature and depth are used to characterize the spatial distribution of the cortical thickness with much higher resolution than conventional regional atlases. To do this, a computational pipeline was developed that is capable of calculating a variety of quantitative measures such as surface area, cortical thickness, curvature (mean curvature, Gaussian curvature, shape index, intrinsic curvature index, and folding index), and sulcal depth. By analyzing 501 neurotypical adult human subjects from the ABIDE-I dataset, we show that cortex has a very organized structure and cortical thickness is strongly correlated with local shape. Our results indicate that cortical thickness consistently increases along the gyral-sulcal spectrum from concave to convex shape, encompassing the saddle shape along the way. Additionally, tangential folds influence cortical thickness in a similar way as gyral and sulcal folds; outer folds are consistently thicker than inner.

Labeling lateral prefrontal sulci using spherical data augmentation and context-aware training

The inference of cortical sulcal labels often focuses on deep (primary and secondary) sulcal regions, whereas shallow (tertiary) sulcal regions are largely overlooked in the literature due to the scarcity of manual/well-defined annotations and their large neuroanatomical variability. In this paper, we present an automated framework for regional labeling of both primary/secondary and tertiary sulci of the dorsal portion of lateral prefrontal cortex (LPFC) using spherical convolutional neural networks. We propose two core components that enhance the inference of sulcal labels to overcome such large neuroanatomical variability: (1) surface data augmentation and (2) context-aware training. (1) To take into account neuroanatomical variability, we synthesize training data from the proposed feature space that embeds intermediate deformation trajectories of spherical data in a rigid to non-rigid fashion, which bridges an augmentation gap in conventional rotation data augmentation. (2) Moreover, we design a two-stage training process to improve labeling accuracy of tertiary sulci by informing the biological associations in neuroanatomy: inference of primary/secondary sulci and then their spatial likelihood to guide the definition of tertiary sulci. In the experiments, we evaluate our method on 13 deep and shallow sulci of human LPFC in two independent data sets with different age ranges: pediatric (N=60) and adult (N=36) cohorts. We compare the proposed method with a conventional multi-atlas approach and spherical convolutional neural networks without/with rotation data augmentation. In both cohorts, the proposed data augmentation improves labeling accuracy of deep and shallow sulci over the baselines, and the proposed context-aware training offers further improvement in the labeling of shallow sulci over the proposed data augmentation. We share our tools with the field and discuss applications of our results for understanding neuroanatomical-functional organization of LPFC and the rest of cortex (https://github.com/ilwoolyu/SphericalLabeling).

Fundamental functional differences between gyri and sulci: implications for brain function, cognition, and behavior

Folding of the cerebral cortex is a prominent characteristic of mammalian brains. Alterations or deficits in cortical folding are strongly correlated with abnormal brain function, cognition, and behavior. Therefore, a precise mapping between the anatomy and function of the brain is critical to our understanding of the mechanisms of brain structural architecture in both health and diseases. Gyri and sulci, the standard nomenclature for cortical anatomy, serve as building blocks to make up complex folding patterns, providing a window to decipher cortical anatomy and its relation with brain functions. Huge efforts have been devoted to this research topic from a variety of disciplines including genetics, cell biology, anatomy, neuroimaging, and neurology, as well as involving computational approaches based on machine learning and artificial intelligence algorithms. However, despite increasing progress, our understanding of the functional anatomy of gyro-sulcal patterns is still in its infancy. In this review, we present the current state of this field and provide our perspectives of the methodologies and conclusions concerning functional differentiation between gyri and sulci, as well as the supporting information from genetic, cell biology, and brain structure research. In particular, we will further present a proposed framework for attempting to interpret the dynamic mechanisms of the functional interplay between gyri and sulci. Hopefully, this review will provide a comprehensive summary of anatomo-functional relationships in the cortical gyro-sulcal system together with a consideration of how these contribute to brain function, cognition, and behavior, as well as to mental disorders.

Group-level cortical surface parcellation with sulcal pits labeling

Sulcal pits are the points of maximal depth within the folds of the cortical surface. These shape descriptors give a unique opportunity to access to a rich, fine-scale representation of the geometry and the developmental milestones of the cortical surface. However, using sulcal pits analysis at group level requires new numerical tools to establish inter-subject correspondences. Here, we address this issue by taking advantage of the geometrical information carried by sulcal basins that are the local patches of surfaces surrounding each sulcal pit. Our framework consists in two phases. First, we present a new method to generate a population-specific atlas of this sulcal basins organi- zation as a fold-level parcellation of the cortical surface. Then, we address the labeling of individual sulcal pits and corresponding basins with respect to this atlas. To assess their validity, we applied these methodological advances on two different populations of healthy subjects. The first database of 137 adults allowed us to compare our method to the state-of-the-art and the second database of 209 children, aged between 0 and 18 years, illustrates the adaptability and relevance of our method in the context of pediatric data showing strong variations in cortical volume and folding.

Genetic Influence on the Sulcal Pits: On the Origin of the First Cortical Folds

The influence of genes on cortical structures has been assessed through various phenotypes. The sulcal pits, which are the putative first cortical folds, have for long been assumed to be under tight genetic control, but this was never quantified. We estimated the pit depth heritability in various brain regions using the high quality and large sample size of the Human Connectome Project pedigree cohort. Analysis of additive genetic variance indicated that their heritability ranges between 0.2 and 0.5 and displays a regional genetic control with an overall symmetric pattern between hemispheres. However, a noticeable asymmetry of heritability estimates is observed in the superior temporal sulcus and could thus be related to language lateralization. The heritability range estimated in this study reinforces the idea that cortical shape is determined primarily by nongenetic factors, which is consistent with the important increase of cortical folding from birth to adult life and thus predominantly constrained by environmental factors. Nevertheless, the genetic cues, implicated with various local levels of heritability in the formation of sulcal pits, play a fundamental role in the normal gyral pattern development. Quantifying their influence and identifying the underlying genetic variants would provide insight into neurodevelopmental disorders.

Improving human cortical sulcal curve labeling in large scale cross-sectional MRI using deep neural networks

BACKGROUND

Human cortical primary sulci are relatively stable landmarks and commonly observed across the population. Despite their stability, the primary sulci exhibit phenotypic variability.

NEW METHOD

We propose a fully automated pipeline that integrates both sulcal curve extraction and labeling. In this study, we use a large normal control population (n = 1424) to train neural networks for accurately labeling the primary sulci. Briefly, we use sulcal curve distance map, surface parcellation, mean curvature and spectral features to delineate their sulcal labels. We evaluate the proposed method with 8 primary sulcal curves in the left and right hemispheres compared to an established multi-atlas curve labeling method.

RESULTS

Sulcal labels by the proposed method reasonably well agree with manual labeling. The proposed method outperforms the existing multi-atlas curve labeling method.

COMPARISON WITH EXISTING METHOD

Significantly improved sulcal labeling results are achieved with over 12.5 and 20.6 percent improvement on labeling accuracy in the left and right hemispheres, respectively compared to that of a multi-atlas curve labeling method in eight curves (p≪0.001, two-sample t-test).

CONCLUSION

The proposed method offers a computationally efficient and robust labeling of major sulci.

Automatic labeling of cortical sulci for the human fetal brain based on spatio-temporal information of gyrification

Accurate parcellation and labeling of primary cortical sulci in the human fetal brain is useful for regional analysis of brain development. However, human fetal brains show large spatio-temporal changes in brain size, cortical folding patterns, and relative position/size of cortical regions, making accurate automatic sulcal labeling challenging. Here, we introduce a novel sulcal labeling method for the fetal brain using spatio-temporal gyrification information from multiple fetal templates. First, spatial probability maps of primary sulci are generated on the templates from 23 to 33 gestational weeks and registered to an individual brain. Second, temporal weights, which determine the level of contribution to the labeling for each template, are defined by similarity of gyrification between the individual and the template brains. We combine the weighted sulcal probability maps from the multiple templates and adopt sulcal basin-wise approach to assign sulcal labels to each basin. Our labeling method was applied to 25 fetuses (22.9-29.6 gestational weeks), and the labeling accuracy was compared to manually assigned sulcal labels using the Dice coefficient. Moreover, our multi-template basin-wise approach was compared to a single-template approach, which does not consider the temporal dynamics of gyrification, and a fully-vertex-wise approach. The mean accuracy of our approach was 0.958 across subjects, significantly higher than the accuracies of the other approaches. This novel approach shows highly accurate sulcal labeling and provides a reliable means to examine characteristics of cortical regions in the fetal brain.

The use of a custom-made virtual template for corrective surgeries of asymmetric patients: proof of principle and a multi-center end-user survey

AIM

To evaluate the utility of an individualized template for corrective surgeries for patients suffering from mandibular asymmetry.

MATERIALS AND METHOD

Twenty patients with history of favorable clinical outcome of the correction of their mandibular asymmetry were chosen. CBCTs were taken before and 6 weeks postoperative using NewTom 3G. Each volume is mirrored and registered on the cranial base. Surface models for the mandible and its registered mirror were used to compute a template using deformable fluid registration. Surgery was simulated based of the resulting template. A multi-center survey using "Qualtrics" was conducted to gain clinical feedback of 20 surgeons/orthodontists comparing treatment outcomes.

RESULTS

Twenty-three clinicians participated. More clinicians rated simulated outcome to be "Good," whereas the actual surgical outcomes were rated as "fair" and "poor." This was true for regional appraisal for the chin, Rami, and body of the mandible as well as the overall assessment of the outcome of surgeries. The gains of computer-assisted simulation tend to be greater for difficult cases especially for the body of the mandible, then the chin, and then the Ramus correction.

CONCLUSIONS

This approach has the potential to optimize and increase the predictability of the outcome of craniofacial corrective surgeries for asymmetric patients.

TRACE: A Topological Graph Representation for Automatic Sulcal Curve Extraction

A proper geometric representation of the cortical regions is a fundamental task for cortical shape analysis and landmark extraction. However, a significant challenge has arisen due to the highly variable, convoluted cortical folding patterns. In this paper, we propose a novel topological graph representation for automatic sulcal curve extraction (TRACE). In practice, the reconstructed surface suffers from noise influences introduced during image acquisition/surface reconstruction. In the presence of noise on the surface, TRACE determines stable sulcal fundic regions by employing the line simplification method that prevents the sulcal folding pattern from being significantly smoothed out. The sulcal curves are then traced over the connected graph in the determined regions by the Dijkstra's shortest path algorithm. For validation, we used the state-of-the-art surface reconstruction pipelines on a reproducibility data set. The experimental results showed higher reproducibility and robustness to noise in TRACE than the existing method (Li et al. 2010) with over 20% relative improvement in error for both surface reconstruction pipelines. In addition, the extracted sulcal curves by TRACE were well-aligned with manually delineated primary sulcal curves. We also provided a choice of parameters to control quality of the extracted sulcal curves and showed the influences of the parameter selection on the resulting curves.

Joint representation of consistent structural and functional profiles for identification of common cortical landmarks

In the brain mapping field, there have been significant interests in representation of structural/functional profiles to establish structural/functional landmark correspondences across individuals and populations. For example, from the structural perspective, our previous studies have identified hundreds of consistent DICCCOL (dense individualized and common connectivity-based cortical landmarks) landmarks across individuals and populations, each of which possess consistent DTI-derived fiber connection patterns. From the functional perspective, a large collection of well-characterized HAFNI (holistic atlases of functional networks and interactions) networks based on sparse representation of whole-brain fMRI signals have been identified in our prior studies. However, due to the remarkable variability of structural and functional architectures in the human brain, it is challenging for earlier studies to jointly represent the connectome-scale structural and functional profiles for establishing a common cortical architecture which can comprehensively encode both structural and functional characteristics across individuals. To address this challenge, we propose an effective computational framework to jointly represent the structural and functional profiles for identification of consistent and common cortical landmarks with both structural and functional correspondences across different brains based on DTI and fMRI data. Experimental results demonstrate that 55 structurally and functionally common cortical landmarks can be successfully identified.

Mindboggling morphometry of human brains

Mindboggle (http://mindboggle.info) is an open source brain morphometry platform that takes in preprocessed T1-weighted MRI data and outputs volume, surface, and tabular data containing label, feature, and shape information for further analysis. In this article, we document the software and demonstrate its use in studies of shape variation in healthy and diseased humans. The number of different shape measures and the size of the populations make this the largest and most detailed shape analysis of human brains ever conducted. Brain image morphometry shows great potential for providing much-needed biological markers for diagnosing, tracking, and predicting progression of mental health disorders. Very few software algorithms provide more than measures of volume and cortical thickness, while more subtle shape measures may provide more sensitive and specific biomarkers. Mindboggle computes a variety of (primarily surface-based) shapes: area, volume, thickness, curvature, depth, Laplace-Beltrami spectra, Zernike moments, etc. We evaluate Mindboggle's algorithms using the largest set of manually labeled, publicly available brain images in the world and compare them against state-of-the-art algorithms where they exist. All data, code, and results of these evaluations are publicly available.

A practical guide for the identification of major sulcogyral structures of the human cortex

The precise sulcogyral localization of cortical lesions is mandatory to improve communication between practitioners and to predict and prevent post-operative deficits. This process, which assumes a good knowledge of the cortex anatomy and a systematic analysis of images, is, nevertheless, sometimes neglected in the neurological and neurosurgical training. This didactic paper proposes a brief overview of the sulcogyral anatomy, using conventional MR-slices, and also reconstructions of the cortical surface after a more or less extended inflation process. This method simplifies the cortical anatomy by removing part of the cortical complexity induced by the folding process, and makes it more understandable. We then reviewed several methods for localizing cortical structures, and proposed a three-step identification: after localizing the lateral, medial or ventro-basal aspect of the hemisphere (step 1), the main interlobar sulci were located to limit the lobes (step 2). Finally, intralobar sulci and gyri were identified (step 3) thanks to the same set of rules. This paper does not propose any new identification method but should be regarded as a set of practical guidelines, useful in daily clinical practice, for detecting the main sulci and gyri of the human cortex.

Group-wise consistent cortical parcellation based on connectional profiles

For decades, seeking common, consistent and corresponding anatomical/functional regions across individual brains via cortical parcellation has been a longstanding challenging problem. In our opinion, two major barriers to solve this problem are determining meaningful cortical boundaries that segregate homogeneous regions and establishing correspondences among parcellated regions of multiple brains. To establish a corresponding system across subjects, we recently developed the Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOL) system which possesses group-wise consistent white matter fiber connection patterns across individuals and thus provides a dense map of corresponding cortical landmarks. Despite this useful property, however, the DICCCOL landmarks are still far from covering the whole cerebral cortex and do not provide clear structural/functional cortical boundaries. To address the above limitation while leveraging the advantage of DICCCOL, in this paper, we present a novel approach for group-wise consistent parcellation of the cerebral cortex via a hierarchical scheme. In each hierarchical level, DICCCOLs are used as corresponding samples to automatically determine the cluster number so that other cortical surface vertices are iteratively classified into corresponding clusters across subjects within a group-wise classification framework. Experimental results showed that this approach can achieve consistent fine-granularity cortical parcellation with intrinsically-established structural correspondences across individual brains. Besides, comparisons with resting-state and task-based fMRI datasets demonstrated that the group-wise parcellation boundaries segregate functionally homogeneous areas.

Anatomy-guided Dense Individualized and Common Connectivity-based Cortical Landmarks (A-DICCCOL)

Establishment of structural and functional correspondences of human brain that can be quantitatively encoded and reproduced across different subjects and populations is one of the key issues in brain mapping. As an attempt to address this challenge, our recently developed Dense Individualized and Common Connectivity-based Cortical Landmarks (DICCCOL) system reported 358 connectional landmarks, each of which possesses consistent DTI-derived white matter fiber connection pattern that is reproducible in over 240 healthy brains. However, the DICCCOL system can be substantially improved by integrating anatomical and morphological information during landmark initialization and optimization procedures. In this paper, we present a novel anatomy-guided landmark discovery framework that defines and optimizes landmarks via integrating rich anatomical, morphological, and fiber connectional information for landmark initialization, group-wise optimization and prediction, which are formulated and solved as an energy minimization problem. The framework finally determined 555 consistent connectional landmarks. Validation studies demonstrated that the 555 landmarks are reproducible, predictable, and exhibited reasonably accurate anatomical, connectional, and functional correspondences across individuals and populations and thus are named anatomy-guided DICCCOL or A-DICCCOL. This A-DICCCOL system represents common cortical architectures with anatomical, connectional, and functional correspondences across different subjects and would potentially provide opportunities for various applications in brain science.

AUTOMATIC PARCELLATION OF CORTICAL SURFACES USING RANDOM FORESTS

Automatic and accurate parcellation of cortical surfaces into anatomically and functionally meaningful regions is of fundamental importance in brain mapping. In this paper, we propose a new method leveraging random forests and graph cuts methods to parcellate cortical surfaces into a set of gyral-based regions, using multiple surface atlases with manual labels by experts. Specifically, our method first takes advantage of random forests and auto-context methods to learn the optimal utilization of cortical features for rough parcellation and then the graph cuts method to further refine the parcellation for improved accuracy and spatial consistency. Particularly, to capitalize on random forests, we propose a novel definition of Haar-like features on cortical surfaces based on spherical mapping. The proposed method has been validated on cortical surfaces from 39 adult brain MR images, each with 35 regions manually labeled by a neuroanatomist, achieving the average Dice ratio of 0.902, higher than the-state-of-art methods.

Simultaneous and consistent labeling of longitudinal dynamic developing cortical surfaces in infants

The human cerebral cortex develops extremely dynamically in the first 2years of life. Accurate and consistent parcellation of longitudinal dynamic cortical surfaces during this critical stage is essential to understand the early development of cortical structure and function in both normal and high-risk infant brains. However, directly applying the existing methods developed for the cross-sectional studies often generates longitudinally-inconsistent results, thus leading to inaccurate measurements of the cortex development. In this paper, we propose a new method for accurate, consistent, and simultaneous labeling of longitudinal cortical surfaces in the serial infant brain MR images. The proposed method is explicitly formulated as a minimization problem with an energy function that includes a data fitting term, a spatial smoothness term, and a temporal consistency term. Specifically, inspired by multi-atlas based label fusion, the data fitting term is designed to integrate the contributions from multi-atlas surfaces adaptively, according to the similarities of their local cortical folding with that of the subject cortical surface. The spatial smoothness term is then designed to adaptively encourage label smoothness based on the local cortical folding geometries, i.e., allowing label discontinuity at sulcal bottoms (which often are the boundaries of cytoarchitecturally and functionally distinct regions). The temporal consistency term is to adaptively encourage the label consistency among the temporally-corresponding vertices, based on their similarity of local cortical folding. Finally, the entire energy function is efficiently minimized by a graph cuts method. The proposed method has been applied to the parcellation of longitudinal cortical surfaces of 13 healthy infants, each with 6 serial MRI scans acquired at 0, 3, 6, 9, 12 and 18months of age. Qualitative and quantitative evaluations demonstrated both accuracy and longitudinal consistency of the proposed method. By using our method, for the first time, we reveal several hitherto unseen properties of the dynamic and regionally heterogeneous development of the cortical surface area in the first 18months of life.

Local analysis of human cortex in MRI brain volume

This paper describes a method for subcortical identification and labeling of 3D medical MRI images. Indeed, the ability to identify similarities between the most characteristic subcortical structures such as sulci and gyri is helpful for human brain mapping studies in general and medical diagnosis in particular. However, these structures vary greatly from one individual to another because they have different geometric properties. For this purpose, we have developed an efficient tool that allows a user to start with brain imaging, to segment the border gray/white matter, to simplify the obtained cortex surface, and to describe this shape locally in order to identify homogeneous features. In this paper, a segmentation procedure using geometric curvature properties that provide an efficient discrimination for local shape is implemented on the brain cortical surface. Experimental results demonstrate the effectiveness and the validity of our approach.

A functional model of cortical gyri and sulci

Diffusion tensor imaging (DTI) and high angular resolution diffusion imaging (HARDI) have been broadly used in the neuroimaging field to investigate the macro-scale fiber connection patterns in the cerebral cortex. Our recent analyses of DTI and HARDI data demonstrated that gyri are connected by denser, streamlined fibers than sulci are. Inspired by this finding and motivated by the fact that DTI-derived fibers provide the structural substrates for functional connectivity, we hypothesize that gyri are global functional connection centers and sulci are local functional units. To test this functional model of gyri and sulci, we examined the structural and functional connectivity among the landmarks on the selected gyral/sulcal areas in the frontal/parietal lobe and in the whole cerebral cortex via multimodal DTI and resting state fMRI (R-fMRI) datasets. Our results demonstrate that functional connectivity is strong among gyri, weak among sulci, and moderate between gyri and sulci. These results suggest that gyri are functional connection centers that exchange information among remote structurally connected gyri and neighboring sulci, while sulci communicate directly with their neighboring gyri and indirectly with other cortical regions through gyri. This functional model of gyri and sulci has been supported by a series of experiments, and provides novel perspectives on the functional architecture of the cerebral cortex.

Prediction for human intelligence using morphometric characteristics of cortical surface: partial least square analysis

A number of imaging studies have reported neuroanatomical correlates of human intelligence with various morphological characteristics of the cerebral cortex. However, it is not yet clear whether these morphological properties of the cerebral cortex account for human intelligence. We assumed that the complex structure of the cerebral cortex could be explained effectively considering cortical thickness, surface area, sulcal depth and absolute mean curvature together. In 78 young healthy adults (age range: 17-27, male/female: 39/39), we used the full-scale intelligence quotient (FSIQ) and the cortical measurements calculated in native space from each subject to determine how much combining various cortical measures explained human intelligence. Since each cortical measure is thought to be not independent but highly inter-related, we applied partial least square (PLS) regression, which is one of the most promising multivariate analysis approaches, to overcome multicollinearity among cortical measures. Our results showed that 30% of FSIQ was explained by the first latent variable extracted from PLS regression analysis. Although it is difficult to relate the first derived latent variable with specific anatomy, we found that cortical thickness measures had a substantial impact on the PLS model supporting the most significant factor accounting for FSIQ. Our results presented here strongly suggest that the new predictor combining different morphometric properties of complex cortical structure is well suited for predicting human intelligence.

Automated sulcal depth measurement on cortical surface reflecting geometrical properties of sulci

Sulcal depth that is one of the quantitative measures of cerebral cortex has been widely used as an important marker for brain morphological studies. Several studies have employed Euclidean (EUD) or geodesic (GED) algorithms to measure sulcal depth, which have limitations that ignore sulcal geometry in highly convoluted regions and result in under or overestimated depth. In this study, we proposed an automated measurement for sulcal depth on cortical surface reflecting geometrical properties of sulci, which named the adaptive distance transform (ADT). We first defined the volume region of cerebrospinal fluid between the 3D convex hull and the cortical surface, and constructed local coordinates for that restricted region. Dijkstra's algorithm was then used to compute the shortest paths from the convex hull to the vertices of the cortical surface based on the local coordinates, which may be the most proper approach for defining sulcal depth. We applied our algorithm to both a clinical dataset including patients with mild Alzheimer's disease (AD) and 25 normal controls and a simulated dataset whose shape was similar to a single sulcus. The mean sulcal depth in the mild AD group was significantly lower than controls (p = 0.007, normal [mean±SD]: 7.29±0.23 mm, AD: 7.11±0.29) and the area under the receiver operating characteristic curve was relatively high, showing the value of 0.818. Results from clinical dataset that were consistent with former studies using EUD or GED demonstrated that ADT was sensitive to cortical atrophy. The robustness against inter-individual variability of ADT was highlighted through simulation dataset. ADT showed a low and constant normalized difference between the depth of the simulated data and the calculated depth, whereas EUD and GED had high and variable differences. We suggest that ADT is more robust than EUD or GED and might be a useful alternative algorithm for measuring sulcal depth.

Mapping longitudinal hemispheric structural asymmetries of the human cerebral cortex from birth to 2 years of age

Mapping cortical hemispheric asymmetries in infants would increase our understanding of the origins and developmental trajectories of hemispheric asymmetries. We analyze longitudinal cortical hemispheric asymmetries in 73 healthy subjects at birth, 1, and 2 years of age using surface-based morphometry of magnetic resonance images with a specific focus on the vertex position, sulcal depth, mean curvature, and local surface area. Prominent cortical asymmetries are found around the peri-Sylvian region and superior temporal sulcus (STS) at birth that evolve modestly from birth to 2 years of age. Sexual dimorphisms of cortical asymmetries are present at birth, with males having the larger magnitudes and sizes of the clusters of asymmetries than females that persist from birth to 2 years of age. The left supramarginal gyrus (SMG) is significantly posterior to the right SMG, and the maximum position difference increases from 10.2 mm for males (6.9 mm for females) at birth to 12.0 mm for males (8.4 mm for females) by 2 years of age. The right STS and parieto-occipital sulcus are significantly larger and deeper than those in the left hemisphere, and the left planum temporale is significantly larger and deeper than that in the right hemisphere at all 3 ages. Our results indicate that early hemispheric structural asymmetries are inherent and gender related.

Automatic Sulcal Curve Extraction with MRF Based Shape Prior

Extracting and labeling sulcal curves on the human cerebral cortex is important for many neuroscience studies, however manually annotating the sulcal curves is a time-consuming task. In this paper, we present an automatic sulcal curve extraction method by registering a set of dense landmark points representing the sulcal curves to the subject cortical surface. A Markov random field is used to model the prior distribution of these landmark points, with short edges in the graph preserving the curve structure and long edges modeling the global context of the curves. Our approach is validated using a leave-one-out strategy of training and evaluation on fifteen cortical surfaces, and a quantitative error analysis on the extracted major sulcal curves.

Simultaneous Cortical Surface Labeling and Sulcal Curve Extraction

Automatic labeling of the gyri and sulci on the cortical surface is important for studying cortical morphology and brain functions within populations. A method to simultaneously label gyral regions and extract sulcal curves is proposed. Assuming that the gyral regions parcellate the whole cortical surface into contiguous regions with certain fixed topology, the proposed method labels the subject cortical surface by deformably registering a network of curves that form the boundary of gyral regions to the subject cortical surface. In the registration process, the curves are encouraged to follow the fine details of the sulcal geometry and to observe the shape statistics learned from training data. Using the framework of probabilistic point set registration methods, the proposed algorithm finds the sulcal curve network that maximizes the posterior probability by Expectation-Maximization (EM). The automatic labeling method was evaluated on 15 cortical surfaces using a leave-one-out strategy. Quantitative error analysis is carried out on both labeled regions and major sulcal curves.

3D Rigid Registration of Intraoperative Ultrasound and Preoperative MR Brain Images Based on Hyperechogenic Structures

The registration of intraoperative ultrasound (US) images with preoperative magnetic resonance (MR) images is a challenging problem due to the difference of information contained in each image modality. To overcome this difficulty, we introduce a new probabilistic function based on the matching of cerebral hyperechogenic structures. In brain imaging, these structures are the liquid interfaces such as the cerebral falx and the sulci, and the lesions when the corresponding tissue is hyperechogenic. The registration procedure is achieved by maximizing the joint probability for a voxel to be included in hyperechogenic structures in both modalities. Experiments were carried out on real datasets acquired during neurosurgical procedures. The proposed validation framework is based on (i) visual assessment, (ii) manual expert estimations , and (iii) a robustness study. Results show that the proposed method (i) is visually efficient, (ii) produces no statistically different registration accuracy compared to manual-based expert registration, and (iii) converges robustly. Finally, the computation time required by our method is compatible with intraoperative use.

Automated extraction of nested sulcus features from human brain MRI data

Extracting objects related to a fold in the cerebral cortex ("sulcus features") from human brain magnetic resonance imaging data has applications in morphometry, landmark-based registration, and anatomical labeling. In prior work, sulcus features such as surfaces, fundi and pits have been extracted separately. Here we define and extract nested sulcus features in a hierarchical manner from a cortical surface mesh having curvature or depth values. Our experimental results show that the nested features are comparable to features extracted separately using other methods, and that they are consistent across subjects and with manual label boundaries. Our open source feature extraction software will be made freely available as part of the Mindboggle project (http://www.mindboggle.info).

Consistent sulcal parcellation of longitudinal cortical surfaces

Automated accurate and consistent sulcal parcellation of longitudinal cortical surfaces is of great importance in studying longitudinal morphological and functional changes of human brains, since longitudinal cortical changes are normally very subtle, especially in aging brains. However, applying the existing methods (which were typically developed for cortical sulcal parcellation of a single cortical surface) independently to longitudinal cortical surfaces might generate longitudinally-inconsistent results. To overcome this limitation, this paper presents a novel energy function based method for accurate and consistent sulcal parcellation of longitudinal cortical surfaces. Specifically, both spatial and temporal smoothness are imposed in the energy function to obtain consistent longitudinal sulcal parcellation results. The energy function is efficiently minimized by a graph cut method. The proposed method has been successfully applied to sulcal parcellation of both real and simulated longitudinal inner cortical surfaces of human brain MR images. Both qualitative and quantitative evaluation results demonstrate the validity of the proposed method.

An improved representation of regional boundaries on parcellated morphological surfaces

Establishing the correspondences of brain anatomy with function is important for understanding neuroimaging data. Regional delineations on morphological surfaces define anatomical landmarks and help to visualize and interpret both functional data and morphological measures mapped onto the cortical surface. We present an efficient algorithm that accurately delineates the morphological surface of the cerebral cortex in real time during generation of the surface using information from parcellated 3D data. With this accurate region delineation, we then develop methods for boundary-preserved simplification and smoothing, as well as procedures for the automated correction of small, misclassified regions to improve the quality of the delineated surface. We demonstrate that our delineation algorithm, together with a new method for double-snapshot visualization of cortical regions, can be used to establish a clear correspondence between brain anatomy and mapped quantities, such as morphological measures, across groups of subjects.

Automatic extraction of sulcal lines on the cortical surface using shortest path probability maps

This paper describes an automatic procedure for extracting sulcal lines from cortical surface meshes of the human brain, which will serve as a tool for landmark extraction as well as for investigating the morphometry of sulci. The procedure consists in a sequence of steps, including sulcal basin segmentation based on local curvature information, estimating a bundle of depth-constrained geodesic paths and determining a robust probability map of sulcal lines crossing. In this experiment, we present quantitative validations on two main sulci to observe the agreement of our method with manually traced curves.

A framework for using diffusion weighted imaging to improve cortical parcellation

Cortical parcellation refers to anatomical labelling of every point in the cortex. An accurate parcellation is useful in many analysis techniques including the study of regional changes in cortical thickness or volume in ageing and neurodegeneration. Parcellation is also key to anatomic apportioning of functional imaging changes. We present preliminary work on a novel algorithm that takes an entire cortical parcellation and iteratively updates it to better match connectivity information derived from diffusion weighted imaging. We demonstrate the algorithm on a cohort of 17 healthy controls. Initial results show the algorithm recovering artificially induced mis-registrations of the parcellation and also converging to a group-wise average. This work introduces a framework to investigate the relationship between structure and function, with no a-priori knowledge of specific regions of interest.

Volumetric topological analysis: a novel approach for trabecular bone classification on the continuum between plates and rods

Trabecular bone (TB) is a complex quasi-random network of interconnected plates and rods. TB constantly remodels to adapt to the stresses to which it is subjected (Wolff's Law). In osteoporosis, this dynamic equilibrium between bone formation and resorption is perturbed, leading to bone loss and structural deterioration. Both bone loss and structural deterioration increase fracture risk. Bone's mechanical behavior can only be partially explained by variations in bone mineral density, which led to the notion of bone structural quality. Previously, we developed digital topological analysis (DTA) which classifies plates, rods, profiles, edges, and junctions in a TB skeletal representation. Although the method has become quite popular, a major limitation of DTA is that it provides only hard classifications of different topological entities, failing to distinguish between narrow and wide plates. Here, we present a new method called volumetric topological analysis (VTA) for regional quantification of TB topology. At each TB location, the method uniquely classifies its topology on the continuum between perfect plates and perfect rods, facilitating early detections of TB alterations from plates to rods according to the known etiology of osteoporotic bone loss. Several new ideas, including manifold distance transform, manifold scale, and feature propagation have been introduced here and combined with existing DTA and distance transform methods, leading to the new VTA technology. This method has been applied to multidetector computed tomography (CT) and micro-computed tomography ( μCT) images of four cadaveric distal tibia and five distal radius specimens. Both intra- and inter-modality reproducibility of the method has been examined using repeat CT and μCT scans of distal tibia specimens. Also, the method's ability to predict experimental biomechanical properties of TB via CT imaging under in vivo conditions has been quantitatively examined and the results found are very encouraging.

Automatic parcellation of human cortical gyri and sulci using standard anatomical nomenclature

Precise localization of sulco-gyral structures of the human cerebral cortex is important for the interpretation of morpho-functional data, but requires anatomical expertise and is time consuming because of the brain's geometric complexity. Software developed to automatically identify sulco-gyral structures has improved substantially as a result of techniques providing topologically correct reconstructions permitting inflated views of the human brain. Here we describe a complete parcellation of the cortical surface using standard internationally accepted nomenclature and criteria. This parcellation is available in the FreeSurfer package. First, a computer-assisted hand parcellation classified each vertex as sulcal or gyral, and these were then subparcellated into 74 labels per hemisphere. Twelve datasets were used to develop rules and algorithms (reported here) that produced labels consistent with anatomical rules as well as automated computational parcellation. The final parcellation was used to build an atlas for automatically labeling the whole cerebral cortex. This atlas was used to label an additional 12 datasets, which were found to have good concordance with manual labels. This paper presents a precisely defined method for automatically labeling the cortical surface in standard terminology.

A computational model of cerebral cortex folding

The geometric complexity and variability of the human cerebral cortex have long intrigued the scientific community. As a result, quantitative description of cortical folding patterns and the understanding of underlying folding mechanisms have emerged as important research goals. This paper presents a computational 3D geometric model of cerebral cortex folding initialized by MRI data of a human fetal brain and deformed under the governance of a partial differential equation modeling cortical growth. By applying different simulation parameters, our model is able to generate folding convolutions and shape dynamics of the cerebral cortex. The simulations of this 3D geometric model provide computational experimental support to the following hypotheses: (1) Mechanical constraints of the skull regulate the cortical folding process. (2) The cortical folding pattern is dependent on the global cell growth rate of the whole cortex. (3) The cortical folding pattern is dependent on relative rates of cell growth in different cortical areas. (4) The cortical folding pattern is dependent on the initial geometry of the cortex.