TRACE: A Topological Graph Representation for Automatic Sulcal Curve Extraction

Leveraging Input-Level Feature Deformation With Guided-Attention for Sulcal Labeling

The identification of cortical sulci is key for understanding functional and structural development of the cortex. While large, consistent sulci (or primary/secondary sulci) receive significant attention in most studies, the exploration of smaller and more variable sulci (or putative tertiary sulci) remains relatively under-investigated. Despite its importance, automatic labeling of cortical sulci is challenging due to (1) the presence of substantial anatomical variability, (2) the relatively small size of the regions of interest (ROIs) compared to unlabeled regions, and (3) the scarcity of annotated labels. In this paper, we propose a novel end-to-end learning framework using a spherical convolutional neural network (CNN). Specifically, the proposed method learns to effectively warp geometric features in a direction that facilitates the labeling of sulci while mitigating the impact of anatomical variability. Moreover, we introduce a guided-attention mechanism that takes into account the extent of deformation induced by the learned warping. This extracts discriminative features that emphasize sulcal ROIs, while suppressing irrelevant information of unlabeled regions. In the experiments, we evaluate the proposed method on 8 sulci of the posterior medial cortex. Our method outperforms existing methods particularly in the putative tertiary sulci. The code is publicly available at https://github.com/Shape-Lab/DSPHARM-Net.

An Organ-Aware Diagnosis Framework for Radiology Report Generation

Radiology report generation (RRG) is crucial to save the valuable time of radiologists in drafting the report, therefore increasing their work efficiency. Compared to typical methods that directly transfer image captioning technologies to RRG, our approach incorporates organ-wise priors into the report generation. Specifically, in this paper, we propose Organ-aware Diagnosis (OaD) to generate diagnostic reports containing descriptions of each physiological organ. During training, we first develop a task distillation (TD) module to extract organ-level descriptions from reports. We then introduce an organ-aware report generation module that, for one thing, provides a specific description for each organ, and for another, simulates clinical situations to provide short descriptions for normal cases. Furthermore, we design an auto-balance mask loss to ensure balanced training for normal/abnormal descriptions and various organs simultaneously. Being intuitively reasonable and practically simple, our OaD outperforms SOTA alternatives by large margins on commonly used IU-Xray and MIMIC-CXR datasets, as evidenced by a 3.4% BLEU-1 improvement on MIMIC-CXR and 2.0% BLEU-2 improvement on IU-Xray.

Comprehensive shape analysis of the cortex in Huntington's disease

The striatum has traditionally been the focus of Huntington's disease research due to the primary insult to this region and its central role in motor symptoms. Beyond the striatum, evidence of cortical alterations caused by Huntington's disease has surfaced. However, findings are not coherent between studies which have used cortical thickness for Huntington's disease since it is the well-established cortical metric of interest in other diseases. In this study, we propose a more comprehensive approach to cortical morphology in Huntington's disease using cortical thickness, sulcal depth, and local gyrification index. Our results show consistency with prior findings in cortical thickness, including its limitations. Our comparison between cortical thickness and local gyrification index underscores the complementary nature of these two measures-cortical thickness detects changes in the sensorimotor and posterior areas while local gyrification index identifies insular differences. Since local gyrification index and cortical thickness measures detect changes in different regions, the two used in tandem could provide a clinically relevant measure of disease progression. Our findings suggest that differences in insular regions may correspond to earlier neurodegeneration and may provide a complementary cortical measure for detection of subtle early cortical changes due to Huntington's disease.

Hierarchical particle optimization for cortical shape correspondence in temporal lobe resection

BACKGROUND

Anterior temporal lobe resection is an effective treatment for temporal lobe epilepsy. The post-surgical structural changes could influence the follow-up treatment. Capturing post-surgical changes necessitates a well-established cortical shape correspondence between pre- and post-surgical surfaces. Yet, most cortical surface registration methods are designed for normal neuroanatomy. Surgical changes can introduce wide ranging artifacts in correspondence, for which conventional surface registration methods may not work as intended.

METHODS

In this paper, we propose a novel particle method for one-to-one dense shape correspondence between pre- and post-surgical surfaces with temporal lobe resection. The proposed method can handle partial structural abnormality involving non-rigid changes. Unlike existing particle methods using implicit particle adjacency, we consider explicit particle adjacency to establish a smooth correspondence. Moreover, we propose hierarchical optimization of particles rather than full optimization of all particles at once to avoid trappings of locally optimal particle update.

RESULTS

We evaluate the proposed method on 25 pairs of T1-MRI with pre- and post-simulated resection on the anterior temporal lobe and 25 pairs of patients with actual resection. We show improved accuracy over several cortical regions in terms of ROI boundary Hausdorff distance with 4.29 mm and Dice similarity coefficients with average value 0.841, compared to existing surface registration methods on simulated data. In 25 patients with actual resection of the anterior temporal lobe, our method shows an improved shape correspondence in qualitative and quantitative evaluation on parcellation-off ratio with average value 0.061 and cortical thickness changes. We also show better smoothness of the correspondence without self-intersection, compared with point-wise matching methods which show various degrees of self-intersection.

CONCLUSION

The proposed method establishes a promising one-to-one dense shape correspondence for temporal lobe resection. The resulting correspondence is smooth without self-intersection. The proposed hierarchical optimization strategy could accelerate optimization and improve the optimization accuracy. According to the results on the paired surfaces with temporal lobe resection, the proposed method outperforms the compared methods and is more reliable to capture cortical thickness changes.

ABLE: Automated Brain Lines Extraction Based on Laplacian Surface Collapse

The archetypical folded shape of the human cortex has been a long-standing topic for neuroscientific research. Nevertheless, the accurate neuroanatomical segmentation of sulci remains a challenge. Part of the problem is the uncertainty of where a sulcus transitions into a gyrus and vice versa. This problem can be avoided by focusing on sulcal fundi and gyral crowns, which represent the topological opposites of cortical folding. We present Automated Brain Lines Extraction (ABLE), a method based on Laplacian surface collapse to reliably segment sulcal fundi and gyral crown lines. ABLE is built to work on standard FreeSurfer outputs and eludes the delineation of anastomotic sulci while maintaining sulcal fundi lines that traverse the regions with the highest depth and curvature. First, it segments the cortex into gyral and sulcal surfaces; then, each surface is spatially filtered. A Laplacian-collapse-based algorithm is applied to obtain a thinned representation of the surfaces. This surface is then used for careful detection of the endpoints of the lines. Finally, sulcal fundi and gyral crown lines are obtained by eroding the surfaces while preserving the connectivity between the endpoints. The method is validated by comparing ABLE with three other sulcal extraction methods using the Human Connectome Project (HCP) test-retest database to assess the reproducibility of the different tools. The results confirm ABLE as a reliable method for obtaining sulcal lines with an accurate representation of the sulcal topology while ignoring anastomotic branches and the overestimation of the sulcal fundi lines. ABLE is publicly available via https://github.com/HGGM-LIM/ABLE .

Multimodal neuroimaging in pediatric type 1 diabetes: a pilot multisite feasibility study of acquisition quality, motion, and variability

Type 1 diabetes (T1D) affects over 200,000 children and is associated with an increased risk of cognitive dysfunction. Prior imaging studies suggest the neurological changes underlying this risk are multifactorial, including macrostructural, microstructural, and inflammatory changes. However, these studies have yet to be integrated, limiting investigation into how these phenomena interact. To better understand these complex mechanisms of brain injury, a well-powered, prospective, multisite, and multimodal neuroimaging study is needed. We take the first step in accomplishing this with a preliminary characterization of multisite, multimodal MRI quality, motion, and variability in pediatric T1D. We acquire structural T1 weighted (T1w) MRI, diffusion tensor MRI (DTI), functional MRI (fMRI), and magnetic resonance spectroscopy (MRS) of 5-7 participants from each of two sites. First, we assess the contrast-to-noise ratio of the T1w MRI and find no differences between sites. Second, we characterize intervolume motion in DTI and fMRI and find it to be on the subvoxel level. Third, we investigate variability in regional gray matter volumes and local gyrification indices, bundle-wise DTI microstructural measures, and N-acetylaspartate to creatine ratios. We find the T1-based measures to be comparable between sites before harmonization and the DTI and MRS-based measures to be comparable after. We find a 5-15% coefficient of variation for most measures, suggesting ~150-200 participants per group on average are needed to detect a 5% difference across these modalities at 0.9 power. We conclude that multisite, multimodal neuroimaging of pediatric T1D is feasible with low motion artifact after harmonization of DTI and MRS.

Cortical Morphology in Autism: Findings from a Cortical Shape-Adaptive Approach to Local Gyrification Indexing

It has been challenging to elucidate the differences in brain structure that underlie behavioral features of autism. Prior studies have begun to identify patterns of changes in autism across multiple structural indices, including cortical thickness, local gyrification, and sulcal depth. However, common approaches to local gyrification indexing used in prior studies have been limited by low spatial resolution relative to functional brain topography. In this study, we analyze the aforementioned structural indices, utilizing a new method of local gyrification indexing that quantifies this index adaptively in relation to specific sulci/gyri, improving interpretation with respect to functional organization. Our sample included n = 115 autistic and n = 254 neurotypical participants aged 5-54, and we investigated structural patterns by group, age, and autism-related behaviors. Differing structural patterns by group emerged in many regions, with age moderating group differences particularly in frontal and limbic regions. There were also several regions, particularly in sensory areas, in which one or more of the structural indices of interest either positively or negatively covaried with autism-related behaviors. Given the advantages of this approach, future studies may benefit from its application in hypothesis-driven examinations of specific brain regions and/or longitudinal studies to assess brain development in autism.

Labeling lateral prefrontal sulci using spherical data augmentation and context-aware training

The inference of cortical sulcal labels often focuses on deep (primary and secondary) sulcal regions, whereas shallow (tertiary) sulcal regions are largely overlooked in the literature due to the scarcity of manual/well-defined annotations and their large neuroanatomical variability. In this paper, we present an automated framework for regional labeling of both primary/secondary and tertiary sulci of the dorsal portion of lateral prefrontal cortex (LPFC) using spherical convolutional neural networks. We propose two core components that enhance the inference of sulcal labels to overcome such large neuroanatomical variability: (1) surface data augmentation and (2) context-aware training. (1) To take into account neuroanatomical variability, we synthesize training data from the proposed feature space that embeds intermediate deformation trajectories of spherical data in a rigid to non-rigid fashion, which bridges an augmentation gap in conventional rotation data augmentation. (2) Moreover, we design a two-stage training process to improve labeling accuracy of tertiary sulci by informing the biological associations in neuroanatomy: inference of primary/secondary sulci and then their spatial likelihood to guide the definition of tertiary sulci. In the experiments, we evaluate our method on 13 deep and shallow sulci of human LPFC in two independent data sets with different age ranges: pediatric (N=60) and adult (N=36) cohorts. We compare the proposed method with a conventional multi-atlas approach and spherical convolutional neural networks without/with rotation data augmentation. In both cohorts, the proposed data augmentation improves labeling accuracy of deep and shallow sulci over the baselines, and the proposed context-aware training offers further improvement in the labeling of shallow sulci over the proposed data augmentation. We share our tools with the field and discuss applications of our results for understanding neuroanatomical-functional organization of LPFC and the rest of cortex (https://github.com/ilwoolyu/SphericalLabeling).

Joint analysis of structural connectivity and cortical surface features: correlates with mild traumatic brain injury

Mild traumatic brain injury (mTBI) is a complex syndrome that affects up to 600 per 100,000 individuals, with a particular concentration among military personnel. About half of all mTBI patients experience a diverse array of chronic symptoms which persist long after the acute injury. Hence, there is an urgent need for better understanding of the white matter and gray matter pathologies associated with mTBI to map which specific brain systems are impacted and identify courses of intervention. Previous works have linked mTBI to disruptions in white matter pathways and cortical surface abnormalities. Herein, we examine these hypothesized links in an exploratory study of joint structural connectivity and cortical surface changes associated with mTBI and its chronic symptoms. Briefly, we consider a cohort of 12 mTBI and 26 control subjects. A set of 588 cortical surface metrics and 4,753 structural connectivity metrics were extracted from cortical surface regions and diffusion weighted magnetic resonance imaging in each subject. Principal component analysis (PCA) was used to reduce the dimensionality of each metric set. We then applied independent component analysis (ICA) both to each PCA space individually and together in a joint ICA approach. We identified a stable independent component across the connectivity-only and joint ICAs which presented significant group differences in subject loadings (p<0.05, corrected). Additionally, we found that two mTBI symptoms, slowed thinking and forgetfulness, were significantly correlated (p<0.05, corrected) with mTBI subject loadings in a surface-only ICA. These surface-only loadings captured an increase in bilateral cortical thickness.

Joint cortical surface and structural connectivity analysis of Alzheimer's Disease

Prior neuroimaging studies have demonstrated isolated structural and connectivity changes in the brain due to Alzheimer's Disease (AD). However, how these changes relate to each other is not well understood. We present a preliminary study to begin to fill this gap by leveraging joint independent component analysis (jICA). We explore how jICA performs in an analysis of T1 and diffusion weighted MRI by characterizing the joint changes of complex cortical surface and structural connectivity metrics in AD in subjects from the Baltimore Longitudinal Study of Aging. We calculate 588 region-based cortical metrics and 4,753 fractional anisotropy-based connectivity metrics and project them into a low-dimensional manifold with principal component analysis. We perform jICA on the manifold and subsequently backproject the independent components to the original data space. We demonstrate component stability with 3-fold cross validation and find differential component loadings between 776 cognitively unimpaired control subjects and 23 with AD that generalizes across folds. In addition, we perform the same analysis on the surface and connectivity metrics separately and find that the joint approach identifies both novel and similar components to the separate approaches. To illustrate the joint approach's primary utility, we provide an example hypothesis for how surface and connectivity components may vary together with AD. These preliminary results suggest jointly varying independent cortical surface and structural connectivity components can be consistently extracted from MRI data and provide a data-driven way for generating novel hypotheses about AD that may not be captured by separate analyses.

A gyrification analysis approach based on Laplace Beltrami eigenfunction level sets

An accurate measure of the complexity of patterns of cortical folding or gyrification is necessary for understanding normal brain development and neurodevelopmental disorders. Conventional gyrification indices (GIs) are calculated based on surface curvature (curvature-based GI) or an outer hull surface of the cortex (outer surface-based GI). The latter is dependent on the definition of the outer hull surface and a corresponding function between surfaces. In the present study, we propose the Laplace Beltrami-based gyrification index (LB-GI). This is a new curvature-based local GI computed using the first three Laplace Beltrami eigenfunction level sets. As with outer surface-based GI methods, this method is based on the hypothesis that gyrification stems from a flat surface during development. However, instead of quantifying gyrification with reference to corresponding points on an outer hull surface, LB-GI quantifies the gyrification at each point on the cortical surface with reference to their surrounding gyral points, overcoming several shortcomings of existing methods. The LB-GI was applied to investigate the cortical maturation profile of the human brain from preschool to early adulthood using the PING database. The results revealed more detail in patterns of cortical folding than conventional curvature-based methods, especially on frontal and posterior tips of the brain, such as the frontal pole, lateral occipital, lateral cuneus, and lingual. Negative associations of cortical folding with age were observed at cortical regions, including bilateral lingual, lateral occipital, precentral gyrus, postcentral gyrus, and superior frontal gyrus. The results also indicated positive significant associations between age and the LB-GI of bilateral insula, the medial orbitofrontal, frontal pole and rostral anterior cingulate regions. It is anticipated that the LB-GI will be advantageous in providing further insights in the understanding of brain development and degeneration in large clinical neuroimaging studies.

Fast Polynomial Approximation of Heat Kernel Convolution on Manifolds and Its Application to Brain Sulcal and Gyral Graph Pattern Analysis

Heat diffusion has been widely used in brain imaging for surface fairing, mesh regularization and cortical data smoothing. Motivated by diffusion wavelets and convolutional neural networks on graphs, we present a new fast and accurate numerical scheme to solve heat diffusion on surface meshes. This is achieved by approximating the heat kernel convolution using high degree orthogonal polynomials in the spectral domain. We also derive the closed-form expression of the spectral decomposition of the Laplace-Beltrami operator and use it to solve heat diffusion on a manifold for the first time. The proposed fast polynomial approximation scheme avoids solving for the eigenfunctions of the Laplace-Beltrami operator, which is computationally costly for large mesh size, and the numerical instability associated with the finite element method based diffusion solvers. The proposed method is applied in localizing the male and female differences in cortical sulcal and gyral graph patterns obtained from MRI in an innovative way. The MATLAB code is available at http://www.stat.wisc.edu/~mchung/chebyshev.

AUTOMATIC LABELING OF CORTICAL SULCI USING SPHERICAL CONVOLUTIONAL NEURAL NETWORKS IN A DEVELOPMENTAL COHORT

In this paper, we present the automatic labeling framework for sulci in the human lateral prefrontal cortex (PFC). We adapt an existing spherical U-Net architecture with our recent surface data augmentation technique to improve the sulcal labeling accuracy in a developmental cohort. Specifically, our framework consists of the following key components: (1) augmented geometrical features being generated during cortical surface registration, (2) spherical U-Net architecture to efficiently fit the augmented features, and (3) postrefinement of sulcal labeling by optimizing spatial coherence via a graph cut technique. We validate our method on 30 healthy subjects with manual labeling of sulcal regions within PFC. In the experiments, we demonstrate significantly improved labeling performance (0.7749) in mean Dice overlap compared to that of multi-atlas (0.6410) and standard spherical U-Net (0.7011) approaches, respectively (p < 0.05). Additionally, the proposed method achieves a full set of sulcal labels in 20 seconds in this developmental cohort.

Hierarchical spherical deformation for cortical surface registration

We present hierarchical spherical deformation for a group-wise shape correspondence to address template selection bias and to minimize registration distortion. In this work, we aim at a continuous and smooth deformation field to guide accurate cortical surface registration. In conventional spherical registration methods, a global rigid alignment and local deformation are independently performed. Motivated by the composition of precession and intrinsic rotation, we simultaneously optimize global rigid rotation and non-rigid local deformation by utilizing spherical harmonics interpolation of local composite rotations in a single framework. To this end, we indirectly encode local displacements by such local composite rotations as functions of spherical locations. Furthermore, we introduce an additional regularization term to the spherical deformation, which maximizes its rigidity while reducing registration distortion. To improve surface registration performance, we employ the second order approximation of the energy function that enables fast convergence of the optimization. In the experiments, we validate our method on healthy normal subjects with manual cortical surface parcellation in registration accuracy and distortion. We show an improved shape correspondence with high accuracy in cortical surface parcellation and significantly low registration distortion in surface area and edge length. In addition to validation, we discuss parameter tuning, optimization, and implementation design with potential acceleration.

Improving human cortical sulcal curve labeling in large scale cross-sectional MRI using deep neural networks

BACKGROUND

Human cortical primary sulci are relatively stable landmarks and commonly observed across the population. Despite their stability, the primary sulci exhibit phenotypic variability.

NEW METHOD

We propose a fully automated pipeline that integrates both sulcal curve extraction and labeling. In this study, we use a large normal control population (n = 1424) to train neural networks for accurately labeling the primary sulci. Briefly, we use sulcal curve distance map, surface parcellation, mean curvature and spectral features to delineate their sulcal labels. We evaluate the proposed method with 8 primary sulcal curves in the left and right hemispheres compared to an established multi-atlas curve labeling method.

RESULTS

Sulcal labels by the proposed method reasonably well agree with manual labeling. The proposed method outperforms the existing multi-atlas curve labeling method.

COMPARISON WITH EXISTING METHOD

Significantly improved sulcal labeling results are achieved with over 12.5 and 20.6 percent improvement on labeling accuracy in the left and right hemispheres, respectively compared to that of a multi-atlas curve labeling method in eight curves (p≪0.001, two-sample t-test).

CONCLUSION

The proposed method offers a computationally efficient and robust labeling of major sulci.

A computational method for longitudinal mapping of orientation-specific expansion of cortical surface in infants

The cortical surface of the human brain expands dynamically and regionally heterogeneously during the first postnatal year. As all primary and secondary cortical folds as well as many tertiary cortical folds are well established at term birth, the cortical surface area expansion during this stage is largely driven by the increase of surface area in two orthogonal orientations in the tangent plane: 1) the expansion parallel to the folding orientation (i.e., increasing the lengths of folds) and 2) the expansion perpendicular to the folding orientation (i.e., increasing the depths of folds). This information would help us better understand the mechanisms of cortical development and provide important insights into neurodevelopmental disorders, but still remains largely unknown due to lack of dedicated computational methods. To address this issue, we propose a novel method for longitudinal mapping of orientation-specific expansion of cortical surface area in these two orthogonal orientations during early infancy. First, to derive the two orientation fields perpendicular and parallel to cortical folds, we propose to adaptively and smoothly fuse the gradient field of sulcal depth and also the maximum principal direction field, by leveraging their region-specific reliability. Specifically, we formulate this task as a discrete labeling problem, in which each vertex is assigned to an orientation label, and solve it by graph cuts. Then, based on the computed longitudinal deformation of the cortical surface, we estimate the Jacobian matrix at each vertex by solving a least-squares problem and derive its corresponding stretch tensor. Finally, to obtain the orientation-specific cortical surface expansion, we project the stretch tensor into the two orthogonal orientations separately. We have applied the proposed method to 30 healthy infants, and for the first time we revealed the orientation-specific longitudinal cortical surface expansion maps during the first postnatal year.