Anatomy-Guided Spatio-Temporal Graph Convolutional Networks (AG-STGCNs) for Modeling Functional Connectivity Between Gyri and Sulci Across Multiple Task Domains

An Explainable Unified Framework of Spatio-Temporal Coupling Learning With Application to Dynamic Brain Functional Connectivity Analysis

Time-series data such as fMRI and MEG carry a wealth of inherent spatio-temporal coupling relationship, and their modeling via deep learning is essential for uncovering biological mechanisms. However, current machine learning models for mining spatio-temporal information usually overlook this intrinsic coupling association, in addition to poor explainability. In this paper, we present an explainable learning framework for spatio-temporal coupling. Specifically, this framework constructs a deep learning network based on spatio-temporal correlation, which can well integrate the time-varying coupled relationships between node representation and inter-node connectivity. Furthermore, it explores spatio-temporal evolution at each time step, providing a better explainability of the analysis results. Finally, we apply the proposed framework to brain dynamic functional connectivity (dFC) analysis. Experimental results demonstrate that it can effectively capture the variations in dFC during brain development and the evolution of spatio-temporal information at the resting state. Two distinct developmental functional connectivity (FC) patterns are identified. Specifically, the connectivity among regions related to emotional regulation decreases, while the connectivity associated with cognitive activities increases. In addition, children and young adults display notable cyclic fluctuations in resting-state brain dFC.

Cortical Morphological Networks Differ Between Gyri and Sulci

This study explored how the human cortical folding pattern composed of convex gyri and concave sulci affected single-subject morphological brain networks, which are becoming an important method for studying the human brain connectome. We found that gyri-gyri networks exhibited higher morphological similarity, lower small-world parameters, and lower long-term test-retest reliability than sulci-sulci networks for cortical thickness- and gyrification index-based networks, while opposite patterns were observed for fractal dimension-based networks. Further behavioral association analysis revealed that gyri-gyri networks and connections between gyral and sulcal regions significantly explained inter-individual variance in Cognition and Motor domains for fractal dimension- and sulcal depth-based networks. Finally, the clinical application showed that only sulci-sulci networks exhibited morphological similarity reductions in major depressive disorder for cortical thickness-, fractal dimension-, and gyrification index-based networks. Taken together, these findings provide novel insights into the constraint of the cortical folding pattern to the network organization of the human brain.

A Deep Dynamic Causal Learning Model to Study Changes in Dynamic Effective Connectivity During Brain Development

OBJECTIVE

Brain dynamic effective connectivity (dEC), characterizes the information transmission patterns between brain regions that change over time, which provides insight into the biological mechanism underlying brain development. However, most existing methods predominantly capture fixed or temporally invariant EC, leaving dEC largely unexplored.

METHODS

Herein we propose a deep dynamic causal learning model specifically designed to capture dEC. It includes a dynamic causal learner to detect time-varying causal relationships from spatio-temporal data, and a dynamic causal discriminator to validate these findings by comparing original and reconstructed data.

RESULTS

Our model outperforms established baselines in the accuracy of identifying dynamic causalities when tested on the simulated data. When applied to the Philadelphia Neurodevelopmental Cohort, the model uncovers distinct patterns in dEC networks across different age groups. Specifically, the evolution process of brain dEC networks in young adults is more stable than in children, and significant differences in information transfer patterns exist between them.

CONCLUSION

This study highlights the brain's developmental trajectory, where networks transition from undifferentiated to specialized structures with age, in accordance with the improvement of an individual's cognitive and information processing capability.

SIGNIFICANCE

The proposed model consists of the identification and verification of dynamic causality, utilizing the spatio-temporal fusing information from fMRI. As a result, it can accurately detect dEC and characterize its evolution over age.

Brain Structural Connectivity Guided Vision Transformers for Identification of Functional Connectivity Characteristics in Preterm Neonates

Preterm birth is the leading cause of death in children under five years old, and is associated with a wide sequence of complications in both short and long term. In view of rapid neurodevelopment during the neonatal period, preterm neonates may exhibit considerable functional alterations compared to term ones. However, the identified functional alterations in previous studies merely achieve moderate classification performance, while more accurate functional characteristics with satisfying discrimination ability for better diagnosis and therapeutic treatment is underexplored. To address this problem, we propose a novel brain structural connectivity (SC) guided Vision Transformer (SCG-ViT) to identify functional connectivity (FC) differences among three neonatal groups: preterm, preterm with early postnatal experience, and term. Particularly, inspired by the neuroscience-derived information, a novel patch token of SC/FC matrix is defined, and the SC matrix is then adopted as an effective mask into the ViT model to screen out input FC patch embeddings with weaker SC, and to focus on stronger ones for better classification and identification of FC differences among the three groups. The experimental results on multi-modal MRI data of 437 neonatal brains from publicly released Developing Human Connectome Project (dHCP) demonstrate that SCG-ViT achieves superior classification ability compared to baseline models, and successfully identifies holistically different FC patterns among the three groups. Moreover, these different FCs are significantly correlated with the differential gene expressions of the three groups. In summary, SCG-ViT provides a powerfully brain-guided pipeline of adopting large-scale and data-intensive deep learning models for medical imaging-based diagnosis.

A novel spatiotemporal graph convolutional network framework for functional connectivity biomarkers identification of Alzheimer's disease

BACKGROUND

Functional connectivity (FC) biomarkers play a crucial role in the early diagnosis and mechanistic study of Alzheimer's disease (AD). However, the identification of effective FC biomarkers remains challenging. In this study, we introduce a novel approach, the spatiotemporal graph convolutional network (ST-GCN) combined with the gradient-based class activation mapping (Grad-CAM) model (STGC-GCAM), to effectively identify FC biomarkers for AD.

METHODS

This multi-center cross-racial retrospective study involved 2,272 participants, including 1,105 cognitively normal (CN) subjects, 790 mild cognitive impairment (MCI) individuals, and 377 AD patients. All participants underwent functional magnetic resonance imaging (fMRI) and T1-weighted MRI scans. In this study, firstly, we optimized the STGC-GCAM model to enhance classification accuracy. Secondly, we identified novel AD-associated biomarkers using the optimized model. Thirdly, we validated the imaging biomarkers using Kaplan-Meier analysis. Lastly, we performed correlation analysis and causal mediation analysis to confirm the physiological significance of the identified biomarkers.

RESULTS

The STGC-GCAM model demonstrated great classification performance (The average area under the curve (AUC) values for different categories were: CN vs MCI = 0.98, CN vs AD = 0.95, MCI vs AD = 0.96, stable MCI vs progressive MCI = 0.79). Notably, the model identified specific brain regions, including the sensorimotor network (SMN), visual network (VN), and default mode network (DMN), as key differentiators between patients and CN individuals. These brain regions exhibited significant associations with the severity of cognitive impairment (p < 0.05). Moreover, the topological features of important brain regions demonstrated excellent predictive capability for the conversion from MCI to AD (Hazard ratio = 3.885, p < 0.001). Additionally, our findings revealed that the topological features of these brain regions mediated the impact of amyloid beta (Aβ) deposition (bootstrapped average causal mediation effect: β = -0.01 [-0.025, 0.00], p < 0.001) and brain glucose metabolism (bootstrapped average causal mediation effect: β = -0.02 [-0.04, -0.001], p < 0.001) on cognitive status.

CONCLUSIONS

This study presents the STGC-GCAM framework, which identifies FC biomarkers using a large multi-site fMRI dataset.

Multi-Scale Dynamic Graph Learning for Brain Disorder Detection With Functional MRI

Resting-state functional magnetic resonance imaging (rs-fMRI) has been widely used in the detection of brain disorders such as autism spectrum disorder based on various machine/deep learning techniques. Learning-based methods typically rely on functional connectivity networks (FCNs) derived from blood-oxygen-level-dependent time series of rs-fMRI data to capture interactions between brain regions-of-interest (ROIs). Graph neural networks have been recently used to extract fMRI features from graph-structured FCNs, but cannot effectively characterize spatiotemporal dynamics of FCNs, e.g., the functional connectivity of brain ROIs is dynamically changing in a short period of time. Also, many studies usually focus on single-scale topology of FCN, thereby ignoring the potential complementary topological information of FCN at different spatial resolutions. To this end, in this paper, we propose a multi-scale dynamic graph learning (MDGL) framework to capture multi-scale spatiotemporal dynamic representations of rs-fMRI data for automated brain disorder diagnosis. The MDGL framework consists of three major components: 1) multi-scale dynamic FCN construction using multiple brain atlases to model multi-scale topological information, 2) multi-scale dynamic graph representation learning to capture spatiotemporal information conveyed in fMRI data, and 3) multi-scale feature fusion and classification. Experimental results on two datasets show that MDGL outperforms several state-of-the-art methods.