Estimating Dynamic Functional Brain Connectivity With a Sparse Hidden Markov Model

Mapping Dynamic Metabolic Energy Distribution in Brain Networks using fMRI: A Novel Dynamic Time Warping Framework

Understanding how metabolic energy is distributed across brain networks is essential for elucidating healthy brain function and neurological disorders. Research has established the link between blood flow changes and glucose metabolic processes that fuel neural activity. Here, we introduce a novel framework based on the normalized dynamic time warping algorithm robust to neural temporal variability, enabling reliable insights into metabolic energy demands using functional magnetic resonance imaging data. Our findings indicate that healthy brains maintain balanced energy distribution, whereas imbalances are more pronounced in schizophrenia with links to both positive and negative symptoms, particularly during rapid neural processes. Additionally, we identified a dynamic state that supports the brain criticality theory and is associated with higher-order cognitive abilities, demonstrating our framework's functional and clinical relevance. By linking metabolic energy distribution to neural dynamics, this framework provides a novel way to estimate and quantify the brain's maintenance of functional balance in a broadly applicable manner for studying brain health and disorders.

An Explainable Unified Framework of Spatio-Temporal Coupling Learning With Application to Dynamic Brain Functional Connectivity Analysis

Time-series data such as fMRI and MEG carry a wealth of inherent spatio-temporal coupling relationship, and their modeling via deep learning is essential for uncovering biological mechanisms. However, current machine learning models for mining spatio-temporal information usually overlook this intrinsic coupling association, in addition to poor explainability. In this paper, we present an explainable learning framework for spatio-temporal coupling. Specifically, this framework constructs a deep learning network based on spatio-temporal correlation, which can well integrate the time-varying coupled relationships between node representation and inter-node connectivity. Furthermore, it explores spatio-temporal evolution at each time step, providing a better explainability of the analysis results. Finally, we apply the proposed framework to brain dynamic functional connectivity (dFC) analysis. Experimental results demonstrate that it can effectively capture the variations in dFC during brain development and the evolution of spatio-temporal information at the resting state. Two distinct developmental functional connectivity (FC) patterns are identified. Specifically, the connectivity among regions related to emotional regulation decreases, while the connectivity associated with cognitive activities increases. In addition, children and young adults display notable cyclic fluctuations in resting-state brain dFC.

Study of dynamic brain function in irritable bowel syndrome via Hidden Markov Modeling

Background and purpose

Irritable bowel syndrome (IBS) is a common bowel-brain interaction disorder whose pathogenesis is unclear. Many studies have investigated abnormal changes in brain function in IBS patients. In this study, we analyzed the dynamic changes in brain function in IBS patients using a Hidden Markov Model (HMM).

Methods

Resting-state functional magnetic resonance imaging (rs-fMRI) data and the clinical characteristics of 35 patients with IBS and 31 healthy controls (HCs) were collected. The rs-fMRI data of all participants were analyzed using HMM to identify recurrent brain activity states that evolve over time during the resting state. Additionally, the temporal properties of these HMM states and their correlations with clinical scale scores were examined.

Result

This study utilized the Hidden Markov Model (HMM) method to identify six distinct HMM states. Significant differences in fractional occupancy (FO) and lifetime (LT) were observed in states 5 and 6 between the IBS and HCs. The state transition probabilities differed between IBS and HCs, with an increased probability of transitioning from state 2 to state 6 in IBS patients. The reconfiguration of HMM states over time scales in IBS patients was associated with abnormal activity in the default mode network (DMN), sensorimotor network (SMN), and cingulo-opercular network (CON).

Conclusion

This study offers novel insights into the dynamic reorganization of brain activity patterns in IBS and elucidates potential links between these patterns and IBS-related emotional regulation and symptom experience, thereby contributing to a deeper understanding of the neural mechanisms underlying IBS.

Constructing High-Order Functional Connectivity Networks With Temporal Information From fMRI Data

Conducting functional connectivity analysis on functional magnetic resonance imaging (fMRI) data presents a significant and intricate challenge. Contemporary studies typically analyze fMRI data by constructing high-order functional connectivity networks (FCNs) due to their strong interpretability. However, these approaches often overlook temporal information, resulting in suboptimal accuracy. Temporal information plays a vital role in reflecting changes in blood oxygenation level-dependent signals. To address this shortcoming, we have devised a framework for extracting temporal dependencies from fMRI data and inferring high-order functional connectivity among regions of interest (ROIs). Our approach postulates that the current state can be determined by the FCN and the state at the previous time, effectively capturing temporal dependencies. Furthermore, we enhance FCN by incorporating high-order features through hypergraph-based manifold regularization. Our algorithm involves causal modeling of the dynamic brain system, and the obtained directed FC reveals differences in the flow of information under different patterns. We have validated the significance of integrating temporal information into FCN using four real-world fMRI datasets. On average, our framework achieves 12% higher accuracy than non-temporal hypergraph-based and low-order FCNs, all while maintaining a short processing time. Notably, our framework successfully identifies the most discriminative ROIs, aligning with previous research, and thereby facilitating cognitive and behavioral studies.

Studying time-resolved functional connectivity via communication theory: on the complementary nature of phase synchronization and sliding window Pearson correlation

Time-resolved functional connectivity (trFC) assesses the time-resolved coupling between brain regions using functional magnetic resonance imaging (fMRI) data. This study aims to compare two techniques used to estimate trFC to investigate their similarities and differences when applied to fMRI data. These techniques are the sliding window Pearson correlation (SWPC), an amplitude-based approach, and phase synchronization (PS), a phase-based technique. To accomplish our objective, we used resting-state fMRI data from the Human Connectome Project (HCP) with 827 subjects (repetition time: 0.72s) and the Function Biomedical Informatics Research Network (fBIRN) with 311 subjects (repetition time: 2s), which included 151 schizophrenia patients and 160 controls. Our simulations reveal distinct strengths in two connectivity methods: SWPC captures high-magnitude, low-frequency connectivity, while PS detects low-magnitude, high-frequency connectivity. Stronger correlations between SWPC and PS align with pronounced fMRI oscillations. For fMRI data, higher correlations between SWPC and PS occur with matched frequencies and smaller SWPC window sizes (~30s), but larger windows (~88s) sacrifice clinically relevant information. Both methods identify a schizophrenia-associated brain network state but show different patterns: SWPC highlights low anti-correlations between visual, subcortical, auditory, and sensory-motor networks, while PS shows reduced positive synchronization among these networks. In sum, our findings underscore the complementary nature of SWPC and PS, elucidating their respective strengths and limitations without implying the superiority of one over the other.

A novel method for sparse dynamic functional connectivity analysis from resting-state fMRI

BACKGROUND

There is growing interest in understanding the dynamic functional connectivity (DFC) between distributed brain regions. However, it remains challenging to reliably estimate the temporal dynamics from resting-state functional magnetic resonance imaging (rs-fMRI) due to the limitations of current methods.

NEW METHODS

We propose a new model called HDP-HSMM-BPCA for sparse DFC analysis of high-dimensional rs-fMRI data, which is a temporal extension of probabilistic principal component analysis using Bayesian nonparametric hidden semi-Markov model (HSMM). Specifically, we utilize a hierarchical Dirichlet process (HDP) prior to remove the parametric assumption of the HMM framework, overcoming the limitations of the standard HMM. An attractive superiority is its ability to automatically infer the state-specific latent space dimensionality within the Bayesian formulation.

RESULTS

The experiment results of synthetic data show that our model outperforms the competitive models with relatively higher estimation accuracy. In addition, the proposed framework is applied to real rs-fMRI data to explore sparse DFC patterns. The findings indicate that there is a time-varying underlying structure and sparse DFC patterns in high-dimensional rs-fMRI data.

COMPARISON WITH EXISTING METHODS

Compared with the existing DFC approaches based on HMM, our method overcomes the limitations of standard HMM. The observation model of HDP-HSMM-BPCA can discover the underlying temporal structure of rs-fMRI data. Furthermore, the relevant sparse DFC construction algorithm provides a scheme for estimating sparse DFC.

CONCLUSION

We describe a new computational framework for sparse DFC analysis to discover the underlying temporal structure of rs-fMRI data, which will facilitate the study of brain functional connectivity.

NHSMM-MAR-sdNC: A novel data-driven computational framework for state-dependent effective connectivity analysis

The brain exhibits intrinsic dynamics characterized by spontaneous spatiotemporal reorganization of neural activity or metastability, which is associated closely with functional integration and segregation. Compared to dynamic functional connectivity, state-dependent effective connectivity (i.e., dynamic effective connectivity) is more suitable for exploring the metastability as its ability to infer causalities between brain regions. However, methods for state-dependent effective connectivity are scarce and urgently needed. In this study, a novel data-driven computational framework, named NHSMM-MAR-sdNC integrating nonparametric hidden semi-Markov model combined with multivariate autoregressive model and state-dependent new causality, is proposed to investigate the state-dependent effective connectivity. The framework is not constrained by any biological assumptions. Furthermore, state number can be inferred from the observed data directly and the state duration distributions will be estimated explicitly rather than restricted by geometric form, which overcomes limitations of hidden Markov model. Experimental results of synthetic data show that the framework can identify the state number adaptively and the state-dependent causality networks accurately. The dynamics of state-related causality networks are also revealed by the new method on real-world resting-state fMRI data. Our method provides a new data-driven computational framework for identifying state-dependent effective connectivity, which will facilitate the identification and assessment of metastability and itinerant dynamics of the brain.

Dynamic functional connectivity and gene expression correlates in temporal lobe epilepsy: insights from hidden markov models

BACKGROUD

Temporal lobe epilepsy (TLE) is associated with abnormal dynamic functional connectivity patterns, but the dynamic changes in brain activity at each time point remain unclear, as does the potential molecular mechanisms associated with the dynamic temporal characteristics of TLE.

METHODS

Resting-state functional magnetic resonance imaging (rs-fMRI) was acquired for 84 TLE patients and 35 healthy controls (HCs). The data was then used to conduct HMM analysis on rs-fMRI data from TLE patients and an HC group in order to explore the intricate temporal dynamics of brain activity in TLE patients with cognitive impairment (TLE-CI). Additionally, we aim to examine the gene expression profiles associated with the dynamic modular characteristics in TLE patients using the Allen Human Brain Atlas (AHBA) database.

RESULTS

Five HMM states were identified in this study. Compared with HCs, TLE and TLE-CI patients exhibited distinct changes in dynamics, including fractional occupancy, lifetimes, mean dwell time and switch rate. Furthermore, transition probability across HMM states were significantly different between TLE and TLE-CI patients (p < 0.05). The temporal reconfiguration of states in TLE and TLE-CI patients was associated with several brain networks (including the high-order default mode network (DMN), subcortical network (SCN), and cerebellum network (CN). Furthermore, a total of 1580 genes were revealed to be significantly associated with dynamic brain states of TLE, mainly enriched in neuronal signaling and synaptic function.

CONCLUSIONS

This study provides new insights into characterizing dynamic neural activity in TLE. The brain network dynamics defined by HMM analysis may deepen our understanding of the neurobiological underpinnings of TLE and TLE-CI, indicating a linkage between neural configuration and gene expression in TLE.

A survey of brain functional network extraction methods using fMRI data

Functional network (FN) analyses play a pivotal role in uncovering insights into brain function and understanding the pathophysiology of various brain disorders. This paper focuses on classical and advanced methods for deriving brain FNs from functional magnetic resonance imaging (fMRI) data. We systematically review their foundational principles, advantages, shortcomings, and interrelations, encompassing both static and dynamic FN extraction approaches. In the context of static FN extraction, we present hypothesis-driven methods such as region of interest (ROI)-based approaches as well as data-driven methods including matrix decomposition, clustering, and deep learning. For dynamic FN extraction, both window-based and windowless methods are surveyed with respect to the estimation of time-varying FN and the subsequent computation of FN states. We also discuss the scope of application of the various methods and avenues for future improvements.

An Attention-Based Hemispheric Relation Inference Network for Perinatal Brain Age Prediction

Brain anatomical age is an effective feature to assess the status of the brain, such as atypical development and aging. Although some deep learning models have been developed for estimating infant brain age, the performance of these models was unsatisfactory because few of them considered the developmental characteristics of brain anatomy during the perinatal period-the most rapid and complex developmental stage across the lifespan. The present study proposed an attention-based hemispheric relation inference network (HRINet) that takes advantage of the nature of brain structural lateralization during early development. This model captures the inter-hemispheric relationship using a graph attention mechanism and transmits lateralization information as features to describe the interactive development between bilateral hemispheres. The HRINet was used to estimate the brain age of 531 preterm and full-term neonates from the Developing Human Connectome Project (dHCP) database based on two metrics (mean curvature and sulcal depth) characterizing the folding morphology of the cortex. Our results showed that the HRINet outperformed other benchmark models in fitting the perinatal brain age, with mean absolute error of 0.53 and determination coefficient of 0.89. We also verified the generalizability of the HRINet on an extra independent dataset collected from the Gansu Provincial Maternity and Child-care Hospital. Furthermore, by applying the best-performing model to an independent dataset consisting of 47 scans of preterm infants at term-equivalent age, we showed that the predicted age was significantly lower than the chronological age, suggesting a delayed development of premature brains. Our results demonstrate the effectiveness and generalizability of the HRINet in estimating infant brain age, providing promising clinical applications for assessing neonatal brain maturity.

Spatio-Temporal Graph Hubness Propagation Model for Dynamic Brain Network Classification

Dynamic brain network has the advantage over static brain network in characterizing the variation pattern of functional brain connectivity, and it has attracted increasing attention in brain disease diagnosis. However, most of the existing dynamic brain networks analysis methods rely on extracting features from independent brain networks divided by sliding windows, making them hard to reveal the high-order dynamic evolution laws of functional brain networks. Additionally, they cannot effectively extract the spatio-temporal topology features in dynamic brain networks. In this paper, we propose to use optimal transport (OT) theory to capture the topology evolution of the dynamic brain networks, and develop a multi-channel spatio-temporal graph convolutional network that collaboratively extracts the temporal and spatial features from the evolution networks. Specifically, we first adaptively evaluate the graph hubness of brain regions in the brain network of each time window, which comprehensively models information transmission among multiple brain regions. Second, the hubness propagation information across adjacent time windows is captured by optimal transport, describing high-order topology evolution of dynamic brain networks. Moreover, we develop a spatio-temporal graph convolutional network with attention mechanism to collaboratively extract the intrinsic temporal and spatial topology information from the above networks. Finally, the multi-layer perceptron is adopted for classifying the dynamic brain network. The extensive experiment on the collected epilepsy dataset and the public ADNI dataset show that our proposed method not only outperforms several state-of-the-art methods in brain disease diagnosis, but also reveals the key dynamic alterations of brain connectivities between patients and healthy controls.

Functional hierarchies in brain dynamics characterized by signal reversibility in ferret cortex

Brain signal irreversibility has been shown to be a promising approach to study neural dynamics. Nevertheless, the relation with cortical hierarchy and the influence of different electrophysiological features is not completely understood. In this study, we recorded local field potentials (LFPs) during spontaneous behavior, including awake and sleep periods, using custom micro-electrocorticographic (μECoG) arrays implanted in ferrets. In contrast to humans, ferrets remain less time in each state across the sleep-wake cycle. We deployed a diverse set of metrics in order to measure the levels of complexity of the different behavioral states. In particular, brain irreversibility, which is a signature of non-equilibrium dynamics, captured by the arrow of time of the signal, revealed the hierarchical organization of the ferret's cortex. We found different signatures of irreversibility and functional hierarchy of large-scale dynamics in three different brain states (active awake, quiet awake, and deep sleep), showing a lower level of irreversibility in the deep sleep stage, compared to the other. Irreversibility also allowed us to disentangle the influence of different cortical areas and frequency bands in this process, showing a predominance of the parietal cortex and the theta band. Furthermore, when inspecting the embedded dynamic through a Hidden Markov Model, the deep sleep stage was revealed to have a lower switching rate and lower entropy production. These results suggest functional hierarchies in organization that can be revealed through thermodynamic features and information theory metrics.

A comprehensive survey of complex brain network representation

Recent years have shown great merits in utilizing neuroimaging data to understand brain structural and functional changes, as well as its relationship to different neurodegenerative diseases and other clinical phenotypes. Brain networks, derived from different neuroimaging modalities, have attracted increasing attention due to their potential to gain system-level insights to characterize brain dynamics and abnormalities in neurological conditions. Traditional methods aim to pre-define multiple topological features of brain networks and relate these features to different clinical measures or demographical variables. With the enormous successes in deep learning techniques, graph learning methods have played significant roles in brain network analysis. In this survey, we first provide a brief overview of neuroimaging-derived brain networks. Then, we focus on presenting a comprehensive overview of both traditional methods and state-of-the-art deep-learning methods for brain network mining. Major models, and objectives of these methods are reviewed within this paper. Finally, we discuss several promising research directions in this field.

Improved dynamic functional connectivity estimation with an alternating hidden Markov model

Dynamic functional connectivity (DFC) analysis has been widely applied to functional magnetic resonance imaging (fMRI) data to reveal the time-varying functional interactions between brain regions. Although the sliding window (SW) method is popular for DFC analysis, the selection of window length is hard, and the temporal resolution is limited by the window length. The hidden Markov model (HMM) without the limitation of window length has been proven to be able to estimate time-varying brain states from fMRI data. However, HMM tends to be overfitted in DFC analysis of fMRI data because of the high spatial dimension and the limited sample size of fMRI data. In this study, we proposed an alternating HMM (aHMM) method that used the functional connectivity estimation of SW to initialize the covariance matrix of HMM and adopted an alternating HMM procedure to reduce the number of parameters during each optimization. The simulated and real fMRI resting data from the Human Connectome Projects showed that aHMM produced better robustness to noise, parameter number and sample size in DFC estimation than SW and HMM. For the real fMRI resting data of cerebral small vessel disease (CSVD), results of aHMM revealed that amnesia and mild cognitive impairment (aMCI) caused the CSVD with aMCI (CSVD-aMCI) group tended to spend more time on the brain state with overall weak connections and less time on the state with overall strong connections than the CSVD-controls. Moreover, CSVD-aMCI showed significantly lower connectivity amplitude and higher connectivity fluctuation than CSVD-control. In contrast, HMM did not detect intergroup differences of the connectivity amplitude and fluctuations and SW did not detect intergroup differences of connectivity fluctuations and fraction of time. The results further indicated that aHMM outperformed HMM and SW in detecting inter-group differences of temporal properties of DFC and connectivity fluctuations.

Supplementary Information

The online version contains supplementary material available at 10.1007/s11571-022-09874-3.

An explainable autoencoder with multi-paradigm fMRI fusion for identifying differences in dynamic functional connectivity during brain development

Multi-paradigm deep learning models show great potential for dynamic functional connectivity (dFC) analysis by integrating complementary information. However, many of them cannot use information from different paradigms effectively and have poor explainability, that is, the ability to identify significant features that contribute to decision making. In this paper, we propose a multi-paradigm fusion-based explainable deep sparse autoencoder (MF-EDSAE) to address these issues. Considering explainability, the MF-EDSAE is constructed based on a deep sparse autoencoder (DSAE). For integrating information effectively, the MF-EDASE contains the nonlinear fusion layer and multi-paradigm hypergraph regularization. We apply the model to the Philadelphia Neurodevelopmental Cohort and demonstrate it achieves better performance in detecting dynamic FC (dFC) that differ significantly during brain development than the single-paradigm DSAE. The experimental results show that children have more dispersive dFC patterns than adults. The function of the brain transits from undifferentiated systems to specialized networks during brain development. Meanwhile, adults have stronger connectivities between task-related functional networks for a given task than children. As the brain develops, the patterns of the global dFC change more quickly when stimulated by a task.

Human Activity Recognition with an HMM-Based Generative Model

Human activity recognition (HAR) has become an interesting topic in healthcare. This application is important in various domains, such as health monitoring, supporting elders, and disease diagnosis. Considering the increasing improvements in smart devices, large amounts of data are generated in our daily lives. In this work, we propose unsupervised, scaled, Dirichlet-based hidden Markov models to analyze human activities. Our motivation is that human activities have sequential patterns and hidden Markov models (HMMs) are some of the strongest statistical models used for modeling data with continuous flow. In this paper, we assume that emission probabilities in HMM follow a bounded-scaled Dirichlet distribution, which is a proper choice in modeling proportional data. To learn our model, we applied the variational inference approach. We used a publicly available dataset to evaluate the performance of our proposed model.

A Similarity Measure-Based Approach Using RS-fMRI Data for Autism Spectrum Disorder Diagnosis

Autism spectrum disorder (ASD) is a lifelong neurological disease, which seriously reduces the patients' life quality. Generally, an early diagnosis is beneficial to improve ASD children's life quality. Current methods based on samples from multiple sites for ASD diagnosis perform poorly in generalization due to the heterogeneity of the data from multiple sites. To address this problem, this paper presents a similarity measure-based approach for ASD diagnosis. Specifically, the few-shot learning strategy is used to measure potential similarities in the RS-fMRI data distributions, and, furthermore, a similarity function for samples from multiple sites is trained to enhance the generalization. On the ABIDE database, the presented approach is compared to some representative methods, such as SVM and random forest, in terms of accuracy, precision, and F1 score. The experimental results show that the experimental indicators of the proposed method are better than those of the comparison methods to varying degrees. For example, the accuracy on the TRINITY site is more than 5% higher than that of the comparison method, which clearly proves that the presented approach achieves a better generalization performance than the compared methods.

Individual functional parcellation revealed compensation of dynamic limbic network organization in healthy ageing

Using group-level functional parcellations and constant-length sliding window analysis, dynamic functional connectivity studies have revealed network-specific impairment and compensation in healthy ageing. However, functional parcellation and dynamic time windows vary across individuals; individual-level ageing-related brain dynamics are uncertain. Here, we performed individual parcellation and individual-length sliding window clustering to characterize ageing-related dynamic network changes. Healthy participants (n = 637, 18-88 years) from the Cambridge Centre for Ageing and Neuroscience dataset were included. An individual seven-network parcellation, varied from group-level parcellation, was mapped for each participant. For each network, strong and weak cognitive brain states were revealed by individual-length sliding window clustering and canonical correlation analysis. The results showed negative linear correlations between age and change ratios of sizes in the default mode, frontoparietal, and salience networks and a positive linear correlation between age and change ratios of size in the limbic network (LN). With increasing age, the occurrence and dwell time of strong states showed inverted U-shaped patterns or a linear decreasing pattern in most networks but showed a linear increasing pattern in the LN. Overall, this study reveals a compensative increase in emotional networks (i.e., the LN) and a decline in cognitive and primary sensory networks in healthy ageing. These findings may provide insights into network-specific and individual-level targeting during neuromodulation in ageing and ageing-related diseases.

Assessment of 3D Visual Discomfort Based on Dynamic Functional Connectivity Analysis with HMM in EEG

Stereoscopic displays can induce visual discomfort despite their wide application. Electroencephalography (EEG) technology has been applied to assess 3D visual discomfort, because it can capture brain activities with high temporal resolution. Previous studies explored the frequency and temporal features relevant to visual discomfort in EEG data. Recently, it was demonstrated that functional connectivity between brain regions fluctuates with time. However, the relationship between 3D visual discomfort and dynamic functional connectivity (DFC) remains unknown. Although HMM showed advantages over the sliding window method in capturing the temporal fluctuations of DFC at a single time point in functional magnetic resonance imaging (fMRI) data, it is unclear whether HMM works well in revealing the time-varying functional connectivity of EEG data. In this study, the hidden Markov model (HMM) was introduced to DFC analysis of EEG data for the first time and was used to investigate the DFC features that can be used to assess 3D visual discomfort. The results indicated that state 2, with strong connections between electrodes, occurred more frequently in the early period, whereas state 4, with overall weak connections between electrodes, occurred more frequently in the late period for both visual comfort and discomfort stimuli. Moreover, the 3D visual discomfort stimuli caused subjects to stay in state 4 more frequently, especially in the later period, in contrast to the 3D visual comfort stimuli. The results suggest that the increasing occurrence of state 4 was possibly related to visual discomfort and that the occurrence frequency of state 4 may be used to assess visual discomfort.

Developing control-theoretic objectives for large-scale brain dynamics and cognitive enhancement

The development of technologies for brain stimulation provides a means for scientists and clinicians to directly actuate the brain and nervous system. Brain stimulation has shown intriguing potential in terms of modifying particular symptom clusters in patients and behavioral characteristics of subjects. The stage is thus set for optimization of these techniques and the pursuit of more nuanced stimulation objectives, including the modification of complex cognitive functions such as memory and attention. Control theory and engineering will play a key role in the development of these methods, guiding computational and algorithmic strategies for stimulation. In particular, realizing this goal will require new development of frameworks that allow for controlling not only brain activity, but also latent dynamics that underlie neural computation and information processing. In the current opinion, we review recent progress in brain stimulation and outline challenges and potential research pathways associated with exogenous control of cognitive function.

Inferring Brain State Dynamics Underlying Naturalistic Stimuli Evoked Emotion Changes With dHA-HMM

The brain functional mechanisms underlying emotional changes have been primarily studied based on the traditional task design with discrete and simple stimuli. However, the brain state transitions when exposed to continuous and naturalistic stimuli with rich affection variations remain poorly understood. This study proposes a dynamic hyperalignment algorithm (dHA) to functionally align the inter-subject neural activity. The hidden Markov model (HMM) was used to study how the brain dynamics responds to emotion during long-time movie-viewing activity. The results showed that dHA significantly improved inter-subject consistency and allowed more consistent temporal HMM states across participants. Afterward, grouping the emotions in a clustering dendrogram revealed a hierarchical grouping of the HMM states. Further emotional sensitivity and specificity analyses of ordered states revealed the most significant differences in happiness and sadness. We then compared the activation map in HMM states during happiness and sadness and found significant differences in the whole brain, but strong activation was observed during both in the superior temporal gyrus, which is related to the early process of emotional prosody processing. A comparison of the inter-network functional connections indicates unique functional connections of the memory retrieval and cognitive network with the cerebellum network during happiness. Moreover, the persistent bilateral connections among salience, cognitive, and sensorimotor networks during sadness may reflect the interaction between high-level cognitive networks and low-level sensory networks. The main results were verified by the second session of the dataset. All these findings enrich our understanding of the brain states related to emotional variation during naturalistic stimuli.

A Fast Detection Method of Break Points in Effective Connectivity Networks

There is increasing interest in identifying changes in the underlying states of brain networks. The availability of large scale neuroimaging data creates a strong need to develop fast, scalable methods for detecting and localizing in time such changes and also identify their drivers, thus enabling neuroscientists to hypothesize about potential mechanisms. This paper presents a fast method for detecting break points in exceedingly long time series neurogimaging data, based on vector autoregressive (Granger causal) models. It uses a multi-step strategy based on a regularized objective function that leads to fast identification of candidate break points, followed by clustering steps to select the final set of break points and subsequent estimation with false positives control of the underlying Granger causal networks. The latter provide insights into key changes in network connectivity that led to the presence of break points. The proposed methodology is illustrated on synthetic data varying in their length, dimensionality, number of break points, strength of signal and also applied to EEG data related to visual tasks.

Functional connectomes incorporating phase synchronization for the characterization and prediction of individual differences

BACKGROUND

Functional connectomes have been proven to be able to predict an individual's traits, acting as a fingerprint. A majority of studies use the amplitude information of fMRI signals to construct the connectivity but it remains unknown whether phase synchronization can be incorporated for improved prediction of individual cognitive behaviors.

METHODS

In this paper, we address the issue by extracting phase information from the fMRI time series with a phase locking approach, followed by the construction of functional connectomes.

RESULTS

We first examine the identification and prediction performance using phase-based profiles in comparison with amplitude-based connectomes. We then combine both phase-based and amplitude-based connectivity to extract subject-specific information enabled by the phase synchronization. Results show that high individual identification rates (from 82.7% to 92.6%) can be achieved by phase-based connectomes. Phase-based connectivity offers unique information complementary to amplitude-based signals. Intra-network phase-locking appears more informative for individual prediction. In addition, phase synchronization can be used to predict cognitive behaviors.

COMPARISON WITH EXISTING METHOD

The amplitude-based connectivity cannot capture the subject-specific information due to neural synchronization. The comparison with other phase-based methods has been involved in the discussion session.

CONCLUSIONS

Our findings suggest that neural synchronization carries subject-specific information, which can be captured by phase locking value. The incorporation of phase information into connectomes presents a promising approach to understand each individual brain's uniqueness.

Uncovering hidden resting state dynamics: A new perspective on auditory verbal hallucinations

In the absence of sensory stimulation, the brain transits between distinct functional networks. Network dynamics such as transition patterns and the time the brain stays in each network link to cognition and behavior and are subject to much investigation. Auditory verbal hallucinations (AVH), the temporally fluctuating unprovoked experience of hearing voices, are associated with aberrant resting state network activity. However, we lack a clear understanding of how different networks contribute to aberrant activity over time. An accurate characterization of latent network dynamics and their relation to neurocognitive changes necessitates methods that capture the sub-second temporal fluctuations of the networks' functional connectivity signatures. Here, we critically evaluate the assumptions and sensitivity of several approaches commonly used to assess temporal dynamics of brain connectivity states in M/EEG and fMRI research, highlighting methodological constraints and their clinical relevance to AVH. Identifying altered brain connectivity states linked to AVH can facilitate the detection of predictive disease markers and ultimately be valuable for generating individual risk profiles, differential diagnosis, targeted intervention, and treatment strategies.

Robotically-induced hallucination triggers subtle changes in brain network transitions

The perception that someone is nearby, although nobody can be seen or heard, is called presence hallucination (PH). Being a frequent hallucination in patients with Parkinson's disease, it has been argued to be indicative of a more severe and rapidly advancing form of the disease, associated with psychosis and cognitive decline. PH may also occur in healthy individuals and has recently been experimentally induced, in a controlled manner during fMRI, using MR-compatible robotics and sensorimotor stimulation. Previous neuroimaging correlates of such robot-induced PH, based on conventional time-averaged fMRI analysis, identified altered activity in the posterior superior temporal sulcus and inferior frontal gyrus in healthy individuals. However, no link with the strength of the robot-induced PH was observed, and such activations were also associated with other sensations induced by robotic stimulation. Here we leverage recent advances in dynamic functional connectivity, which have been applied to different psychiatric conditions, to decompose fMRI data during PH-induction into a set of co-activation patterns that are tracked over time, as to characterize their occupancies, durations, and transitions. Our results reveal that, when PH is induced, the identified brain patterns significantly and selectively increase their transition probabilities towards a specific brain pattern, centred on the posterior superior temporal sulcus, angular gyrus, dorso-lateral prefrontal cortex, and middle prefrontal cortex. This change is not observed in any other control conditions, nor is it observed in association with other sensations induced by robotic stimulation. The present findings describe the neural mechanisms of PH in healthy individuals and identify a specific disruption of the dynamics of network interactions, extending previously reported network dysfunctions in psychotic patients with hallucinations to an induced robot-controlled specific hallucination in healthy individuals.

Validating dynamicity in resting state fMRI with activation-informed temporal segmentation

Confirming the presence (or absence) of dynamic functional connectivity (dFC) states during rest is an important open question in the field of cognitive neuroscience. The prevailing dFC framework aims to identify dynamics directly from connectivity estimates with a sliding window approach, however this method suffers from several drawbacks including sensitivity to window size and poor test-retest reliability. We hypothesize that time-varying changes in functional connectivity are mirrored by significant temporal changes in functional activation, and that this coupling can be leveraged to study dFC without the need for a predefined sliding window. Here, we introduce a data-driven dFC framework, which involves informed segmentation of fMRI time series at candidate FC state transition points estimated from changes in whole-brain functional activation, rather than a fixed-length sliding window. We show our approach reliably identifies true cognitive state change points when applied on block-design working memory task data and outperforms the standard sliding window approach in both accuracy and computational efficiency in this context. When applied to data from four resting state fMRI scanning sessions, our method consistently recovers five reliable FC states, and subject-specific features derived from these states show significant correlation with behavioral phenotypes of interest (cognitive ability, personality). Overall, these results suggest abrupt whole-brain changes in activation can be used as a marker for changes in connectivity states and provides new evidence for the existence of time-varying FC in rest.

Spatio-temporal graph convolutional network for diagnosis and treatment response prediction of major depressive disorder from functional connectivity

The pathophysiology of major depressive disorder (MDD) has been explored to be highly associated with the dysfunctional integration of brain networks. It is therefore imperative to explore neuroimaging biomarkers to aid diagnosis and treatment. In this study, we developed a spatiotemporal graph convolutional network (STGCN) framework to learn discriminative features from functional connectivity for automatic diagnosis and treatment response prediction of MDD. Briefly, dynamic functional networks were first obtained from the resting-state fMRI with the sliding temporal window method. Secondly, a novel STGCN approach was proposed by introducing the modules of spatial graph attention convolution (SGAC) and temporal fusion. A novel SGAC was proposed to improve the feature learning ability and special anatomy prior guided pooling was developed to enable the feature dimension reduction. A temporal fusion module was proposed to capture the dynamic features of functional connectivity between adjacent sliding windows. Finally, the STGCN proposed approach was utilized to the tasks of diagnosis and antidepressant treatment response prediction for MDD. Performances of the framework were comprehensively examined with large cohorts of clinical data, which demonstrated its effectiveness in classifying MDD patients and predicting the treatment response. The sound performance suggests the potential of the STGCN for the clinical use in diagnosis and treatment prediction.

Functional connectome fingerprinting: Identifying individuals and predicting cognitive functions via autoencoder

Functional network connectivity has been widely acknowledged to characterize brain functions, which can be regarded as “brain fingerprinting” to identify an individual from a pool of subjects. Both common and unique information has been shown to exist in the connectomes across individuals. However, very little is known about whether and how this information can be used to predict the individual variability of the brain. In this paper, we propose to enhance the uniqueness of individual connectome based on an autoencoder network. Specifically, we hypothesize that the common neural activities shared across individuals may reduce the individual identification. By removing contributions from shared activities, inter‐subject variability can be enhanced. Our experimental results on HCP data show that the refined connectomes obtained by utilizing autoencoder with sparse dictionary learning can distinguish an individual from the remaining participants with high accuracy (up to 99.5% for the rest–rest pair). Furthermore, high‐level cognitive behaviors (e.g., fluid intelligence, executive function, and language comprehension) can also be better predicted with the obtained refined connectomes. We also find that high‐order association cortices contribute more to both individual discrimination and behavior prediction. In summary, our proposed framework provides a promising way to leverage functional connectivity networks for cognition and behavior study, in addition to a better understanding of brain functions.

Behavioural relevance of spontaneous, transient brain network interactions in fMRI

How spontaneously fluctuating functional magnetic resonance imaging (fMRI) signals in different brain regions relate to behaviour has been an open question for decades. Correlations in these signals, known as functional connectivity, can be averaged over several minutes of data to provide a stable representation of the functional network architecture for an individual. However, associations between these stable features and behavioural traits have been shown to be dominated by individual differences in anatomy. Here, using kernel learning tools, we propose methods to assess and compare the relation between time-varying functional connectivity, time-averaged functional connectivity, structural brain data, and non-imaging subject behavioural traits. We applied these methods to Human Connectome Project resting-state fMRI data to show that time-varying fMRI functional connectivity, detected at time-scales of a few seconds, has associations with some behavioural traits that are not dominated by anatomy. Despite time-averaged functional connectivity accounting for the largest proportion of variability in the fMRI signal between individuals, we found that some aspects of intelligence could only be explained by time-varying functional connectivity. The finding that time-varying fMRI functional connectivity has a unique relationship to population behavioural variability suggests that it might reflect transient neuronal communication fluctuating around a stable neural architecture.

Utilization of Time Series Tools in Life-sciences and Neuroscience

Time series tools are part and parcel of modern day research. Their usage in the biomedical field; specifically, in neuroscience, has not been previously quantified. A quantification of trends can tell about lacunae in the current uses and point towards future uses. We evaluated the principles and applications of few classical time series tools, such as Principal Component Analysis, Neural Networks, common Auto-regression Models, Markov Models, Hidden Markov Models, Fourier Analysis, Spectral Analysis, in addition to diverse work, generically lumped under time series category. We quantified the usage from two perspectives, one, information technology professionals', other, researchers utilizing these tools for biomedical and neuroscience research. For understanding trends from the information technology perspective, we evaluated two of the largest open source question and answer databases of Stack Overflow and Cross Validated. We quantified the trends in their application in the biomedical domain, and specifically neuroscience, by searching literature and application usage on PubMed. While the use of all the time series tools continues to gain popularity in general biomedical and life science research, and also neuroscience, and so have been the total number of questions asked on Stack overflow and Cross Validated, the total views to questions on these are on a decrease in recent years, indicating well established texts, algorithms, and libraries, resulting in engineers not looking for what used to be common questions a few years back. The use of these tools in neuroscience clearly leaves room for improvement.

Sparse coupled logistic regression to estimate co-activation and modulatory influences of brain regions

Accurate mapping of the functional interactions between remote brain areas with resting-state functional magnetic resonance imaging requires the quantification of their underlying dynamics. In conventional methodological pipelines, a spatial scale of interest is first selected, and dynamic analysis then proceeds at this hypothesised level of complexity. If large-scale functional networks or states are studied, more local regional rearrangements are then not described, potentially missing important neurobiological information. Here, we propose a novel mathematical framework that jointly estimates resting-state functional networks, and spatially more localised cross-regional modulations. To do so, the changes in activity of each brain region are modelled by a logistic regression including co-activation coefficients (reflective of network assignment, as they highlight simultaneous activations across areas) and causal interplays (denoting finer regional cross-talks, when one region active at timetmodulates thettot+1 transition likelihood of another area). A two-parameter L1 regularisation scheme is used to make these two sets of coefficients sparse: one controls overall sparsity, while the other governs the trade-off between co-activations and causal interplays, enabling to properly fit the data despite the yet unknown balance between both types of couplings. Across a range of simulation settings, we show that the framework successfully retrieves the two types of cross-regional interactions at once. Performance across noise and sample size settings was globally on par with that of other existing methods, with the potential to reveal more precise information missed by alternative approaches. Preliminary application to experimental data revealed that in the resting brain, co-activations and causal modulations co-exist with a varying balance across regions. Our methodological pipeline offers a conceptually elegant alternative for the assessment of functional brain dynamics, and can be downloaded at https://c4science.ch/source/Sparse_logistic_regression.git.

Nonlinear ICA of fMRI reveals primitive temporal structures linked to rest, task, and behavioral traits

Accumulating evidence from whole brain functional magnetic resonance imaging (fMRI) suggests that the human brain at rest is functionally organized in a spatially and temporally constrained manner. However, because of their complexity, the fundamental mechanisms underlying time-varying functional networks are still not well understood. Here, we develop a novel nonlinear feature extraction framework called local space-contrastive learning (LSCL), which extracts distinctive nonlinear temporal structure hidden in time series, by training a deep temporal convolutional neural network in an unsupervised, data-driven manner. We demonstrate that LSCL identifies certain distinctive local temporal structures, referred to as temporal primitives, which repeatedly appear at different time points and spatial locations, reflecting dynamic resting-state networks. We also show that these temporal primitives are also present in task-evoked spatiotemporal responses. We further show that the temporal primitives capture unique aspects of behavioral traits such as fluid intelligence and working memory. These results highlight the importance of capturing transient spatiotemporal dynamics within fMRI data and suggest that such temporal primitives may capture fundamental information underlying both spontaneous and task-induced fMRI dynamics.