Multivariate information theory uncovers synergistic subsystems of the human cerebral cortex

Changes in high-order interaction measures of synergy and redundancy during non-ordinary states of consciousness induced by meditation, hypnosis, and auto-induced cognitive trance

High-order interactions are required across brain regions to accomplish specific cognitive functions. These functional interdependencies are reflected by synergistic information that can be obtained by combining the information from all the sources considered and redundant information (i.e., common information provided by all the sources). However, electroencephalogram (EEG) functional connectivity is limited to pairwise interactions thereby precluding the estimation of high-order interactions. In this multicentric study, we used measures of synergistic and redundant information to study in parallel the high-order interactions between five EEG electrodes during three non-ordinary states of consciousness (NSCs): Rajyoga meditation (RM), hypnosis, and auto-induced cognitive trance (AICT). We analyzed EEG data from 22 long-term Rajyoga meditators, nine volunteers undergoing hypnosis, and 21 practitioners of AICT. We here report the within-group changes in synergy and redundancy for each NSC in comparison with their respective baseline. During RM, synergy increased at the whole brain level in the delta and theta bands. Redundancy decreased in frontal, right central, and posterior electrodes in delta, and frontal, central, and posterior electrodes in beta1 and beta2 bands. During hypnosis, synergy decreased in mid-frontal, temporal, and mid-centro-parietal electrodes in the delta band. The decrease was also observed in the beta2 band in the left frontal and right parietal electrodes. During AICT, synergy decreased in delta and theta bands in left-frontal, right-frontocentral, and posterior electrodes. The decrease was also observed at the whole brain level in the alpha band. However, redundancy changes during hypnosis and AICT were not significant. The subjective reports of absorption and dissociation during hypnosis and AICT, as well as the mystical experience questionnaires during AICT, showed no correlation with the high-order measures. The proposed study is the first exploratory attempt to utilize the concepts of synergy and redundancy in NSCs. The differences in synergy and redundancy during different NSCs warrant further studies to relate the extracted measures with the phenomenology of the NSCs.

Modeling the neurocognitive dynamics of language across the lifespan

Healthy aging is associated with a heterogeneous decline across cognitive functions, typically observed between language comprehension and language production (LP). Examining resting-state fMRI and neuropsychological data from 628 healthy adults (age 18-88) from the CamCAN cohort, we performed state-of-the-art graph theoretical analysis to uncover the neural mechanisms underlying this variability. At the cognitive level, our findings suggest that LP is not an isolated function but is modulated throughout the lifespan by the extent of inter-cognitive synergy between semantic and domain-general processes. At the cerebral level, we show that default mode network (DMN) suppression coupled with fronto-parietal network (FPN) integration is the way for the brain to compensate for the effects of dedifferentiation at a minimal cost, efficiently mitigating the age-related decline in LP. Relatedly, reduced DMN suppression in midlife could compromise the ability to manage the cost of FPN integration. This may prompt older adults to adopt a more cost-efficient compensatory strategy that maintains global homeostasis at the expense of LP performances. Taken together, we propose that midlife represents a critical neurocognitive juncture that signifies the onset of LP decline, as older adults gradually lose control over semantic representations. We summarize our findings in a novel synergistic, economical, nonlinear, emergent, cognitive aging model, integrating connectomic and cognitive dimensions within a complex system perspective.

Information decomposition and the informational architecture of the brain

To explain how the brain orchestrates information-processing for cognition, we must understand information itself. Importantly, information is not a monolithic entity. Information decomposition techniques provide a way to split information into its constituent elements: unique, redundant, and synergistic information. We review how disentangling synergistic and redundant interactions is redefining our understanding of integrative brain function and its neural organisation. To explain how the brain navigates the trade-offs between redundancy and synergy, we review converging evidence integrating the structural, molecular, and functional underpinnings of synergy and redundancy; their roles in cognition and computation; and how they might arise over evolution and development. Overall, disentangling synergistic and redundant information provides a guiding principle for understanding the informational architecture of the brain and cognition.

Information synergy maximizes the growth rate of heterogeneous groups

Collective action and group formation are fundamental behaviors among both organisms cooperating to maximize their fitness and people forming socioeconomic organizations. Researchers have extensively explored social interaction structures via game theory and homophilic linkages, such as kin selection and scalar stress, to understand emergent cooperation in complex systems. However, we still lack a general theory capable of predicting how agents benefit from heterogeneous preferences, joint information, or skill complementarities in statistical environments. Here, we derive general statistical dynamics for the origin of cooperation based on the management of resources and pooled information. Specifically, we show how groups that optimally combine complementary agent knowledge about resources in statistical environments maximize their growth rate. We show that these advantages are quantified by the information synergy embedded in the conditional probability of environmental states given agents' signals, such that groups with a greater diversity of signals maximize their collective information. It follows that, when constraints are placed on group formation, agents must intelligently select with whom they cooperate to maximize the synergy available to their own signal. Our results show how the general properties of information underlie the optimal collective formation and dynamics of groups of heterogeneous agents across social and biological phenomena.

Behavioural relevance of redundant and synergistic stimulus information between functionally connected neurons in mouse auditory cortex

Measures of functional connectivity have played a central role in advancing our understanding of how information is transmitted and processed within the brain. Traditionally, these studies have focused on identifying redundant functional connectivity, which involves determining when activity is similar across different sites or neurons. However, recent research has highlighted the importance of also identifying synergistic connectivity-that is, connectivity that gives rise to information not contained in either site or neuron alone. Here, we measured redundant and synergistic functional connectivity between neurons in the mouse primary auditory cortex during a sound discrimination task. Specifically, we measured directed functional connectivity between neurons simultaneously recorded with calcium imaging. We used Granger Causality as a functional connectivity measure. We then used Partial Information Decomposition to quantify the amount of redundant and synergistic information about the presented sound that is carried by functionally connected or functionally unconnected pairs of neurons. We found that functionally connected pairs present proportionally more redundant information and proportionally less synergistic information about sound than unconnected pairs, suggesting that their functional connectivity is primarily redundant. Further, synergy and redundancy coexisted both when mice made correct or incorrect perceptual discriminations. However, redundancy was much higher (both in absolute terms and in proportion to the total information available in neuron pairs) in correct behavioural choices compared to incorrect ones, whereas synergy was higher in absolute terms but lower in relative terms in correct than in incorrect behavioural choices. Moreover, the proportion of redundancy reliably predicted perceptual discriminations, with the proportion of synergy adding no extra predictive power. These results suggest a crucial contribution of redundancy to correct perceptual discriminations, possibly due to the advantage it offers for information propagation, and also suggest a role of synergy in enhancing information level during correct discriminations.

Statistical Approaches to Identify Pairwise and High-Order Brain Functional Connectivity Signatures on a Single-Subject Basis

Keeping up with the shift towards personalized neuroscience essentially requires the derivation of meaningful insights from individual brain signal recordings by analyzing the descriptive indexes of physio-pathological states through statistical methods that prioritize subject-specific differences under varying experimental conditions. Within this framework, the current study presents a methodology for assessing the value of the single-subject fingerprints of brain functional connectivity, assessed both by standard pairwise and novel high-order measures. Functional connectivity networks, which investigate the inter-relationships between pairs of brain regions, have long been a valuable tool for modeling the brain as a complex system. However, their usefulness is limited by their inability to detect high-order dependencies beyond pairwise correlations. In this study, by leveraging multivariate information theory, we confirm recent evidence suggesting that the brain contains a plethora of high-order, synergistic subsystems that would go unnoticed using a pairwise graph structure. The significance and variations across different conditions of functional pairwise and high-order interactions (HOIs) between groups of brain signals are statistically verified on an individual level through the utilization of surrogate and bootstrap data analyses. The approach is illustrated on the single-subject recordings of resting-state functional magnetic resonance imaging (rest-fMRI) signals acquired using a pediatric patient with hepatic encephalopathy associated with a portosystemic shunt and undergoing liver vascular shunt correction. Our results show that (i) the proposed single-subject analysis may have remarkable clinical relevance for subject-specific investigations and treatment planning, and (ii) the possibility of investigating brain connectivity and its post-treatment functional developments at a high-order level may be essential to fully capture the complexity and modalities of the recovery.

Partial entropy decomposition reveals higher-order information structures in human brain activity

The standard approach to modeling the human brain as a complex system is with a network, where the basic unit of interaction is a pairwise link between two brain regions. While powerful, this approach is limited by the inability to assess higher-order interactions involving three or more elements directly. In this work, we explore a method for capturing higher-order dependencies in multivariate data: the partial entropy decomposition (PED). Our approach decomposes the joint entropy of the whole system into a set of nonnegative atoms that describe the redundant, unique, and synergistic interactions that compose the system's structure. PED gives insight into the mathematics of functional connectivity and its limitation. When applied to resting-state fMRI data, we find robust evidence of higher-order synergies that are largely invisible to standard functional connectivity analyses. Our approach can also be localized in time, allowing a frame-by-frame analysis of how the distributions of redundancies and synergies change over the course of a recording. We find that different ensembles of regions can transiently change from being redundancy-dominated to synergy-dominated and that the temporal pattern is structured in time. These results provide strong evidence that there exists a large space of unexplored structures in human brain data that have been largely missed by a focus on bivariate network connectivity models. This synergistic structure is dynamic in time and likely will illuminate interesting links between brain and behavior. Beyond brain-specific application, the PED provides a very general approach for understanding higher-order structures in a variety of complex systems.

Neural complexity through a nonextensive statistical-mechanical approach of human electroencephalograms

The brain is a complex system whose understanding enables potentially deeper approaches to mental phenomena. Dynamics of wide classes of complex systems have been satisfactorily described within q-statistics, a current generalization of Boltzmann-Gibbs (BG) statistics. Here, we study human electroencephalograms of typical human adults (EEG), very specifically their inter-occurrence times across an arbitrarily chosen threshold of the signal (observed, for instance, at the midparietal location in scalp). The distributions of these inter-occurrence times differ from those usually emerging within BG statistical mechanics. They are instead well approached within the q-statistical theory, based on non-additive entropies characterized by the index q. The present method points towards a suitable tool for quantitatively accessing brain complexity, thus potentially opening useful studies of the properties of both typical and altered brain physiology.