Characterizing information-theoretic storage and transfer in continuous time processes

Exploring the Short-Term Memory of Heart Rate Variability through Model-Free Information Measures

In this work, we perform a comparative analysis of discrete- and continuous-time estimators of information-theoretic measures quantifying the concept of memory utilization in short-term heart rate variability (HRV). Specifically, considering heartbeat intervals in discrete time we compute the measure of information storage (IS) and decompose it into immediate memory utilization (IMU) and longer memory utilization (MU) terms; considering the timings of heartbeats in continuous time we compute the measure of MU rate (MUR). All measures are computed through model-free approaches based on nearest neighbor entropy estimators applied to the HRV series of a group of 15 healthy subjects measured at rest and during postural stress. We find, moving from rest to stress, statistically significant increases of the IS and the IMU, as well as of the MUR. Our results suggest that both discrete-time and continuous-time approaches can detect the higher predictive capacity of HRV occurring with postural stress, and that such increased memory utilization is due to fast mechanisms likely related to sympathetic activation.

The Consensus Problem in Polities of Agents with Dissimilar Cognitive Architectures

Agents interacting with their environments, machine or otherwise, arrive at decisions based on their incomplete access to data and their particular cognitive architecture, including data sampling frequency and memory storage limitations. In particular, the same data streams, sampled and stored differently, may cause agents to arrive at different conclusions and to take different actions. This phenomenon has a drastic impact on polities-populations of agents predicated on the sharing of information. We show that, even under ideal conditions, polities consisting of epistemic agents with heterogeneous cognitive architectures might not achieve consensus concerning what conclusions to draw from datastreams. Transfer entropy applied to a toy model of a polity is analyzed to showcase this effect when the dynamics of the environment is known. As an illustration where the dynamics is not known, we examine empirical data streams relevant to climate and show the consensus problem manifest.

Early lock-in of structured and specialised information flows during neural development

The brains of many organisms are capable of complicated distributed computation underpinned by a highly advanced information processing capacity. Although substantial progress has been made towards characterising the information flow component of this capacity in mature brains, there is a distinct lack of work characterising its emergence during neural development. This lack of progress has been largely driven by the lack of effective estimators of information processing operations for spiking data. Here, we leverage recent advances in this estimation task in order to quantify the changes in transfer entropy during development. We do so by studying the changes in the intrinsic dynamics of the spontaneous activity of developing dissociated neural cell cultures. We find that the quantity of information flowing across these networks undergoes a dramatic increase across development. Moreover, the spatial structure of these flows exhibits a tendency to lock-in at the point when they arise. We also characterise the flow of information during the crucial periods of population bursts. We find that, during these bursts, nodes tend to undertake specialised computational roles as either transmitters, mediators, or receivers of information, with these roles tending to align with their average spike ordering. Further, we find that these roles are regularly locked-in when the information flows are established. Finally, we compare these results to information flows in a model network developing according to a spike-timing-dependent plasticity learning rule. Similar temporal patterns in the development of information flows were observed in these networks, hinting at the broader generality of these phenomena.

An Information-Theoretic Framework to Measure the Dynamic Interaction Between Neural Spike Trains

OBJECTIVE

While understanding the interaction patterns among simultaneous recordings of spike trains from multiple neuronal units is a key topic in neuroscience, existing methods either do not consider the inherent point-process nature of spike trains or are based on parametric assumptions. This work presents an information-theoretic framework for the model-free, continuous-time estimation of both undirected (symmetric) and directed (Granger-causal) interactions between spike trains.

METHODS

The framework computes the mutual information rate (MIR) and the transfer entropy rate (TER) for two point processes X and Y, showing that the MIR between X and Y can be decomposed as the sum of the TER along the directions X → Y and Y → X. We present theoretical expressions and introduce strategies to estimate efficiently the two measures through nearest neighbor statistics.

RESULTS

Using simulations of independent and coupled point processes, we show the accuracy of MIR and TER to assess interactions even for weakly coupled and short realizations, and demonstrate the superiority of continuous-time estimation over the standard discrete-time approach. We also apply the MIR and TER to real-world data, specifically, recordings from in-vitro preparations of spontaneously-growing cultures of cortical neurons. Using this dataset, we demonstrate the ability of MIR and TER to describe how the functional networks between recording units emerge over the course of the maturation of the neuronal cultures.

CONCLUSION AND SIGNIFICANCE

the proposed framework provides principled measures to assess undirected and directed spike train interactions with more efficiency and flexibility than previous discrete-time or parametric approaches, opening new perspectives for the analysis of point-process data in neuroscience and many other fields.

Measuring the Rate of Information Exchange in Point-Process Data With Application to Cardiovascular Variability

The amount of information exchanged per unit of time between two dynamic processes is an important concept for the analysis of complex systems. Theoretical formulations and data-efficient estimators have been recently introduced for this quantity, known as the mutual information rate (MIR), allowing its continuous-time computation for event-based data sets measured as realizations of coupled point processes. This work presents the implementation of MIR for point process applications in Network Physiology and cardiovascular variability, which typically feature short and noisy experimental time series. We assess the bias of MIR estimated for uncoupled point processes in the frame of surrogate data, and we compensate it by introducing a corrected MIR (cMIR) measure designed to return zero values when the two processes do not exchange information. The method is first tested extensively in synthetic point processes including a physiologically-based model of the heartbeat dynamics and the blood pressure propagation times, where we show the ability of cMIR to compensate the negative bias of MIR and return statistically significant values even for weakly coupled processes. The method is then assessed in real point-process data measured from healthy subjects during different physiological conditions, showing that cMIR between heartbeat and pressure propagation times increases significantly during postural stress, though not during mental stress. These results document that cMIR reflects physiological mechanisms of cardiovascular variability related to the joint neural autonomic modulation of heart rate and arterial compliance.

Transitions in information processing dynamics at the whole-brain network level are driven by alterations in neural gain

A key component of the flexibility and complexity of the brain is its ability to dynamically adapt its functional network structure between integrated and segregated brain states depending on the demands of different cognitive tasks. Integrated states are prevalent when performing tasks of high complexity, such as maintaining items in working memory, consistent with models of a global workspace architecture. Recent work has suggested that the balance between integration and segregation is under the control of ascending neuromodulatory systems, such as the noradrenergic system, via changes in neural gain (in terms of the amplification and non-linearity in stimulus-response transfer function of brain regions). In a previous large-scale nonlinear oscillator model of neuronal network dynamics, we showed that manipulating neural gain parameters led to a 'critical' transition in phase synchrony that was associated with a shift from segregated to integrated topology, thus confirming our original prediction. In this study, we advance these results by demonstrating that the gain-mediated phase transition is characterized by a shift in the underlying dynamics of neural information processing. Specifically, the dynamics of the subcritical (segregated) regime are dominated by information storage, whereas the supercritical (integrated) regime is associated with increased information transfer (measured via transfer entropy). Operating near to the critical regime with respect to modulating neural gain parameters would thus appear to provide computational advantages, offering flexibility in the information processing that can be performed with only subtle changes in gain control. Our results thus link studies of whole-brain network topology and the ascending arousal system with information processing dynamics, and suggest that the constraints imposed by the ascending arousal system constrain low-dimensional modes of information processing within the brain.

Conformity in the collective: differences in hunger affect individual and group behavior in a shoaling fish

Animal groups are often composed of individuals that vary according to behavioral, morphological, and internal state parameters. Understanding the importance of such individual-level heterogeneity to the establishment and maintenance of coherent group responses is of fundamental interest in collective behavior. We examined the influence of hunger on the individual and collective behavior of groups of shoaling fish, x-ray tetras (Pristella maxillaris). Fish were assigned to one of two nutritional states, satiated or hungry, and then allocated to 5 treatments that represented different ratios of satiated to hungry individuals (8 hungry, 8 satiated, 4:4 hungry:satiated, 2:6 hungry:satiated, 6:2 hungry:satiated). Our data show that groups with a greater proportion of hungry fish swam faster and exhibited greater nearest neighbor distances. Within groups, however, there was no difference in the swimming speeds of hungry versus well-fed fish, suggesting that group members conform and adapt their swimming speed according to the overall composition of the group. We also found significant differences in mean group transfer entropy, suggesting stronger patterns of information flow in groups comprising all, or a majority of, hungry individuals. In contrast, we did not observe differences in polarization, a measure of group alignment, within groups across treatments. Taken together these results demonstrate that the nutritional state of animals within social groups impacts both individual and group behavior, and that members of heterogenous groups can adapt their behavior to facilitate coherent collective motion.