Statistical complexity is maximized close to criticality in cortical dynamics

The network structural entropy for single-cell RNA sequencing data during skin aging

Aging is a complex and heterogeneous biological process at cellular, tissue, and individual levels. Despite extensive effort in scientific research, a comprehensive understanding of aging mechanisms remains lacking. This study analyzed aging-related gene networks, using single-cell RNA sequencing data from >15 000 cells. We constructed a gene correlation network, integrating gene expressions into the weights of network edges, and ranked gene importance using a random walk model to generate a gene importance matrix. This unsupervised method improved the clustering performance of cell types. To further quantify the complexity of gene networks during aging, we introduced network structural entropy. The findings of our study reveal that the overall network structural entropy increases in the aged cells compared to the young cells. However, network entropy changes varied greatly within different cell subtypes. Specifically, the network structural entropy among various cell types may increase, remain unchanged, or decrease. This wide range of changes may be closely related to their individual functions, highlighting the cellular heterogeneity and potential key network reconfigurations. Analyzing gene network entropy provides insights into the molecular mechanisms behind aging. This study offers new scientific evidence and theoretical support for understanding the changes in cell functions during aging.

Entropy of Neuronal Spike Patterns

Neuronal spike patterns are the fundamental units of neural communication in the brain, which is still not fully understood. Entropy measures offer a quantitative framework to assess the variability and information content of these spike patterns. By quantifying the uncertainty and informational content of neuronal patterns, entropy measures provide insights into neural coding strategies, synaptic plasticity, network dynamics, and cognitive processes. Here, we review basic entropy metrics and then we provide examples of recent advancements in using entropy as a tool to improve our understanding of neuronal processing. It focuses especially on studies on critical dynamics in neural networks and the relation of entropy to predictive coding and cortical communication. We highlight the necessity of expanding entropy measures from single neurons to encompass multi-neuronal activity patterns, as cortical circuits communicate through coordinated spatiotemporal activity patterns, called neuronal packets. We discuss how the sequential and partially stereotypical nature of neuronal packets influences the entropy of cortical communication. Stereotypy reduces entropy by enhancing reliability and predictability in neural signaling, while variability within packets increases entropy, allowing for greater information capacity. This balance between stereotypy and variability supports both robustness and flexibility in cortical information processing. We also review challenges in applying entropy to analyze such spatiotemporal neuronal spike patterns, notably, the "curse of dimensionality" in estimating entropy for high-dimensional neuronal data. Finally, we discuss strategies to overcome these challenges, including dimensionality reduction techniques, advanced entropy estimators, sparse coding schemes, and the integration of machine learning approaches. Thus, this work summarizes the most recent developments on how entropy measures contribute to our understanding of principles underlying neural coding.

Maximum-entropy-based metrics for quantifying critical dynamics in spiking neuron data

An important working hypothesis to investigate brain activity is whether it operates in a critical regime. Recently, maximum-entropy phenomenological models have emerged as an alternative way of identifying critical behavior in neuronal data sets. In the present paper, we investigate the signatures of criticality from a firing rate-based maximum-entropy approach on data sets generated by computational models, and we compare them to experimental results. We found that the maximum entropy approach consistently identifies critical behavior around the phase transition in models and rules out criticality in models without phase transition. The maximum-entropy-model results are compatible with results for cortical data from urethane-anesthetized rats data, providing further support for criticality in the brain.

Symbolic information approach applied to human intracranial data to characterize and distinguish different congnitive processes

How the human brain processes information during different cognitive tasks is one of the greatest questions in contemporary neuroscience. Understanding the statistical properties of brain signals during specific activities is one promising way to address this question. Here we analyze freely available data from implanted electrocorticography (ECoG) in five human subjects during two different cognitive tasks in the light of information theory quantifiers ideas. We employ a symbolic information approach to determine the probability distribution function associated with the time series from different cortical areas. Then we utilize these probabilities to calculate the associated Shannon entropy and a statistical complexity measure based on the disequilibrium between the actual time series and one with a uniform probability distribution function. We show that an Euclidian distance in the complexity-entropy plane and an asymmetry index for complexity are useful for comparing the two conditions. We show that our method can distinguish visual search epochs from blank screen intervals in different electrodes and patients. By using a multiscale approach and embedding time delays to downsample the data, we find important timescales in which the relevant information is being processed. We also determine cortical regions and time intervals along the 2-s-long trials that present more pronounced differences between the two cognitive tasks. Finally, we show that the method is useful to distinguish cognitive processes using brain activity on a trial-by-trial basis.

State-dependent complexity of the local field potential in the primary visual cortex

The local field potential (LFP) is as a measure of the combined activity of neurons within a region of brain tissue. While biophysical modeling schemes for LFP in cortical circuits are well established, there is a paramount lack of understanding regarding the LFP properties along the states assumed in cortical circuits over long periods. Here we use a symbolic information approach to determine the statistical complexity based on Jensen disequilibrium measure and Shannon entropy of LFP data recorded from the primary visual cortex (V1) of urethane-anesthetized rats and freely moving mice. Using these information quantifiers, we find consistent relations between LFP recordings and measures of cortical states at the neuronal level. More specifically, we show that LFP's statistical complexity is sensitive to cortical state (characterized by spiking variability), as well as to cortical layer. In addition, we apply these quantifiers to characterize behavioral states of freely moving mice, where we find indirect relations between such states and spiking variability.

Brain criticality predicts individual levels of inter-areal synchronization in human electrophysiological data

Neuronal oscillations and their synchronization between brain areas are fundamental for healthy brain function. Yet, synchronization levels exhibit large inter-individual variability that is associated with behavioral variability. We test whether individual synchronization levels are predicted by individual brain states along an extended regime of critical-like dynamics - the Griffiths phase (GP). We use computational modelling to assess how synchronization is dependent on brain criticality indexed by long-range temporal correlations (LRTCs). We analyze LRTCs and synchronization of oscillations from resting-state magnetoencephalography and stereo-electroencephalography data. Synchronization and LRTCs are both positively linearly and quadratically correlated among healthy subjects, while in epileptogenic areas they are negatively linearly correlated. These results show that variability in synchronization levels is explained by the individual position along the GP with healthy brain areas operating in its subcritical and epileptogenic areas in its supercritical side. We suggest that the GP is fundamental for brain function allowing individual variability while retaining functional advantages of criticality.

Parabolic avalanche scaling in the synchronization of cortical cell assemblies

Neurons in the cerebral cortex fire coincident action potentials during ongoing activity and in response to sensory inputs. These synchronized cell assemblies are fundamental to cortex function, yet basic dynamical aspects of their size and duration are largely unknown. Using 2-photon imaging of neurons in the superficial cortex of awake mice, we show that synchronized cell assemblies organize as scale-invariant avalanches that quadratically grow with duration. The quadratic avalanche scaling was only found for correlated neurons, required temporal coarse-graining to compensate for spatial subsampling of the imaged cortex, and suggested cortical dynamics to be critical as demonstrated in simulations of balanced E/I-networks. The corresponding time course of an inverted parabola with exponent of χ = 2 described cortical avalanches of coincident firing for up to 5 s duration over an area of 1 mm². These parabolic avalanches maximized temporal complexity in the ongoing activity of prefrontal and somatosensory cortex and in visual responses of primary visual cortex. Our results identify a scale-invariant temporal order in the synchronization of highly diverse cortical cell assemblies in the form of parabolic avalanches.

Characterizing the information transmission of inverse stochastic resonance and noise-induced activity amplification in neuronal systems

Purkinje cells exhibit a reduction of the mean firing rate at intermediate-noise intensities, which is somewhat reminiscent of the response enhancement known as "stochastic resonance" (SR). Although the comparison with the stochastic resonance ends here, the current phenomenon has been given the name "inverse stochastic resonance" (ISR). Recent research has demonstrated that the ISR effect, like its close relative "nonstandard SR" [or, more correctly, noise-induced activity amplification (NIAA)], has been shown to stem from the weak-noise quenching of the initial distribution, in bistable regimes where the metastable state has a larger attraction basin than the global minimum. To understand the underlying mechanism of the ISR and NIAA phenomena, we study the probability distribution function of a one-dimensional system subjected to a bistable potential that has the property of symmetry, i.e., if we change the sign of one of its parameters, we can obtain both phenomena with the same properties in the depth of the wells and the width of their basins of attraction subjected to Gaussian white noise with variable intensity. Previous work has shown that one can theoretically determine the probability distribution function using the convex sum between the behavior at small and high noise intensities. To determine the probability distribution function more precisely, we resort to the "weighted ensemble Brownian dynamics simulation" model, which provides an accurate estimate of the probability distribution function for both low and high noise intensities and, most importantly, for the transition of both behaviors. In this way, on the one hand, we show that both phenomena emerge from a metastable system where, in the case of ISR, the global minimum of the system is in a state of lower activity, while in the case of NIAA, the global minimum is in a state of increased activity, the importance of which does not depend on the width of the basins of attraction. On the other hand, we see that quantifiers such as Fisher information, statistical complexity, and especially Shannon entropy fail to distinguish them, but they show the existence of the mentioned phenomena. Thus, noise management may well be a mechanism by which Purkinje cells find an efficient way to transmit information in the cerebral cortex.

Neuronal avalanche dynamics and functional connectivity elucidate information propagation in vitro

Cascading activity is commonly observed in complex dynamical systems, including networks of biological neurons, and how these cascades spread through the system is reliant on how the elements of the system are connected and organized. In this work, we studied networks of neurons as they matured over 50 days in vitro and evaluated both their dynamics and their functional connectivity structures by observing their electrophysiological activity using microelectrode array recordings. Correlations were obtained between features of their activity propagation and functional connectivity characteristics to elucidate the interplay between dynamics and structure. The results indicate that in vitro networks maintain a slightly subcritical state by striking a balance between integration and segregation. Our work demonstrates the complementarity of these two approaches—functional connectivity and avalanche dynamics—in studying information propagation in neurons in vitro, which can in turn inform the design and optimization of engineered computational substrates.

Entropy, Economics, and Criticality

Information theory is a well-established method for the study of many phenomena and more than 70 years after Claude Shannon first described it in A Mathematical Theory of Communication it has been extended well beyond Shannon's initial vision. It is now an interdisciplinary tool that is used from 'causal' information flow to inferring complex computational processes and it is common to see it play an important role in fields as diverse as neuroscience, artificial intelligence, quantum mechanics, and astrophysics. In this article, I provide a selective review of a specific aspect of information theory that has received less attention than many of the others: as a tool for understanding, modelling, and detecting non-linear phenomena in finance and economics. Although some progress has been made in this area, it is still an under-developed area that I argue has considerable scope for further development.