Finite-size effects of avalanche dynamics

Adaptive rewiring: a general principle for neural network development

The nervous system, especially the human brain, is characterized by its highly complex network topology. The neurodevelopment of some of its features has been described in terms of dynamic optimization rules. We discuss the principle of adaptive rewiring, i.e., the dynamic reorganization of a network according to the intensity of internal signal communication as measured by synchronization or diffusion, and its recent generalization for applications in directed networks. These have extended the principle of adaptive rewiring from highly oversimplified networks to more neurally plausible ones. Adaptive rewiring captures all the key features of the complex brain topology: it transforms initially random or regular networks into networks with a modular small-world structure and a rich-club core. This effect is specific in the sense that it can be tailored to computational needs, robust in the sense that it does not depend on a critical regime, and flexible in the sense that parametric variation generates a range of variant network configurations. Extreme variant networks can be associated at macroscopic level with disorders such as schizophrenia, autism, and dyslexia, and suggest a relationship between dyslexia and creativity. Adaptive rewiring cooperates with network growth and interacts constructively with spatial organization principles in the formation of topographically distinct modules and structures such as ganglia and chains. At the mesoscopic level, adaptive rewiring enables the development of functional architectures, such as convergent-divergent units, and sheds light on the early development of divergence and convergence in, for example, the visual system. Finally, we discuss future prospects for the principle of adaptive rewiring.

Neuronal avalanches: Sandpiles of self-organized criticality or critical dynamics of brain waves?

Analytical expressions for scaling of brain wave spectra derived from the general nonlinear wave Hamiltonian form show excellent agreement with experimental "neuronal avalanche" data. The theory of the weakly evanescent nonlinear brain wave dynamics [Phys. Rev. Research 2, 023061 (2020); J. Cognitive Neurosci. 32, 2178 (2020)] reveals the underlying collective processes hidden behind the phenomenological statistical description of the neuronal avalanches and connects together the whole range of brain activity states, from oscillatory wave-like modes, to neuronal avalanches, to incoherent spiking, showing that the neuronal avalanches are just the manifestation of the different nonlinear side of wave processes abundant in cortical tissue. In a more broad way these results show that a system of wave modes interacting through all possible combinations of the third order nonlinear terms described by a general wave Hamiltonian necessarily produces anharmonic wave modes with temporal and spatial scaling properties that follow scale free power laws. To the best of our knowledge this has never been reported in the physical literature and may be applicable to many physical systems that involve wave processes and not just to neuronal avalanches.

Empirical mode decomposition of local field potential data from optogenetic experiments

Introduction

This study investigated the effects of cocaine administration and parvalbumin-type interneuron stimulation on local field potentials (LFPs) recorded in vivo from the medial prefrontal cortex (mPFC) of six mice using optogenetic tools.

Methods

The local network was subject to a brief 10 ms laser pulse, and the response was recorded for 2 s over 100 trials for each of the six subjects who showed stable coupling between the mPFC and the optrode. Due to the strong non-stationary and nonlinearity of the LFP, we used the adaptive, data-driven, Empirical Mode Decomposition (EMD) method to decompose the signal into orthogonal Intrinsic Mode Functions (IMFs).

Results

Through trial and error, we found that seven is the optimum number of orthogonal IMFs that overlaps with known frequency bands of brain activity. We found that the Index of Orthogonality (IO) of IMF amplitudes was close to zero. The Index of Energy Conservation (IEC) for each decomposition was close to unity, as expected for orthogonal decompositions. We found that the power density distribution vs. frequency follows a power law with an average scaling exponent of ~1.4 over the entire range of IMF frequencies 2-2,000 Hz.

Discussion

The scaling exponent is slightly smaller for cocaine than the control, suggesting that neural activity avalanches under cocaine have longer life spans and sizes.

Critical brain wave dynamics of neuronal avalanches

Analytical expressions for scaling of brain wave spectra derived from the general non-linear wave Hamiltonian form show excellent agreement with experimental "neuronal avalanche" data. The theory of the weakly evanescent non-linear brain wave dynamics reveals the underlying collective processes hidden behind the phenomenological statistical description of the neuronal avalanches and connects together the whole range of brain activity states, from oscillatory wave-like modes, to neuronal avalanches, to incoherent spiking, showing that the neuronal avalanches are just the manifestation of the different non-linear side of wave processes abundant in cortical tissue. In a more broad way these results show that a system of wave modes interacting through all possible combinations of the third order non-linear terms described by a general wave Hamiltonian necessarily produces anharmonic wave modes with temporal and spatial scaling properties that follow scale free power laws. To the best of our knowledge this has never been reported in the physical literature and may be applicable to many physical systems that involve wave processes and not just to neuronal avalanches.

Addressing skepticism of the critical brain hypothesis

The hypothesis that living neural networks operate near a critical phase transition point has received substantial discussion. This “criticality hypothesis” is potentially important because experiments and theory show that optimal information processing and health are associated with operating near the critical point. Despite the promise of this idea, there have been several objections to it. While earlier objections have been addressed already, the more recent critiques of Touboul and Destexhe have not yet been fully met. The purpose of this paper is to describe their objections and offer responses. Their first objection is that the well-known Brunel model for cortical networks does not display a peak in mutual information near its phase transition, in apparent contradiction to the criticality hypothesis. In response I show that it does have such a peak near the phase transition point, provided it is not strongly driven by random inputs. Their second objection is that even simple models like a coin flip can satisfy multiple criteria of criticality. This suggests that the emergent criticality claimed to exist in cortical networks is just the consequence of a random walk put through a threshold. In response I show that while such processes can produce many signatures criticality, these signatures (1) do not emerge from collective interactions, (2) do not support information processing, and (3) do not have long-range temporal correlations. Because experiments show these three features are consistently present in living neural networks, such random walk models are inadequate. Nevertheless, I conclude that these objections have been valuable for refining research questions and should always be welcomed as a part of the scientific process.

Self-organized criticality as a framework for consciousness: A review study

Objective

No current model of consciousness is univocally accepted on either theoretical or empirical grounds, and the need for a solid unifying framework is evident. Special attention has been given to the premise that self-organized criticality (SOC) is a fundamental property of neural system. SOC provides a competitive model to describe the physical mechanisms underlying spontaneous brain activity, and thus, critical dynamics were proposed as general gauges of information processing representing a strong candidate for a surrogate measure of consciousness. As SOC could be a neurodynamical framework, which may be able to bring together existing theories and experimental evidence, the purpose of this work was to provide a comprehensive overview of progress of research on SOC in association with consciousness.

Methods

A comprehensive search of publications on consciousness and SOC published between 1998 and 2021 was conducted. The Web of Science database was searched, and annual number of publications and citations, type of articles, and applied methods were determined.

Results

A total of 71 publications were identified. The annual number of citations steadily increased over the years. Original articles comprised 50.7% and reviews/theoretical articles 43.6%. Sixteen studies reported on human data and in seven studies data were recorded in animals. Computational models were utilized in n = 12 studies. EcoG data were assessed in n = 4 articles, fMRI in n = 4 studies, and EEG/MEG in n = 10 studies. Notably, different analytical tools were applied in the EEG/MEG studies to assess a surrogate measure of criticality such as the detrended fluctuation analysis, the pair correlation function, parameters from the neuronal avalanche analysis and the spectral exponent.

Conclusion

Recent studies pointed out agreements of critical dynamics with the current most influencing theories in the field of consciousness research, the global workspace theory and the integrated information theory. Thus, the framework of SOC as a neurodynamical parameter for consciousness seems promising. However, identified experimental work was small in numbers, and a heterogeneity of applied analytical tools as a surrogate measure of criticality was observable, which limits the generalizability of findings.

Insulin signaling shapes fractal scaling of C. elegans behavior

Fractal scaling in animal behavioral activity, where similar temporal patterns appear repeatedly over a series of magnifications among time scales, governs the complex behavior of various animal species and, in humans, can be altered by neurodegenerative diseases and aging. However, the mechanism underlying fractal scaling remains unknown. Here, we cultured C. elegans in a microfluidic device for 3 days and analyzed temporal patterns of C. elegans activity by fractal analyses. The residence-time distribution of C. elegans behaviors shared a common feature with those of human and mice. Specifically, the residence-time power-law distribution of the active state changed to an exponential-like decline at a longer time scale, whereas the inactive state followed a power-law distribution. An exponential-like decline appeared with nutrient supply in wild-type animals, whereas this decline disappeared in insulin-signaling-defective daf-2 and daf-16 mutants. The absolute value of the power-law exponent of the inactive state distribution increased with nutrient supply in wild-type animals, whereas the value decreased in daf-2 and daf-16 mutants. We conclude that insulin signaling differentially affects mechanisms that determine the residence time in active and inactive states in C. elegans behavior. In humans, diabetes mellitus, which is caused by defects in insulin signaling, is associated with mood disorders that affect daily behavioral activities. We hypothesize that comorbid behavioral defects in patients with diabetes may be attributed to altered fractal scaling of human behavior.

The Analysis of Mammalian Hearing Systems Supports the Hypothesis That Criticality Favors Neuronal Information Representation but Not Computation

In the neighborhood of critical states, distinct materials exhibit the same physical behavior, expressed by common simple laws among measurable observables, hence rendering a more detailed analysis of the individual systems obsolete. It is a widespread view that critical states are fundamental to neuroscience and directly favor computation. We argue here that from an evolutionary point of view, critical points seem indeed to be a natural phenomenon. Using mammalian hearing as our example, we show, however, explicitly that criticality does not describe the proper computational process and thus is only indirectly related to the computation in neural systems.

Evidence for Quasicritical Brain Dynamics

Much evidence seems to suggest the cortex operates near a critical point, yet a single set of exponents defining its universality class has not been found. In fact, when critical exponents are estimated from data, they widely differ across species, individuals of the same species, and even over time, or depending on stimulus. Interestingly, these exponents still approximately hold to a dynamical scaling relation. Here we show that the theory of quasicriticality, an organizing principle for brain dynamics, can account for this paradoxical situation. As external stimuli drive the cortex, quasicriticality predicts a departure from criticality along a Widom line with exponents that decrease in absolute value, while still holding approximately to a dynamical scaling relation. We use simulations and experimental data to confirm these predictions and describe new ones that could be tested soon.

Self-organized criticality in neural networks from activity-based rewiring

Neural systems process information in a dynamical regime between silence and chaotic dynamics. This has lead to the criticality hypothesis, which suggests that neural systems reach such a state by self-organizing toward the critical point of a dynamical phase transition. Here, we study a minimal neural network model that exhibits self-organized criticality in the presence of stochastic noise using a rewiring rule which only utilizes local information. For network evolution, incoming links are added to a node or deleted, depending on the node's average activity. Based on this rewiring-rule only, the network evolves toward a critical state, showing typical power-law-distributed avalanche statistics. The observed exponents are in accord with criticality as predicted by dynamical scaling theory, as well as with the observed exponents of neural avalanches. The critical state of the model is reached autonomously without the need for parameter tuning, is independent of initial conditions, is robust under stochastic noise, and independent of details of the implementation as different variants of the model indicate. We argue that this supports the hypothesis that real neural systems may utilize such a mechanism to self-organize toward criticality, especially during early developmental stages.

Collective firing patterns of neuronal networks with short-term synaptic plasticity

We investigate the occurrence of synchronous population activities in a neuronal network composed of both excitatory and inhibitory neurons and equipped with short-term synaptic plasticity. The collective firing patterns with different macroscopic properties emerge visually with the change of system parameters, and most long-time collective evolution also shows periodic-like characteristics. We systematically discuss the pattern-formation dynamics on a microscopic level and find a lot of hidden features of the population activities. The bursty phase with power-law distributed avalanches is observed in which the population activity can be either entire or local periodic-like. In the purely spike-to-spike synchronous regime, the periodic-like phase emerges from the synchronous chaos after the backward period-doubling transition. The local periodic-like population activity and the synchronous chaotic activity show substantial trial-to-trial variability, which is unfavorable for neural code, while they are contrary to the stable periodic-like phases. We also show that the inhibitory neurons can promote the generation of cluster firing behavior and strong bursty collective firing activity by depressing the activities of postsynaptic neurons partially or wholly.

Avalanche size distribution of an integrate-and-fire neural model on complex networks

We considered the neural avalanche dynamics of a modified integrate-and-fire model on complex networks, as well as the neural dynamics in a fully connected network, random network, small-world network, and scale-free network. We observed the self-organized criticality of the neural model on complex networks. The probability distribution of the avalanche size and lifetime follow the power law at the critical synaptic strength. Neuronal dynamics on a complex network are not universal. The critical exponents of the avalanche dynamics depend on the structure of the complex network. We observed that the critical exponents deviate from the mean-field value.

Extreme value theory of evolving phenomena in complex dynamical systems: Firing cascades in a model of a neural network

We extend the scope of the dynamical theory of extreme values to include phenomena that do not happen instantaneously but evolve over a finite, albeit unknown at the onset, time interval. We consider complex dynamical systems composed of many individual subsystems linked by a network of interactions. As a specific example of the general theory, a model of a neural network, previously introduced by other authors to describe the electrical activity of the cerebral cortex, is analyzed in detail. On the basis of this analysis, we propose a novel definition of a neuronal cascade, a physiological phenomenon of primary importance. We derive extreme value laws for the statistics of these cascades, both from the point of view of exceedances (that satisfy critical scaling theory in a certain regime) and of block maxima.

Inhibitory Units: An Organizing Nidus for Feature-Selective SubNetworks in Area V1

Neuronal circuits often display small-world network architecture characterized by neuronal cliques of dense local connectivity communicating with each other through a limited number of cells that participate in multiple cliques. The principles by which such cliques organize to encode information remain poorly understood. Similarly tuned pyramidal cells that preferentially target each other may form multicellular encoding units performing distinct computational tasks. The existence of such units can reflect upon both spontaneous and stimulus-driven population events.We applied two-photon calcium imaging to study spontaneous population bursts in layer 2/3 of area V1 in male C57BL/6 mice. To identify potential small-world cliques, we searched for pyramidal cells whose calcium events had a consistent temporal relationship with the events of local inhibitory interneurons. This was guided by the intuition that groups of neurons whose synchronous firing represents a temporally coherent computational unit should be inhibited together. Pyramidal members of these interneuron-centered clusters on average displayed stronger functional connectivity between each other than with nonmember pyramidal neurons. The structure of the clusters evolved during postnatal development: cluster size and overlap between clusters decreased with developmental maturation. Pyramidal neurons in a cluster showed higher than chance tuning function similarity between each other and with the linked interneuron. Thus, spontaneous population events in V1 are shaped by small-world subnetworks of pyramidal neurons that share functional properties and work as a coherent unit with a local interneuron. These interneuron-pyramidal cell partnerships may represent a fundamental neocortical unit of computation at the population level.SIGNIFICANCE STATEMENT Neuronal circuit in layer 2/3 of mouse area V1 possesses small-world network architecture, where cliques of densely interconnected neurons ("small worlds") communicate via restricted number of hub cells. We show that: (1) in mouse V1 individual small-world cliques preferably incorporate pyramidal neurons with similar visual feature tuning, and (2) ongoing population activity of such pyramidal neuron clique is temporally linked to the activity of the local interneuron sharing its feature tuning with the clique members. Functional grouping of similarly tuned interneurons and pyramidal cells into cliques may ensure that ensembles of functionally alike pyramidal cells recruited during perceptual tasks and spontaneous activity are also turned off together as a unit, with interneurons serving as organizers of linked pyramidal ensemble activity.

Growing Critical: Self-Organized Criticality in a Developing Neural System

Experiments in various neural systems found avalanches: bursts of activity with characteristics typical for critical dynamics. A possible explanation for their occurrence is an underlying network that self-organizes into a critical state. We propose a simple spiking model for developing neural networks, showing how these may "grow into" criticality. Avalanches generated by our model correspond to clusters of widely applied Hawkes processes. We analytically derive the cluster size and duration distributions and find that they agree with those of experimentally observed neuronal avalanches.

On the origin of lognormal network synchrony in CA1

The sharp wave ripple complex in rodent hippocampus is associated with a network burst in CA3 (NB) that triggers a synchronous event in the CA1 population (SE). The number of CA1 pyramidal cells participating in a SE has been observed to follow a lognormal distribution. However, the origin of this skewed and heavy-tailed distribution of population synchrony in CA1 remains unknown. Because the size of SEs is likely to originate from the size of the NBs and the underlying neural circuitry, we model the CA3-CA1 circuit to study the underlying mechanisms and their functional implications. We show analytically that if the size of a NB in CA3 is distributed according to a normal distribution, then the size of the resulting SE in CA1 follows a lognormal distribution. Our model predicts the distribution of the NB size in CA3, which remains to be tested experimentally. Moreover, we show that a putative lognormal NB size distribution leads to an extremely heavy-tailed SE size distribution in CA1, contradicting experimental evidence. In conclusion, our model provides general insight on the origin of lognormally distributed network synchrony as a consequence of synchronous synaptic transmission of normally distributed input events.

Can a time varying external drive give rise to apparent criticality in neural systems?

The finding of power law scaling in neural recordings lends support to the hypothesis of critical brain dynamics. However, power laws are not unique to critical systems and can arise from alternative mechanisms. Here, we investigate whether a common time-varying external drive to a set of Poisson units can give rise to neuronal avalanches and exhibit apparent criticality. To this end, we analytically derive the avalanche size and duration distributions, as well as additional measures, first for homogeneous Poisson activity, and then for slowly varying inhomogeneous Poisson activity. We show that homogeneous Poisson activity cannot give rise to power law distributions. Inhomogeneous activity can also not generate perfect power laws, but it can exhibit approximate power laws with cutoffs that are comparable to those typically observed in experiments. The mechanism of generating apparent criticality by time-varying external fields, forces or input may generalize to many other systems like dynamics of swarms, diseases or extinction cascades. Here, we illustrate the analytically derived effects for spike recordings in vivo and discuss approaches to distinguish true from apparent criticality. Ultimately, this requires causal interventions, which allow separating internal system properties from externally imposed ones.

Comparative approximations of criticality in a neural and quantum regime

Under a variety of conditions, stochastic and non-linear systems with many degrees of freedom tend to evolve towards complexity and criticality. Over the last decades, a steady proliferation of models re: far-from-equilibrium thermodynamics of metastable, many-valued systems arose, serving as attributes of a 'critical' attractor landscape. Building off recent data citing trademark aspects of criticality in the brain-including: power-laws, scale-free (1/f) behavior (scale invariance, or scale independence), critical slowing, and avalanches-it has been conjectured that operating at criticality entails functional advantages such as: optimized neural computation and information processing; boosted memory; large dynamical ranges; long-range communication; and an increased ability to react to highly diverse stimuli. In short, critical dynamics provide a necessary condition for neurobiologically significant elements of brain dynamics. Theoretical predictions have been verified in specific models such as Boolean networks, liquid state machines, and neural networks. These findings inspired the neural criticality hypothesis, proposing that the brain operates in a critical state because the associated optimal computational capabilities provide an evolutionarily advantage. This paper develops in three parts: after developing the critical landscape, we will then shift gears to rediscover another inroad to criticality via stochastic quantum field theory and dissipative dynamics. The existence of these two approaches deserves some consideration, given both neural and quantum criticality hypotheses propose specific mechanisms that leverage the same phenomena. This suggests that understanding the quantum approach could help to shed light on brain-based modeling. In the third part, we will turn to Whitehead's actual entities and modes of perception in order to demonstrate a concomitant logic underwriting both models. In the discussion, I briefly motivate a reading of criticality and its properties as responsive to the characterization of tenets from Eastern wisdom traditions.

Criticality predicts maximum irregularity in recurrent networks of excitatory nodes

A rigorous understanding of brain dynamics and function requires a conceptual bridge between multiple levels of organization, including neural spiking and network-level population activity. Mounting evidence suggests that neural networks of cerebral cortex operate at a critical regime, which is defined as a transition point between two phases of short lasting and chaotic activity. However, despite the fact that criticality brings about certain functional advantages for information processing, its supporting evidence is still far from conclusive, as it has been mostly based on power law scaling of size and durations of cascades of activity. Moreover, to what degree such hypothesis could explain some fundamental features of neural activity is still largely unknown. One of the most prevalent features of cortical activity in vivo is known to be spike irregularity of spike trains, which is measured in terms of the coefficient of variation (CV) larger than one. Here, using a minimal computational model of excitatory nodes, we show that irregular spiking (CV > 1) naturally emerges in a recurrent network operating at criticality. More importantly, we show that even at the presence of other sources of spike irregularity, being at criticality maximizes the mean coefficient of variation of neurons, thereby maximizing their spike irregularity. Furthermore, we also show that such a maximized irregularity results in maximum correlation between neuronal firing rates and their corresponding spike irregularity (measured in terms of CV). On the one hand, using a model in the universality class of directed percolation, we propose new hallmarks of criticality at single-unit level, which could be applicable to any network of excitable nodes. On the other hand, given the controversy of the neural criticality hypothesis, we discuss the limitation of this approach to neural systems and to what degree they support the criticality hypothesis in real neural networks. Finally, we discuss the limitations of applying our results to real networks and to what degree they support the criticality hypothesis.

A stochastic-field description of finite-size spiking neural networks

Neural network dynamics are governed by the interaction of spiking neurons. Stochastic aspects of single-neuron dynamics propagate up to the network level and shape the dynamical and informational properties of the population. Mean-field models of population activity disregard the finite-size stochastic fluctuations of network dynamics and thus offer a deterministic description of the system. Here, we derive a stochastic partial differential equation (SPDE) describing the temporal evolution of the finite-size refractory density, which represents the proportion of neurons in a given refractory state at any given time. The population activity—the density of active neurons per unit time—is easily extracted from this refractory density. The SPDE includes finite-size effects through a two-dimensional Gaussian white noise that acts both in time and along the refractory dimension. For an infinite number of neurons the standard mean-field theory is recovered. A discretization of the SPDE along its characteristic curves allows direct simulations of the activity of large but finite spiking networks; this constitutes the main advantage of our approach. Linearizing the SPDE with respect to the deterministic asynchronous state allows the theoretical investigation of finite-size activity fluctuations. In particular, analytical expressions for the power spectrum and autocorrelation of activity fluctuations are obtained. Moreover, our approach can be adapted to incorporate multiple interacting populations and quasi-renewal single-neuron dynamics.

In the brain, information about stimuli is encoded in the timing of action potentials produced by neurons. An understanding of this neural code is facilitated by the use of a well-established method called mean-field theory. Over the last two decades or so, mean-field theory has brought an important added value to the study of emergent properties of neural circuits. Nonetheless, in the mean-field framework, the thermodynamic limit has to be taken, that is, to postulate the number of neurons to be infinite. Doing so, small fluctuations are neglected, and the randomness so present at the cellular level disappears from the description of the circuit dynamics. The origin and functional implications of variability at the network scale are ongoing questions of interest in neuroscience. It is therefore crucial to go beyond the mean-field approach and to propose a description that fully entails the stochastic aspects of network dynamics. In this manuscript, we address this issue by showing that the dynamics of finite-size networks can be represented by stochastic partial differential equations.

Neocortical activity is stimulus- and scale-invariant

Mounting evidence supports the hypothesis that the cortex operates near a critical state, defined as the transition point between order (large-scale activity) and disorder (small-scale activity). This criticality is manifested by power law distribution of the size and duration of spontaneous cascades of activity, which are referred as neuronal avalanches. The existence of such neuronal avalanches has been confirmed by several studies both in vitro and in vivo, among different species and across multiple spatial scales. However, despite the prevalence of scale free activity, still very little is known concerning whether and how the scale-free nature of cortical activity is altered during external stimulation. To address this question, we performed in vivo two-photon population calcium imaging of layer 2/3 neurons in primary visual cortex of behaving mice during visual stimulation and conducted statistical analyses on the inferred spike trains. Our investigation for each mouse and condition revealed power law distributed neuronal avalanches, and irregular spiking individual neurons. Importantly, both the avalanche and the spike train properties remained largely unchanged for different stimuli, while the cross-correlation structure varied with stimuli. Our results establish that microcircuits in the visual cortex operate near the critical regime, while rearranging functional connectivity in response to varying sensory inputs.

Long-range temporal correlations in neural narrowband time-series arise due to critical dynamics

We show theoretically that the hypothesis of criticality as a theory of long-range fluctuation in the human brain may be distinguished from the theory of passive filtering on the basis of macroscopic neuronal signals such as the electroencephalogram, using novel theory of narrowband amplitude time-series at criticality. Our theory predicts the division of critical activity into meta-universality classes. As a consequence our analysis shows that experimental electroencephalography data favours the hypothesis of criticality in the human brain.

Subsampling scaling

In real-world applications, observations are often constrained to a small fraction of a system. Such spatial subsampling can be caused by the inaccessibility or the sheer size of the system, and cannot be overcome by longer sampling. Spatial subsampling can strongly bias inferences about a system's aggregated properties. To overcome the bias, we derive analytically a subsampling scaling framework that is applicable to different observables, including distributions of neuronal avalanches, of number of people infected during an epidemic outbreak, and of node degrees. We demonstrate how to infer the correct distributions of the underlying full system, how to apply it to distinguish critical from subcritical systems, and how to disentangle subsampling and finite size effects. Lastly, we apply subsampling scaling to neuronal avalanche models and to recordings from developing neural networks. We show that only mature, but not young networks follow power-law scaling, indicating self-organization to criticality during development.

We can often observe only a small fraction of a system, which leads to biases in the inference of its global properties. Here, the authors develop a framework that enables overcoming subsampling effects, apply it to recordings from developing neural networks, and find that neural networks become critical as they mature.

Spontaneous cortical activity is transiently poised close to criticality

Brain activity displays a large repertoire of dynamics across the sleep-wake cycle and even during anesthesia. It was suggested that criticality could serve as a unifying principle underlying the diversity of dynamics. This view has been supported by the observation of spontaneous bursts of cortical activity with scale-invariant sizes and durations, known as neuronal avalanches, in recordings of mesoscopic cortical signals. However, the existence of neuronal avalanches in spiking activity has been equivocal with studies reporting both its presence and absence. Here, we show that signs of criticality in spiking activity can change between synchronized and desynchronized cortical states. We analyzed the spontaneous activity in the primary visual cortex of the anesthetized cat and the awake monkey, and found that neuronal avalanches and thermodynamic indicators of criticality strongly depend on collective synchrony among neurons, LFP fluctuations, and behavioral state. We found that synchronized states are associated to criticality, large dynamical repertoire and prolonged epochs of eye closure, while desynchronized states are associated to sub-criticality, reduced dynamical repertoire, and eyes open conditions. Our results show that criticality in cortical dynamics is not stationary, but fluctuates during anesthesia and between different vigilance states.

Modulation of Context-Dependent Spatiotemporal Patterns within Packets of Spiking Activity

Recent experiments have shown that stereotypical spatiotemporal patterns occur during brief packets of spiking activity in the cortex, and it has been suggested that top-down inputs can modulate these patterns according to the context. We propose a simple model that may explain important features of these experimental observations and is analytically tractable. The key mechanism underlying this model is that context-dependent top-down inputs can modulate the effective connection strengths between neurons because of short-term synaptic depression. As a result, the degree of synchrony and, in turn, the spatiotemporal patterns of spiking activity that occur during packets are modulated by the top-down inputs. This is shown using an analytical framework, based on avalanche dynamics, that allows calculating the probability that a given neuron spikes during a packet and numerical simulations. Finally, we show that the spatiotemporal patterns that replay previously experienced sequential stimuli and their binding with their corresponding context can be learned because of spike-timing-dependent plasticity.

Inhibitory neurons promote robust critical firing dynamics in networks of integrate-and-fire neurons

We study the firing dynamics of a discrete-state and discrete-time version of an integrate-and-fire neuronal network model with both excitatory and inhibitory neurons. When the integer-valued state of a neuron exceeds a threshold value, the neuron fires, sends out state-changing signals to its connected neurons, and returns to the resting state. In this model, a continuous phase transition from non-ceaseless firing to ceaseless firing is observed. At criticality, power-law distributions of avalanche size and duration with the previously derived exponents, -3/2 and -2, respectively, are observed. Using a mean-field approach, we show analytically how the critical point depends on model parameters. Our main result is that the combined presence of both inhibitory neurons and integrate-and-fire dynamics greatly enhances the robustness of critical power-law behavior (i.e., there is an increased range of parameters, including both sub- and supercritical values, for which several decades of power-law behavior occurs).

Auditory Power-Law Activation Avalanches Exhibit a Fundamental Computational Ground State

The cochlea provides a biological information-processing paradigm that we are only beginning to understand in its full complexity. Our work reveals an interacting network of strongly nonlinear dynamical nodes, on which even a simple sound input triggers subnetworks of activated elements that follow power-law size statistics ("avalanches"). From dynamical systems theory, power-law size distributions relate to a fundamental ground state of biological information processing. Learning destroys these power laws. These results strongly modify the models of mammalian sound processing and provide a novel methodological perspective for understanding how the brain processes information.

Avalanche dynamics

The avalanche transformation as a model for avalanches in neural dynamics was introduced in [8] in 2008. Here we discuss this transformation in terms of group actions, random dynamics and skew products with a finite invariant measure. The results are based on [8]. Some open problems are mentioned.

Stochastic Oscillation in Self-Organized Critical States of Small Systems: Sensitive Resting State in Neural Systems

Self-organized critical states (SOCs) and stochastic oscillations (SOs) are simultaneously observed in neural systems, which appears to be theoretically contradictory since SOCs are characterized by scale-free avalanche sizes but oscillations indicate typical scales. Here, we show that SOs can emerge in SOCs of small size systems due to temporal correlation between large avalanches at the finite-size cutoff, resulting from the accumulation-release process in SOCs. In contrast, the critical branching process without accumulation-release dynamics cannot exhibit oscillations. The reconciliation of SOCs and SOs is demonstrated both in the sandpile model and robustly in biologically plausible neuronal networks. The oscillations can be suppressed if external inputs eliminate the prominent slow accumulation process, providing a potential explanation of the widely studied Berger effect or event-related desynchronization in neural response. The features of neural oscillations and suppression are confirmed during task processing in monkey eye-movement experiments. Our results suggest that finite-size, columnar neural circuits may play an important role in generating neural oscillations around the critical states, potentially enabling functional advantages of both SOCs and oscillations for sensitive response to transient stimuli.

Two universal physical principles shape the power-law statistics of real-world networks

The study of complex networks has pursued an understanding of macroscopic behaviour by focusing on power-laws in microscopic observables. Here, we uncover two universal fundamental physical principles that are at the basis of complex network generation. These principles together predict the generic emergence of deviations from ideal power laws, which were previously discussed away by reference to the thermodynamic limit. Our approach proposes a paradigm shift in the physics of complex networks, toward the use of power-law deviations to infer meso-scale structure from macroscopic observations.

Irregular spiking of pyramidal neurons organizes as scale-invariant neuronal avalanches in the awake state

Spontaneous fluctuations in neuronal activity emerge at many spatial and temporal scales in cortex. Population measures found these fluctuations to organize as scale-invariant neuronal avalanches, suggesting cortical dynamics to be critical. Macroscopic dynamics, though, depend on physiological states and are ambiguous as to their cellular composition, spatiotemporal origin, and contributions from synaptic input or action potential (AP) output. Here, we study spontaneous firing in pyramidal neurons (PNs) from rat superficial cortical layers in vivo and in vitro using 2-photon imaging. As the animal transitions from the anesthetized to awake state, spontaneous single neuron firing increases in irregularity and assembles into scale-invariant avalanches at the group level. In vitro spike avalanches emerged naturally yet required balanced excitation and inhibition. This demonstrates that neuronal avalanches are linked to the global physiological state of wakefulness and that cortical resting activity organizes as avalanches from firing of local PN groups to global population activity.

DOI:http://dx.doi.org/10.7554/eLife.07224.001

Even when we are not engaged in any specific task, the brain shows coordinated patterns of spontaneous activity that can be monitored using electrodes placed on the scalp. This resting activity shapes the way that the brain responds to subsequent stimuli. Changes in resting activity patterns are seen in various neurological and psychiatric disorders, as well as in healthy individuals following sleep deprivation.

The brain's outer layer is known as the cortex. On a large scale, when monitoring many thousands of neurons, resting activity in the cortex demonstrates propagation in the brain in an organized manner. Specifically, resting activity was found to organize as so-called neuronal avalanches, in which large bursts of neuronal activity are grouped with medium-sized and smaller bursts in a very characteristic order. In fact, the sizes of these bursts—that is, the number of neurons that fire—are found to be scale-invariant, that is, the ratio of large bursts to medium-sized bursts is the same as that of medium-sized to small bursts. Such scale-invariance suggests that neuronal bursts are not independent of one another. However, it is largely unclear how neuronal avalanches arise from individual neurons, which fire simply in a noisy, irregular manner.

Bellay, Klaus et al. have now provided insights into this process by examining patterns of firing of a particular type of neuron—known as a pyramidal cell—in the cortex of rats as they recover from anesthesia. As the animals awaken, the firing of individual pyramidal cells in the cortex becomes even more irregular than under anesthesia. However, by considering the activity of a group of these neurons, Bellay, Klaus et al. realized that it is this more irregular firing that gives rise to neuronal avalanches, and that this occurs only when the animals are awake. Further experiments on individual pyramidal cells grown in the laboratory confirmed that neuronal avalanches emerge spontaneously from the irregular firing of individual neurons. These avalanches depend on there being a balance between two types of activity among the cells: ‘excitatory’ activity that causes other neurons to fire, and ‘inhibitory’ activity that prevents neuronal firing.

Given that resting activity influences the brain's responses to the outside world, the origins of neuronal avalanches are likely to provide clues about the way the brain processes information. Future experiments should also examine the possibility that the emergence of neuronal avalanches marks the transition from unconsciousness to wakefulness within the brain.

DOI:http://dx.doi.org/10.7554/eLife.07224.002

Unambiguous reconstruction of network structure using avalanche dynamics

A robust method for inferring the structure of networks is presented based on the one-to-one correspondence between the expected composition of cascades of bursts of activity, called crackling noise or avalanches, and the weight matrix. Using a model of neuronal avalanches as a paradigmatic example, we derive this correspondence exactly by calculating the closed-form expression of the joint probability distribution of avalanche sizes obtained by counting separately the number of elements active in each subnetwork during avalanches.

Self-organized criticality as a fundamental property of neural systems

The neural criticality hypothesis states that the brain may be poised in a critical state at a boundary between different types of dynamics. Theoretical and experimental studies show that critical systems often exhibit optimal computational properties, suggesting the possibility that criticality has been evolutionarily selected as a useful trait for our nervous system. Evidence for criticality has been found in cell cultures, brain slices, and anesthetized animals. Yet, inconsistent results were reported for recordings in awake animals and humans, and current results point to open questions about the exact nature and mechanism of criticality, as well as its functional role. Therefore, the criticality hypothesis has remained a controversial proposition. Here, we provide an account of the mathematical and physical foundations of criticality. In the light of this conceptual framework, we then review and discuss recent experimental studies with the aim of identifying important next steps to be taken and connections to other fields that should be explored.

Marginally subcritical dynamics explain enhanced stimulus discriminability under attention

Recent experimental and theoretical work has established the hypothesis that cortical neurons operate close to a critical state which describes a phase transition from chaotic to ordered dynamics. Critical dynamics are suggested to optimize several aspects of neuronal information processing. However, although critical dynamics have been demonstrated in recordings of spontaneously active cortical neurons, little is known about how these dynamics are affected by task-dependent changes in neuronal activity when the cortex is engaged in stimulus processing. Here we explore this question in the context of cortical information processing modulated by selective visual attention. In particular, we focus on recent findings that local field potentials (LFPs) in macaque area V4 demonstrate an increase in γ-band synchrony and a simultaneous enhancement of object representation with attention. We reproduce these results using a model of integrate-and-fire neurons where attention increases synchrony by enhancing the efficacy of recurrent interactions. In the phase space spanned by excitatory and inhibitory coupling strengths, we identify critical points and regions of enhanced discriminability. Furthermore, we quantify encoding capacity using information entropy. We find a rapid enhancement of stimulus discriminability with the emergence of synchrony in the network. Strikingly, only a narrow region in the phase space, at the transition from subcritical to supercritical dynamics, supports the experimentally observed discriminability increase. At the supercritical border of this transition region, information entropy decreases drastically as synchrony sets in. At the subcritical border, entropy is maximized under the assumption of a coarse observation scale. Our results suggest that cortical networks operate at such near-critical states, allowing minimal attentional modulations of network excitability to substantially augment stimulus representation in the LFPs.

Spike avalanches in vivo suggest a driven, slightly subcritical brain state

In self-organized critical (SOC) systems avalanche size distributions follow power-laws. Power-laws have also been observed for neural activity, and so it has been proposed that SOC underlies brain organization as well. Surprisingly, for spiking activity in vivo, evidence for SOC is still lacking. Therefore, we analyzed highly parallel spike recordings from awake rats and monkeys, anesthetized cats, and also local field potentials from humans. We compared these to spiking activity from two established critical models: the Bak-Tang-Wiesenfeld model, and a stochastic branching model. We found fundamental differences between the neural and the model activity. These differences could be overcome for both models through a combination of three modifications: (1) subsampling, (2) increasing the input to the model (this way eliminating the separation of time scales, which is fundamental to SOC and its avalanche definition), and (3) making the model slightly sub-critical. The match between the neural activity and the modified models held not only for the classical avalanche size distributions and estimated branching parameters, but also for two novel measures (mean avalanche size, and frequency of single spikes), and for the dependence of all these measures on the temporal bin size. Our results suggest that neural activity in vivo shows a mélange of avalanches, and not temporally separated ones, and that their global activity propagation can be approximated by the principle that one spike on average triggers a little less than one spike in the next step. This implies that neural activity does not reflect a SOC state but a slightly sub-critical regime without a separation of time scales. Potential advantages of this regime may be faster information processing, and a safety margin from super-criticality, which has been linked to epilepsy.

The Abelian distribution

We define the Abelian distribution and study its basic properties. Abelian distributions arise in the context of neural modeling and describe the size of neural avalanches in fully-connected integrate-and-fire models of self-organized criticality in neural systems.

Avalanches in self-organized critical neural networks: a minimal model for the neural SOC universality class

The brain keeps its overall dynamics in a corridor of intermediate activity and it has been a long standing question what possible mechanism could achieve this task. Mechanisms from the field of statistical physics have long been suggesting that this homeostasis of brain activity could occur even without a central regulator, via self-organization on the level of neurons and their interactions, alone. Such physical mechanisms from the class of self-organized criticality exhibit characteristic dynamical signatures, similar to seismic activity related to earthquakes. Measurements of cortex rest activity showed first signs of dynamical signatures potentially pointing to self-organized critical dynamics in the brain. Indeed, recent more accurate measurements allowed for a detailed comparison with scaling theory of non-equilibrium critical phenomena, proving the existence of criticality in cortex dynamics. We here compare this new evaluation of cortex activity data to the predictions of the earliest physics spin model of self-organized critical neural networks. We find that the model matches with the recent experimental data and its interpretation in terms of dynamical signatures for criticality in the brain. The combination of signatures for criticality, power law distributions of avalanche sizes and durations, as well as a specific scaling relationship between anomalous exponents, defines a universality class characteristic of the particular critical phenomenon observed in the neural experiments. Thus the model is a candidate for a minimal model of a self-organized critical adaptive network for the universality class of neural criticality. As a prototype model, it provides the background for models that may include more biological details, yet share the same universality class characteristic of the homeostasis of activity in the brain.

Critical dynamics in associative memory networks

Critical behavior in neural networks is characterized by scale-free avalanche size distributions and can be explained by self-regulatory mechanisms. Theoretical and experimental evidence indicates that information storage capacity reaches its maximum in the critical regime. We study the effect of structural connectivity formed by Hebbian learning on the criticality of network dynamics. The network only endowed with Hebbian learning does not allow for simultaneous information storage and criticality. However, the critical regime can be stabilized by short-term synaptic dynamics in the form of synaptic depression and facilitation or, alternatively, by homeostatic adaptation of the synaptic weights. We show that a heterogeneous distribution of maximal synaptic strengths does not preclude criticality if the Hebbian learning is alternated with periods of critical dynamics recovery. We discuss the relevance of these findings for the flexibility of memory in aging and with respect to the recent theory of synaptic plasticity.

Neuronal avalanches, epileptic quakes and other transient forms of neurodynamics

Power-law behaviors in brain activity in healthy animals, in the form of neuronal avalanches, potentially benefit the computational activities of the brain, including information storage, transmission and processing. In contrast, power-law behaviors associated with seizures, in the form of epileptic quakes, potentially interfere with the brain's computational activities. This review draws attention to the potential roles played by homeostatic mechanisms and multistable time-delayed recurrent inhibitory loops in the generation of power-law phenomena. Moreover, it is suggested that distinctions between health and disease are scale-dependent. In other words, what is abnormal and defines disease it is not the propagation of neural activity but the propagation of activity in a neural population that is large enough to interfere with the normal activities of the brain. From this point of view, epilepsy is a disease that results from a failure of mechanisms, possibly located in part in the cortex itself or in the deep brain nuclei and brainstem, which truncate or otherwise confine the spatiotemporal scales of these power-law phenomena.

Being critical of criticality in the brain

Relatively recent work has reported that networks of neurons can produce avalanches of activity whose sizes follow a power law distribution. This suggests that these networks may be operating near a critical point, poised between a phase where activity rapidly dies out and a phase where activity is amplified over time. The hypothesis that the electrical activity of neural networks in the brain is critical is potentially important, as many simulations suggest that information processing functions would be optimized at the critical point. This hypothesis, however, is still controversial. Here we will explain the concept of criticality and review the substantial objections to the criticality hypothesis raised by skeptics. Points and counter points are presented in dialog form.

Synchrony and asynchrony for neuronal dynamics defined on complex networks

We describe and analyze a model for a stochastic pulse-coupled neuronal network with many sources of randomness: random external input, potential synaptic failure, and random connectivity topologies. We show that different classes of network topologies give rise to qualitatively different types of synchrony: uniform (Erdős-Rényi) and "small-world" networks give rise to synchronization phenomena similar to that in "all-to-all" networks (in which there is a sharp onset of synchrony as coupling is increased); in contrast, in "scale-free" networks the dependence of synchrony on coupling strength is smoother. Moreover, we show that in the uniform and small-world cases, the fine details of the network are not important in determining the synchronization properties; this depends only on the mean connectivity. In contrast, for scale-free networks, the dynamics are significantly affected by the fine details of the network; in particular, they are significantly affected by the local neighborhoods of the "hubs" in the network.

Sustained activity in hierarchical modular neural networks: self-organized criticality and oscillations

Cerebral cortical brain networks possess a number of conspicuous features of structure and dynamics. First, these networks have an intricate, non-random organization. In particular, they are structured in a hierarchical modular fashion, from large-scale regions of the whole brain, via cortical areas and area subcompartments organized as structural and functional maps to cortical columns, and finally circuits made up of individual neurons. Second, the networks display self-organized sustained activity, which is persistent in the absence of external stimuli. At the systems level, such activity is characterized by complex rhythmical oscillations over a broadband background, while at the cellular level, neuronal discharges have been observed to display avalanches, indicating that cortical networks are at the state of self-organized criticality (SOC). We explored the relationship between hierarchical neural network organization and sustained dynamics using large-scale network modeling. Previously, it was shown that sparse random networks with balanced excitation and inhibition can sustain neural activity without external stimulation. We found that a hierarchical modular architecture can generate sustained activity better than random networks. Moreover, the system can simultaneously support rhythmical oscillations and SOC, which are not present in the respective random networks. The mechanism underlying the sustained activity is that each dense module cannot sustain activity on its own, but displays SOC in the presence of weak perturbations. Therefore, the hierarchical modular networks provide the coupling among subsystems with SOC. These results imply that the hierarchical modular architecture of cortical networks plays an important role in shaping the ongoing spontaneous activity of the brain, potentially allowing the system to take advantage of both the sensitivity of critical states and the predictability and timing of oscillations for efficient information processing.

Self-organized criticality in developing neuronal networks

Recently evidence has accumulated that many neural networks exhibit self-organized criticality. In this state, activity is similar across temporal scales and this is beneficial with respect to information flow. If subcritical, activity can die out, if supercritical epileptiform patterns may occur. Little is known about how developing networks will reach and stabilize criticality. Here we monitor the development between 13 and 95 days in vitro (DIV) of cortical cell cultures (n = 20) and find four different phases, related to their morphological maturation: An initial low-activity state (≈19 DIV) is followed by a supercritical (≈20 DIV) and then a subcritical one (≈36 DIV) until the network finally reaches stable criticality (≈58 DIV). Using network modeling and mathematical analysis we describe the dynamics of the emergent connectivity in such developing systems. Based on physiological observations, the synaptic development in the model is determined by the drive of the neurons to adjust their connectivity for reaching on average firing rate homeostasis. We predict a specific time course for the maturation of inhibition, with strong onset and delayed pruning, and that total synaptic connectivity should be strongly linked to the relative levels of excitation and inhibition. These results demonstrate that the interplay between activity and connectivity guides developing networks into criticality suggesting that this may be a generic and stable state of many networks in vivo and in vitro.

Neuronal avalanches in spontaneous activity in vivo

Many complex systems give rise to events that are clustered in space and time, thereby establishing a correlation structure that is governed by power law statistics. In the cortex, such clusters of activity, called "neuronal avalanches," were recently found in local field potentials (LFPs) of spontaneous activity in acute cortex slices, slice cultures, the developing cortex of the anesthetized rat, and premotor and motor cortex of awake monkeys. At present, it is unclear whether neuronal avalanches also exist in the spontaneous LFPs and spike activity in vivo in sensory areas of the mature brain. To address this question, we recorded spontaneous LFPs and extracellular spiking activity with multiple 4 × 4 microelectrode arrays (Michigan Probes) in area 17 of adult cats under anesthesia. A cluster of events was defined as a consecutive sequence of time bins Δt (1-32 ms), each containing at least one LFP event or spike anywhere on the array. LFP cluster sizes consistently distributed according to a power law with a slope largely above -1.5. In two thirds of the corresponding experiments, spike clusters also displayed a power law that displayed a slightly steeper slope of -1.8 and was destroyed by subsampling operations. The power law in spike clusters was accompanied with stronger temporal correlations between spiking activities of neurons that spanned longer time periods compared with spike clusters lacking power law statistics. The results suggest that spontaneous activity of the visual cortex under anesthesia has the properties of neuronal avalanches.

Fractals in the nervous system: conceptual implications for theoretical neuroscience

This essay is presented with two principal objectives in mind: first, to document the prevalence of fractals at all levels of the nervous system, giving credence to the notion of their functional relevance; and second, to draw attention to the as yet still unresolved issues of the detailed relationships among power-law scaling, self-similarity, and self-organized criticality. As regards criticality, I will document that it has become a pivotal reference point in Neurodynamics. Furthermore, I will emphasize the not yet fully appreciated significance of allometric control processes. For dynamic fractals, I will assemble reasons for attributing to them the capacity to adapt task execution to contextual changes across a range of scales. The final Section consists of general reflections on the implications of the reviewed data, and identifies what appear to be issues of fundamental importance for future research in the rapidly evolving topic of this review.

Epilepsy as a dynamic disease: a tutorial of the past with an eye to the future

How can clinical epileptologists and computational neuroscientists learn to function together within the confines of interdisciplinary teams to develop new and more effective treatment strategies for epilepsy? Here we introduce epileptologists to the way modelers think about epilepsy as a dynamic disease. Not only is there terminology to be learned, but also it is necessary to identify those areas where clinical input might be expected to have the greatest impact. It is concluded that both groups have major roles to play in educating, evaluating, and shaping the direction of the efforts of each other.