Universal critical dynamics in high resolution neuronal avalanche data

Whole-Brain Neuronal Activity Displays Crackling Noise Dynamics

Previous studies suggest that the brain operates at a critical point in which phases of order and disorder coexist, producing emergent patterned dynamics at all scales and optimizing several brain functions. Here, we combined light-sheet microscopy with GCaMP zebrafish larvae to study whole-brain dynamics in vivo at near single-cell resolution. We show that spontaneous activity propagates in the brain's three-dimensional space, generating scale-invariant neuronal avalanches with time courses and recurrence times that exhibit statistical self-similarity at different magnitude, temporal, and frequency scales. This suggests that the nervous system operates close to a non-equilibrium phase transition, where a large repertoire of spatial, temporal, and interactive modes can be supported. Finally, we show that gap junctions contribute to the maintenance of criticality and that, during interactions with the environment (sensory inputs and self-generated behaviors), the system is transiently displaced to a more ordered regime, conceivably to limit the potential sensory representations and motor outcomes.

Heterogeneity of synaptic input connectivity regulates spike-based neuronal avalanches

Our mysterious brain is believed to operate near a non-equilibrium point and generate critical self-organized avalanches in neuronal activity. A central topic in neuroscience is to elucidate the underlying circuitry mechanisms of neuronal avalanches in the brain. Recent experimental evidence has revealed significant heterogeneity in both synaptic input and output connectivity, but whether the structural heterogeneity participates in the regulation of neuronal avalanches remains poorly understood. By computational modeling, we predict that different types of structural heterogeneity contribute distinct effects on avalanche neurodynamics. In particular, neuronal avalanches can be triggered at an intermediate level of input heterogeneity, but heterogeneous output connectivity cannot evoke avalanche dynamics. In the criticality region, the co-emergence of multi-scale cortical activities is observed, and both the avalanche dynamics and neuronal oscillations are modulated by the input heterogeneity. Remarkably, we show similar results can be reproduced in networks with various types of in- and out-degree distributions. Overall, these findings not only provide details on the underlying circuitry mechanisms of nonrandom synaptic connectivity in the regulation of neuronal avalanches, but also inspire testable hypotheses for future experimental studies.

Coexistence of scale-invariant and rhythmic behavior in self-organized criticality

Scale-free behavior as well as oscillations are frequently observed in the activity of many natural systems. One important example is the cortical tissues of mammalian brain where both phenomena are simultaneously observed. Rhythmic oscillations as well as critical (scale-free) dynamics are thought to be important, but theoretically incompatible, features of a healthy brain. Motivated by the above, we study the possibility of the coexistence of scale-free avalanches along with rhythmic behavior within the framework of self-organized criticality. In particular, we add an oscillatory perturbation to local threshold condition of the continuous Zhang model and characterize the subsequent activity of the system. We observe regular oscillations embedded in well-defined avalanches which exhibit scale-free size and duration in line with observed neuronal avalanches. The average amplitude of such oscillations are shown to decrease with increasing frequency consistent with real brain oscillations. Furthermore, it is shown that optimal amplification of oscillations occur at the critical point, further providing evidence for functional advantages of criticality.

Hysteresis, neural avalanches, and critical behavior near a first-order transition of a spiking neural network

Many experimental results, both in vivo and in vitro, support the idea that the brain cortex operates near a critical point and at the same time works as a reservoir of precise spatiotemporal patterns. However, the mechanism at the basis of these observations is still not clear. In this paper we introduce a model which combines both these features, showing that scale-free avalanches are the signature of a system posed near the spinodal line of a first-order transition, with many spatiotemporal patterns stored as dynamical metastable attractors. Specifically, we studied a network of leaky integrate-and-fire neurons whose connections are the result of the learning of multiple spatiotemporal dynamical patterns, each with a randomly chosen ordering of the neurons. We found that the network shows a first-order transition between a low-spiking-rate disordered state (down), and a high-rate state characterized by the emergence of collective activity and the replay of one of the stored patterns (up). The transition is characterized by hysteresis, or alternation of up and down states, depending on the lifetime of the metastable states. In both cases, critical features and neural avalanches are observed. Notably, critical phenomena occur at the edge of a discontinuous phase transition, as recently observed in a network of glow lamps.

The characteristic patterns of neuronal avalanches in mice under anesthesia and at rest: An investigation using constrained artificial neural networks

Local perturbations within complex dynamical systems can trigger cascade-like events that spread across significant portions of the system. Cascades of this type have been observed across a broad range of scales in the brain. Studies of these cascades, known as neuronal avalanches, usually report the statistics of large numbers of avalanches, without probing the characteristic patterns produced by the avalanches themselves. This is partly due to limitations in the extent or spatiotemporal resolution of commonly used neuroimaging techniques. In this study, we overcome these limitations by using optical voltage (genetically encoded voltage indicators) imaging. This allows us to record cortical activity in vivo across an entire cortical hemisphere, at both high spatial (~30um) and temporal (~20ms) resolution in mice that are either in an anesthetized or awake state. We then use artificial neural networks to identify the characteristic patterns created by neuronal avalanches in our data. The avalanches in the anesthetized cortex are most accurately classified by an artificial neural network architecture that simultaneously connects spatial and temporal information. This is in contrast with the awake cortex, in which avalanches are most accurately classified by an architecture that treats spatial and temporal information separately, due to the increased levels of spatiotemporal complexity. This is in keeping with reports of higher levels of spatiotemporal complexity in the awake brain coinciding with features of a dynamical system operating close to criticality.

Can a time varying external drive give rise to apparent criticality in neural systems?

The finding of power law scaling in neural recordings lends support to the hypothesis of critical brain dynamics. However, power laws are not unique to critical systems and can arise from alternative mechanisms. Here, we investigate whether a common time-varying external drive to a set of Poisson units can give rise to neuronal avalanches and exhibit apparent criticality. To this end, we analytically derive the avalanche size and duration distributions, as well as additional measures, first for homogeneous Poisson activity, and then for slowly varying inhomogeneous Poisson activity. We show that homogeneous Poisson activity cannot give rise to power law distributions. Inhomogeneous activity can also not generate perfect power laws, but it can exhibit approximate power laws with cutoffs that are comparable to those typically observed in experiments. The mechanism of generating apparent criticality by time-varying external fields, forces or input may generalize to many other systems like dynamics of swarms, diseases or extinction cascades. Here, we illustrate the analytically derived effects for spike recordings in vivo and discuss approaches to distinguish true from apparent criticality. Ultimately, this requires causal interventions, which allow separating internal system properties from externally imposed ones.

Increasing power-law range in avalanche amplitude and energy distributions

Power-law-type probability density functions spanning several orders of magnitude are found for different avalanche properties. We propose a methodology to overcome empirical constraints that limit the range of truncated power-law distributions. By considering catalogs of events that cover different observation windows, the maximum likelihood estimation of a global power-law exponent is computed. This methodology is applied to amplitude and energy distributions of acoustic emission avalanches in failure-under-compression experiments of a nanoporous silica glass, finding in some cases global exponents in an unprecedented broad range: 4.5 decades for amplitudes and 9.5 decades for energies. In the latter case, however, strict statistical analysis suggests experimental limitations might alter the power-law behavior.

Neuronal avalanche dynamics indicates different universality classes in neuronal cultures

Neuronal avalanches have become an ubiquitous tool to describe the activity of large neuronal assemblies. The emergence of scale-free statistics with well-defined exponents has led to the belief that the brain might operate near a critical point. Yet not much is known in terms of how the different exponents arise or how robust they are. Using calcium imaging recordings of dissociated neuronal cultures we show that the exponents are not universal, and that significantly different exponents arise with different culture preparations, leading to the existence of different universality classes. Naturally developing cultures show avalanche statistics consistent with those of a mean-field branching process, however, cultures grown in the presence of folic acid metabolites appear to be in a distinct universality class with significantly different critical exponents. Given the increased synaptic density and number of feedback loops in folate reared cultures, our results suggest that network topology plays a leading role in shaping the avalanche dynamics. We also show that for both types of cultures pronounced correlations exist in the sizes of neuronal avalanches indicating size clustering, being much stronger in folate reared cultures.

Coexistence of Stochastic Oscillations and Self-Organized Criticality in a Neuronal Network: Sandpile Model Application

Self-organized criticality (SOC) and stochastic oscillations (SOs) are two theoretically contradictory phenomena that are suggested to coexist in the brain. Recently it has been shown that an accumulation-release process like sandpile dynamics can generate SOC and SOs simultaneously. We considered the effect of the network structure on this coexistence and showed that the sandpile dynamics on a small-world network can produce two power law regimes along with two groups of SOs-two peaks in the power spectrum of the generated signal simultaneously. We also showed that external stimuli in the sandpile dynamics do not affect the coexistence of SOC and SOs but increase the frequency of SOs, which is consistent with our knowledge of the brain.

Balancing building and maintenance costs in growing transport networks

The costs associated to the length of links impose unavoidable constraints to the growth of natural and artificial transport networks. When future network developments cannot be predicted, the costs of building and maintaining connections cannot be minimized simultaneously, requiring competing optimization mechanisms. Here, we study a one-parameter nonequilibrium model driven by an optimization functional, defined as the convex combination of building cost and maintenance cost. By varying the coefficient of the combination, the model interpolates between global and local length minimization, i.e., between minimum spanning trees and a local version known as dynamical minimum spanning trees. We show that cost balance within this ensemble of dynamical networks is a sufficient ingredient for the emergence of tradeoffs between the network's total length and transport efficiency, and of optimal strategies of construction. At the transition between two qualitatively different regimes, the dynamics builds up power-law distributed waiting times between global rearrangements, indicating a point of nonoptimality. Finally, we use our model as a framework to analyze empirical ant trail networks, showing its relevance as a null model for cost-constrained network formation.

Perspectives on theory at the interface of physics and biology

Theoretical physics is the search for simple and universal mathematical descriptions of the natural world. In contrast, much of modern biology is an exploration of the complexity and diversity of life. For many, this contrast is prima facie evidence that theory, in the sense that physicists use the word, is impossible in a biological context. For others, this contrast serves to highlight a grand challenge. I am an optimist, and believe (along with many colleagues) that the time is ripe for the emergence of a more unified theoretical physics of biological systems, building on successes in thinking about particular phenomena. In this essay I try to explain the reasons for my optimism, through a combination of historical and modern examples.

A Novel EEG Based Spectral Analysis of Persistent Brain Function Alteration in Athletes with Concussion History

The neurocognitive sequelae of a sport-related concussion and its management are poorly defined. Detecting deficits are vital in making a decision about the treatment plan as it can persist one year or more following a brain injury. The reliability of traditional cognitive assessment tools is debatable, and thus attention has turned to assessments based on electroencephalogram (EEG) to evaluate subtle post-concussive alterations. In this study, we calculated neurocognitive deficits combining EEG analysis with three standard post-concussive assessment tools. Data were collected for all testing modalities from 21 adolescent athletes (seven concussive and fourteen healthy) in three different trials. For EEG assessment, along with linear frequency-based features, we introduced a set of time-frequency (Hjorth Parameters) and nonlinear features (approximate entropy and Hurst exponent) for the first time to explore post-concussive deficits. Besides traditional frequency-band analysis, we also presented a new individual frequency-based approach for EEG assessment. While EEG analysis exhibited significant discrepancies between the groups, none of the cognitive assessment resulted in significant deficits. Therefore, the evidence from the study highlights that our proposed EEG analysis and markers are more efficient at deciphering post-concussion residual neurocognitive deficits and thus has a potential clinical utility of proper concussion assessment and management.

Neuronal avalanches: Where temporal complexity and criticality meet

The model of the current paper is an extension of a previous publication, wherein we have used the leaky integrate-and-fire model on a regular lattice with periodic boundary conditions, and introduced the temporal complexity as a genuine signature of criticality. In that work, the power-law distribution of neural avalanches was a manifestation of supercriticality rather than criticality. Here, however, we show that the continuous solution of the model and replacing the stochastic noise with a Gaussian zero-mean noise leads to the coincidence of power-law display of temporal complexity, and spatiotemporal patterns of neural avalanches at the critical point. We conclude that the source of inconsistency may be a numerical artifact originated by the discrete description of the model which may imply a slow numerical convergence of the avalanche distribution compared to temporal complexity.

Temporal profiles of avalanches on networks

An avalanche or cascade occurs when one event causes one or more subsequent events, which in turn may cause further events in a chain reaction. Avalanching dynamics are studied in many disciplines, with a recent focus on average avalanche shapes, i.e., the temporal profiles of avalanches of fixed duration. At the critical point of the dynamics, the rescaled average avalanche shapes for different durations collapse onto a single universal curve. We apply Markov branching process theory to derive an equation governing the average avalanche shape for cascade dynamics on networks. Analysis of the equation at criticality demonstrates that nonsymmetric average avalanche shapes (as observed in some experiments) occur for certain combinations of dynamics and network topology. We give examples using numerical simulations of models for information spreading, neural dynamics, and behavior adoption and we propose simple experimental tests to quantify whether cascading systems are in the critical state.

Mechanisms of self-organized criticality in social processes of knowledge creation

In online social dynamics, a robust scale invariance appears as a key feature of collaborative efforts that lead to new social value. The underlying empirical data thus offers a unique opportunity to study the origin of self-organized criticality (SOC) in social systems. In contrast to physical systems in the laboratory, various human attributes of the actors play an essential role in the process along with the contents (cognitive, emotional) of the communicated artifacts. As a prototypical example, we consider the social endeavor of knowledge creation via Questions and Answers (Q&A). Using a large empirical data set from one of such Q&A sites and theoretical modeling, we reveal fundamental characteristics of SOC by investigating the temporal correlations at all scales and the role of cognitive contents to the avalanches of the knowledge-creation process. Our analysis shows that the universal social dynamics with power-law inhomogeneities of the actions and delay times provides the primary mechanism for self-tuning towards the critical state; it leads to the long-range correlations and the event clustering in response to the external driving by the arrival of new users. In addition, the involved cognitive contents (systematically annotated in the data and observed in the model) exert important constraints that identify unique classes of the knowledge-creation avalanches. Specifically, besides determining a fine structure of the developing knowledge networks, they affect the values of scaling exponents and the geometry of large avalanches and shape the multifractal spectrum. Furthermore, we find that the level of the activity of the communities that share the knowledge correlates with the fluctuations of the innovation rate, implying that the increase of innovation may serve as the active principle of self-organization. To identify relevant parameters and unravel the role of the network evolution underlying the process in the social system under consideration, we compare the social avalanches to the avalanche sequences occurring in the field-driven physical model of disordered solids, where the factors contributing to the collective dynamics are better understood.

Deviations from Critical Dynamics in Interictal Epileptiform Activity

The framework of criticality provides a unifying perspective on neuronal dynamics from in vitro cortical cultures to functioning human brains. Recent findings suggest that a healthy cortex displays critical dynamics, giving rise to scale-free spatiotemporal cascades of activity, termed neuronal avalanches. Pharmacological manipulations of the excitation-inhibition balance (EIB) in cortical cultures were previously shown to result in deviations from criticality and from the power law scaling of avalanche size distribution. To examine the sensitivity of neuronal avalanche metrics to altered EIB in humans, we focused on epilepsy, a neurological disorder characterized by hyperexcitable networks. Using magnetoencephalography, we quantitatively assessed deviations from criticality in the brain dynamics of patients with epilepsy during interictal (between-seizures) activity. Compared with healthy control subjects, epilepsy patients tended to exhibit a higher neural gain and larger avalanches, particularly during interictal epileptiform activity. Moreover, deviations from scale-free behavior were exclusively connected to brief intervals at epileptiform discharges, strengthening the association between deviations from criticality and the instantaneous changes in EIB. The avalanches collected during interictal epileptiform activity had not only a stereotypical size range but also involved particular spatial patterns of activations, as expected for periods of epileptic network dominance. Overall, the neuronal avalanche metrics provide a quantitative novel description of interictal brain activity of patients with epilepsy.

SIGNIFICANCE STATEMENT

Healthy brain dynamics requires a delicate balance between excitatory and inhibitory processes. Several brain disorders, such as epilepsy, are associated with altered excitation-inhibition balance, but assessing this balance using noninvasive tools is still challenging. In this study, we apply the framework of critical brain dynamics to data from epilepsy patients, which were recorded between seizures. We show that metrics of criticality provide a sensitive tool for noninvasive assessment of changes in the balance. Specifically, brain activity of epilepsy patients deviates from healthy critical brain dynamics, particularly during abnormal epileptiform activity. The study offers a novel quantitative perspective on epilepsy and its relation to healthy brain dynamics.

Criticality predicts maximum irregularity in recurrent networks of excitatory nodes

A rigorous understanding of brain dynamics and function requires a conceptual bridge between multiple levels of organization, including neural spiking and network-level population activity. Mounting evidence suggests that neural networks of cerebral cortex operate at a critical regime, which is defined as a transition point between two phases of short lasting and chaotic activity. However, despite the fact that criticality brings about certain functional advantages for information processing, its supporting evidence is still far from conclusive, as it has been mostly based on power law scaling of size and durations of cascades of activity. Moreover, to what degree such hypothesis could explain some fundamental features of neural activity is still largely unknown. One of the most prevalent features of cortical activity in vivo is known to be spike irregularity of spike trains, which is measured in terms of the coefficient of variation (CV) larger than one. Here, using a minimal computational model of excitatory nodes, we show that irregular spiking (CV > 1) naturally emerges in a recurrent network operating at criticality. More importantly, we show that even at the presence of other sources of spike irregularity, being at criticality maximizes the mean coefficient of variation of neurons, thereby maximizing their spike irregularity. Furthermore, we also show that such a maximized irregularity results in maximum correlation between neuronal firing rates and their corresponding spike irregularity (measured in terms of CV). On the one hand, using a model in the universality class of directed percolation, we propose new hallmarks of criticality at single-unit level, which could be applicable to any network of excitable nodes. On the other hand, given the controversy of the neural criticality hypothesis, we discuss the limitation of this approach to neural systems and to what degree they support the criticality hypothesis in real neural networks. Finally, we discuss the limitations of applying our results to real networks and to what degree they support the criticality hypothesis.

Refractory period in network models of excitable nodes: self-sustaining stable dynamics, extended scaling region and oscillatory behavior

Networks of excitable nodes have recently attracted much attention particularly in regards to neuronal dynamics, where criticality has been argued to be a fundamental property. Refractory behavior, which limits the excitability of neurons is thought to be an important dynamical property. We therefore consider a simple model of excitable nodes which is known to exhibit a transition to instability at a critical point (λ = 1), and introduce refractory period into its dynamics. We use mean-field analytical calculations as well as numerical simulations to calculate the activity dependent branching ratio that is useful to characterize the behavior of critical systems. We also define avalanches and calculate probability distribution of their size and duration. We find that in the presence of refractory period the dynamics stabilizes while various parameter regimes become accessible. A sub-critical regime with λ < 1.0, a standard critical behavior with exponents close to critical branching process for λ = 1, a regime with 1 < λ < 2 that exhibits an interesting scaling behavior, and an oscillating regime with λ > 2.0. We have therefore shown that refractory behavior leads to a wide range of scaling as well as periodic behavior which are relevant to real neuronal dynamics.

Optimizing Neural Information Capacity through Discretization

Discretization in neural circuits occurs on many levels, from the generation of action potentials and dendritic integration, to neuropeptide signaling and processing of signals from multiple neurons, to behavioral decisions. It is clear that discretization, when implemented properly, can convey many benefits. However, the optimal solutions depend on both the level of noise and how it impacts a particular computation. This Perspective discusses how current physiological data could potentially be integrated into one theoretical framework based on maximizing information. Key experiments for testing that framework are discussed.

Criticality in the brain: A synthesis of neurobiology, models and cognition

Cognitive function requires the coordination of neural activity across many scales, from neurons and circuits to large-scale networks. As such, it is unlikely that an explanatory framework focused upon any single scale will yield a comprehensive theory of brain activity and cognitive function. Modelling and analysis methods for neuroscience should aim to accommodate multiscale phenomena. Emerging research now suggests that multi-scale processes in the brain arise from so-called critical phenomena that occur very broadly in the natural world. Criticality arises in complex systems perched between order and disorder, and is marked by fluctuations that do not have any privileged spatial or temporal scale. We review the core nature of criticality, the evidence supporting its role in neural systems and its explanatory potential in brain health and disease.

Criticality and Adaptivity in Enzymatic Networks

The contrast between the stochasticity of biochemical networks and the regularity of cellular behavior suggests that biological networks generate robust behavior from noisy constituents. Identifying the mechanisms that confer this ability on biological networks is essential to understanding cells. Here we show that queueing for a limited shared resource in broad classes of enzymatic networks in certain conditions leads to a critical state characterized by strong and long-ranged correlations between molecular species. An enzymatic network reaches this critical state when the input flux of its substrate is balanced by the maximum processing capacity of the network. We then consider enzymatic networks with adaptation, when the limiting resource (enzyme or cofactor) is produced in proportion to the demand for it. We show that the critical state becomes an attractor for these networks, which points toward the onset of self-organized criticality. We suggest that the adaptive queueing motif that leads to significant correlations between multiple species may be widespread in biological systems.

Modular co-organization of functional connectivity and scale-free dynamics in the human brain

Scale-free neuronal dynamics and interareal correlations are emergent characteristics of spontaneous brain activity. How such dynamics and the anatomical patterns of neuronal connectivity are mutually related in brain networks has, however, remained unclear. We addressed this relationship by quantifying the network colocalization of scale-free neuronal activity-both neuronal avalanches and long-range temporal correlations (LRTCs)-and functional connectivity (FC) by means of intracranial and noninvasive human resting-state electrophysiological recordings. We found frequency-specific colocalization of scale-free dynamics and FC so that the interareal couplings of LRTCs and the propagation of neuronal avalanches were most pronounced in the predominant pathways of FC. Several control analyses and the frequency specificity of network colocalization showed that the results were not trivial by-products of either brain dynamics or our analysis approach. Crucially, scale-free neuronal dynamics and connectivity also had colocalized modular structures at multiple levels of network organization, suggesting that modules of FC would be endowed with partially independent dynamic states. These findings thus suggest that FC and scale-free dynamics-hence, putatively, neuronal criticality as well-coemerge in a hierarchically modular structure in which the modules are characterized by dense connectivity, avalanche propagation, and shared dynamic states.

Adaptation towards scale-free dynamics improves cortical stimulus discrimination at the cost of reduced detection

Fundamental to the function of nervous systems is the ability to reorganize to cope with changing sensory input. Although well-studied in single neurons, how such adaptive versatility manifests in the collective population dynamics and function of cerebral cortex remains unknown. Here we measured population neural activity with microelectrode arrays in turtle visual cortex while visually stimulating the retina. First, we found that, following the onset of stimulation, adaptation tunes the collective population dynamics towards a special regime with scale-free spatiotemporal activity, after an initial large-scale transient response. Concurrently, we observed an adaptive tradeoff between two important aspects of population coding-sensory detection and discrimination. As adaptation tuned the cortex toward scale-free dynamics, stimulus discrimination was enhanced, while stimulus detection was reduced. Finally, we used a network-level computational model to show that short-term synaptic depression was sufficient to mechanistically explain our experimental results. In the model, scale-free dynamics emerge only when the model operates near a special regime called criticality. Together our model and experimental results suggest unanticipated functional benefits and costs of adaptation near criticality in visual cortex.

Criticality meets learning: Criticality signatures in a self-organizing recurrent neural network

Many experiments have suggested that the brain operates close to a critical state, based on signatures of criticality such as power-law distributed neuronal avalanches. In neural network models, criticality is a dynamical state that maximizes information processing capacities, e.g. sensitivity to input, dynamical range and storage capacity, which makes it a favorable candidate state for brain function. Although models that self-organize towards a critical state have been proposed, the relation between criticality signatures and learning is still unclear. Here, we investigate signatures of criticality in a self-organizing recurrent neural network (SORN). Investigating criticality in the SORN is of particular interest because it has not been developed to show criticality. Instead, the SORN has been shown to exhibit spatio-temporal pattern learning through a combination of neural plasticity mechanisms and it reproduces a number of biological findings on neural variability and the statistics and fluctuations of synaptic efficacies. We show that, after a transient, the SORN spontaneously self-organizes into a dynamical state that shows criticality signatures comparable to those found in experiments. The plasticity mechanisms are necessary to attain that dynamical state, but not to maintain it. Furthermore, onset of external input transiently changes the slope of the avalanche distributions – matching recent experimental findings. Interestingly, the membrane noise level necessary for the occurrence of the criticality signatures reduces the model’s performance in simple learning tasks. Overall, our work shows that the biologically inspired plasticity and homeostasis mechanisms responsible for the SORN’s spatio-temporal learning abilities can give rise to criticality signatures in its activity when driven by random input, but these break down under the structured input of short repeating sequences.

A distribution model of functional connectome based on criticality and energy constraints

The analysis of the network structure of the functional connectivity data constructed from fMRI images provides basic information about functions and features of the brain activity. We focus on the two features which are considered as relevant to the brain activity, the criticality and the constraint regarding energy consumptions. Within a wide variety of complex systems, the critical state occurs associated with a phase transition between distinct phases, random one and order one. Although the hypothesis that human brain activity is also in a state of criticality is supported by some experimental results, it still remains controversial. One issue is that experimental distributions exhibit deviations from the power law predicted by the criticality. Based on the assumption that constraints on brain from the biological costs cause these deviations, we derive a distribution model. The evaluation using the information criteria indicates an advantage of this model in fitting to experimental data compared to other representative distribution models, the truncated power law and the power law. Our findings also suggest that the mechanism underlying this model is closely related to the cost effective behavior in human brain with maximizing the network efficiency for the given network cost.

Neocortical activity is stimulus- and scale-invariant

Mounting evidence supports the hypothesis that the cortex operates near a critical state, defined as the transition point between order (large-scale activity) and disorder (small-scale activity). This criticality is manifested by power law distribution of the size and duration of spontaneous cascades of activity, which are referred as neuronal avalanches. The existence of such neuronal avalanches has been confirmed by several studies both in vitro and in vivo, among different species and across multiple spatial scales. However, despite the prevalence of scale free activity, still very little is known concerning whether and how the scale-free nature of cortical activity is altered during external stimulation. To address this question, we performed in vivo two-photon population calcium imaging of layer 2/3 neurons in primary visual cortex of behaving mice during visual stimulation and conducted statistical analyses on the inferred spike trains. Our investigation for each mouse and condition revealed power law distributed neuronal avalanches, and irregular spiking individual neurons. Importantly, both the avalanche and the spike train properties remained largely unchanged for different stimuli, while the cross-correlation structure varied with stimuli. Our results establish that microcircuits in the visual cortex operate near the critical regime, while rearranging functional connectivity in response to varying sensory inputs.

Long-range temporal correlations in neural narrowband time-series arise due to critical dynamics

We show theoretically that the hypothesis of criticality as a theory of long-range fluctuation in the human brain may be distinguished from the theory of passive filtering on the basis of macroscopic neuronal signals such as the electroencephalogram, using novel theory of narrowband amplitude time-series at criticality. Our theory predicts the division of critical activity into meta-universality classes. As a consequence our analysis shows that experimental electroencephalography data favours the hypothesis of criticality in the human brain.

Subsampling scaling

In real-world applications, observations are often constrained to a small fraction of a system. Such spatial subsampling can be caused by the inaccessibility or the sheer size of the system, and cannot be overcome by longer sampling. Spatial subsampling can strongly bias inferences about a system's aggregated properties. To overcome the bias, we derive analytically a subsampling scaling framework that is applicable to different observables, including distributions of neuronal avalanches, of number of people infected during an epidemic outbreak, and of node degrees. We demonstrate how to infer the correct distributions of the underlying full system, how to apply it to distinguish critical from subcritical systems, and how to disentangle subsampling and finite size effects. Lastly, we apply subsampling scaling to neuronal avalanche models and to recordings from developing neural networks. We show that only mature, but not young networks follow power-law scaling, indicating self-organization to criticality during development.

We can often observe only a small fraction of a system, which leads to biases in the inference of its global properties. Here, the authors develop a framework that enables overcoming subsampling effects, apply it to recordings from developing neural networks, and find that neural networks become critical as they mature.

Spontaneous cortical activity is transiently poised close to criticality

Brain activity displays a large repertoire of dynamics across the sleep-wake cycle and even during anesthesia. It was suggested that criticality could serve as a unifying principle underlying the diversity of dynamics. This view has been supported by the observation of spontaneous bursts of cortical activity with scale-invariant sizes and durations, known as neuronal avalanches, in recordings of mesoscopic cortical signals. However, the existence of neuronal avalanches in spiking activity has been equivocal with studies reporting both its presence and absence. Here, we show that signs of criticality in spiking activity can change between synchronized and desynchronized cortical states. We analyzed the spontaneous activity in the primary visual cortex of the anesthetized cat and the awake monkey, and found that neuronal avalanches and thermodynamic indicators of criticality strongly depend on collective synchrony among neurons, LFP fluctuations, and behavioral state. We found that synchronized states are associated to criticality, large dynamical repertoire and prolonged epochs of eye closure, while desynchronized states are associated to sub-criticality, reduced dynamical repertoire, and eyes open conditions. Our results show that criticality in cortical dynamics is not stationary, but fluctuates during anesthesia and between different vigilance states.

Avalanche and edge-of-chaos criticality do not necessarily co-occur in neural networks

There are indications that for optimizing neural computation, neural networks may operate at criticality. Previous approaches have used distinct fingerprints of criticality, leaving open the question whether the different notions would necessarily reflect different aspects of one and the same instance of criticality, or whether they could potentially refer to distinct instances of criticality. In this work, we choose avalanche criticality and edge-of-chaos criticality and demonstrate for a recurrent spiking neural network that avalanche criticality does not necessarily entrain dynamical edge-of-chaos criticality. This suggests that the different fingerprints may pertain to distinct phenomena.

Modulation of Context-Dependent Spatiotemporal Patterns within Packets of Spiking Activity

Recent experiments have shown that stereotypical spatiotemporal patterns occur during brief packets of spiking activity in the cortex, and it has been suggested that top-down inputs can modulate these patterns according to the context. We propose a simple model that may explain important features of these experimental observations and is analytically tractable. The key mechanism underlying this model is that context-dependent top-down inputs can modulate the effective connection strengths between neurons because of short-term synaptic depression. As a result, the degree of synchrony and, in turn, the spatiotemporal patterns of spiking activity that occur during packets are modulated by the top-down inputs. This is shown using an analytical framework, based on avalanche dynamics, that allows calculating the probability that a given neuron spikes during a packet and numerical simulations. Finally, we show that the spatiotemporal patterns that replay previously experienced sequential stimuli and their binding with their corresponding context can be learned because of spike-timing-dependent plasticity.

Power-law statistics and universal scaling in the absence of criticality

Critical states are sometimes identified experimentally through power-law statistics or universal scaling functions. We show here that such features naturally emerge from networks in self-sustained irregular regimes away from criticality. In these regimes, statistical physics theory of large interacting systems predict a regime where the nodes have independent and identically distributed dynamics. We thus investigated the statistics of a system in which units are replaced by independent stochastic surrogates and found the same power-law statistics, indicating that these are not sufficient to establish criticality. We rather suggest that these are universal features of large-scale networks when considered macroscopically. These results put caution on the interpretation of scaling laws found in nature.

Critical dynamics on a large human Open Connectome network

Extended numerical simulations of threshold models have been performed on a human brain network with N=836733 connected nodes available from the Open Connectome Project. While in the case of simple threshold models a sharp discontinuous phase transition without any critical dynamics arises, variable threshold models exhibit extended power-law scaling regions. This is attributed to fact that Griffiths effects, stemming from the topological or interaction heterogeneity of the network, can become relevant if the input sensitivity of nodes is equalized. I have studied the effects of link directness, as well as the consequence of inhibitory connections. Nonuniversal power-law avalanche size and time distributions have been found with exponents agreeing with the values obtained in electrode experiments of the human brain. The dynamical critical region occurs in an extended control parameter space without the assumption of self-organized criticality.

Inhibitory neurons promote robust critical firing dynamics in networks of integrate-and-fire neurons

We study the firing dynamics of a discrete-state and discrete-time version of an integrate-and-fire neuronal network model with both excitatory and inhibitory neurons. When the integer-valued state of a neuron exceeds a threshold value, the neuron fires, sends out state-changing signals to its connected neurons, and returns to the resting state. In this model, a continuous phase transition from non-ceaseless firing to ceaseless firing is observed. At criticality, power-law distributions of avalanche size and duration with the previously derived exponents, -3/2 and -2, respectively, are observed. Using a mean-field approach, we show analytically how the critical point depends on model parameters. Our main result is that the combined presence of both inhibitory neurons and integrate-and-fire dynamics greatly enhances the robustness of critical power-law behavior (i.e., there is an increased range of parameters, including both sub- and supercritical values, for which several decades of power-law behavior occurs).

Development of neural population activity toward self-organized criticality

Self-organized criticality (SoC), a spontaneous dynamic state established and maintained in networks of moderate complexity, is a universal characteristic of neural systems. Such systems produce cascades of spontaneous activity that are typically characterized by power-law distributions and rich, stable spatiotemporal patterns (i.e., neuronal avalanches). Since the dynamics of the critical state confer advantages in information processing within neuronal networks, it is of great interest to determine how criticality emerges during development. One possible mechanism is developmental, and includes axonal elongation during synaptogenesis and subsequent synaptic pruning in combination with the maturation of GABAergic inhibition (i.e., the integration then fragmentation process). Because experimental evidence for this mechanism remains inconclusive, we studied the developmental variation of neuronal avalanches in dissociated cortical neurons using high-density complementary metal-oxide semiconductor (CMOS) microelectrode arrays (MEAs). The spontaneous activities of nine cultures were monitored using CMOS MEAs from 4 to 30days in vitro (DIV) at single-cell spatial resolution. While cells were immature, cultures demonstrated random-like patterns of activity and an exponential avalanche size distribution; this distribution was followed by a bimodal distribution, and finally a power-law-like distribution. The bimodal distribution was associated with a large-scale avalanche with a homogeneous spatiotemporal pattern, while the subsequent power-law distribution was associated with diverse patterns. These results suggest that the SoC emerges through a two-step process: the integration process accompanying the characteristic large-scale avalanche and the fragmentation process associated with diverse middle-size avalanches.

Simultaneous multi-patch-clamp and extracellular-array recordings: Single neuron reflects network activity

The increasing number of recording electrodes enhances the capability of capturing the network’s cooperative activity, however, using too many monitors might alter the properties of the measured neural network and induce noise. Using a technique that merges simultaneous multi-patch-clamp and multi-electrode array recordings of neural networks in-vitro, we show that the membrane potential of a single neuron is a reliable and super-sensitive probe for monitoring such cooperative activities and their detailed rhythms. Specifically, the membrane potential and the spiking activity of a single neuron are either highly correlated or highly anti-correlated with the time-dependent macroscopic activity of the entire network. This surprising observation also sheds light on the cooperative origin of neuronal burst in cultured networks. Our findings present an alternative flexible approach to the technique based on a massive tiling of networks by large-scale arrays of electrodes to monitor their activity.

Criticality Maximizes Complexity in Neural Tissue

The analysis of neural systems leverages tools from many different fields. Drawing on techniques from the study of critical phenomena in statistical mechanics, several studies have reported signatures of criticality in neural systems, including power-law distributions, shape collapses, and optimized quantities under tuning. Independently, neural complexity-an information theoretic measure-has been introduced in an effort to quantify the strength of correlations across multiple scales in a neural system. This measure represents an important tool in complex systems research because it allows for the quantification of the complexity of a neural system. In this analysis, we studied the relationships between neural complexity and criticality in neural culture data. We analyzed neural avalanches in 435 recordings from dissociated hippocampal cultures produced from rats, as well as neural avalanches from a cortical branching model. We utilized recently developed maximum likelihood estimation power-law fitting methods that account for doubly truncated power-laws, an automated shape collapse algorithm, and neural complexity and branching ratio calculation methods that account for sub-sampling, all of which are implemented in the freely available Neural Complexity and Criticality MATLAB toolbox. We found evidence that neural systems operate at or near a critical point and that neural complexity is optimized in these neural systems at or near the critical point. Surprisingly, we found evidence that complexity in neural systems is dependent upon avalanche profiles and neuron firing rate, but not precise spiking relationships between neurons. In order to facilitate future research, we made all of the culture data utilized in this analysis freely available online.

Fractal analysis reveals subclasses of neurons and suggests an explanation of their spontaneous activity

The present work used fractal time series analysis (detrended fluctuation analysis; DFA) to examine the spontaneous activity of single neurons in an anesthetized animal model, specifically, the mitral cells in the rat main olfactory bulb. DFA bolstered previous research in suggesting two subclasses of mitral cells. Although there was no difference in the fractal scaling of the interspike interval series at the shorter timescales, there was a significant difference at longer timescales. Neurons in Group B exhibited fractal, power-law scaled interspike intervals, whereas neurons in Group A exhibited random variation. These results raise questions about the role of these different cells within the olfactory bulb and potential explanations of their dynamics. Specifically, self-organized criticality has been proposed as an explanation of fractal scaling in many natural systems, including neural systems. However, this theory is based on certain assumptions that do not clearly hold in the case of spontaneous neural activity, which likely reflects intrinsic cell dynamics rather than activity driven by external stimulation. Moreover, it is unclear how self-organized criticality might account for the random dynamics observed in Group A, and how these random dynamics might serve some functional role when embedded in the typical activity of the olfactory bulb. These theoretical considerations provide direction for additional experimental work.

Critical phenomena at a first-order phase transition in a lattice of glow lamps: Experimental findings and analogy to neural activity

Networks of non-linear electronic oscillators have shown potential as physical models of neural dynamics. However, two properties of brain activity, namely, criticality and metastability, remain under-investigated with this approach. Here, we present a simple circuit that exhibits both phenomena. The apparatus consists of a two-dimensional square lattice of capacitively coupled glow (neon) lamps. The dynamics of lamp breakdown (flash) events are controlled by a DC voltage globally connected to all nodes via fixed resistors. Depending on this parameter, two phases having distinct event rate and degree of spatiotemporal order are observed. The transition between them is hysteretic, thus a first-order one, and it is possible to enter a metastability region, wherein, approaching a spinodal point, critical phenomena emerge. Avalanches of events occur according to power-law distributions having exponents ≈3/2 for size and ≈2 for duration, and fractal structure is evident as power-law scaling of the Fano factor. These critical exponents overlap observations in biological neural networks; hence, this circuit may have value as building block to realize corresponding physical models.

Analysis of Power Laws, Shape Collapses, and Neural Complexity: New Techniques and MATLAB Support via the NCC Toolbox

Neural systems include interactions that occur across many scales. Two divergent methods for characterizing such interactions have drawn on the physical analysis of critical phenomena and the mathematical study of information. Inferring criticality in neural systems has traditionally rested on fitting power laws to the property distributions of "neural avalanches" (contiguous bursts of activity), but the fractal nature of avalanche shapes has recently emerged as another signature of criticality. On the other hand, neural complexity, an information theoretic measure, has been used to capture the interplay between the functional localization of brain regions and their integration for higher cognitive functions. Unfortunately, treatments of all three methods-power-law fitting, avalanche shape collapse, and neural complexity-have suffered from shortcomings. Empirical data often contain biases that introduce deviations from true power law in the tail and head of the distribution, but deviations in the tail have often been unconsidered; avalanche shape collapse has required manual parameter tuning; and the estimation of neural complexity has relied on small data sets or statistical assumptions for the sake of computational efficiency. In this paper we present technical advancements in the analysis of criticality and complexity in neural systems. We use maximum-likelihood estimation to automatically fit power laws with left and right cutoffs, present the first automated shape collapse algorithm, and describe new techniques to account for large numbers of neural variables and small data sets in the calculation of neural complexity. In order to facilitate future research in criticality and complexity, we have made the software utilized in this analysis freely available online in the MATLAB NCC (Neural Complexity and Criticality) Toolbox.

Dynamical systems, attractors, and neural circuits

Biology is the study of dynamical systems. Yet most of us working in biology have limited pedagogical training in the theory of dynamical systems, an unfortunate historical fact that can be remedied for future generations of life scientists. In my particular field of systems neuroscience, neural circuits are rife with nonlinearities at all levels of description, rendering simple methodologies and our own intuition unreliable. Therefore, our ideas are likely to be wrong unless informed by good models. These models should be based on the mathematical theories of dynamical systems since functioning neurons are dynamic—they change their membrane potential and firing rates with time. Thus, selecting the appropriate type of dynamical system upon which to base a model is an important first step in the modeling process. This step all too easily goes awry, in part because there are many frameworks to choose from, in part because the sparsely sampled data can be consistent with a variety of dynamical processes, and in part because each modeler has a preferred modeling approach that is difficult to move away from. This brief review summarizes some of the main dynamical paradigms that can arise in neural circuits, with comments on what they can achieve computationally and what signatures might reveal their presence within empirical data. I provide examples of different dynamical systems using simple circuits of two or three cells, emphasizing that any one connectivity pattern is compatible with multiple, diverse functions.

Statistical Evaluation of Waveform Collapse Reveals Scale-Free Properties of Neuronal Avalanches

Neural avalanches are a prominent form of brain activity characterized by network-wide bursts whose statistics follow a power-law distribution with a slope near 3/2. Recent work suggests that avalanches of different durations can be rescaled and thus collapsed together. This collapse mirrors work in statistical physics where it is proposed to form a signature of systems evolving in a critical state. However, no rigorous statistical test has been proposed to examine the degree to which neuronal avalanches collapse together. Here, we describe a statistical test based on functional data analysis, where raw avalanches are first smoothed with a Fourier basis, then rescaled using a time-warping function. Finally, an F ratio test combined with a bootstrap permutation is employed to determine if avalanches collapse together in a statistically reliable fashion. To illustrate this approach, we recorded avalanches from cortical cultures on multielectrode arrays as in previous work. Analyses show that avalanches of various durations can be collapsed together in a statistically robust fashion. However, a principal components analysis revealed that the offset of avalanches resulted in marked variance in the time-warping function, thus arguing for limitations to the strict fractal nature of avalanche dynamics. We compared these results with those obtained from cultures treated with an AMPA/NMDA receptor antagonist (APV/DNQX), which yield a power-law of avalanche durations with a slope greater than 3/2. When collapsed together, these avalanches showed marked misalignments both at onset and offset time-points. In sum, the proposed statistical evaluation suggests the presence of scale-free avalanche waveforms and constitutes an avenue for examining critical dynamics in neuronal systems.

Repertoires of Spike Avalanches Are Modulated by Behavior and Novelty

Neuronal avalanches measured as consecutive bouts of thresholded field potentials represent a statistical signature that the brain operates near a critical point. In theory, criticality optimizes stimulus sensitivity, information transmission, computational capability and mnemonic repertoires size. Field potential avalanches recorded via multielectrode arrays from cortical slice cultures are repeatable spatiotemporal activity patterns. It remains unclear whether avalanches of action potentials observed in forebrain regions of freely-behaving rats also form recursive repertoires, and whether these have any behavioral relevance. Here, we show that spike avalanches, recorded from hippocampus (HP) and sensory neocortex of freely-behaving rats, constitute distinct families of recursive spatiotemporal patterns. A significant number of those patterns were specific to a behavioral state. Although avalanches produced during sleep were mostly similar to others that occurred during waking, the repertoire of patterns recruited during sleep differed significantly from that of waking. More importantly, exposure to novel objects increased the rate at which new patterns arose, also leading to changes in post-exposure repertoires, which were significantly different from those before the exposure. A significant number of families occurred exclusively during periods of whisker contact with objects, but few were associated with specific objects. Altogether, the results provide original evidence linking behavior and criticality at the spike level: spike avalanches form repertoires that emerge in waking, recur during sleep, are diversified by novelty and contribute to object representation.

Rich-Club Organization in Effective Connectivity among Cortical Neurons

The performance of complex networks, like the brain, depends on how effectively their elements communicate. Despite the importance of communication, it is virtually unknown how information is transferred in local cortical networks, consisting of hundreds of closely spaced neurons. To address this, it is important to record simultaneously from hundreds of neurons at a spacing that matches typical axonal connection distances, and at a temporal resolution that matches synaptic delays. We used a 512-electrode array (60 μm spacing) to record spontaneous activity at 20 kHz from up to 500 neurons simultaneously in slice cultures of mouse somatosensory cortex for 1 h at a time. We applied a previously validated version of transfer entropy to quantify information transfer. Similar to in vivo reports, we found an approximately lognormal distribution of firing rates. Pairwise information transfer strengths also were nearly lognormally distributed, similar to reports of synaptic strengths. Some neurons transferred and received much more information than others, which is consistent with previous predictions. Neurons with the highest outgoing and incoming information transfer were more strongly connected to each other than chance, thus forming a "rich club." We found similar results in networks recorded in vivo from rodent cortex, suggesting the generality of these findings. A rich-club structure has been found previously in large-scale human brain networks and is thought to facilitate communication between cortical regions. The discovery of a small, but information-rich, subset of neurons within cortical regions suggests that this population will play a vital role in communication, learning, and memory. Significance statement: Many studies have focused on communication networks between cortical brain regions. In contrast, very few studies have examined communication networks within a cortical region. This is the first study to combine such a large number of neurons (several hundred at a time) with such high temporal resolution (so we can know the direction of communication between neurons) for mapping networks within cortex. We found that information was not transferred equally through all neurons. Instead, ∼70% of the information passed through only 20% of the neurons. Network models suggest that this highly concentrated pattern of information transfer would be both efficient and robust to damage. Therefore, this work may help in understanding how the cortex processes information and responds to neurodegenerative diseases.

Near-Critical Dynamics in Stimulus-Evoked Activity of the Human Brain and Its Relation to Spontaneous Resting-State Activity

In recent years, numerous studies have found that the brain at resting state displays many features characteristic of a critical state. Here we examine whether stimulus-evoked activity can also be regarded as critical. Additionally, we investigate the relation between resting-state activity and stimulus-evoked activity from the perspective of criticality. We found that cortical activity measured by magnetoencephalography (MEG) is near critical and organizes as neuronal avalanches at both resting-state and stimulus-evoked activities. Moreover, a significantly high intrasubject similarity between avalanche size and duration distributions at both cognitive states was found, suggesting that the distributions capture specific features of the individual brain dynamics. When comparing different subjects, a higher intersubject consistency was found for stimulus-evoked activity than for resting state. This was expressed by the distance between avalanche size and duration distributions of different participants and was supported by the spatial spreading of the avalanches involved. During the course of stimulus-evoked activity, time locked to the stimulus onset, we demonstrate fluctuations in the gain of the neuronal system and thus short timescale deviations from the critical state. Nonetheless, the overall near-critical state in stimulus-evoked activity is retained over longer timescales, in close proximity and with a high correlation to spontaneous (not time-locked) resting-state activity. Spatially, the observed fluctuations in gain manifest through anticorrelative activations of brain sites involved, suggesting a switch between task-negative (default mode) and task-positive networks and assigning the changes in excitation-inhibition balance to nodes within these networks. Overall, this study offers a novel outlook on evoked activity through the framework of criticality.

SIGNIFICANCE STATEMENT

The organization of stimulus-evoked activity and ongoing cortical activity is a topic of high importance. The article addresses several general questions. What is the spatiotemporal organization of stimulus-evoked cortical activity in healthy human subjects? Are there deviations from excitation-inhibition balance during stimulus-evoked activity? What is the relationship between stimulus-evoked activity and ongoing resting-state activity? Using magnetoencephalography (MEG), we demonstrate that stimulus-evoked activity in humans follows a critical branching process that produces neuronal avalanches. Additionally, we investigate the spatiotemporal relationship between resting-state activity and stimulus-evoked activity from the perspective of critical dynamics. These analyses reveal new aspects of this complex relationship and offer novel insights into the interplay between excitation and inhibition that were not observed previously using conventional approaches.