Finite-size effects of avalanche dynamics

Learning as a phenomenon occurring in a critical state

Recent physiological measurements have provided clear evidence about scale-free avalanche brain activity and EEG spectra, feeding the classical enigma of how such a chaotic system can ever learn or respond in a controlled and reproducible way. Models for learning, like neural networks or perceptrons, have traditionally avoided strong fluctuations. Conversely, we propose that brain activity having features typical of systems at a critical point represents a crucial ingredient for learning. We present here a study that provides unique insights toward the understanding of the problem. Our model is able to reproduce quantitatively the experimentally observed critical state of the brain and, at the same time, learns and remembers logical rules including the exclusive OR, which has posed difficulties to several previous attempts. We implement the model on a network with topological properties close to the functionality network in real brains. Learning occurs via plastic adaptation of synaptic strengths and exhibits universal features. We find that the learning performance and the average time required to learn are controlled by the strength of plastic adaptation, in a way independent of the specific task assigned to the system. Even complex rules can be learned provided that the plastic adaptation is sufficiently slow.

Subsampling effects in neuronal avalanche distributions recorded in vivo

BACKGROUND

Many systems in nature are characterized by complex behaviour where large cascades of events, or avalanches, unpredictably alternate with periods of little activity. Snow avalanches are an example. Often the size distribution f(s) of a system's avalanches follows a power law, and the branching parameter sigma, the average number of events triggered by a single preceding event, is unity. A power law for f(s), and sigma = 1, are hallmark features of self-organized critical (SOC) systems, and both have been found for neuronal activity in vitro. Therefore, and since SOC systems and neuronal activity both show large variability, long-term stability and memory capabilities, SOC has been proposed to govern neuronal dynamics in vivo. Testing this hypothesis is difficult because neuronal activity is spatially or temporally subsampled, while theories of SOC systems assume full sampling. To close this gap, we investigated how subsampling affects f(s) and sigma by imposing subsampling on three different SOC models. We then compared f(s) and sigma of the subsampled models with those of multielectrode local field potential (LFP) activity recorded in three macaque monkeys performing a short term memory task.

RESULTS

Neither the LFP nor the subsampled SOC models showed a power law for f(s). Both, f(s) and sigma, depended sensitively on the subsampling geometry and the dynamics of the model. Only one of the SOC models, the Abelian Sandpile Model, exhibited f(s) and sigma similar to those calculated from LFP activity.

CONCLUSION

Since subsampling can prevent the observation of the characteristic power law and sigma in SOC systems, misclassifications of critical systems as sub- or supercritical are possible. Nevertheless, the system specific scaling of f(s) and sigma under subsampling conditions may prove useful to select physiologically motivated models of brain function. Models that better reproduce f(s) and sigma calculated from the physiological recordings may be selected over alternatives.

Early-stage waves in the retinal network emerge close to a critical state transition between local and global functional connectivity

A novel, biophysically realistic model for early-stage, acetylcholine-mediated retinal waves is presented. In this model, neural excitability is regulated through a slow after-hyperpolarization (sAHP) operating on two different temporal scales. As a result, the simulated network exhibits competition between a desynchronizing effect of spontaneous, cell-intrinsic bursts, and the synchronizing effect of synaptic transmission during retinal waves. Cell-intrinsic bursts decouple the retinal network through activation of the sAHP current, and we show that the network is capable of operating at a transition point between purely local and global functional connectedness, which corresponds to a percolation phase transition. Multielectrode array recordings show that, at this point, the properties of retinal waves are reliably predicted by the model. These results indicate that early spontaneous activity in the developing retina is regulated according to a very specific principle, which maximizes randomness and variability in the resulting activity patterns.

Phase transitions towards criticality in a neural system with adaptive interactions

We analytically describe a transition scenario to self-organized criticality (SOC) that is new for physics as well as neuroscience; it combines the criticality of first and second-order phase transitions with a SOC phase. We consider a network of pulse-coupled neurons interacting via dynamical synapses, which exhibit depression and facilitation as found in experiments. We analytically show the coexistence of a SOC phase and a subcritical phase connected by a cusp bifurcation. Switching between the two phases can be triggered by varying the intensity of noisy inputs.

Critical phenomena in globally coupled excitable elements

Critical phenomena in globally coupled excitable elements are studied by focusing on a saddle-node bifurcation at the collective level. Critical exponents that characterize divergent fluctuations of interspike intervals near the bifurcation are calculated theoretically. The calculated values appear to be in good agreement with those determined by numerical experiments. The relevance of our results to jamming transitions is also mentioned.

Neuronal avalanches organize as nested theta- and beta/gamma-oscillations during development of cortical layer 2/3

Maturation of the cerebral cortex involves the spontaneous emergence of distinct patterns of neuronal synchronization, which regulate neuronal differentiation, synapse formation, and serve as a substrate for information processing. The intrinsic activity patterns that characterize the maturation of cortical layer 2/3 are poorly understood. By using microelectrode array recordings in vivo and in vitro, we show that this development is marked by the emergence of nested - and beta/gamma-oscillations that require NMDA- and GABA(A)-mediated synaptic transmission. The oscillations organized as neuronal avalanches, i.e., they were synchronized across cortical sites forming diverse and millisecond-precise spatiotemporal patterns that distributed in sizes according to a power law with a slope of -1.5. The correspondence between nested oscillations and neuronal avalanches required activation of the dopamine D(1) receptor. We suggest that the repetitive formation of neuronal avalanches provides an intrinsic template for the selective linking of external inputs to developing superficial layers.

The criticality hypothesis: how local cortical networks might optimize information processing

Early theoretical and simulation work independently undertaken by Packard, Langton and Kauffman suggested that adaptability and computational power would be optimized in systems at the 'edge of chaos', at a critical point in a phase transition between total randomness and boring order. This provocative hypothesis has received much attention, but biological experiments supporting it have been relatively few. Here, we review recent experiments on networks of cortical neurons, showing that they appear to be operating near the critical point. Simulation studies capture the main features of these data and suggest that criticality may allow cortical networks to optimize information processing. These simulations lead to predictions that could be tested in the near future, possibly providing further experimental evidence for the criticality hypothesis.

Self-organized critical noise amplification in human closed loop control

When humans perform closed loop control tasks like in upright standing or while balancing a stick, their behavior exhibits non-Gaussian fluctuations with long-tailed distributions. The origin of these fluctuations is not known. Here, we investigate if they are caused by self-organized critical noise amplification which emerges in control systems when an unstable dynamics becomes stabilized by an adaptive controller that has finite memory. Starting from this theory, we formulate a realistic model of adaptive closed loop control by including constraints on memory and delays. To test this model, we performed psychophysical experiments where humans balanced an unstable target on a screen. It turned out that the model reproduces the long tails of the distributions together with other characteristic features of the human control dynamics. Fine-tuning the model to match the experimental dynamics identifies parameters characterizing a subject's control system which can be independently tested. Our results suggest that the nervous system involved in closed loop motor control nearly optimally estimates system parameters on-line from very short epochs of past observations.

Activity-dependent neural network model on scale-free networks

Networks of living neurons exhibit an avalanche mode of activity, experimentally found in organotypic cultures. Moreover, experimental studies of morphology indicate that neurons develop a network of small-world-like connections, with the possibility of a very high connectivity degree. Here we study a recent model based on self-organized criticality, which consists of an electrical network with threshold firing and activity-dependent synapse strengths. We study the model on a scale-free network, the Apollonian network. The system exhibits an avalanche activity with a power law distribution of sizes and durations. The analysis of the power spectra of the electrical signal reproduces very robustly the power law behavior with the exponent 0.8, experimentally measured in electroencephalogram spectra. The exponents are found to be quite stable with respect to initial configurations and strength of plastic remodeling, indicating that universality holds for a wide class of neural network models.

Field-theoretic approach to fluctuation effects in neural networks

A well-defined stochastic theory for neural activity, which permits the calculation of arbitrary statistical moments and equations governing them, is a potentially valuable tool for theoretical neuroscience. We produce such a theory by analyzing the dynamics of neural activity using field theoretic methods for nonequilibrium statistical processes. Assuming that neural network activity is Markovian, we construct the effective spike model, which describes both neural fluctuations and response. This analysis leads to a systematic expansion of corrections to mean field theory, which for the effective spike model is a simple version of the Wilson-Cowan equation. We argue that neural activity governed by this model exhibits a dynamical phase transition which is in the universality class of directed percolation. More general models (which may incorporate refractoriness) can exhibit other universality classes, such as dynamic isotropic percolation. Because of the extremely high connectivity in typical networks, it is expected that higher-order terms in the systematic expansion are small for experimentally accessible measurements, and thus, consistent with measurements in neocortical slice preparations, we expect mean field exponents for the transition. We provide a quantitative criterion for the relative magnitude of each term in the systematic expansion, analogous to the Ginsburg criterion. Experimental identification of dynamic universality classes in vivo is an outstanding and important question for neuroscience.

The organizing principles of neuronal avalanches: cell assemblies in the cortex?

Neuronal avalanches are spatiotemporal patterns of neuronal activity that occur spontaneously in superficial layers of the mammalian cortex under various experimental conditions. These patterns reflect fast propagation of local synchrony, display a rich spatiotemporal diversity and recur over several hours. The statistical organization of pattern sizes is invariant to the choice of spatial scale, demonstrating that the functional linking of cortical sites into avalanches occurs on all spatial scales with a fractal organization. These features suggest an underlying network of neuronal interactions that balances diverse representations with predictable recurrence, similar to what has been theorized for cell assembly formation. We propose that avalanches reflect the transient formation of cell assemblies in the cortex and discuss various models that provide mechanistic insights into the underlying dynamics, suggesting that they arise in a critical regime.

Local cortical circuit model inferred from power-law distributed neuronal avalanches

How cortical neurons process information crucially depends on how their local circuits are organized. Spontaneous synchronous neuronal activity propagating through neocortical slices displays highly diverse, yet repeatable, activity patterns called "neuronal avalanches". They obey power-law distributions of the event sizes and lifetimes, presumably reflecting the structure of local circuits developed in slice cultures. However, the explicit network structure underlying the power-law statistics remains unclear. Here, we present a neuronal network model of pyramidal and inhibitory neurons that enables stable propagation of avalanche-like spiking activity. We demonstrate a neuronal wiring rule that governs the formation of mutually overlapping cell assemblies during the development of this network. The resultant network comprises a mixture of feedforward chains and recurrent circuits, in which neuronal avalanches are stable if the former structure is predominant. Interestingly, the recurrent synaptic connections formed by this wiring rule limit the number of cell assemblies embeddable in a neuron pool of given size. We investigate how the resultant power laws depend on the details of the cell-assembly formation as well as on the inhibitory feedback. Our model suggests that local cortical circuits may have a more complex topological design than has previously been thought.

Critical branching captures activity in living neural networks and maximizes the number of metastable States

Recent experimental work has shown that activity in living neural networks can propagate as a critical branching process that revisits many metastable states. Neural network theory suggests that attracting states could store information, but little is known about how a branching process could form such states. Here we use a branching process to model actual data and to explore metastable states in the network. When we tune the branching parameter to the critical point, we find that metastable states are most numerous and that network dynamics are not attracting, but neutral.

Human stick balancing: tuning Lèvy flights to improve balance control

State-dependent, or parametric, noise is an essential component of the neural control mechanism for stick balancing at the fingertip. High-speed motion analysis in three dimensions demonstrates that the controlling movements made by the fingertip during stick balancing can be described by a Lèvy flight. The Lèvy index, alpha, is approximately 0.9; a value close to optimal for a random search. With increased skill, the index alpha does not change. However, the tails of the Lèvy distribution become broader. These observations suggest a Lèvy flight that is truncated by the properties of the nervous and musculoskeletal system; the truncation decreasing as skill level increases. Measurements of the cross-correlation between the position of the tip of the stick and the fingertip demonstrate that the role of closed-loop feedback changes with increased skill. Moreover, estimation of the neural latencies for stick balancing show that for a given stick length, the latency increases with skill level. It is suggested that the neural control for stick balancing involves a mechanism in which brief intervals of consciously generated, corrective movements alternate with longer intervals of prediction-free control. With learning the truncation of the Lèvy flight becomes better optimized for balance control and hence the time between successive conscious corrections increases. These observations provide the first evidence that changes in a Lèvy flight may have functional significance for the nervous system. This work has implications for the control of balancing problems ranging from falling in the elderly to the design of two-legged robots and earthquake proof buildings.

Neuronal avalanches in neocortical circuits

Networks of living neurons exhibit diverse patterns of activity, including oscillations, synchrony, and waves. Recent work in physics has shown yet another mode of activity in systems composed of many nonlinear units interacting locally. For example, avalanches, earthquakes, and forest fires all propagate in systems organized into a critical state in which event sizes show no characteristic scale and are described by power laws. We hypothesized that a similar mode of activity with complex emergent properties could exist in networks of cortical neurons. We investigated this issue in mature organotypic cultures and acute slices of rat cortex by recording spontaneous local field potentials continuously using a 60 channel multielectrode array. Here, we show that propagation of spontaneous activity in cortical networks is described by equations that govern avalanches. As predicted by theory for a critical branching process, the propagation obeys a power law with an exponent of -3/2 for event sizes, with a branching parameter close to the critical value of 1. Simulations show that a branching parameter at this value optimizes information transmission in feedforward networks, while preventing runaway network excitation. Our findings suggest that "neuronal avalanches" may be a generic property of cortical networks, and represent a mode of activity that differs profoundly from oscillatory, synchronized, or wave-like network states. In the critical state, the network may satisfy the competing demands of information transmission and network stability.

Perimeter growth of a branched structure: application to crackle sounds in the lung

We study an invasion percolation process on Cayley trees and find that the dynamics of perimeter growth is strongly dependent on the nature of the invasion process, as well as on the underlying tree structure. We apply this process to model the inflation of the lung in the airway tree, where crackling sounds are generated when airways open. We define the perimeter as the interface between the closed and opened regions of the lung. In this context we find that the distribution of time intervals between consecutive openings is a power law with an exponent beta approximately 2. We generalize the binary structure of the lung to a Cayley tree with a coordination number Z between 2 and 4. For Z=4, beta remains close to 2, while for a chain, Z=2 and beta=1, exactly. We also find a mean field solution of the model.