Mean-field behavior as a result of noisy local dynamics in self-organized criticality: neuroscience implications

Optimal reinforcement learning near the edge of a synchronization transition

Recent experimental and theoretical studies have indicated that the putative criticality of cortical dynamics may correspond to a synchronization phase transition. The critical dynamics near such a critical point needs further investigation specifically when compared to the critical behavior near the standard absorbing state phase transition. Since the phenomena of learning and self-organized criticality (SOC) at the edge of synchronization transition can emerge jointly in spiking neural networks due to the presence of spike-timing dependent plasticity (STDP), it is tempting to ask the following: what is the relationship between synchronization and learning in neural networks? Further, does learning benefit from SOC at the edge of synchronization transition? In this paper, we intend to address these important issues. Accordingly, we construct a biologically inspired model of a cognitive system which learns to perform stimulus-response tasks. We train this system using a reinforcement learning rule implemented through dopamine-modulated STDP. We find that the system exhibits a continuous transition from synchronous to asynchronous neural oscillations upon increasing the average axonal time delay. We characterize the learning performance of the system and observe that it is optimized near the synchronization transition. We also study neuronal avalanches in the system and provide evidence that optimized learning is achieved in a slightly supercritical state.

Spike-Timing-Dependent Plasticity With Axonal Delay Tunes Networks of Izhikevich Neurons to the Edge of Synchronization Transition With Scale-Free Avalanches

Critical brain hypothesis has been intensively studied both in experimental and theoretical neuroscience over the past two decades. However, some important questions still remain: (i) What is the critical point the brain operates at? (ii) What is the regulatory mechanism that brings about and maintains such a critical state? (iii) The critical state is characterized by scale-invariant behavior which is seemingly at odds with definitive brain oscillations? In this work we consider a biologically motivated model of Izhikevich neuronal network with chemical synapses interacting via spike-timing-dependent plasticity (STDP) as well as axonal time delay. Under generic and physiologically relevant conditions we show that the system is organized and maintained around a synchronization transition point as opposed to an activity transition point associated with an absorbing state phase transition. However, such a state exhibits experimentally relevant signs of critical dynamics including scale-free avalanches with finite-size scaling as well as critical branching ratios. While the system displays stochastic oscillations with highly correlated fluctuations, it also displays dominant frequency modes seen as sharp peaks in the power spectrum. The role of STDP as well as time delay is crucial in achieving and maintaining such critical dynamics, while the role of inhibition is not as crucial. In this way we provide possible answers to all three questions posed above. We also show that one can achieve supercritical or subcritical dynamics if one changes the average time delay associated with axonal conduction.

Coexistence of scale-invariant and rhythmic behavior in self-organized criticality

Scale-free behavior as well as oscillations are frequently observed in the activity of many natural systems. One important example is the cortical tissues of mammalian brain where both phenomena are simultaneously observed. Rhythmic oscillations as well as critical (scale-free) dynamics are thought to be important, but theoretically incompatible, features of a healthy brain. Motivated by the above, we study the possibility of the coexistence of scale-free avalanches along with rhythmic behavior within the framework of self-organized criticality. In particular, we add an oscillatory perturbation to local threshold condition of the continuous Zhang model and characterize the subsequent activity of the system. We observe regular oscillations embedded in well-defined avalanches which exhibit scale-free size and duration in line with observed neuronal avalanches. The average amplitude of such oscillations are shown to decrease with increasing frequency consistent with real brain oscillations. Furthermore, it is shown that optimal amplification of oscillations occur at the critical point, further providing evidence for functional advantages of criticality.

A Basic Phase Diagram of Neuronal Dynamics

The extreme complexity of the brain has attracted the attention of neuroscientists and other researchers for a long time. More recently, the neuromorphic hardware has matured to provide a new powerful tool to study neuronal dynamics. Here, we study neuronal dynamics using different settings on a neuromorphic chip built with flexible parameters of neuron models. Our unique setting in the network of leaky integrate-and-fire (LIF) neurons is to introduce a weak noise environment. We observed three different types of collective neuronal activities, or phases, separated by sharp boundaries, or phase transitions. From this, we construct a rudimentary phase diagram of neuronal dynamics and demonstrate that a noise-induced chaotic phase (N-phase), which is dominated by neuronal avalanche activity (intermittent aperiodic neuron firing), emerges in the presence of noise and its width grows with the noise intensity. The dynamics can be manipulated in this N-phase. Our results and comparison with clinical data is consistent with the literature and our previous work showing that healthy brain must reside in the N-phase. We argue that the brain phase diagram with further refinement may be used for the diagnosis and treatment of mental disease and also suggest that the dynamics may be manipulated to serve as a means of new information processing (e.g., for optimization). Neuromorphic chips, similar to the one we used but with a variety of neuron models, may be used to further enhance the understanding of human brain function and accelerate the development of neuroscience research.

Refractory period in network models of excitable nodes: self-sustaining stable dynamics, extended scaling region and oscillatory behavior

Networks of excitable nodes have recently attracted much attention particularly in regards to neuronal dynamics, where criticality has been argued to be a fundamental property. Refractory behavior, which limits the excitability of neurons is thought to be an important dynamical property. We therefore consider a simple model of excitable nodes which is known to exhibit a transition to instability at a critical point (λ = 1), and introduce refractory period into its dynamics. We use mean-field analytical calculations as well as numerical simulations to calculate the activity dependent branching ratio that is useful to characterize the behavior of critical systems. We also define avalanches and calculate probability distribution of their size and duration. We find that in the presence of refractory period the dynamics stabilizes while various parameter regimes become accessible. A sub-critical regime with λ < 1.0, a standard critical behavior with exponents close to critical branching process for λ = 1, a regime with 1 < λ < 2 that exhibits an interesting scaling behavior, and an oscillating regime with λ > 2.0. We have therefore shown that refractory behavior leads to a wide range of scaling as well as periodic behavior which are relevant to real neuronal dynamics.

Correlations induced by depressing synapses in critically self-organized networks with quenched dynamics

In a recent work, mean-field analysis and computer simulations were employed to analyze critical self-organization in networks of excitable cellular automata where randomly chosen synapses in the network were depressed after each spike (the so-called annealed dynamics). Calculations agree with simulations of the annealed version, showing that the nominal branching ratio σ converges to unity in the thermodynamic limit, as expected of a self-organized critical system. However, the question remains whether the same results apply to the biological case where only the synapses of firing neurons are depressed (the so-called quenched dynamics). We show that simulations of the quenched model yield significant deviations from σ=1 due to spatial correlations. However, the model is shown to be critical, as the largest eigenvalue of the synaptic matrix approaches unity in the thermodynamic limit, that is, λ_{c}=1. We also study the finite size effects near the critical state as a function of the parameters of the synaptic dynamics.

Synaptic plasticity and neuronal refractory time cause scaling behaviour of neuronal avalanches

Neuronal avalanches measured in vitro and in vivo in different cortical networks consistently exhibit power law behaviour for the size and duration distributions with exponents typical for a mean field self-organized branching process. These exponents are also recovered in neuronal network simulations implementing various neuronal dynamics on different network topologies. They can therefore be considered a very robust feature of spontaneous neuronal activity. Interestingly, this scaling behaviour is also observed on regular lattices in finite dimensions, which raises the question about the origin of the mean field behavior observed experimentally. In this study we provide an answer to this open question by investigating the effect of activity dependent plasticity in combination with the neuronal refractory time in a neuronal network. Results show that the refractory time hinders backward avalanches forcing a directed propagation. Hebbian plastic adaptation plays the role of sculpting these directed avalanche patterns into the topology of the network slowly changing it into a branched structure where loops are marginal.

Structural versus dynamical origins of mean-field behavior in a self-organized critical model of neuronal avalanches

Critical dynamics of cortical neurons have been intensively studied over the past decade. Neuronal avalanches provide the main experimental as well as theoretical tools to consider criticality in such systems. Experimental studies show that critical neuronal avalanches show mean-field behavior. There are structural as well as recently proposed [Phys. Rev. E 89, 052139 (2014)] dynamical mechanisms that can lead to mean-field behavior. In this work we consider a simple model of neuronal dynamics based on threshold self-organized critical models with synaptic noise. We investigate the role of high-average connectivity, random long-range connections, as well as synaptic noise in achieving mean-field behavior. We employ finite-size scaling in order to extract critical exponents with good accuracy. We conclude that relevant structural mechanisms responsible for mean-field behavior cannot be justified in realistic models of the cortex. However, strong dynamical noise, which can have realistic justifications, always leads to mean-field behavior regardless of the underlying structure. Our work provides a different (dynamical) origin than the conventionally accepted (structural) mechanisms for mean-field behavior in neuronal avalanches.

Functional scale-free networks in the two-dimensional Abelian sandpile model

Recently, the similarity of the functional network of the brain and the Ising model was investigated by Chialvo [Nat. Phys. 6, 744 (2010)]. This similarity supports the idea that the brain is a self-organized critical system. In this study we derive a functional network of the two-dimensional Bak-Tang-Wiesenfeld sandpile model as a self-organized critical model, and compare its characteristics with those of the functional network of the brain, obtained from functional magnetic resonance imaging.