From Quasiperiodic Partial Synchronization to Collective Chaos in Populations of Inhibitory Neurons with Delay

Low-dimensional model for adaptive networks of spiking neurons

We investigate a large ensemble of quadratic integrate-and-fire neurons with heterogeneous input currents and adaptation variables. Our analysis reveals that, for a specific class of adaptation, termed quadratic spike-frequency adaptation, the high-dimensional system can be exactly reduced to a low-dimensional system of ordinary differential equations, which describes the dynamics of three mean-field variables: the population's firing rate, the mean membrane potential, and a mean adaptation variable. The resulting low-dimensional firing rate equations (FREs) uncover a key generic feature of heterogeneous networks with spike-frequency adaptation: Both the center and width of the distribution of the neurons' firing frequencies are reduced, and this largely promotes the emergence of collective synchronization in the network. Our findings are further supported by the bifurcation analysis of the FREs, which accurately captures the collective dynamics of the spiking neuron network, including phenomena such as collective oscillations, bursting, and macroscopic chaos.

How synaptic function controls critical transitions in spiking neuron networks: insight from a Kuramoto model reduction

The dynamics of synaptic interactions within spiking neuron networks play a fundamental role in shaping emergent collective behavior. This paper studies a finite-size network of quadratic integrate-and-fire neurons interconnected via a general synaptic function that accounts for synaptic dynamics and time delays. Through asymptotic analysis, we transform this integrate-and-fire network into the Kuramoto-Sakaguchi model, whose parameters are explicitly expressed via synaptic function characteristics. This reduction yields analytical conditions on synaptic activation rates and time delays determining whether the synaptic coupling is attractive or repulsive. Our analysis reveals alternating stability regions for synchronous and partially synchronous firing, dependent on slow synaptic activation and time delay. We also demonstrate that the reduced microscopic model predicts the emergence of synchronization, weakly stable cyclops states, and non-stationary regimes remarkably well in the original integrate-and-fire network and its theta neuron counterpart. Our reduction approach promises to open the door to rigorous analysis of rhythmogenesis in networks with synaptic adaptation and plasticity.

Pulse Shape and Voltage-Dependent Synchronization in Spiking Neuron Networks

Pulse-coupled spiking neural networks are a powerful tool to gain mechanistic insights into how neurons self-organize to produce coherent collective behavior. These networks use simple spiking neuron models, such as the θ-neuron or the quadratic integrate-and-fire (QIF) neuron, that replicate the essential features of real neural dynamics. Interactions between neurons are modeled with infinitely narrow pulses, or spikes, rather than the more complex dynamics of real synapses. To make these networks biologically more plausible, it has been proposed that they must also account for the finite width of the pulses, which can have a significant impact on the network dynamics. However, the derivation and interpretation of these pulses are contradictory, and the impact of the pulse shape on the network dynamics is largely unexplored. Here, I take a comprehensive approach to pulse coupling in networks of QIF and θ-neurons. I argue that narrow pulses activate voltage-dependent synaptic conductances and show how to implement them in QIF neurons such that their effect can last through the phase after the spike. Using an exact low-dimensional description for networks of globally coupled spiking neurons, I prove for instantaneous interactions that collective oscillations emerge due to an effective coupling through the mean voltage. I analyze the impact of the pulse shape by means of a family of smooth pulse functions with arbitrary finite width and symmetric or asymmetric shapes. For symmetric pulses, the resulting voltage coupling is not very effective in synchronizing neurons, but pulses that are slightly skewed to the phase after the spike readily generate collective oscillations. The results unveil a voltage-dependent spike synchronization mechanism at the heart of emergent collective behavior, which is facilitated by pulses of finite width and complementary to traditional synaptic transmission in spiking neuron networks.

Order parameter dynamics in complex systems: From models to data

Collective ordering behaviors are typical macroscopic manifestations embedded in complex systems and can be ubiquitously observed across various physical backgrounds. Elements in complex systems may self-organize via mutual or external couplings to achieve diverse spatiotemporal coordinations. The order parameter, as a powerful quantity in describing the transition to collective states, may emerge spontaneously from large numbers of degrees of freedom through competitions. In this minireview, we extensively discussed the collective dynamics of complex systems from the viewpoint of order-parameter dynamics. A synergetic theory is adopted as the foundation of order-parameter dynamics, and it focuses on the self-organization and collective behaviors of complex systems. At the onset of macroscopic transitions, slow modes are distinguished from fast modes and act as order parameters, whose evolution can be established in terms of the slaving principle. We explore order-parameter dynamics in both model-based and data-based scenarios. For situations where microscopic dynamics modeling is available, as prototype examples, synchronization of coupled phase oscillators, chimera states, and neuron network dynamics are analytically studied, and the order-parameter dynamics is constructed in terms of reduction procedures such as the Ott-Antonsen ansatz, the Lorentz ansatz, and so on. For complicated systems highly challenging to be well modeled, we proposed the eigen-microstate approach (EMP) to reconstruct the macroscopic order-parameter dynamics, where the spatiotemporal evolution brought by big data can be well decomposed into eigenmodes, and the macroscopic collective behavior can be traced by Bose-Einstein condensation-like transitions and the emergence of dominant eigenmodes. The EMP is successfully applied to some typical examples, such as phase transitions in the Ising model, climate dynamics in earth systems, fluctuation patterns in stock markets, and collective motion in living systems.

Synaptic dependence of dynamic regimes when coupling neural populations

In this article we focus on the study of the collective dynamics of neural networks. The analysis of two recent models of coupled "next-generation" neural mass models allows us to observe different global mean dynamics of large neural populations. These models describe the mean dynamics of all-to-all coupled networks of quadratic integrate-and-fire spiking neurons. In addition, one of these models considers the influence of the synaptic adaptation mechanism on the macroscopic dynamics. We show how both models are related through a parameter and we study the evolution of the dynamics when switching from one model to the other by varying that parameter. Interestingly, we have detected three main dynamical regimes in the coupled models: Rössler-type (funnel type), bursting-type, and spiking-like (oscillator-type) dynamics. This result opens the question of which regime is the most suitable for realistic simulations of large neural networks and shows the possibility of the emergence of chaotic collective dynamics when synaptic adaptation is very weak.

Exact low-dimensional description for fast neural oscillations with low firing rates

Recently, low-dimensional models of neuronal activity have been exactly derived for large networks of deterministic, quadratic integrate-and-fire (QIF) neurons. Such firing rate models (FRM) describe the emergence of fast collective oscillations (>30 Hz) via the frequency locking of a subset of neurons to the global oscillation frequency. However, the suitability of such models to describe realistic neuronal states is seriously challenged by the fact that during episodes of fast collective oscillations, neuronal discharges are often very irregular and have low firing rates compared to the global oscillation frequency. Here we extend the theory to derive exact FRM for QIF neurons to include noise and show that networks of stochastic neurons displaying irregular discharges at low firing rates during episodes of fast oscillations are governed by exactly the same evolution equations as deterministic networks. Our results reconcile two traditionally confronted views on neuronal synchronization and upgrade the applicability of exact FRM to describe a broad range of biologically realistic neuronal states.

Comparison between an exact and a heuristic neural mass model with second-order synapses

Neural mass models (NMMs) are designed to reproduce the collective dynamics of neuronal populations. A common framework for NMMs assumes heuristically that the output firing rate of a neural population can be described by a static nonlinear transfer function (NMM1). However, a recent exact mean-field theory for quadratic integrate-and-fire (QIF) neurons challenges this view by showing that the mean firing rate is not a static function of the neuronal state but follows two coupled nonlinear differential equations (NMM2). Here we analyze and compare these two descriptions in the presence of second-order synaptic dynamics. First, we derive the mathematical equivalence between the two models in the infinitely slow synapse limit, i.e., we show that NMM1 is an approximation of NMM2 in this regime. Next, we evaluate the applicability of this limit in the context of realistic physiological parameter values by analyzing the dynamics of models with inhibitory or excitatory synapses. We show that NMM1 fails to reproduce important dynamical features of the exact model, such as the self-sustained oscillations of an inhibitory interneuron QIF network. Furthermore, in the exact model but not in the limit one, stimulation of a pyramidal cell population induces resonant oscillatory activity whose peak frequency and amplitude increase with the self-coupling gain and the external excitatory input. This may play a role in the enhanced response of densely connected networks to weak uniform inputs, such as the electric fields produced by noninvasive brain stimulation.

Theta neuron subject to delayed feedback: a prototypical model for self-sustained pulsing

We consider a single theta neuron with delayed self-feedback in the form of a Dirac delta function in time. Because the dynamics of a theta neuron on its own can be solved explicitly—it is either excitable or shows self-pulsations—we are able to derive algebraic expressions for the existence and stability of the periodic solutions that arise in the presence of feedback. These periodic solutions are characterized by one or more equally spaced pulses per delay interval, and there is an increasing amount of multistability with increasing delay time. We present a complete description of where these self-sustained oscillations can be found in parameter space; in particular, we derive explicit expressions for the loci of their saddle-node bifurcations. We conclude that the theta neuron with delayed self-feedback emerges as a prototypical model: it provides an analytical basis for understanding pulsating dynamics observed in other excitable systems subject to delayed self-coupling.

Exact mean-field models for spiking neural networks with adaptation

Networks of spiking neurons with adaption have been shown to be able to reproduce a wide range of neural activities, including the emergent population bursting and spike synchrony that underpin brain disorders and normal function. Exact mean-field models derived from spiking neural networks are extremely valuable, as such models can be used to determine how individual neurons and the network they reside within interact to produce macroscopic network behaviours. In the paper, we derive and analyze a set of exact mean-field equations for the neural network with spike frequency adaptation. Specifically, our model is a network of Izhikevich neurons, where each neuron is modeled by a two dimensional system consisting of a quadratic integrate and fire equation plus an equation which implements spike frequency adaptation. Previous work deriving a mean-field model for this type of network, relied on the assumption of sufficiently slow dynamics of the adaptation variable. However, this approximation did not succeed in establishing an exact correspondence between the macroscopic description and the realistic neural network, especially when the adaptation time constant was not large. The challenge lies in how to achieve a closed set of mean-field equations with the inclusion of the mean-field dynamics of the adaptation variable. We address this problem by using a Lorentzian ansatz combined with the moment closure approach to arrive at a mean-field system in the thermodynamic limit. The resulting macroscopic description is capable of qualitatively and quantitatively describing the collective dynamics of the neural network, including transition between states where the individual neurons exhibit asynchronous tonic firing and synchronous bursting. We extend the approach to a network of two populations of neurons and discuss the accuracy and efficacy of our mean-field approximations by examining all assumptions that are imposed during the derivation. Numerical bifurcation analysis of our mean-field models reveals bifurcations not previously observed in the models, including a novel mechanism for emergence of bursting in the network. We anticipate our results will provide a tractable and reliable tool to investigate the underlying mechanism of brain function and dysfunction from the perspective of computational neuroscience.

Mean-field equations for neural populations with q-Gaussian heterogeneities

Describing the collective dynamics of large neural populations using low-dimensional models for averaged variables has long been an attractive task in theoretical neuroscience. Recently developed reduction methods make it possible to derive such models directly from the microscopic dynamics of individual neurons. To simplify the reduction, the Cauchy distribution is usually assumed for heterogeneous network parameters. Here we extend the reduction method for a wider class of heterogeneities defined by the q-Gaussian distribution. The shape of this distribution depends on the Tsallis index q and gradually changes from the Cauchy distribution to the normal Gaussian distribution as this index changes. We derive the mean-field equations for an inhibitory network of quadratic integrate-and-fire neurons with a q-Gaussian-distributed excitability parameter. It is shown that the dynamic modes of the network significantly depend on the form of the distribution determined by the Tsallis index. The results obtained from the mean-field equations are confirmed by numerical simulation of the microscopic model.

Complexity Collapse, Fluctuating Synchrony, and Transient Chaos in Neural Networks With Delay Clusters

Neural circuits operate with delays over a range of time scales, from a few milliseconds in recurrent local circuitry to tens of milliseconds or more for communication between populations. Modeling usually incorporates single fixed delays, meant to represent the mean conduction delay between neurons making up the circuit. We explore conditions under which the inclusion of more delays in a high-dimensional chaotic neural network leads to a reduction in dynamical complexity, a phenomenon recently described as multi-delay complexity collapse (CC) in delay-differential equations with one to three variables. We consider a recurrent local network of 80% excitatory and 20% inhibitory rate model neurons with 10% connection probability. An increase in the width of the distribution of local delays, even to unrealistically large values, does not cause CC, nor does adding more local delays. Interestingly, multiple small local delays can cause CC provided there is a moderate global delayed inhibitory feedback and random initial conditions. CC then occurs through the settling of transient chaos onto a limit cycle. In this regime, there is a form of noise-induced order in which the mean activity variance decreases as the noise increases and disrupts the synchrony. Another novel form of CC is seen where global delayed feedback causes “dropouts,” i.e., epochs of low firing rate network synchrony. Their alternation with epochs of higher firing rate asynchrony closely follows Poisson statistics. Such dropouts are promoted by larger global feedback strength and delay. Finally, periodic driving of the chaotic regime with global feedback can cause CC; the extinction of chaos can outlast the forcing, sometimes permanently. Our results suggest a wealth of phenomena that remain to be discovered in networks with clusters of delays.

Patient-Specific Network Connectivity Combined With a Next Generation Neural Mass Model to Test Clinical Hypothesis of Seizure Propagation

Dynamics underlying epileptic seizures span multiple scales in space and time, therefore, understanding seizure mechanisms requires identifying the relations between seizure components within and across these scales, together with the analysis of their dynamical repertoire. In this view, mathematical models have been developed, ranging from single neuron to neural population. In this study, we consider a neural mass model able to exactly reproduce the dynamics of heterogeneous spiking neural networks. We combine mathematical modeling with structural information from non invasive brain imaging, thus building large-scale brain network models to explore emergent dynamics and test the clinical hypothesis. We provide a comprehensive study on the effect of external drives on neuronal networks exhibiting multistability, in order to investigate the role played by the neuroanatomical connectivity matrices in shaping the emergent dynamics. In particular, we systematically investigate the conditions under which the network displays a transition from a low activity regime to a high activity state, which we identify with a seizure-like event. This approach allows us to study the biophysical parameters and variables leading to multiple recruitment events at the network level. We further exploit topological network measures in order to explain the differences and the analogies among the subjects and their brain regions, in showing recruitment events at different parameter values. We demonstrate, along with the example of diffusion-weighted magnetic resonance imaging (dMRI) connectomes of 20 healthy subjects and 15 epileptic patients, that individual variations in structural connectivity, when linked with mathematical dynamic models, have the capacity to explain changes in spatiotemporal organization of brain dynamics, as observed in network-based brain disorders. In particular, for epileptic patients, by means of the integration of the clinical hypotheses on the epileptogenic zone (EZ), i.e., the local network where highly synchronous seizures originate, we have identified the sequence of recruitment events and discussed their links with the topological properties of the specific connectomes. The predictions made on the basis of the implemented set of exact mean-field equations turn out to be in line with the clinical pre-surgical evaluation on recruited secondary networks.

Suppression of synchronous spiking in two interacting populations of excitatory and inhibitory quadratic integrate-and-fire neurons

Collective oscillations and their suppression by external stimulation are analyzed in a large-scale neural network consisting of two interacting populations of excitatory and inhibitory quadratic integrate-and-fire neurons. In the limit of an infinite number of neurons, the microscopic model of this network can be reduced to an exact low-dimensional system of mean-field equations. Bifurcation analysis of these equations reveals three different dynamic modes in a free network: a stable resting state, a stable limit cycle, and bistability with a coexisting resting state and a limit cycle. We show that in the limit cycle mode, high-frequency stimulation of an inhibitory population can stabilize an unstable resting state and effectively suppress collective oscillations. We also show that in the bistable mode, the dynamics of the network can be switched from a stable limit cycle to a stable resting state by applying an inhibitory pulse to the excitatory population. The results obtained from the mean-field equations are confirmed by numerical simulation of the microscopic model.

Reduction of the collective dynamics of neural populations with realistic forms of heterogeneity

Reduction of collective dynamics of large heterogeneous populations to low-dimensional mean-field models is an important task of modern theoretical neuroscience. Such models can be derived from microscopic equations, for example with the help of Ott-Antonsen theory. An often used assumption of the Lorentzian distribution of the unit parameters makes the reduction especially efficient. However, the Lorentzian distribution is often implausible as having undefined moments, and the collective behavior of populations with other distributions needs to be studied. In the present Letter we propose a method which allows efficient reduction for an arbitrary distribution and show how it performs for the Gaussian distribution. We show that a reduced system for several macroscopic complex variables provides an accurate description of a population of thousands of neurons. Using this reduction technique we demonstrate that the population dynamics depends significantly on the form of its parameter distribution. In particular, the dynamics of populations with Lorentzian and Gaussian distributions with the same center and width differ drastically.

Collective dynamics in the presence of finite-width pulses

The idealization of neuronal pulses as δ-spikes is a convenient approach in neuroscience but can sometimes lead to erroneous conclusions. We investigate the effect of a finite pulse width on the dynamics of balanced neuronal networks. In particular, we study two populations of identical excitatory and inhibitory neurons in a random network of phase oscillators coupled through exponential pulses with different widths. We consider three coupling functions inspired by leaky integrate-and-fire neurons with delay and type I phase-response curves. By exploring the role of the pulse widths for different coupling strengths, we find a robust collective irregular dynamics, which collapses onto a fully synchronous regime if the inhibitory pulses are sufficiently wider than the excitatory ones. The transition to synchrony is accompanied by hysteretic phenomena (i.e., the co-existence of collective irregular and synchronous dynamics). Our numerical results are supported by a detailed scaling and stability analysis of the fully synchronous solution. A conjectured first-order phase transition emerging for δ-spikes is smoothed out for finite-width pulses.

A universal route to explosive phenomena

Critical transitions are observed in many complex systems. This includes the onset of synchronization in a network of coupled oscillators or the emergence of an epidemic state within a population. "Explosive" first-order transitions have caught particular attention in a variety of systems when classical models are generalized by incorporating additional effects. Here, we give a mathematical argument that the emergence of these first-order transitions is not surprising but rather a universally expected effect: Varying a classical model along a generic two-parameter family must lead to a change of the criticality. To illustrate our framework, we give three explicit examples of the effect in distinct physical systems: a model of adaptive epidemic dynamics, for a generalization of the Kuramoto model, and for a percolation transition.

Exact Mean-Field Theory Explains the Dual Role of Electrical Synapses in Collective Synchronization

Electrical synapses play a major role in setting up neuronal synchronization, but the precise mechanisms whereby these synapses contribute to synchrony are subtle and remain elusive. To investigate these mechanisms mean-field theories for quadratic integrate-and-fire neurons with electrical synapses have been recently put forward. Still, the validity of these theories is controversial since they assume that the neurons produce unrealistic, symmetric spikes, ignoring the well-known impact of spike shape on synchronization. Here, we show that the assumption of symmetric spikes can be relaxed in such theories. The resulting mean-field equations reveal a dual role of electrical synapses: First, they equalize membrane potentials favoring the emergence of synchrony. Second, electrical synapses act as "virtual chemical synapses," which can be either excitatory or inhibitory depending upon the spike shape. Our results offer a precise mathematical explanation of the intricate effect of electrical synapses in collective synchronization. This reconciles previous theoretical and numerical works, and confirms the suitability of recent low-dimensional mean-field theories to investigate electrically coupled neuronal networks.

The Winfree model with non-infinitesimal phase-response curve: Ott-Antonsen theory

A novel generalization of the Winfree model of globally coupled phase oscillators, representing phase reduction under finite coupling, is studied analytically. We consider interactions through a non-infinitesimal (or finite) phase-response curve (PRC), in contrast to the infinitesimal PRC of the original model. For a family of non-infinitesimal PRCs, the global dynamics is captured by one complex-valued ordinary differential equation resorting to the Ott-Antonsen ansatz. The phase diagrams are thereupon obtained for four illustrative cases of non-infinitesimal PRC. Bistability between collective synchronization and full desynchronization is observed in all cases.

Effective low-dimensional dynamics of a mean-field coupled network of slow-fast spiking lasers

Low-dimensional dynamics of large networks is the focus of many theoretical works, but controlled laboratory experiments are comparatively very few. Here, we discuss experimental observations on a mean-field coupled network of hundreds of semiconductor lasers, which collectively display effectively low-dimensional mixed mode oscillations and chaotic spiking typical of slow-fast systems. We demonstrate that such a reduced dimensionality originates from the slow-fast nature of the system and of the existence of a critical manifold of the network where most of the dynamics takes place. Experimental measurement of the bifurcation parameter for different network sizes corroborates the theory.

Exact firing rate model reveals the differential effects of chemical versus electrical synapses in spiking networks

Chemical and electrical synapses shape the dynamics of neuronal networks. Numerous theoretical studies have investigated how each of these types of synapses contributes to the generation of neuronal oscillations, but their combined effect is less understood. This limitation is further magnified by the impossibility of traditional neuronal mean-field models-also known as firing rate models or firing rate equations-to account for electrical synapses. Here, we introduce a firing rate model that exactly describes the mean-field dynamics of heterogeneous populations of quadratic integrate-and-fire (QIF) neurons with both chemical and electrical synapses. The mathematical analysis of the firing rate model reveals a well-established bifurcation scenario for networks with chemical synapses, characterized by a codimension-2 cusp point and persistent states for strong recurrent excitatory coupling. The inclusion of electrical coupling generally implies neuronal synchrony by virtue of a supercritical Hopf bifurcation. This transforms the cusp scenario into a bifurcation scenario characterized by three codimension-2 points (cusp, Takens-Bogdanov, and saddle-node separatrix loop), which greatly reduces the possibility for persistent states. This is generic for heterogeneous QIF networks with both chemical and electrical couplings. Our results agree with several numerical studies on the dynamics of large networks of heterogeneous spiking neurons with electrical and chemical couplings.

Noise-induced macroscopic oscillations in a network of synaptically coupled quadratic integrate-and-fire neurons

We consider the effect of small independent local noise on a network of quadratic integrate-and-fire neurons, globally coupled via synaptic pulses of finite width. The Fokker-Planck equation for a network of infinite size is reduced to a low-dimensional system of ordinary differential equations using the recently proposed perturbation theory based on circular cumulants. A bifurcation analysis of the reduced equations is performed, and areas in the parameter space, where the noise causes macroscopic oscillations of the network, are determined. The validity of the reduced equations is verified by comparing their solutions with "exact" solutions of the Fokker-Planck equation, as well as with the results of direct simulation of stochastic microscopic dynamics of a finite-size network.

Phase reduction beyond the first order: The case of the mean-field complex Ginzburg-Landau equation

Phase reduction is a powerful technique that makes possible to describe the dynamics of a weakly perturbed limit-cycle oscillator in terms of its phase. For ensembles of oscillators, a classical example of phase reduction is the derivation of the Kuramoto model from the mean-field complex Ginzburg-Landau equation (MF-CGLE). Still, the Kuramoto model is a first-order phase approximation that displays either full synchronization or incoherence, but none of the nontrivial dynamics of the MF-CGLE. This fact calls for an expansion beyond the first order in the coupling constant. We develop an isochron-based scheme to obtain the second-order phase approximation, which reproduces the weak-coupling dynamics of the MF-CGLE. The practicality of our method is evidenced by extending the calculation up to third order. Each new term of the power-series expansion contributes with additional higher-order multibody (i.e., nonpairwise) interactions. This points to intricate multibody phase interactions as the source of pure collective chaos in the MF-CGLE at moderate coupling.

Between phase and amplitude oscillators

We analyze an intermediate collective regime where amplitude oscillators distribute themselves along a closed, smooth, time-dependent curve C, thereby maintaining the typical ordering of (identical) phase oscillators. This is achieved by developing a general formalism based on two partial differential equations, which describe the evolution of the probability density along C and of the shape of C itself. The formalism is specifically developed for Stuart-Landau oscillators, but it is general enough to apply to other classes of amplitude oscillators. The main achievements consist in (i) identification and characterization of a transition to self-consistent partial synchrony (SCPS), which confirms the crucial role played by higher Fourier harmonics in the coupling function; (ii) an analytical treatment of SCPS, including a detailed stability analysis; and (iii) the discovery of a different form of collective chaos, which can be seen as a generalization of SCPS and characterized by a multifractal probability density. Finally, we are able to describe given dynamical regimes at both the macroscopic and the microscopic level, thereby shedding additional light on the relationship between the two different levels of description.

Macroscopic phase resetting-curves determine oscillatory coherence and signal transfer in inter-coupled neural circuits

Macroscopic oscillations of different brain regions show multiple phase relationships that are persistent across time and have been implicated in routing information. While multiple cellular mechanisms influence the network oscillatory dynamics and structure the macroscopic firing motifs, one of the key questions is to identify the biophysical neuronal and synaptic properties that permit such motifs to arise. A second important issue is how the different neural activity coherence states determine the communication between the neural circuits. Here we analyse the emergence of phase-locking within bidirectionally delayed-coupled spiking circuits in which global gamma band oscillations arise from synaptic coupling among largely excitable neurons. We consider both the interneuronal (ING) and the pyramidal-interneuronal (PING) population gamma rhythms and the inter coupling targeting the pyramidal or the inhibitory neurons. Using a mean-field approach together with an exact reduction method, we reduce each spiking network to a low dimensional nonlinear system and derive the macroscopic phase resetting-curves (mPRCs) that determine how the phase of the global oscillation responds to incoming perturbations. This is made possible by the use of the quadratic integrate-and-fire model together with a Lorentzian distribution of the bias current. Depending on the type of gamma (PING vs. ING), we show that incoming excitatory inputs can either speed up the macroscopic oscillation (phase advance; type I PRC) or induce both a phase advance and a delay (type II PRC). From there we determine the structure of macroscopic coherence states (phase-locking) of two weakly synaptically-coupled networks. To do so we derive a phase equation for the coupled system which links the synaptic mechanisms to the coherence states of the system. We show that a synaptic transmission delay is a necessary condition for symmetry breaking, i.e. a non-symmetric phase lag between the macroscopic oscillations. This potentially provides an explanation to the experimentally observed variety of gamma phase-locking modes. Our analysis further shows that symmetry-broken coherence states can lead to a preferred direction of signal transfer between the oscillatory networks where this directionality also depends on the timing of the signal. Hence we suggest a causal theory for oscillatory modulation of functional connectivity between cortical circuits.

Large scale brain oscillations emerge from synaptic interactions within neuronal circuits. Over the past years, such macroscopic rhythms have been suggested to play a crucial role in routing the flow of information across cortical regions, resulting in a functional connectome. The underlying mechanism is cortical oscillations that bind together following a well-known motif called phase-locking. While there is significant experimental support for multiple phase-locking modes in the brain, it is still unclear what is the underlying mechanism that permits macroscopic rhythms to phase lock. In the present paper we take up with this issue, and to show that, one can study the emergent macroscopic phase-locking within the mathematical framework of weakly coupled oscillators. We find that under synaptic delays, fully symmetrically coupled networks can display symmetry-broken states of activity, where one network starts to lead in phase the second (also sometimes known as stuttering states). When we analyse how incoming transient signals affect the coupled system, we find that in the symmetry-broken state, the effect depends strongly on which network is targeted (the leader or the follower) as well as the timing of the input. Hence we show how the dynamics of the emergent phase-locked activity imposes a functional directionality on how signals are processed. We thus offer clarification on the synaptic and circuit properties responsible for the emergence of multiple phase-locking patterns and provide support for its functional implication in information transfer.

Beta-Rhythm Oscillations and Synchronization Transition in Network Models of Izhikevich Neurons: Effect of Topology and Synaptic Type

Despite their significant functional roles, beta-band oscillations are least understood. Synchronization in neuronal networks have attracted much attention in recent years with the main focus on transition type. Whether one obtains explosive transition or a continuous transition is an important feature of the neuronal network which can depend on network structure as well as synaptic types. In this study we consider the effect of synaptic interaction (electrical and chemical) as well as structural connectivity on synchronization transition in network models of Izhikevich neurons which spike regularly with beta rhythms. We find a wide range of behavior including continuous transition, explosive transition, as well as lack of global order. The stronger electrical synapses are more conducive to synchronization and can even lead to explosive synchronization. The key network element which determines the order of transition is found to be the clustering coefficient and not the small world effect, or the existence of hubs in a network. These results are in contrast to previous results which use phase oscillator models such as the Kuramoto model. Furthermore, we show that the patterns of synchronization changes when one goes to the gamma band. We attribute such a change to the change in the refractory period of Izhikevich neurons which changes significantly with frequency.

Chaos in small networks of theta neurons

We consider small networks of instantaneously coupled theta neurons. For inhibitory coupling and fixed parameter values, some initial conditions give chaotic solutions while others give quasiperiodic ones. This behaviour seems to result from the reversibility of the equations governing the networks' dynamics. We investigate the robustness of the chaotic behaviour with respect to changes in initial conditions and parameters and find the behaviour to be quite robust as long as the reversibility of the system is preserved.

Synchronization transition in neuronal networks composed of chaotic or non-chaotic oscillators

Chaotic dynamics has been shown in the dynamics of neurons and neural networks, in experimental data and numerical simulations. Theoretical studies have proposed an underlying role of chaos in neural systems. Nevertheless, whether chaotic neural oscillators make a significant contribution to network behaviour and whether the dynamical richness of neural networks is sensitive to the dynamics of isolated neurons, still remain open questions. We investigated synchronization transitions in heterogeneous neural networks of neurons connected by electrical coupling in a small world topology. The nodes in our model are oscillatory neurons that – when isolated – can exhibit either chaotic or non-chaotic behaviour, depending on conductance parameters. We found that the heterogeneity of firing rates and firing patterns make a greater contribution than chaos to the steepness of the synchronization transition curve. We also show that chaotic dynamics of the isolated neurons do not always make a visible difference in the transition to full synchrony. Moreover, macroscopic chaos is observed regardless of the dynamics nature of the neurons. However, performing a Functional Connectivity Dynamics analysis, we show that chaotic nodes can promote what is known as multi-stable behaviour, where the network dynamically switches between a number of different semi-synchronized, metastable states.

Firing rate equations require a spike synchrony mechanism to correctly describe fast oscillations in inhibitory networks

Recurrently coupled networks of inhibitory neurons robustly generate oscillations in the gamma band. Nonetheless, the corresponding Wilson-Cowan type firing rate equation for such an inhibitory population does not generate such oscillations without an explicit time delay. We show that this discrepancy is due to a voltage-dependent spike-synchronization mechanism inherent in networks of spiking neurons which is not captured by standard firing rate equations. Here we investigate an exact low-dimensional description for a network of heterogeneous canonical Class 1 inhibitory neurons which includes the sub-threshold dynamics crucial for generating synchronous states. In the limit of slow synaptic kinetics the spike-synchrony mechanism is suppressed and the standard Wilson-Cowan equations are formally recovered as long as external inputs are also slow. However, even in this limit synchronous spiking can be elicited by inputs which fluctuate on a time-scale of the membrane time-constant of the neurons. Our meanfield equations therefore represent an extension of the standard Wilson-Cowan equations in which spike synchrony is also correctly described.

Population models describing the average activity of large neuronal ensembles are a powerful mathematical tool to investigate the principles underlying cooperative function of large neuronal systems. However, these models do not properly describe the phenomenon of spike synchrony in networks of neurons. In particular, they fail to capture the onset of synchronous oscillations in networks of inhibitory neurons. We show that this limitation is due to a voltage-dependent synchronization mechanism which is naturally present in spiking neuron models but not captured by traditional firing rate equations. Here we investigate a novel set of macroscopic equations which incorporate both firing rate and membrane potential dynamics, and that correctly generate fast inhibition-based synchronous oscillations. In the limit of slow-synaptic processing oscillations are suppressed, and the model reduces to an equation formally equivalent to the Wilson-Cowan model.

Synchrony-induced modes of oscillation of a neural field model

We investigate the modes of oscillation of heterogeneous ring networks of quadratic integrate-and-fire (QIF) neurons with nonlocal, space-dependent coupling. Perturbations of the equilibrium state with a particular wave number produce transient standing waves with a specific temporal frequency, analogously to those in a tense string. In the neuronal network, the equilibrium corresponds to a spatially homogeneous, asynchronous state. Perturbations of this state excite the network's oscillatory modes, which reflect the interplay of episodes of synchronous spiking with the excitatory-inhibitory spatial interactions. In the thermodynamic limit, an exact low-dimensional neural field model describing the macroscopic dynamics of the network is derived. This allows us to obtain formulas for the Turing eigenvalues of the spatially homogeneous state and hence to obtain its stability boundary. We find that the frequency of each Turing mode depends on the corresponding Fourier coefficient of the synaptic pattern of connectivity. The decay rate instead is identical for all oscillation modes as a consequence of the heterogeneity-induced desynchronization of the neurons. Finally, we numerically compute the spectrum of spatially inhomogeneous solutions branching from the Turing bifurcation, showing that similar oscillatory modes operate in neural bump states and are maintained away from onset.

Macroscopic phase-resetting curves for spiking neural networks

The study of brain rhythms is an open-ended, and challenging, subject of interest in neuroscience. One of the best tools for the understanding of oscillations at the single neuron level is the phase-resetting curve (PRC). Synchronization in networks of neurons, effects of noise on the rhythms, effects of transient stimuli on the ongoing rhythmic activity, and many other features can be understood by the PRC. However, most macroscopic brain rhythms are generated by large populations of neurons, and so far it has been unclear how the PRC formulation can be extended to these more common rhythms. In this paper, we describe a framework to determine a macroscopic PRC (mPRC) for a network of spiking excitatory and inhibitory neurons that generate a macroscopic rhythm. We take advantage of a thermodynamic approach combined with a reduction method to simplify the network description to a small number of ordinary differential equations. From this simplified but exact reduction, we can compute the mPRC via the standard adjoint method. Our theoretical findings are illustrated with and supported by numerical simulations of the full spiking network. Notably our mPRC framework allows us to predict the difference between effects of transient inputs to the excitatory versus the inhibitory neurons in the network.

Synchronization scenarios in the Winfree model of coupled oscillators

Fifty years ago Arthur Winfree proposed a deeply influential mean-field model for the collective synchronization of large populations of phase oscillators. Here we provide a detailed analysis of the model for some special, analytically tractable cases. Adopting the thermodynamic limit, we derive an ordinary differential equation that exactly describes the temporal evolution of the macroscopic variables in the Ott-Antonsen invariant manifold. The low-dimensional model is then thoroughly investigated for a variety of pulse types and sinusoidal phase response curves (PRCs). Two structurally different synchronization scenarios are found, which are linked via the mutation of a Bogdanov-Takens point. From our results, we infer a general rule of thumb relating pulse shape and PRC offset with each scenario. Finally, we compare the exact synchronization threshold with the prediction of the averaging approximation given by the Kuramoto-Sakaguchi model. At the leading order, the discrepancy appears to behave as an odd function of the PRC offset.

Chaos and Correlated Avalanches in Excitatory Neural Networks with Synaptic Plasticity

A collective chaotic phase with power law scaling of activity events is observed in a disordered mean field network of purely excitatory leaky integrate-and-fire neurons with short-term synaptic plasticity. The dynamical phase diagram exhibits two transitions from quasisynchronous and asynchronous regimes to the nontrivial, collective, bursty regime with avalanches. In the homogeneous case without disorder, the system synchronizes and the bursty behavior is reflected into a period doubling transition to chaos for a two dimensional discrete map. Numerical simulations show that the bursty chaotic phase with avalanches exhibits a spontaneous emergence of persistent time correlations and enhanced Kolmogorov complexity. Our analysis reveals a mechanism for the generation of irregular avalanches that emerges from the combination of disorder and deterministic underlying chaotic dynamics.

Modeling the network dynamics of pulse-coupled neurons

We derive a mean-field approximation for the macroscopic dynamics of large networks of pulse-coupled theta neurons in order to study the effects of different network degree distributions and degree correlations (assortativity). Using the ansatz of Ott and Antonsen [Chaos 18, 037113 (2008)], we obtain a reduced system of ordinary differential equations describing the mean-field dynamics, with significantly lower dimensionality compared with the complete set of dynamical equations for the system. We find that, for sufficiently large networks and degrees, the dynamical behavior of the reduced system agrees well with that of the full network. This dimensional reduction allows for an efficient characterization of system phase transitions and attractors. For networks with tightly peaked degree distributions, the macroscopic behavior closely resembles that of fully connected networks previously studied by others. In contrast, networks with highly skewed degree distributions exhibit different macroscopic dynamics due to the emergence of degree dependent behavior of different oscillators. For nonassortative networks (i.e., networks without degree correlations), we observe the presence of a synchronously firing phase that can be suppressed by the presence of either assortativity or disassortativity in the network. We show that the results derived here can be used to analyze the effects of network topology on macroscopic behavior in neuronal networks in a computationally efficient fashion.

Hopf bifurcation in a nonlocal nonlinear transport equation stemming from stochastic neural dynamics

In this work, we provide three different numerical evidences for the occurrence of a Hopf bifurcation in a recently derived [De Masi et al., J. Stat. Phys. 158, 866-902 (2015) and Fournier and löcherbach, Ann. Inst. H. Poincaré Probab. Stat. 52, 1844-1876 (2016)] mean field limit of a stochastic network of excitatory spiking neurons. The mean field limit is a challenging nonlocal nonlinear transport equation with boundary conditions. The first evidence relies on the computation of the spectrum of the linearized equation. The second stems from the simulation of the full mean field. Finally, the last evidence comes from the simulation of the network for a large number of neurons. We provide a "recipe" to find such bifurcation which nicely complements the works in De Masi et al. [J. Stat. Phys. 158, 866-902 (2015)] and Fournier and löcherbach [Ann. Inst. H. Poincaré Probab. Stat. 52, 1844-1876 (2016)]. This suggests in return to revisit theoretically these mean field equations from a dynamical point of view. Finally, this work shows how the noise level impacts the transition from asynchronous activity to partial synchronization in excitatory globally pulse-coupled networks.