Input-Driven Oscillations in Networks with Excitatory and Inhibitory Neurons with Dynamic Synapses

Neurosystems: brain rhythms and cognitive processing

Neuronal rhythms are ubiquitous features of brain dynamics, and are highly correlated with cognitive processing. However, the relationship between the physiological mechanisms producing these rhythms and the functions associated with the rhythms remains mysterious. This article investigates the contributions of rhythms to basic cognitive computations (such as filtering signals by coherence and/or frequency) and to major cognitive functions (such as attention and multi-modal coordination). We offer support to the premise that the physiology underlying brain rhythms plays an essential role in how these rhythms facilitate some cognitive operations.

Effect of inhibitory feedback on correlated firing of spiking neural network

Understanding the properties and mechanisms that generate different forms of correlation is critical for determining their role in cortical processing. Researches on retina, visual cortex, sensory cortex, and computational model have suggested that fast correlation with high temporal precision appears consistent with common input, and correlation on a slow time scale likely involves feedback. Based on feedback spiking neural network model, we investigate the role of inhibitory feedback in shaping correlations on a time scale of 100 ms. Notably, the relationship between the correlation coefficient and inhibitory feedback strength is non-monotonic. Further, computational simulations show how firing rate and oscillatory activity form the basis of the mechanisms underlying this relationship. When the mean firing rate holds unvaried, the correlation coefficient increases monotonically with inhibitory feedback, but the correlation coefficient keeps decreasing when the network has no oscillatory activity. Our findings reveal that two opposing effects of the inhibitory feedback on the firing activity of the network contribute to the non-monotonic relationship between the correlation coefficient and the strength of the inhibitory feedback. The inhibitory feedback affects the correlated firing activity by modulating the intensity and regularity of the spike trains. Finally, the non-monotonic relationship is replicated with varying transmission delay and different spatial network structure, demonstrating the universality of the results.

Time scales of memory, learning, and plasticity

After only about 10 days would the storage capacity of our nervous system be reached if we stored every bit of input. The nervous system relies on at least two mechanisms that counteract this capacity limit: compression and forgetting. But the latter mechanism needs to know how long an entity should be stored: some memories are relevant only for the next few minutes, some are important even after the passage of several years. Psychology and physiology have found and described many different memory mechanisms, and these mechanisms indeed use different time scales. In this prospect we review these mechanisms with respect to their time scale and propose relations between mechanisms in learning and memory and their underlying physiological basis.

Information filtering by synchronous spikes in a neural population

Information about time-dependent sensory stimuli is encoded by the spike trains of neurons. Here we consider a population of uncoupled but noisy neurons (each subject to some intrinsic noise) that are driven by a common broadband signal. We ask specifically how much information is encoded in the synchronous activity of the population and how this information transfer is distributed with respect to frequency bands. In order to obtain some insight into the mechanism of information filtering effects found previously in the literature, we develop a mathematical framework to calculate the coherence of the synchronous output with the common stimulus for populations of simple neuron models. Within this frame, the synchronous activity is treated as the product of filtered versions of the spike trains of a subset of neurons. We compare our results for the simple cases of (1) a Poisson neuron with a rate modulation and (2) an LIF neuron with intrinsic white current noise and a current stimulus. For the Poisson neuron, formulas are particularly simple but show only a low-pass behavior of the coherence of synchronous activity. For the LIF model, in contrast, the coherence function of the synchronous activity shows a clear peak at high frequencies, comparable to recent experimental findings. We uncover the mechanism for this shift in the maximum of the coherence and discuss some biological implications of our findings.

Impact of network structure and cellular response on spike time correlations

Novel experimental techniques reveal the simultaneous activity of larger and larger numbers of neurons. As a result there is increasing interest in the structure of cooperative – or correlated – activity in neural populations, and in the possible impact of such correlations on the neural code. A fundamental theoretical challenge is to understand how the architecture of network connectivity along with the dynamical properties of single cells shape the magnitude and timescale of correlations. We provide a general approach to this problem by extending prior techniques based on linear response theory. We consider networks of general integrate-and-fire cells with arbitrary architecture, and provide explicit expressions for the approximate cross-correlation between constituent cells. These correlations depend strongly on the operating point (input mean and variance) of the neurons, even when connectivity is fixed. Moreover, the approximations admit an expansion in powers of the matrices that describe the network architecture. This expansion can be readily interpreted in terms of paths between different cells. We apply our results to large excitatory-inhibitory networks, and demonstrate first how precise balance – or lack thereof – between the strengths and timescales of excitatory and inhibitory synapses is reflected in the overall correlation structure of the network. We then derive explicit expressions for the average correlation structure in randomly connected networks. These expressions help to identify the important factors that shape coordinated neural activity in such networks.

Is neural activity more than the sum of its individual parts? What is the impact of cooperative, or correlated, spiking among multiple cells? We can start addressing these questions, as rapid advances in experimental techniques allow simultaneous recordings from ever-increasing populations. However, we still lack a general understanding of the origin and consequences of the joint activity that is revealed. The challenge is compounded by the fact that both the intrinsic dynamics of single cells and the correlations among then vary depending on the overall state of the network. Here, we develop a toolbox that addresses this issue. Specifically, we show how linear response theory allows for the expression of correlations explicitly in terms of the underlying network connectivity and known single-cell properties – and that the predictions of this theory accurately match simulations of a touchstone, nonlinear model in computational neuroscience, the general integrate-and-fire cell. Thus, our theory should help unlock the relationship between network architecture, single-cell dynamics, and correlated activity in diverse neural circuits.

Neural adaptation facilitates oscillatory responses to static inputs in a recurrent network of ON and OFF cells

We investigate the role of adaptation in a neural field model, composed of ON and OFF cells, with delayed all-to-all recurrent connections. As external spatially profiled inputs drive the network, ON cells receive inputs directly, while OFF cells receive an inverted image of the original signals. Via global and delayed inhibitory connections, these signals can cause the system to enter states of sustained oscillatory activity. We perform a bifurcation analysis of our model to elucidate how neural adaptation influences the ability of the network to exhibit oscillatory activity. We show that slow adaptation encourages input-induced rhythmic states by decreasing the Andronov-Hopf bifurcation threshold. We further determine how the feedback and adaptation together shape the resonant properties of the ON and OFF cell network and how this affects the response to time-periodic input. By introducing an additional frequency in the system, adaptation alters the resonance frequency by shifting the peaks where the response is maximal. We support these results with numerical experiments of the neural field model. Although developed in the context of the circuitry of the electric sense, these results are applicable to any network of spontaneously firing cells with global inhibitory feedback to themselves, in which a fraction of these cells receive external input directly, while the remaining ones receive an inverted version of this input via feedforward di-synaptic inhibition. Thus the results are relevant beyond the many sensory systems where ON and OFF cells are usually identified, and provide the backbone for understanding dynamical network effects of lateral connections and various forms of ON/OFF responses.

Responses of recurrent nets of asymmetric ON and OFF cells

A neural field model of ON and OFF cells with all-to-all inhibitory feedback is investigated. External spatiotemporal stimuli drive the ON and OFF cells with, respectively, direct and inverted polarity. The dynamic differences between networks built of ON and OFF cells ("ON/OFF") and those having only ON cells ("ON/ON") are described for the general case where ON and OFF cells can have different spontaneous firing rates; this asymmetric case is generic. Neural responses to nonhomogeneous static and time-periodic inputs are analyzed in regimes close to and away from self-oscillation. Static stimuli can cause oscillatory behavior for certain asymmetry levels. Time-periodic stimuli expose dynamical differences between ON/OFF and ON/ON nets. Outside the stimulated region, we show that ON/OFF nets exhibit frequency doubling, while ON/ON nets cannot. On the other hand, ON/ON networks show antiphase responses between stimulated and unstimulated regions, an effect that does not rely on specific receptive field circuitry. An analysis of the resonance properties of both net types reveals that ON/OFF nets exhibit larger response amplitude. Numerical simulations of the neural field models agree with theoretical predictions for localized static and time-periodic forcing. This is also the case for simulations of a network of noisy integrate-and-fire neurons. We finally discuss the application of the model to the electrosensory system and to frequency-doubling effects in retina.

Neurophysiological and computational principles of cortical rhythms in cognition

Synchronous rhythms represent a core mechanism for sculpting temporal coordination of neural activity in the brain-wide network. This review focuses on oscillations in the cerebral cortex that occur during cognition, in alert behaving conditions. Over the last two decades, experimental and modeling work has made great strides in elucidating the detailed cellular and circuit basis of these rhythms, particularly gamma and theta rhythms. The underlying physiological mechanisms are diverse (ranging from resonance and pacemaker properties of single cells to multiple scenarios for population synchronization and wave propagation), but also exhibit unifying principles. A major conceptual advance was the realization that synaptic inhibition plays a fundamental role in rhythmogenesis, either in an interneuronal network or in a reciprocal excitatory-inhibitory loop. Computational functions of synchronous oscillations in cognition are still a matter of debate among systems neuroscientists, in part because the notion of regular oscillation seems to contradict the common observation that spiking discharges of individual neurons in the cortex are highly stochastic and far from being clocklike. However, recent findings have led to a framework that goes beyond the conventional theory of coupled oscillators and reconciles the apparent dichotomy between irregular single neuron activity and field potential oscillations. From this perspective, a plethora of studies will be reviewed on the involvement of long-distance neuronal coherence in cognitive functions such as multisensory integration, working memory, and selective attention. Finally, implications of abnormal neural synchronization are discussed as they relate to mental disorders like schizophrenia and autism.

Oscillatory response in a sensory network of ON and OFF cells with instantaneous and delayed recurrent connections

A neural field model with multiple cell-to-cell feedback connections is investigated. Our model incorporates populations of ON and OFF cells, receiving sensory inputs with direct and inverted polarity, respectively. Oscillatory responses to spatially localized stimuli are found to occur via Andronov-Hopf bifurcations of stationary activity. We explore the impact of multiple delayed feedback components as well as additional excitatory and/or inhibitory non-delayed recurrent signals on the instability threshold. Paradoxically, instantaneous excitatory recurrent terms are found to enhance network responsiveness by reducing the oscillatory response threshold, allowing smaller inputs to trigger oscillatory activity. Instantaneous inhibitory components do the opposite. The frequency of these response oscillations is further shaped by the polarity of the non-delayed terms.

Dynamic control for synchronization of separated cortical areas through thalamic relay

Binding of features and information which are processed at different cortical areas is generally supposed to be achieved by synchrony despite the non-negligible delays between these areas. In this work we study the dynamics and synchronization properties of a simplified model of the thalamocortical circuit where different cortical areas are interconnected with a certain delay, that is longer than the internal time scale of the neurons. Using this simple model we find that the thalamus could serve as a central subcortical area that is able to generate zero-lag synchrony between distant cortical areas by means of dynamical relaying (Vicente et al., 2008). Our results show that the model circuit is able to generate fast oscillations in frequency ranges of the beta and gamma bands triggered by an external input to the thalamus formed by independent Poisson trains. We propose a control mechanism to turn "On" and "Off" the synchronization between cortical areas as a function of the relative rate of the external input fed into dorsal and ventral thalamic neuronal populations. The current results emphasize the hypothesis that the thalamus could control the dynamics of the thalamocortical functional networks enabling two separated cortical areas to be either synchronized (at zero-lag) or unsynchronized. This control may happen at a fast time scale, in agreement with experimental data, and without any need of plasticity or adaptation mechanisms which typically require longer time scales.

Spike-Timing Error Backpropagation in Theta Neuron Networks

The main contribution of this letter is the derivation of a steepest gradient descent learning rule for a multilayer network of theta neurons, a one-dimensional nonlinear neuron model. Central to our model is the assumption that the intrinsic neuron dynamics are sufficient to achieve consistent time coding, with no need to involve the precise shape of postsynaptic currents; this assumption departs from other related models such as SpikeProp and Tempotron learning. Our results clearly show that it is possible to perform complex computations by applying supervised learning techniques to the spike times and time response properties of nonlinear integrate and fire neurons. Networks trained with our multilayer training rule are shown to have similar generalization abilities for spike latency pattern classification as Tempotron learning. The rule is also able to train networks to perform complex regression tasks that neither SpikeProp or Tempotron learning appears to be capable of.

Delays and oscillations in networks of spiking neurons: a two-timescale analysis

Oscillations are a ubiquitous feature of many neural systems, spanning many orders of magnitude in frequency. One of the most prominent oscillatory patterns, with possible functional implications, is that occurring in the mammalian thalamocortical system during sleep. This system is characterized by relatively long delays (reaching up to 40 msec) and gives rise to low-frequency oscillatory waves. Motivated by these phenomena, we study networks of excitatory and inhibitory integrate-and-fire neurons within a Fokker-Planck delay partial differential equation formalism and establish explicit conditions for the emergence of oscillatory solutions, and for the amplitude and period of the ensuing oscillations, for relatively large values of the delays. When a two-timescale analysis is employed, the full partial differential equation is replaced in this limit by a discrete time iterative map, leading to a relatively simple dynamic interpretation. This asymptotic result is shown numerically to hold, to a good approximation, over a wide range of parameter values, leading to an accurate characterization of the behavior in terms of the underlying physical parameters. Our results provide a simple mechanistic explanation for one type of slow oscillation based on delayed inhibition, which may play an important role in the slow spindle oscillations occurring during sleep. Moreover, they are consistent with experimental findings related to human motor behavior with visual feedback.

Driving neural oscillations with correlated spatial input and topographic feedback

We consider how oscillatory activity in networks of excitable systems depends on spatial correlations of random inputs and the spatial range of feedback coupling. Analysis of a neural field model with topographic delayed recurrent feedback reveals how oscillations in certain frequency bands, including the gamma band, are enhanced by increases in the input correlation length. Further, the enhancement is maximal when this length exceeds the feedback coupling range. Suppression of oscillatory power occurs concomitantly in other bands. These effects depend solely on the ratio of input and feedback length scales. The precise positions of these bands are determined by the synaptic constants and the delays. The results agree with numerical simulations of the model and of a network of stochastic spiking neurons, and are expected for any noise-driven excitable element networks.