Fast adaptation to rule switching using neuronal surprise

In humans and animals, surprise is a physiological reaction to an unexpected event, but how surprise can be linked to plausible models of neuronal activity is an open problem. We propose a self-supervised spiking neural network model where a surprise signal is extracted from an increase in neural activity after an imbalance of excitation and inhibition. The surprise signal modulates synaptic plasticity via a three-factor learning rule which increases plasticity at moments of surprise. The surprise signal remains small when transitions between sensory events follow a previously learned rule but increases immediately after rule switching. In a spiking network with several modules, previously learned rules are protected against overwriting, as long as the number of modules is larger than the total number of rules-making a step towards solving the stability-plasticity dilemma in neuroscience. Our model relates the subjective notion of surprise to specific predictions on the circuit level.

Learning what matters: Synaptic plasticity with invariance to second-order input correlations

Cortical populations of neurons develop sparse representations adapted to the statistics of the environment. To learn efficient population codes, synaptic plasticity mechanisms must differentiate relevant latent features from spurious input correlations, which are omnipresent in cortical networks. Here, we develop a theory for sparse coding and synaptic plasticity that is invariant to second-order correlations in the input. Going beyond classical Hebbian learning, our learning objective explains the functional form of observed excitatory plasticity mechanisms, showing how Hebbian long-term depression (LTD) cancels the sensitivity to second-order correlations so that receptive fields become aligned with features hidden in higher-order statistics. Invariance to second-order correlations enhances the versatility of biologically realistic learning models, supporting optimal decoding from noisy inputs and sparse population coding from spatially correlated stimuli. In a spiking model with triplet spike-timing-dependent plasticity (STDP), we show that individual neurons can learn localized oriented receptive fields, circumventing the need for input preprocessing, such as whitening, or population-level lateral inhibition. The theory advances our understanding of local unsupervised learning in cortical circuits, offers new interpretations of the Bienenstock-Cooper-Munro and triplet STDP models, and assigns a specific functional role to synaptic LTD mechanisms in pyramidal neurons.

Distributed and specific encoding of sensory, motor, and decision information in the mouse neocortex during goal-directed behavior

Goal-directed behaviors involve coordinated activity in many cortical areas, but whether the encoding of task variables is distributed across areas or is more specifically represented in distinct areas remains unclear. Here, we compared representations of sensory, motor, and decision information in the whisker primary somatosensory cortex, medial prefrontal cortex, and tongue-jaw primary motor cortex in mice trained to lick in response to a whisker stimulus with mice that were not taught this association. Irrespective of learning, properties of the sensory stimulus were best encoded in the sensory cortex, whereas fine movement kinematics were best represented in the motor cortex. However, movement initiation and the decision to lick in response to the whisker stimulus were represented in all three areas, with decision neurons in the medial prefrontal cortex being more selective, showing minimal sensory responses in miss trials and motor responses during spontaneous licks. Our results reconcile previous studies indicating highly specific vs. highly distributed sensorimotor processing.

Curiosity-driven exploration: foundations in neuroscience and computational modeling

Curiosity refers to the intrinsic desire of humans and animals to explore the unknown, even when there is no apparent reason to do so. Thus far, no single, widely accepted definition or framework for curiosity has emerged, but there is growing consensus that curious behavior is not goal-directed but related to seeking or reacting to information. In this review, we take a phenomenological approach and group behavioral and neurophysiological studies which meet these criteria into three categories according to the type of information seeking observed. We then review recent computational models of curiosity from the field of machine learning and discuss how they enable integrating different types of information seeking into one theoretical framework. Combinations of behavioral and neurophysiological studies along with computational modeling will be instrumental in demystifying the notion of curiosity.

A dynamic attractor network model of memory formation, reinforcement and forgetting

Empirical evidence shows that memories that are frequently revisited are easy to recall, and that familiar items involve larger hippocampal representations than less familiar ones. In line with these observations, here we develop a modelling approach to provide a mechanistic understanding of how hippocampal neural assemblies evolve differently, depending on the frequency of presentation of the stimuli. For this, we added an online Hebbian learning rule, background firing activity, neural adaptation and heterosynaptic plasticity to a rate attractor network model, thus creating dynamic memory representations that can persist, increase or fade according to the frequency of presentation of the corresponding memory patterns. Specifically, we show that a dynamic interplay between Hebbian learning and background firing activity can explain the relationship between the memory assembly sizes and their frequency of stimulation. Frequently stimulated assemblies increase their size independently from each other (i.e. creating orthogonal representations that do not share neurons, thus avoiding interference). Importantly, connections between neurons of assemblies that are not further stimulated become labile so that these neurons can be recruited by other assemblies, providing a neuronal mechanism of forgetting.

An exact mapping from ReLU networks to spiking neural networks

Deep spiking neural networks (SNNs) offer the promise of low-power artificial intelligence. However, training deep SNNs from scratch or converting deep artificial neural networks to SNNs without loss of performance has been a challenge. Here we propose an exact mapping from a network with Rectified Linear Units (ReLUs) to an SNN that fires exactly one spike per neuron. For our constructive proof, we assume that an arbitrary multi-layer ReLU network with or without convolutional layers, batch normalization and max pooling layers was trained to high performance on some training set. Furthermore, we assume that we have access to a representative example of input data used during training and to the exact parameters (weights and biases) of the trained ReLU network. The mapping from deep ReLU networks to SNNs causes zero percent drop in accuracy on CIFAR10, CIFAR100 and the ImageNet-like data sets Places365 and PASS. More generally our work shows that an arbitrary deep ReLU network can be replaced by an energy-efficient single-spike neural network without any loss of performance.

Surprise and novelty in the brain

Notions of surprise and novelty have been used in various experimental and theoretical studies across multiple brain areas and species. However, 'surprise' and 'novelty' refer to different quantities in different studies, which raises concerns about whether these studies indeed relate to the same functionalities and mechanisms in the brain. Here, we address these concerns through a systematic investigation of how different aspects of surprise and novelty relate to different brain functions and physiological signals. We review recent classifications of definitions proposed for surprise and novelty along with links to experimental observations. We show that computational modeling and quantifiable definitions enable novel interpretations of previous findings and form a foundation for future theoretical and experimental studies.

Computational models of episodic-like memory in food-caching birds

Birds of the crow family adapt food-caching strategies to anticipated needs at the time of cache recovery and rely on memory of the what, where and when of previous caching events to recover their hidden food. It is unclear if this behavior can be explained by simple associative learning or if it relies on higher cognitive processes like mental time-travel. We present a computational model and propose a neural implementation of food-caching behavior. The model has hunger variables for motivational control, reward-modulated update of retrieval and caching policies and an associative neural network for remembering caching events with a memory consolidation mechanism for flexible decoding of the age of a memory. Our methodology of formalizing experimental protocols is transferable to other domains and facilitates model evaluation and experiment design. Here, we show that memory-augmented, associative reinforcement learning without mental time-travel is sufficient to explain the results of 28 behavioral experiments with food-caching birds.

When shared concept cells support associations: Theory of overlapping memory engrams

Assemblies of neurons, called concepts cells, encode acquired concepts in human Medial Temporal Lobe. Those concept cells that are shared between two assemblies have been hypothesized to encode associations between concepts. Here we test this hypothesis in a computational model of attractor neural networks. We find that for concepts encoded in sparse neural assemblies there is a minimal fraction c_min of neurons shared between assemblies below which associations cannot be reliably implemented; and a maximal fraction c_max of shared neurons above which single concepts can no longer be retrieved. In the presence of a periodically modulated background signal, such as hippocampal oscillations, recall takes the form of association chains reminiscent of those postulated by theories of free recall of words. Predictions of an iterative overlap-generating model match experimental data on the number of concepts to which a neuron responds.

Experimental evidence suggests that associations between concepts are encoded in the hippocampus by cells shared between neuronal assemblies (“overlap” of concepts). What is the necessary overlap that ensures a reliable encoding of associations? Under which conditions can associations induce a simultaneous or a chain-like activation of concepts? Our theoretical model shows that the ideal overlap presents a tradeoff: the overlap should be larger than a minimum value in order to reliably encode associations, but lower than a maximum value to prevent loss of individual memories. Our theory explains experimental data from human Medial Temporal Lobe and provides a mechanism for chain-like recall in presence of inhibition, while still allowing for simultaneous recall if inhibition is weak.

Brain signals of a Surprise-Actor-Critic model: Evidence for multiple learning modules in human decision making

Learning how to reach a reward over long series of actions is a remarkable capability of humans, and potentially guided by multiple parallel learning modules. Current brain imaging of learning modules is limited by (i) simple experimental paradigms, (ii) entanglement of brain signals of different learning modules, and (iii) a limited number of computational models considered as candidates for explaining behavior. Here, we address these three limitations and (i) introduce a complex sequential decision making task with surprising events that allows us to (ii) dissociate correlates of reward prediction errors from those of surprise in functional magnetic resonance imaging (fMRI); and (iii) we test behavior against a large repertoire of model-free, model-based, and hybrid reinforcement learning algorithms, including a novel surprise-modulated actor-critic algorithm. Surprise, derived from an approximate Bayesian approach for learning the world-model, is extracted in our algorithm from a state prediction error. Surprise is then used to modulate the learning rate of a model-free actor, which itself learns via the reward prediction error from model-free value estimation by the critic. We find that action choices are well explained by pure model-free policy gradient, but reaction times and neural data are not. We identify signatures of both model-free and surprise-based learning signals in blood oxygen level dependent (BOLD) responses, supporting the existence of multiple parallel learning modules in the brain. Our results extend previous fMRI findings to a multi-step setting and emphasize the role of policy gradient and surprise signalling in human learning.

Rapid suppression and sustained activation of distinct cortical regions for a delayed sensory-triggered motor response

The neuronal mechanisms generating a delayed motor response initiated by a sensory cue remain elusive. Here, we tracked the precise sequence of cortical activity in mice transforming a brief whisker stimulus into delayed licking using wide-field calcium imaging, multiregion high-density electrophysiology, and time-resolved optogenetic manipulation. Rapid activity evoked by whisker deflection acquired two prominent features for task performance: (1) an enhanced excitation of secondary whisker motor cortex, suggesting its important role connecting whisker sensory processing to lick motor planning; and (2) a transient reduction of activity in orofacial sensorimotor cortex, which contributed to suppressing premature licking. Subsequent widespread cortical activity during the delay period largely correlated with anticipatory movements, but when these were accounted for, a focal sustained activity remained in frontal cortex, which was causally essential for licking in the response period. Our results demonstrate key cortical nodes for motor plan generation and timely execution in delayed goal-directed licking.

A functional model of adult dentate gyrus neurogenesis

In adult dentate gyrus neurogenesis, the link between maturation of newborn neurons and their function, such as behavioral pattern separation, has remained puzzling. By analyzing a theoretical model, we show that the switch from excitation to inhibition of the GABAergic input onto maturing newborn cells is crucial for their proper functional integration. When the GABAergic input is excitatory, cooperativity drives the growth of synapses such that newborn cells become sensitive to stimuli similar to those that activate mature cells. When GABAergic input switches to inhibitory, competition pushes the configuration of synapses onto newborn cells toward stimuli that are different from previously stored ones. This enables the maturing newborn cells to code for concepts that are novel, yet similar to familiar ones. Our theory of newborn cell maturation explains both how adult-born dentate granule cells integrate into the preexisting network and why they promote separation of similar but not distinct patterns.

Novelty is not surprise: Human exploratory and adaptive behavior in sequential decision-making

Classic reinforcement learning (RL) theories cannot explain human behavior in the absence of external reward or when the environment changes. Here, we employ a deep sequential decision-making paradigm with sparse reward and abrupt environmental changes. To explain the behavior of human participants in these environments, we show that RL theories need to include surprise and novelty, each with a distinct role. While novelty drives exploration before the first encounter of a reward, surprise increases the rate of learning of a world-model as well as of model-free action-values. Even though the world-model is available for model-based RL, we find that human decisions are dominated by model-free action choices. The world-model is only marginally used for planning, but it is important to detect surprising events. Our theory predicts human action choices with high probability and allows us to dissociate surprise, novelty, and reward in EEG signals.

Learning in Volatile Environments With the Bayes Factor Surprise

Surprise-based learning allows agents to rapidly adapt to nonstationary stochastic environments characterized by sudden changes. We show that exact Bayesian inference in a hierarchical model gives rise to a surprise-modulated trade-off between forgetting old observations and integrating them with the new ones. The modulation depends on a probability ratio, which we call the Bayes Factor Surprise, that tests the prior belief against the current belief. We demonstrate that in several existing approximate algorithms, the Bayes Factor Surprise modulates the rate of adaptation to new observations. We derive three novel surprise-based algorithms, one in the family of particle filters, one in the family of variational learning, and one in the family of message passing, that have constant scaling in observation sequence length and particularly simple update dynamics for any distribution in the exponential family. Empirical results show that these surprise-based algorithms estimate parameters better than alternative approximate approaches and reach levels of performance comparable to computationally more expensive algorithms. The Bayes Factor Surprise is related to but different from the Shannon Surprise. In two hypothetical experiments, we make testable predictions for physiological indicators that dissociate the Bayes Factor Surprise from the Shannon Surprise. The theoretical insight of casting various approaches as surprise-based learning, as well as the proposed online algorithms, may be applied to the analysis of animal and human behavior and to reinforcement learning in nonstationary environments.

Dendritic Voltage Recordings Explain Paradoxical Synaptic Plasticity: A Modeling Study

Experiments have shown that the same stimulation pattern that causes Long-Term Potentiation in proximal synapses, will induce Long-Term Depression in distal ones. In order to understand these, and other, surprising observations we use a phenomenological model of Hebbian plasticity at the location of the synapse. Our model describes the Hebbian condition of joint activity of pre- and postsynaptic neurons in a compact form as the interaction of the glutamate trace left by a presynaptic spike with the time course of the postsynaptic voltage. Instead of simulating the voltage, we test the model using experimentally recorded dendritic voltage traces in hippocampus and neocortex. We find that the time course of the voltage in the neighborhood of a stimulated synapse is a reliable predictor of whether a stimulated synapse undergoes potentiation, depression, or no change. Our computational model can explain the existence of different -at first glance seemingly paradoxical- outcomes of synaptic potentiation and depression experiments depending on the dendritic location of the synapse and the frequency or timing of the stimulation.

On the choice of metric in gradient-based theories of brain function

This is a PLOS Computational Biology Education paper.

The idea that the brain functions so as to minimize certain costs pervades theoretical neuroscience. Because a cost function by itself does not predict how the brain finds its minima, additional assumptions about the optimization method need to be made to predict the dynamics of physiological quantities. In this context, steepest descent (also called gradient descent) is often suggested as an algorithmic principle of optimization potentially implemented by the brain. In practice, researchers often consider the vector of partial derivatives as the gradient. However, the definition of the gradient and the notion of a steepest direction depend on the choice of a metric. Because the choice of the metric involves a large number of degrees of freedom, the predictive power of models that are based on gradient descent must be called into question, unless there are strong constraints on the choice of the metric. Here, we provide a didactic review of the mathematics of gradient descent, illustrate common pitfalls of using gradient descent as a principle of brain function with examples from the literature, and propose ways forward to constrain the metric.

A good skier may choose to follow the steepest direction to move as quickly as possible from the mountain peak to the base. Steepest descent in an abstract sense is also an appealing idea to describe adaptation and learning in the brain. For example, a scientist may hypothesize that synaptic or neuronal variables change in the direction of steepest descent in an abstract error landscape during learning of a new task or memorization of a new concept. There is, however, a pitfall in this reasoning: a multitude of steepest directions exists for any abstract error landscape because the steepest direction depends on how angles are measured, and it may be unclear how angles should be measured. Many scientists are taught that the steepest direction can be found by computing the vector of partial derivatives. But the vector of partial derivatives is equal to the steepest direction only if the angles in the abstract space are measured in a particular way. In this article, we provide a didactic review of the mathematics of finding steepest directions in abstract spaces, illustrate the pitfalls with examples from the neuroscience literature, and propose guidelines to constrain the way angles are measured in these spaces.

Mesoscopic population equations for spiking neural networks with synaptic short-term plasticity

Coarse-graining microscopic models of biological neural networks to obtain mesoscopic models of neural activities is an essential step towards multi-scale models of the brain. Here, we extend a recent theory for mesoscopic population dynamics with static synapses to the case of dynamic synapses exhibiting short-term plasticity (STP). The extended theory offers an approximate mean-field dynamics for the synaptic input currents arising from populations of spiking neurons and synapses undergoing Tsodyks-Markram STP. The approximate mean-field dynamics accounts for both finite number of synapses and correlation between the two synaptic variables of the model (utilization and available resources) and its numerical implementation is simple. Comparisons with Monte Carlo simulations of the microscopic model show that in both feedforward and recurrent networks, the mesoscopic mean-field model accurately reproduces the first- and second-order statistics of the total synaptic input into a postsynaptic neuron and accounts for stochastic switches between Up and Down states and for population spikes. The extended mesoscopic population theory of spiking neural networks with STP may be useful for a systematic reduction of detailed biophysical models of cortical microcircuits to numerically efficient and mathematically tractable mean-field models.

Optimal Stimulation Protocol in a Bistable Synaptic Consolidation Model

Synaptic changes induced by neural activity need to be consolidated to maintain memory over a timescale of hours. In experiments, synaptic consolidation can be induced by repeating a stimulation protocol several times and the effectiveness of consolidation depends crucially on the repetition frequency of the stimulations. We address the question: is there an understandable reason why induction protocols with repetitions at some frequency work better than sustained protocols—even though the accumulated stimulation strength might be exactly the same in both cases? In real synapses, plasticity occurs on multiple time scales from seconds (induction), to several minutes (early phase of long-term potentiation) to hours and days (late phase of synaptic consolidation). We use a simplified mathematical model of just two times scales to elucidate the above question in a purified setting. Our mathematical results show that, even in such a simple model, the repetition frequency of stimulation plays an important role for the successful induction, and stabilization, of potentiation.

One-shot learning and behavioral eligibility traces in sequential decision making

In many daily tasks, we make multiple decisions before reaching a goal. In order to learn such sequences of decisions, a mechanism to link earlier actions to later reward is necessary. Reinforcement learning (RL) theory suggests two classes of algorithms solving this credit assignment problem: In classic temporal-difference learning, earlier actions receive reward information only after multiple repetitions of the task, whereas models with eligibility traces reinforce entire sequences of actions from a single experience (one-shot). Here, we show one-shot learning of sequences. We developed a novel paradigm to directly observe which actions and states along a multi-step sequence are reinforced after a single reward. By focusing our analysis on those states for which RL with and without eligibility trace make qualitatively distinct predictions, we find direct behavioral (choice probability) and physiological (pupil dilation) signatures of reinforcement learning with eligibility trace across multiple sensory modalities.

Multicontact Co-operativity in Spike-Timing-Dependent Structural Plasticity Stabilizes Networks

Excitatory synaptic connections in the adult neocortex consist of multiple synaptic contacts, almost exclusively formed on dendritic spines. Changes of spine volume, a correlate of synaptic strength, can be tracked in vivo for weeks. Here, we present a combined model of structural and spike-timing–dependent plasticity that explains the multicontact configuration of synapses in adult neocortical networks under steady-state and lesion-induced conditions. Our plasticity rule with Hebbian and anti-Hebbian terms stabilizes both the postsynaptic firing rate and correlations between the pre- and postsynaptic activity at an active synaptic contact. Contacts appear spontaneously at a low rate and disappear if their strength approaches zero. Many presynaptic neurons compete to make strong synaptic connections onto a postsynaptic neuron, whereas the synaptic contacts of a given presynaptic neuron co-operate via postsynaptic firing. We find that co-operation of multiple synaptic contacts is crucial for stable, long-term synaptic memories. In simulations of a simplified network model of barrel cortex, our plasticity rule reproduces whisker-trimming–induced rewiring of thalamocortical and recurrent synaptic connectivity on realistic time scales.

Biologically plausible deep learning - But how far can we go with shallow networks?

Training deep neural networks with the error backpropagation algorithm is considered implausible from a biological perspective. Numerous recent publications suggest elaborate models for biologically plausible variants of deep learning, typically defining success as reaching around 98% test accuracy on the MNIST data set. Here, we investigate how far we can go on digit (MNIST) and object (CIFAR10) classification with biologically plausible, local learning rules in a network with one hidden layer and a single readout layer. The hidden layer weights are either fixed (random or random Gabor filters) or trained with unsupervised methods (Principal/Independent Component Analysis or Sparse Coding) that can be implemented by local learning rules. The readout layer is trained with a supervised, local learning rule. We first implement these models with rate neurons. This comparison reveals, first, that unsupervised learning does not lead to better performance than fixed random projections or Gabor filters for large hidden layers. Second, networks with localized receptive fields perform significantly better than networks with all-to-all connectivity and can reach backpropagation performance on MNIST. We then implement two of the networks - fixed, localized, random & random Gabor filters in the hidden layer - with spiking leaky integrate-and-fire neurons and spike timing dependent plasticity to train the readout layer. These spiking models achieve >98.2% test accuracy on MNIST, which is close to the performance of rate networks with one hidden layer trained with backpropagation. The performance of our shallow network models is comparable to most current biologically plausible models of deep learning. Furthermore, our results with a shallow spiking network provide an important reference and suggest the use of data sets other than MNIST for testing the performance of future models of biologically plausible deep learning.

How single neuron properties shape chaotic dynamics and signal transmission in random neural networks

While most models of randomly connected neural networks assume single-neuron models with simple dynamics, neurons in the brain exhibit complex intrinsic dynamics over multiple timescales. We analyze how the dynamical properties of single neurons and recurrent connections interact to shape the effective dynamics in large randomly connected networks. A novel dynamical mean-field theory for strongly connected networks of multi-dimensional rate neurons shows that the power spectrum of the network activity in the chaotic phase emerges from a nonlinear sharpening of the frequency response function of single neurons. For the case of two-dimensional rate neurons with strong adaptation, we find that the network exhibits a state of "resonant chaos", characterized by robust, narrow-band stochastic oscillations. The coherence of stochastic oscillations is maximal at the onset of chaos and their correlation time scales with the adaptation timescale of single units. Surprisingly, the resonance frequency can be predicted from the properties of isolated neurons, even in the presence of heterogeneity in the adaptation parameters. In the presence of these internally-generated chaotic fluctuations, the transmission of weak, low-frequency signals is strongly enhanced by adaptation, whereas signal transmission is not influenced by adaptation in the non-chaotic regime. Our theoretical framework can be applied to other mechanisms at the level of single neurons, such as synaptic filtering, refractoriness or spike synchronization. These results advance our understanding of the interaction between the dynamics of single units and recurrent connectivity, which is a fundamental step toward the description of biologically realistic neural networks.

Stability of working memory in continuous attractor networks under the control of short-term plasticity

Continuous attractor models of working-memory store continuous-valued information in continuous state-spaces, but are sensitive to noise processes that degrade memory retention. Short-term synaptic plasticity of recurrent synapses has previously been shown to affect continuous attractor systems: short-term facilitation can stabilize memory retention, while short-term depression possibly increases continuous attractor volatility. Here, we present a comprehensive description of the combined effect of both short-term facilitation and depression on noise-induced memory degradation in one-dimensional continuous attractor models. Our theoretical description, applicable to rate models as well as spiking networks close to a stationary state, accurately describes the slow dynamics of stored memory positions as a combination of two processes: (i) diffusion due to variability caused by spikes; and (ii) drift due to random connectivity and neuronal heterogeneity. We find that facilitation decreases both diffusion and directed drifts, while short-term depression tends to increase both. Using mutual information, we evaluate the combined impact of short-term facilitation and depression on the ability of networks to retain stable working memory. Finally, our theory predicts the sensitivity of continuous working memory to distractor inputs and provides conditions for stability of memory.

The ability to transiently memorize positions in the visual field is crucial for behavior. Models and experiments have shown that such memories can be maintained in networks of cortical neurons with a continuum of possible activity states, that reflects the continuum of positions in the environment. However, the accuracy of positions stored in such networks will degrade over time due to the noisiness of neuronal signaling and imperfections of the biological substrate. Previous work in simplified models has shown that synaptic short-term plasticity could stabilize this degradation by dynamically up- or down-regulating the strength of synaptic connections, thereby “pinning down” memorized positions. Here, we present a general theory that accurately predicts the extent of this “pinning down” by short-term plasticity in a broad class of biologically plausible network models, thereby untangling the interplay of varying biological sources of noise with short-term plasticity. Importantly, our work provides a novel theoretical link from the microscopic substrate of working memory—neurons and synaptic connections—to observable behavioral correlates, for example the susceptibility to distracting stimuli.

Multi-Timescale Memory Dynamics Extend Task Repertoire in a Reinforcement Learning Network With Attention-Gated Memory

The interplay of reinforcement learning and memory is at the core of several recent neural network models, such as the Attention-Gated MEmory Tagging (AuGMEnT) model. While successful at various animal learning tasks, we find that the AuGMEnT network is unable to cope with some hierarchical tasks, where higher-level stimuli have to be maintained over a long time, while lower-level stimuli need to be remembered and forgotten over a shorter timescale. To overcome this limitation, we introduce a hybrid AuGMEnT, with leaky (or short-timescale) and non-leaky (or long-timescale) memory units, that allows the exchange of low-level information while maintaining high-level one. We test the performance of the hybrid AuGMEnT network on two cognitive reference tasks, sequence prediction and 12AX.

Eligibility Traces and Plasticity on Behavioral Time Scales: Experimental Support of NeoHebbian Three-Factor Learning Rules

Most elementary behaviors such as moving the arm to grasp an object or walking into the next room to explore a museum evolve on the time scale of seconds; in contrast, neuronal action potentials occur on the time scale of a few milliseconds. Learning rules of the brain must therefore bridge the gap between these two different time scales. Modern theories of synaptic plasticity have postulated that the co-activation of pre- and postsynaptic neurons sets a flag at the synapse, called an eligibility trace, that leads to a weight change only if an additional factor is present while the flag is set. This third factor, signaling reward, punishment, surprise, or novelty, could be implemented by the phasic activity of neuromodulators or specific neuronal inputs signaling special events. While the theoretical framework has been developed over the last decades, experimental evidence in support of eligibility traces on the time scale of seconds has been collected only during the last few years. Here we review, in the context of three-factor rules of synaptic plasticity, four key experiments that support the role of synaptic eligibility traces in combination with a third factor as a biological implementation of neoHebbian three-factor learning rules.

Excitable neuronal assemblies with adaptation as a building block of brain circuits for velocity-controlled signal propagation

The time scale of neuronal network dynamics is determined by synaptic interactions and neuronal signal integration, both of which occur on the time scale of milliseconds. Yet many behaviors like the generation of movements or vocalizations of sounds occur on the much slower time scale of seconds. Here we ask the question of how neuronal networks of the brain can support reliable behavior on this time scale. We argue that excitable neuronal assemblies with spike-frequency adaptation may serve as building blocks that can flexibly adjust the speed of execution of neural circuit function. We show in simulations that a chain of neuronal assemblies can propagate signals reliably, similar to the well-known synfire chain, but with the crucial difference that the propagation speed is slower and tunable to the behaviorally relevant range. Moreover we study a grid of excitable neuronal assemblies as a simplified model of the somatosensory barrel cortex of the mouse and demonstrate that various patterns of experimentally observed spatial activity propagation can be explained.

Models of activity propagation in cortical networks have often been based on feedforward structures. Here we propose a model of activity propagation, called excitation chain, which does not need such a feedforward structure. The model is composed of excitable neural assemblies with spike-frequency adaptation, connected bidirectionally in a row or a grid. This prototypical neural circuit can propagate activity forwards, backwards or in both directions. Furthermore, the propagation speed is slow enough to trigger the generation of behaviors on the time scale of hundreds of milliseconds. A two-dimensional variant of the model is able to generate different activity propagation patterns, similar to spontaneous activity and stimulus-evoked responses in anesthetized mouse barrel cortex. We propose the excitation chain model as a basic component that can be employed in various ways to create spiking neural circuit models that generate signals on behavioral time scales. In contrast to abstract models of excitable media, our model makes an explicit link to the time scale of neuronal spikes.

Hebbian plasticity requires compensatory processes on multiple timescales

We review a body of theoretical and experimental research on Hebbian and homeostatic plasticity, starting from a puzzling observation: while homeostasis of synapses found in experiments is a slow compensatory process, most mathematical models of synaptic plasticity use rapid compensatory processes (RCPs). Even worse, with the slow homeostatic plasticity reported in experiments, simulations of existing plasticity models cannot maintain network stability unless further control mechanisms are implemented. To solve this paradox, we suggest that in addition to slow forms of homeostatic plasticity there are RCPs which stabilize synaptic plasticity on short timescales. These rapid processes may include heterosynaptic depression triggered by episodes of high postsynaptic firing rate. While slower forms of homeostatic plasticity are not sufficient to stabilize Hebbian plasticity, they are important for fine-tuning neural circuits. Taken together we suggest that learning and memory rely on an intricate interplay of diverse plasticity mechanisms on different timescales which jointly ensure stability and plasticity of neural circuits.This article is part of the themed issue 'Integrating Hebbian and homeostatic plasticity'.

Predicting non-linear dynamics by stable local learning in a recurrent spiking neural network

The brain needs to predict how the body reacts to motor commands, but how a network of spiking neurons can learn non-linear body dynamics using local, online and stable learning rules is unclear. Here, we present a supervised learning scheme for the feedforward and recurrent connections in a network of heterogeneous spiking neurons. The error in the output is fed back through fixed random connections with a negative gain, causing the network to follow the desired dynamics. The rule for Feedback-based Online Local Learning Of Weights (FOLLOW) is local in the sense that weight changes depend on the presynaptic activity and the error signal projected onto the postsynaptic neuron. We provide examples of learning linear, non-linear and chaotic dynamics, as well as the dynamics of a two-link arm. Under reasonable approximations, we show, using the Lyapunov method, that FOLLOW learning is uniformly stable, with the error going to zero asymptotically.

Balancing New against Old Information: The Role of Puzzlement Surprise in Learning

Surprise describes a range of phenomena from unexpected events to behavioral responses. We propose a novel measure of surprise and use it for surprise-driven learning. Our surprise measure takes into account data likelihood as well as the degree of commitment to a belief via the entropy of the belief distribution. We find that surprise-minimizing learning dynamically adjusts the balance between new and old information without the need of knowledge about the temporal statistics of the environment. We apply our framework to a dynamic decision-making task and a maze exploration task. Our surprise-minimizing framework is suitable for learning in complex environments, even if the environment undergoes gradual or sudden changes, and it could eventually provide a framework to study the behavior of humans and animals as they encounter surprising events.

Cortical Dynamics in Presence of Assemblies of Densely Connected Weight-Hub Neurons

Experimental measurements of pairwise connection probability of pyramidal neurons together with the distribution of synaptic weights have been used to construct randomly connected model networks. However, several experimental studies suggest that both wiring and synaptic weight structure between neurons show statistics that differ from random networks. Here we study a network containing a subset of neurons which we call weight-hub neurons, that are characterized by strong inward synapses. We propose a connectivity structure for excitatory neurons that contain assemblies of densely connected weight-hub neurons, while the pairwise connection probability and synaptic weight distribution remain consistent with experimental data. Simulations of such a network with generalized integrate-and-fire neurons display regular and irregular slow oscillations akin to experimentally observed up/down state transitions in the activity of cortical neurons with a broad distribution of pairwise spike correlations. Moreover, stimulation of a model network in the presence or absence of assembly structure exhibits responses similar to light-evoked responses of cortical layers in optogenetically modified animals. We conclude that a high connection probability into and within assemblies of excitatory weight-hub neurons, as it likely is present in some but not all cortical layers, changes the dynamics of a layer of cortical microcircuitry significantly.

Integrating Hebbian and homeostatic plasticity: the current state of the field and future research directions

We summarize here the results presented and subsequent discussion from the meeting on Integrating Hebbian and Homeostatic Plasticity at the Royal Society in April 2016. We first outline the major themes and results presented at the meeting. We next provide a synopsis of the outstanding questions that emerged from the discussion at the end of the meeting and finally suggest potential directions of research that we believe are most promising to develop an understanding of how these two forms of plasticity interact to facilitate functional changes in the brain.This article is part of the themed issue 'Integrating Hebbian and homeostatic plasticity'.

Exponentially Long Orbits in Hopfield Neural Networks

We show that Hopfield neural networks with synchronous dynamics and asymmetric weights admit stable orbits that form sequences of maximal length. For [Formula: see text] units, these sequences have length [Formula: see text]; that is, they cover the full state space. We present a mathematical proof that maximal-length orbits exist for all [Formula: see text], and we provide a method to construct both the sequence and the weight matrix that allow its production. The orbit is relatively robust to dynamical noise, and perturbations of the optimal weights reveal other periodic orbits that are not maximal but typically still very long. We discuss how the resulting dynamics on slow time-scales can be used to generate desired output sequences.

Nonlinear Hebbian Learning as a Unifying Principle in Receptive Field Formation

The development of sensory receptive fields has been modeled in the past by a variety of models including normative models such as sparse coding or independent component analysis and bottom-up models such as spike-timing dependent plasticity or the Bienenstock-Cooper-Munro model of synaptic plasticity. Here we show that the above variety of approaches can all be unified into a single common principle, namely nonlinear Hebbian learning. When nonlinear Hebbian learning is applied to natural images, receptive field shapes were strongly constrained by the input statistics and preprocessing, but exhibited only modest variation across different choices of nonlinearities in neuron models or synaptic plasticity rules. Neither overcompleteness nor sparse network activity are necessary for the development of localized receptive fields. The analysis of alternative sensory modalities such as auditory models or V2 development lead to the same conclusions. In all examples, receptive fields can be predicted a priori by reformulating an abstract model as nonlinear Hebbian learning. Thus nonlinear Hebbian learning and natural statistics can account for many aspects of receptive field formation across models and sensory modalities.

The question of how the brain self-organizes to develop precisely tuned neurons has puzzled neuroscientists at least since the discoveries of Hubel and Wiesel. In the past decades, a variety of theories and models have been proposed to describe receptive field formation, notably V1 simple cells, from natural inputs. We cut through the jungle of candidate explanations by demonstrating that in fact a single principle is sufficient to explain receptive field development. Our results follow from two major insights. First, we show that many representative models of sensory development are in fact implementing variations of a common principle: nonlinear Hebbian learning. Second, we reveal that nonlinear Hebbian learning is sufficient for receptive field formation through sensory inputs. The surprising result is that our findings are robust of specific details of a model, and allows for robust predictions on the learned receptive fields. Nonlinear Hebbian learning is therefore general in two senses: it applies to many models developed by theoreticians, and to many sensory modalities studied by experimental neuroscientists.

25th Annual Computational Neuroscience Meeting: CNS-2016

A1 Functional advantages of cell-type heterogeneity in neural circuits

Tatyana O. Sharpee

A2 Mesoscopic modeling of propagating waves in visual cortex

Alain Destexhe

A3 Dynamics and biomarkers of mental disorders

Mitsuo Kawato

F1 Precise recruitment of spiking output at theta frequencies requires dendritic h-channels in multi-compartment models of oriens-lacunosum/moleculare hippocampal interneurons

Vladislav Sekulić, Frances K. Skinner

F2 Kernel methods in reconstruction of current sources from extracellular potentials for single cells and the whole brains

Daniel K. Wójcik, Chaitanya Chintaluri, Dorottya Cserpán, Zoltán Somogyvári

F3 The synchronized periods depend on intracellular transcriptional repression mechanisms in circadian clocks.

Jae Kyoung Kim, Zachary P. Kilpatrick, Matthew R. Bennett, Kresimir Josić

O1 Assessing irregularity and coordination of spiking-bursting rhythms in central pattern generators

Irene Elices, David Arroyo, Rafael Levi, Francisco B. Rodriguez, Pablo Varona

O2 Regulation of top-down processing by cortically-projecting parvalbumin positive neurons in basal forebrain

Eunjin Hwang, Bowon Kim, Hio-Been Han, Tae Kim, James T. McKenna, Ritchie E. Brown, Robert W. McCarley, Jee Hyun Choi

O3 Modeling auditory stream segregation, build-up and bistability

James Rankin, Pamela Osborn Popp, John Rinzel

O4 Strong competition between tonotopic neural ensembles explains pitch-related dynamics of auditory cortex evoked fields

Alejandro Tabas, André Rupp, Emili Balaguer-Ballester

O5 A simple model of retinal response to multi-electrode stimulation

Matias I. Maturana, David B. Grayden, Shaun L. Cloherty, Tatiana Kameneva, Michael R. Ibbotson, Hamish Meffin

O6 Noise correlations in V4 area correlate with behavioral performance in visual discrimination task

Veronika Koren, Timm Lochmann, Valentin Dragoi, Klaus Obermayer

O7 Input-location dependent gain modulation in cerebellar nucleus neurons

Maria Psarrou, Maria Schilstra, Neil Davey, Benjamin Torben-Nielsen, Volker Steuber

O8 Analytic solution of cable energy function for cortical axons and dendrites

Huiwen Ju, Jiao Yu, Michael L. Hines, Liang Chen, Yuguo Yu

O9 C. elegans interactome: interactive visualization of Caenorhabditis elegans worm neuronal network

Jimin Kim, Will Leahy, Eli Shlizerman

O10 Is the model any good? Objective criteria for computational neuroscience model selection

Justas Birgiolas, Richard C. Gerkin, Sharon M. Crook

O11 Cooperation and competition of gamma oscillation mechanisms

Atthaphon Viriyopase, Raoul-Martin Memmesheimer, Stan Gielen

O12 A discrete structure of the brain waves

Yuri Dabaghian, Justin DeVito, Luca Perotti

O13 Direction-specific silencing of the Drosophila gaze stabilization system

Anmo J. Kim, Lisa M. Fenk, Cheng Lyu, Gaby Maimon

O14 What does the fruit fly think about values? A model of olfactory associative learning

Chang Zhao, Yves Widmer, Simon Sprecher,Walter Senn

O15 Effects of ionic diffusion on power spectra of local field potentials (LFP)

Geir Halnes, Tuomo Mäki-Marttunen, Daniel Keller, Klas H. Pettersen,Ole A. Andreassen, Gaute T. Einevoll

O16 Large-scale cortical models towards understanding relationship between brain structure abnormalities and cognitive deficits

Yasunori Yamada

O17 Spatial coarse-graining the brain: origin of minicolumns

Moira L. Steyn-Ross, D. Alistair Steyn-Ross

O18 Modeling large-scale cortical networks with laminar structure

Jorge F. Mejias, John D. Murray, Henry Kennedy, Xiao-Jing Wang

O19 Information filtering by partial synchronous spikes in a neural population

Alexandra Kruscha, Jan Grewe, Jan Benda, Benjamin Lindner

O20 Decoding context-dependent olfactory valence in Drosophila

Laurent Badel, Kazumi Ohta, Yoshiko Tsuchimoto, Hokto Kazama

P1 Neural network as a scale-free network: the role of a hub

B. Kahng

P2 Hemodynamic responses to emotions and decisions using near-infrared spectroscopy optical imaging

Nicoladie D. Tam

P3 Phase space analysis of hemodynamic responses to intentional movement directions using functional near-infrared spectroscopy (fNIRS) optical imaging technique

Nicoladie D.Tam, Luca Pollonini, George Zouridakis

P4 Modeling jamming avoidance of weakly electric fish

Jaehyun Soh, DaeEun Kim

P5 Synergy and redundancy of retinal ganglion cells in prediction

Minsu Yoo, S. E. Palmer

P6 A neural field model with a third dimension representing cortical depth

Viviana Culmone, Ingo Bojak

P7 Network analysis of a probabilistic connectivity model of the Xenopus tadpole spinal cord

Andrea Ferrario, Robert Merrison-Hort, Roman Borisyuk

P8 The recognition dynamics in the brain

Chang Sub Kim

P9 Multivariate spike train analysis using a positive definite kernel

Taro Tezuka

P10 Synchronization of burst periods may govern slow brain dynamics during general anesthesia

Pangyu Joo

P11 The ionic basis of heterogeneity affects stochastic synchrony

Young-Ah Rho, Shawn D. Burton, G. Bard Ermentrout, Jaeseung Jeong, Nathaniel N. Urban

P12 Circular statistics of noise in spike trains with a periodic component

Petr Marsalek

P14 Representations of directions in EEG-BCI using Gaussian readouts

Hoon-Hee Kim, Seok-hyun Moon, Do-won Lee, Sung-beom Lee, Ji-yong Lee, Jaeseung Jeong

P15 Action selection and reinforcement learning in basal ganglia during reaching movements

Yaroslav I. Molkov, Khaldoun Hamade, Wondimu Teka, William H. Barnett, Taegyo Kim, Sergey Markin, Ilya A. Rybak

P17 Axon guidance: modeling axonal growth in T-Junction assay

Csaba Forro, Harald Dermutz, László Demkó, János Vörös

P19 Transient cell assembly networks encode persistent spatial memories

Yuri Dabaghian, Andrey Babichev

P20 Theory of population coupling and applications to describe high order correlations in large populations of interacting neurons

Haiping Huang

P21 Design of biologically-realistic simulations for motor control

Sergio Verduzco-Flores

P22 Towards understanding the functional impact of the behavioural variability of neurons

Filipa Dos Santos, Peter Andras

P23 Different oscillatory dynamics underlying gamma entrainment deficits in schizophrenia

Christoph Metzner, Achim Schweikard, Bartosz Zurowski

P24 Memory recall and spike frequency adaptation

James P. Roach, Leonard M. Sander, Michal R. Zochowski

P25 Stability of neural networks and memory consolidation preferentially occur near criticality

Quinton M. Skilling, Nicolette Ognjanovski, Sara J. Aton, Michal Zochowski

P26 Stochastic Oscillation in Self-Organized Critical States of Small Systems: Sensitive Resting State in Neural Systems

Sheng-Jun Wang, Guang Ouyang, Jing Guang, Mingsha Zhang, K. Y. Michael Wong, Changsong Zhou

P27 Neurofield: a C++ library for fast simulation of 2D neural field models

Peter A. Robinson, Paula Sanz-Leon, Peter M. Drysdale, Felix Fung, Romesh G. Abeysuriya, Chris J. Rennie, Xuelong Zhao

P28 Action-based grounding: Beyond encoding/decoding in neural code

Yoonsuck Choe, Huei-Fang Yang

P29 Neural computation in a dynamical system with multiple time scales

Yuanyuan Mi, Xiaohan Lin, Si Wu

P30 Maximum entropy models for 3D layouts of orientation selectivity

Joscha Liedtke, Manuel Schottdorf, Fred Wolf

P31 A behavioral assay for probing computations underlying curiosity in rodents

Yoriko Yamamura, Jeffery R. Wickens

P32 Using statistical sampling to balance error function contributions to optimization of conductance-based models

Timothy Rumbell, Julia Ramsey, Amy Reyes, Danel Draguljić, Patrick R. Hof, Jennifer Luebke, Christina M. Weaver

P33 Exploration and implementation of a self-growing and self-organizing neuron network building algorithm

Hu He, Xu Yang, Hailin Ma, Zhiheng Xu, Yuzhe Wang

P34 Disrupted resting state brain network in obese subjects: a data-driven graph theory analysis

Kwangyeol Baek, Laurel S. Morris, Prantik Kundu, Valerie Voon

P35 Dynamics of cooperative excitatory and inhibitory plasticity

Everton J. Agnes, Tim P. Vogels

P36 Frequency-dependent oscillatory signal gating in feed-forward networks of integrate-and-fire neurons

William F. Podlaski, Tim P. Vogels

P37 Phenomenological neural model for adaptation of neurons in area IT

Martin Giese, Pradeep Kuravi, Rufin Vogels

P38 ICGenealogy: towards a common topology of neuronal ion channel function and genealogy in model and experiment

Alexander Seeholzer, William Podlaski, Rajnish Ranjan, Tim Vogels

P39 Temporal input discrimination from the interaction between dynamic synapses and neural subthreshold oscillations

Joaquin J. Torres, Fabiano Baroni, Roberto Latorre, Pablo Varona

P40 Different roles for transient and sustained activity during active visual processing

Bart Gips, Eric Lowet, Mark J. Roberts, Peter de Weerd, Ole Jensen, Jan van der Eerden

P41 Scale-free functional networks of 2D Ising model are highly robust against structural defects: neuroscience implications

Abdorreza Goodarzinick, Mohammad D. Niry, Alireza Valizadeh

P42 High frequency neuron can facilitate propagation of signal in neural networks

Aref Pariz, Shervin S. Parsi, Alireza Valizadeh

P43 Investigating the effect of Alzheimer’s disease related amyloidopathy on gamma oscillations in the CA1 region of the hippocampus

Julia M. Warburton, Lucia Marucci, Francesco Tamagnini, Jon Brown, Krasimira Tsaneva-Atanasova

P44 Long-tailed distributions of inhibitory and excitatory weights in a balanced network with eSTDP and iSTDP

Florence I. Kleberg, Jochen Triesch

P45 Simulation of EMG recording from hand muscle due to TMS of motor cortex

Bahar Moezzi, Nicolangelo Iannella, Natalie Schaworonkow, Lukas Plogmacher, Mitchell R. Goldsworthy, Brenton Hordacre, Mark D. McDonnell, Michael C. Ridding, Jochen Triesch

P46 Structure and dynamics of axon network formed in primary cell culture

Martin Zapotocky, Daniel Smit, Coralie Fouquet, Alain Trembleau

P47 Efficient signal processing and sampling in random networks that generate variability

Sakyasingha Dasgupta, Isao Nishikawa, Kazuyuki Aihara, Taro Toyoizumi

P48 Modeling the effect of riluzole on bursting in respiratory neural networks

Daniel T. Robb, Nick Mellen, Natalia Toporikova

P49 Mapping relaxation training using effective connectivity analysis

Rongxiang Tang, Yi-Yuan Tang

P50 Modeling neuron oscillation of implicit sequence learning

Guangsheng Liang, Seth A. Kiser, James H. Howard, Jr., Yi-Yuan Tang

P51 The role of cerebellar short-term synaptic plasticity in the pathology and medication of downbeat nystagmus

Julia Goncharenko, Neil Davey, Maria Schilstra, Volker Steuber

P52 Nonlinear response of noisy neurons

Sergej O. Voronenko, Benjamin Lindner

P53 Behavioral embedding suggests multiple chaotic dimensions underlie C. elegans locomotion

Tosif Ahamed, Greg Stephens

P54 Fast and scalable spike sorting for large and dense multi-electrodes recordings

Pierre Yger, Baptiste Lefebvre, Giulia Lia Beatrice Spampinato, Elric Esposito, Marcel Stimberg et Olivier Marre

P55 Sufficient sampling rates for fast hand motion tracking

Hansol Choi, Min-Ho Song

P56 Linear readout of object manifolds

SueYeon Chung, Dan D. Lee, Haim Sompolinsky

P57 Differentiating models of intrinsic bursting and rhythm generation of the respiratory pre-Bötzinger complex using phase response curves

Ryan S. Phillips, Jeffrey Smith

P58 The effect of inhibitory cell network interactions during theta rhythms on extracellular field potentials in CA1 hippocampus

Alexandra Pierri Chatzikalymniou, Katie Ferguson, Frances K. Skinner

P59 Expansion recoding through sparse sampling in the cerebellar input layer speeds learning

N. Alex Cayco Gajic, Claudia Clopath, R. Angus Silver

P60 A set of curated cortical models at multiple scales on Open Source Brain

Padraig Gleeson, Boris Marin, Sadra Sadeh, Adrian Quintana, Matteo Cantarelli, Salvador Dura-Bernal, William W. Lytton, Andrew Davison, R. Angus Silver

P61 A synaptic story of dynamical information encoding in neural adaptation

Luozheng Li, Wenhao Zhang, Yuanyuan Mi, Dahui Wang, Si Wu

P62 Physical modeling of rule-observant rodent behavior

Youngjo Song, Sol Park, Ilhwan Choi, Jaeseung Jeong, Hee-sup Shin

P64 Predictive coding in area V4 and prefrontal cortex explains dynamic discrimination of partially occluded shapes

Hannah Choi, Anitha Pasupathy, Eric Shea-Brown

P65 Stability of FORCE learning on spiking and rate-based networks

Dongsung Huh, Terrence J. Sejnowski

P66 Stabilising STDP in striatal neurons for reliable fast state recognition in noisy environments

Simon M. Vogt, Arvind Kumar, Robert Schmidt

P67 Electrodiffusion in one- and two-compartment neuron models for characterizing cellular effects of electrical stimulation

Stephen Van Wert, Steven J. Schiff

P68 STDP improves speech recognition capabilities in spiking recurrent circuits parameterized via differential evolution Markov Chain Monte Carlo

Richard Veale, Matthias Scheutz

P69 Bidirectional transformation between dominant cortical neural activities and phase difference distributions

Sang Wan Lee

P70 Maturation of sensory networks through homeostatic structural plasticity

Júlia Gallinaro, Stefan Rotter

P71 Corticothalamic dynamics: structure, number of solutions and stability of steady-state solutions in the space of synaptic couplings

Paula Sanz-Leon, Peter A. Robinson

P72 Optogenetic versus electrical stimulation of the parkinsonian basal ganglia. Computational study

Leonid L. Rubchinsky, Chung Ching Cheung, Shivakeshavan Ratnadurai-Giridharan

P73 Exact spike-timing distribution reveals higher-order interactions of neurons

Safura Rashid Shomali, Majid Nili Ahmadabadi, Hideaki Shimazaki, S. Nader Rasuli

P74 Neural mechanism of visual perceptual learning using a multi-layered neural network

Xiaochen Zhao, Malte J. Rasch

P75 Inferring collective spiking dynamics from mostly unobserved systems

Jens Wilting, Viola Priesemann

P76 How to infer distributions in the brain from subsampled observations

Anna Levina, Viola Priesemann

P77 Influences of embedding and estimation strategies on the inferred memory of single spiking neurons

Lucas Rudelt, Joseph T. Lizier, Viola Priesemann

P78 A nearest-neighbours based estimator for transfer entropy between spike trains

Joseph T. Lizier, Richard E. Spinney, Mikail Rubinov, Michael Wibral, Viola Priesemann

P79 Active learning of psychometric functions with multinomial logistic models

Ji Hyun Bak, Jonathan Pillow

P81 Inferring low-dimensional network dynamics with variational latent Gaussian process

Yuan Zaho, Il Memming Park

P82 Computational investigation of energy landscapes in the resting state subcortical brain network

Jiyoung Kang, Hae-Jeong Park

P83 Local repulsive interaction between retinal ganglion cells can generate a consistent spatial periodicity of orientation map

Jaeson Jang, Se-Bum Paik

P84 Phase duration of bistable perception reveals intrinsic time scale of perceptual decision under noisy condition

Woochul Choi, Se-Bum Paik

P85 Feedforward convergence between retina and primary visual cortex can determine the structure of orientation map

Changju Lee, Jaeson Jang, Se-Bum Paik

P86 Computational method classifying neural network activity patterns for imaging data

Min Song, Hyeonsu Lee, Se-Bum Paik

P87 Symmetry of spike-timing-dependent-plasticity kernels regulates volatility of memory

Youngjin Park, Woochul Choi^, Se-Bum Paik

P88 Effects of time-periodic coupling strength on the first-spike latency dynamics of a scale-free network of stochastic Hodgkin-Huxley neurons

Ergin Yilmaz, Veli Baysal, Mahmut Ozer

P89 Spectral properties of spiking responses in V1 and V4 change within the trial and are highly relevant for behavioral performance

Veronika Koren, Klaus Obermayer

P90 Methods for building accurate models of individual neurons

Daniel Saska, Thomas Nowotny

P91 A full size mathematical model of the early olfactory system of honeybees

Ho Ka Chan, Alan Diamond, Thomas Nowotny

P92 Stimulation-induced tuning of ongoing oscillations in spiking neural networks

Christoph S. Herrmann, Micah M. Murray, Silvio Ionta, Axel Hutt, Jérémie Lefebvre

P93 Decision-specific sequences of neural activity in balanced random networks driven by structured sensory input

Philipp Weidel, Renato Duarte, Abigail Morrison

P94 Modulation of tuning induced by abrupt reduction of SST cell activity

Jung H. Lee, Ramakrishnan Iyer, Stefan Mihalas

P95 The functional role of VIP cell activation during locomotion

Jung H. Lee, Ramakrishnan Iyer, Christof Koch, Stefan Mihalas

P96 Stochastic inference with spiking neural networks

Mihai A. Petrovici, Luziwei Leng, Oliver Breitwieser, David Stöckel, Ilja Bytschok, Roman Martel, Johannes Bill, Johannes Schemmel, Karlheinz Meier

P97 Modeling orientation-selective electrical stimulation with retinal prostheses

Timothy B. Esler, Anthony N. Burkitt, David B. Grayden, Robert R. Kerr, Bahman Tahayori, Hamish Meffin

P98 Ion channel noise can explain firing correlation in auditory nerves

Bahar Moezzi, Nicolangelo Iannella, Mark D. McDonnell

P99 Limits of temporal encoding of thalamocortical inputs in a neocortical microcircuit

Max Nolte, Michael W. Reimann, Eilif Muller, Henry Markram

P100 On the representation of arm reaching movements: a computational model

Antonio Parziale, Rosa Senatore, Angelo Marcelli

P101 A computational model for investigating the role of cerebellum in acquisition and retention of motor behavior

Rosa Senatore, Antonio Parziale, Angelo Marcelli

P102 The emergence of semantic categories from a large-scale brain network of semantic knowledge

K. Skiker, M. Maouene

P103 Multiscale modeling of M1 multitarget pharmacotherapy for dystonia

Samuel A. Neymotin, Salvador Dura-Bernal, Alexandra Seidenstein, Peter Lakatos, Terence D. Sanger, William W. Lytton

P104 Effect of network size on computational capacity

Salvador Dura-Bernal, Rosemary J. Menzies, Campbell McLauchlan, Sacha J. van Albada, David J. Kedziora, Samuel Neymotin, William W. Lytton, Cliff C. Kerr

P105 NetPyNE: a Python package for NEURON to facilitate development and parallel simulation of biological neuronal networks

Salvador Dura-Bernal, Benjamin A. Suter, Samuel A. Neymotin, Cliff C. Kerr, Adrian Quintana, Padraig Gleeson, Gordon M. G. Shepherd, William W. Lytton

P107 Inter-areal and inter-regional inhomogeneity in co-axial anisotropy of Cortical Point Spread in human visual areas

Juhyoung Ryu, Sang-Hun Lee

P108 Two bayesian quanta of uncertainty explain the temporal dynamics of cortical activity in the non-sensory areas during bistable perception

Joonwon Lee, Sang-Hun Lee

P109 Optimal and suboptimal integration of sensory and value information in perceptual decision making

Hyang Jung Lee, Sang-Hun Lee

P110 A Bayesian algorithm for phoneme Perception and its neural implementation

Daeseob Lim, Sang-Hun Lee

P111 Complexity of EEG signals is reduced during unconsciousness induced by ketamine and propofol

Jisung Wang, Heonsoo Lee

P112 Self-organized criticality of neural avalanche in a neural model on complex networks

Nam Jung, Le Anh Quang, Seung Eun Maeng, Tae Ho Lee, Jae Woo Lee

P113 Dynamic alterations in connection topology of the hippocampal network during ictal-like epileptiform activity in an in vitro rat model

Chang-hyun Park, Sora Ahn, Jangsup Moon, Yun Seo Choi, Juhee Kim, Sang Beom Jun, Seungjun Lee, Hyang Woon Lee

P114 Computational model to replicate seizure suppression effect by electrical stimulation

Sora Ahn, Sumin Jo, Eunji Jun, Suin Yu, Hyang Woon Lee, Sang Beom Jun, Seungjun Lee

P115 Identifying excitatory and inhibitory synapses in neuronal networks from spike trains using sorted local transfer entropy

Felix Goetze, Pik-Yin Lai

P116 Neural network model for obstacle avoidance based on neuromorphic computational model of boundary vector cell and head direction cell

Seonghyun Kim, Jeehyun Kwag

P117 Dynamic gating of spike pattern propagation by Hebbian and anti-Hebbian spike timing-dependent plasticity in excitatory feedforward network model

Hyun Jae Jang, Jeehyun Kwag

P118 Inferring characteristics of input correlations of cells exhibiting up-down state transitions in the rat striatum

Marko Filipović, Ramon Reig, Ad Aertsen, Gilad Silberberg, Arvind Kumar

P119 Graph properties of the functional connected brain under the influence of Alzheimer’s disease

Claudia Bachmann, Simone Buttler, Heidi Jacobs, Kim Dillen, Gereon R. Fink, Juraj Kukolja, Abigail Morrison

P120 Learning sparse representations in the olfactory bulb

Daniel Kepple, Hamza Giaffar, Dima Rinberg, Steven Shea, Alex Koulakov

P121 Functional classification of homologous basal-ganglia networks

Jyotika Bahuguna,Tom Tetzlaff, Abigail Morrison, Arvind Kumar, Jeanette Hellgren Kotaleski

P122 Short term memory based on multistability

Tim Kunze, Andre Peterson, Thomas Knösche

P123 A physiologically plausible, computationally efficient model and simulation software for mammalian motor units

Minjung Kim, Hojeong Kim

P125 Decoding laser-induced somatosensory information from EEG

Ji Sung Park, Ji Won Yeon, Sung-Phil Kim

P126 Phase synchronization of alpha activity for EEG-based personal authentication

Jae-Hwan Kang, Chungho Lee, Sung-Phil Kim

P129 Investigating phase-lags in sEEG data using spatially distributed time delays in a large-scale brain network model

Andreas Spiegler, Spase Petkoski, Matias J. Palva, Viktor K. Jirsa

P130 Epileptic seizures in the unfolding of a codimension-3 singularity

Maria L. Saggio, Silvan F. Siep, Andreas Spiegler, William C. Stacey, Christophe Bernard, Viktor K. Jirsa

P131 Incremental dimensional exploratory reasoning under multi-dimensional environment

Oh-hyeon Choung, Yong Jeong

P132 A low-cost model of eye movements and memory in personal visual cognition

Yong-il Lee, Jaeseung Jeong

P133 Complex network analysis of structural connectome of autism spectrum disorder patients

Su Hyun Kim, Mir Jeong, Jaeseung Jeong

P134 Cognitive motives and the neural correlates underlying human social information transmission, gossip

Jeungmin Lee, Jaehyung Kwon, Jerald D. Kralik, Jaeseung Jeong

P135 EEG hyperscanning detects neural oscillation for the social interaction during the economic decision-making

Jaehwan Jahng, Dong-Uk Hwang, Jaeseung Jeong

P136 Detecting purchase decision based on hyperfrontality of the EEG

Jae-Hyung Kwon, Sang-Min Park, Jaeseung Jeong

P137 Vulnerability-based critical neurons, synapses, and pathways in the Caenorhabditis elegans connectome

Seongkyun Kim, Hyoungkyu Kim, Jerald D. Kralik, Jaeseung Jeong

P138 Motif analysis reveals functionally asymmetrical neurons in C. elegans

Pyeong Soo Kim, Seongkyun Kim, Hyoungkyu Kim, Jaeseung Jeong

P139 Computational approach to preference-based serial decision dynamics: do temporal discounting and working memory affect it?

Sangsup Yoon, Jaehyung Kwon, Sewoong Lim, Jaeseung Jeong

P141 Social stress induced neural network reconfiguration affects decision making and learning in zebrafish

Choongseok Park, Thomas Miller, Katie Clements, Sungwoo Ahn, Eoon Hye Ji, Fadi A. Issa

P142 Descriptive, generative, and hybrid approaches for neural connectivity inference from neural activity data

JeongHun Baek, Shigeyuki Oba, Junichiro Yoshimoto, Kenji Doya, Shin Ishii

P145 Divergent-convergent synaptic connectivities accelerate coding in multilayered sensory systems

Thiago S. Mosqueiro, Martin F. Strube-Bloss, Brian Smith, Ramon Huerta

P146 Swinging networks

Michal Hadrava, Jaroslav Hlinka

P147 Inferring dynamically relevant motifs from oscillatory stimuli: challenges, pitfalls, and solutions

Hannah Bos, Moritz Helias

P148 Spatiotemporal mapping of brain network dynamics during cognitive tasks using magnetoencephalography and deep learning

Charles M. Welzig, Zachary J. Harper

P149 Multiscale complexity analysis for the segmentation of MRI images

Won Sup Kim, In-Seob Shin, Hyeon-Man Baek, Seung Kee Han

P150 A neuro-computational model of emotional attention

René Richter, Julien Vitay, Frederick Beuth, Fred H. Hamker

P151 Multi-site delayed feedback stimulation in parkinsonian networks

Kelly Toppin, Yixin Guo

P152 Bistability in Hodgkin–Huxley-type equations

Tatiana Kameneva, Hamish Meffin, Anthony N. Burkitt, David B. Grayden

P153 Phase changes in postsynaptic spiking due to synaptic connectivity and short term plasticity: mathematical analysis of frequency dependency

Mark D. McDonnell, Bruce P. Graham

P154 Quantifying resilience patterns in brain networks: the importance of directionality

Penelope J. Kale, Leonardo L. Gollo

P155 Dynamics of rate-model networks with separate excitatory and inhibitory populations

Merav Stern, L. F. Abbott

P156 A model for multi-stable dynamics in action recognition modulated by integration of silhouette and shading cues

Leonid A. Fedorov, Martin A. Giese

P157 Spiking model for the interaction between action recognition and action execution

Mohammad Hovaidi Ardestani, Martin Giese

P158 Surprise-modulated belief update: how to learn within changing environments?

Mohammad Javad Faraji, Kerstin Preuschoff, Wulfram Gerstner

P159 A fast, stochastic and adaptive model of auditory nerve responses to cochlear implant stimulation

Margriet J. van Gendt, Jeroen J. Briaire, Randy K. Kalkman, Johan H. M. Frijns

P160 Quantitative comparison of graph theoretical measures of simulated and empirical functional brain networks

Won Hee Lee, Sophia Frangou

P161 Determining discriminative properties of fMRI signals in schizophrenia using highly comparative time-series analysis

Ben D. Fulcher, Patricia H. P. Tran, Alex Fornito

P162 Emergence of narrowband LFP oscillations from completely asynchronous activity during seizures and high-frequency oscillations

Stephen V. Gliske, William C. Stacey, Eugene Lim, Katherine A. Holman, Christian G. Fink

P163 Neuronal diversity in structure and function: cross-validation of anatomical and physiological classification of retinal ganglion cells in the mouse

Jinseop S. Kim, Shang Mu, Kevin L. Briggman, H. Sebastian Seung, the EyeWirers

P164 Analysis and modelling of transient firing rate changes in area MT in response to rapid stimulus feature changes

Detlef Wegener, Lisa Bohnenkamp, Udo A. Ernst

P165 Step-wise model fitting accounting for high-resolution spatial measurements: construction of a layer V pyramidal cell model with reduced morphology

Tuomo Mäki-Marttunen, Geir Halnes, Anna Devor, Christoph Metzner, Anders M. Dale, Ole A. Andreassen, Gaute T. Einevoll

P166 Contributions of schizophrenia-associated genes to neuron firing and cardiac pacemaking: a polygenic modeling approach

Tuomo Mäki-Marttunen, Glenn T. Lines, Andy Edwards, Aslak Tveito, Anders M. Dale, Gaute T. Einevoll, Ole A. Andreassen

P167 Local field potentials in a 4 × 4 mm² multi-layered network model

Espen Hagen, Johanna Senk, Sacha J. van Albada, Markus Diesmann

P168 A spiking network model explains multi-scale properties of cortical dynamics

Maximilian Schmidt, Rembrandt Bakker, Kelly Shen, Gleb Bezgin, Claus-Christian Hilgetag, Markus Diesmann, Sacha Jennifer van Albada

P169 Using joint weight-delay spike-timing dependent plasticity to find polychronous neuronal groups

Haoqi Sun, Olga Sourina, Guang-Bin Huang, Felix Klanner, Cornelia Denk

P170 Tensor decomposition reveals RSNs in simulated resting state fMRI

Katharina Glomb, Adrián Ponce-Alvarez, Matthieu Gilson, Petra Ritter, Gustavo Deco

P171 Getting in the groove: testing a new model-based method for comparing task-evoked vs resting-state activity in fMRI data on music listening

Matthieu Gilson, Maria AG Witek, Eric F. Clarke, Mads Hansen, Mikkel Wallentin, Gustavo Deco, Morten L. Kringelbach^, Peter Vuust

P172 STochastic engine for pathway simulation (STEPS) on massively parallel processors

Guido Klingbeil, Erik De Schutter

P173 Toolkit support for complex parallel spatial stochastic reaction–diffusion simulation in STEPS

Weiliang Chen, Erik De Schutter

P174 Modeling the generation and propagation of Purkinje cell dendritic spikes caused by parallel fiber synaptic input

Yunliang Zang, Erik De Schutter

P175 Dendritic morphology determines how dendrites are organized into functional subunits

Sungho Hong, Akira Takashima, Erik De Schutter

P176 A model of Ca²⁺/calmodulin-dependent protein kinase II activity in long term depression at Purkinje cells

Criseida Zamora, Andrew R. Gallimore, Erik De Schutter

P177 Reward-modulated learning of population-encoded vectors for insect-like navigation in embodied agents

Dennis Goldschmidt, Poramate Manoonpong, Sakyasingha Dasgupta

P178 Data-driven neural models part II: connectivity patterns of human seizures

Philippa J. Karoly, Dean R. Freestone, Daniel Soundry, Levin Kuhlmann, Liam Paninski, Mark Cook

P179 Data-driven neural models part I: state and parameter estimation

Dean R. Freestone, Philippa J. Karoly, Daniel Soundry, Levin Kuhlmann, Mark Cook

P180 Spectral and spatial information processing in human auditory streaming

Jaejin Lee, Yonatan I. Fishman, Yale E. Cohen

P181 A tuning curve for the global effects of local perturbations in neural activity: Mapping the systems-level susceptibility of the brain

Leonardo L. Gollo, James A. Roberts, Luca Cocchi

P182 Diverse homeostatic responses to visual deprivation mediated by neural ensembles

Yann Sweeney, Claudia Clopath

P183 Opto-EEG: a novel method for investigating functional connectome in mouse brain based on optogenetics and high density electroencephalography

Soohyun Lee, Woo-Sung Jung, Jee Hyun Choi

P184 Biphasic responses of frontal gamma network to repetitive sleep deprivation during REM sleep

Bowon Kim, Youngsoo Kim, Eunjin Hwang, Jee Hyun Choi

P185 Brain-state correlate and cortical connectivity for frontal gamma oscillations in top-down fashion assessed by auditory steady-state response

Younginha Jung, Eunjin Hwang, Yoon-Kyu Song, Jee Hyun Choi

P186 Neural field model of localized orientation selective activation in V1

James Rankin, Frédéric Chavane

P187 An oscillatory network model of Head direction and Grid cells using locomotor inputs

Karthik Soman, Vignesh Muralidharan, V. Srinivasa Chakravarthy

P188 A computational model of hippocampus inspired by the functional architecture of basal ganglia

Karthik Soman, Vignesh Muralidharan, V. Srinivasa Chakravarthy

P189 A computational architecture to model the microanatomy of the striatum and its functional properties

Sabyasachi Shivkumar, Vignesh Muralidharan, V. Srinivasa Chakravarthy

P190 A scalable cortico-basal ganglia model to understand the neural dynamics of targeted reaching

Vignesh Muralidharan, Alekhya Mandali, B. Pragathi Priyadharsini, Hima Mehta, V. Srinivasa Chakravarthy

P191 Emergence of radial orientation selectivity from synaptic plasticity

Catherine E. Davey, David B. Grayden, Anthony N. Burkitt

P192 How do hidden units shape effective connections between neurons?

Braden A. W. Brinkman, Tyler Kekona, Fred Rieke, Eric Shea-Brown, Michael Buice

P193 Characterization of neural firing in the presence of astrocyte-synapse signaling

Maurizio De Pittà, Hugues Berry, Nicolas Brunel

P194 Metastability of spatiotemporal patterns in a large-scale network model of brain dynamics

James A. Roberts, Leonardo L. Gollo, Michael Breakspear

P195 Comparison of three methods to quantify detection and discrimination capacity estimated from neural population recordings

Gary Marsat, Jordan Drew, Phillip D. Chapman, Kevin C. Daly, Samual P. Bradley

P196 Quantifying the constraints for independent evoked and spontaneous NMDA receptor mediated synaptic transmission at individual synapses

Sat Byul Seo, Jianzhong Su, Ege T. Kavalali, Justin Blackwell

P199 Gamma oscillation via adaptive exponential integrate-and-fire neurons

LieJune Shiau, Laure Buhry, Kanishka Basnayake

P200 Visual face representations during memory retrieval compared to perception

Sue-Hyun Lee, Brandon A. Levy, Chris I. Baker

P201 Top-down modulation of sequential activity within packets modeled using avalanche dynamics

Timothée Leleu, Kazuyuki Aihara

Q28 An auto-encoder network realizes sparse features under the influence of desynchronized vascular dynamics

Ryan T. Philips, Karishma Chhabria, V. Srinivasa Chakravarthy

A Model of Synaptic Reconsolidation

Reconsolidation of memories has mostly been studied at the behavioral and molecular level. Here, we put forward a simple extension of existing computational models of synaptic consolidation to capture hippocampal slice experiments that have been interpreted as reconsolidation at the synaptic level. The model implements reconsolidation through stabilization of consolidated synapses by stabilizing entities combined with an activity-dependent reservoir of stabilizing entities that are immune to protein synthesis inhibition (PSI). We derive a reduced version of our model to explore the conditions under which synaptic reconsolidation does or does not occur, often referred to as the boundary conditions of reconsolidation. We find that our computational model of synaptic reconsolidation displays complex boundary conditions. Our results suggest that a limited resource of hypothetical stabilizing molecules or complexes, which may be implemented by protein phosphorylation or different receptor subtypes, can underlie the phenomenon of synaptic reconsolidation.

Enhanced Sensitivity to Rapid Input Fluctuations by Nonlinear Threshold Dynamics in Neocortical Pyramidal Neurons

The way in which single neurons transform input into output spike trains has fundamental consequences for network coding. Theories and modeling studies based on standard Integrate-and-Fire models implicitly assume that, in response to increasingly strong inputs, neurons modify their coding strategy by progressively reducing their selective sensitivity to rapid input fluctuations. Combining mathematical modeling with in vitro experiments, we demonstrate that, in L5 pyramidal neurons, the firing threshold dynamics adaptively adjust the effective timescale of somatic integration in order to preserve sensitivity to rapid signals over a broad range of input statistics. For that, a new Generalized Integrate-and-Fire model featuring nonlinear firing threshold dynamics and conductance-based adaptation is introduced that outperforms state-of-the-art neuron models in predicting the spiking activity of neurons responding to a variety of in vivo-like fluctuating currents. Our model allows for efficient parameter extraction and can be analytically mapped to a Generalized Linear Model in which both the input filter—describing somatic integration—and the spike-history filter—accounting for spike-frequency adaptation—dynamically adapt to the input statistics, as experimentally observed. Overall, our results provide new insights on the computational role of different biophysical processes known to underlie adaptive coding in single neurons and support previous theoretical findings indicating that the nonlinear dynamics of the firing threshold due to Na⁺-channel inactivation regulate the sensitivity to rapid input fluctuations.

Over the last decades, a variety of simplified spiking models have been shown to achieve a surprisingly high performance in predicting the neuronal responses to in vitro somatic current injections. Because of the complex adaptive behavior featured by cortical neurons, this success is however restricted to limited stimulus ranges: model parameters optimized for a specific input regime are often inappropriate to describe the response to input currents with different statistical properties. In the present study, a new spiking neuron model is introduced that captures single-neuron computation over a wide range of input statistics and explains different aspects of the neuronal dynamics within a single framework. Our results indicate that complex forms of single neuron adaptation are mediated by the nonlinear dynamics of the firing threshold and that the input-output transformation performed by cortical pyramidal neurons can be intuitively understood in terms of an enhanced Generalized Linear Model in which both the input filter and the spike-history filter adapt to the input statistics.

Neuromodulated Spike-Timing-Dependent Plasticity, and Theory of Three-Factor Learning Rules

Classical Hebbian learning puts the emphasis on joint pre- and postsynaptic activity, but neglects the potential role of neuromodulators. Since neuromodulators convey information about novelty or reward, the influence of neuromodulators on synaptic plasticity is useful not just for action learning in classical conditioning, but also to decide "when" to create new memories in response to a flow of sensory stimuli. In this review, we focus on timing requirements for pre- and postsynaptic activity in conjunction with one or several phasic neuromodulatory signals. While the emphasis of the text is on conceptual models and mathematical theories, we also discuss some experimental evidence for neuromodulation of Spike-Timing-Dependent Plasticity. We highlight the importance of synaptic mechanisms in bridging the temporal gap between sensory stimulation and neuromodulatory signals, and develop a framework for a class of neo-Hebbian three-factor learning rules that depend on presynaptic activity, postsynaptic variables as well as the influence of neuromodulators.

Automated High-Throughput Characterization of Single Neurons by Means of Simplified Spiking Models

Single-neuron models are useful not only for studying the emergent properties of neural circuits in large-scale simulations, but also for extracting and summarizing in a principled way the information contained in electrophysiological recordings. Here we demonstrate that, using a convex optimization procedure we previously introduced, a Generalized Integrate-and-Fire model can be accurately fitted with a limited amount of data. The model is capable of predicting both the spiking activity and the subthreshold dynamics of different cell types, and can be used for online characterization of neuronal properties. A protocol is proposed that, combined with emergent technologies for automatic patch-clamp recordings, permits automated, in vitro high-throughput characterization of single neurons.

Fluctuations and information filtering in coupled populations of spiking neurons with adaptation

Finite-sized populations of spiking elements are fundamental to brain function but also are used in many areas of physics. Here we present a theory of the dynamics of finite-sized populations of spiking units, based on a quasirenewal description of neurons with adaptation. We derive an integral equation with colored noise that governs the stochastic dynamics of the population activity in response to time-dependent stimulation and calculate the spectral density in the asynchronous state. We show that systems of coupled populations with adaptation can generate a frequency band in which sensory information is preferentially encoded. The theory is applicable to fully as well as randomly connected networks and to leaky integrate-and-fire as well as to generalized spiking neurons with adaptation on multiple time scales.

Limits to high-speed simulations of spiking neural networks using general-purpose computers

To understand how the central nervous system performs computations using recurrent neuronal circuitry, simulations have become an indispensable tool for theoretical neuroscience. To study neuronal circuits and their ability to self-organize, increasing attention has been directed toward synaptic plasticity. In particular spike-timing-dependent plasticity (STDP) creates specific demands for simulations of spiking neural networks. On the one hand a high temporal resolution is required to capture the millisecond timescale of typical STDP windows. On the other hand network simulations have to evolve over hours up to days, to capture the timescale of long-term plasticity. To do this efficiently, fast simulation speed is the crucial ingredient rather than large neuron numbers. Using different medium-sized network models consisting of several thousands of neurons and off-the-shelf hardware, we compare the simulation speed of the simulators: Brian, NEST and Neuron as well as our own simulator Auryn. Our results show that real-time simulations of different plastic network models are possible in parallel simulations in which numerical precision is not a primary concern. Even so, the speed-up margin of parallelism is limited and boosting simulation speeds beyond one tenth of real-time is difficult. By profiling simulation code we show that the run times of typical plastic network simulations encounter a hard boundary. This limit is partly due to latencies in the inter-process communications and thus cannot be overcome by increased parallelism. Overall, these results show that to study plasticity in medium-sized spiking neural networks, adequate simulation tools are readily available which run efficiently on small clusters. However, to run simulations substantially faster than real-time, special hardware is a prerequisite.

Spike-timing prediction in cortical neurons with active dendrites

A complete single-neuron model must correctly reproduce the firing of spikes and bursts. We present a study of a simplified model of deep pyramidal cells of the cortex with active dendrites. We hypothesized that we can model the soma and its apical dendrite with only two compartments, without significant loss in the accuracy of spike-timing predictions. The model is based on experimentally measurable impulse-response functions, which transfer the effect of current injected in one compartment to current reaching the other. Each compartment was modeled with a pair of non-linear differential equations and a small number of parameters that approximate the Hodgkin-and-Huxley equations. The predictive power of this model was tested on electrophysiological experiments where noisy current was injected in both the soma and the apical dendrite simultaneously. We conclude that a simple two-compartment model can predict spike times of pyramidal cells stimulated in the soma and dendrites simultaneously. Our results support that regenerating activity in the apical dendritic is required to properly account for the dynamics of layer 5 pyramidal cells under in-vivo-like conditions.

Optimal control of transient dynamics in balanced networks supports generation of complex movements

Populations of neurons in motor cortex engage in complex transient dynamics of large amplitude during the execution of limb movements. Traditional network models with stochastically assigned synapses cannot reproduce this behavior. Here we introduce a class of cortical architectures with strong and random excitatory recurrence that is stabilized by intricate, fine-tuned inhibition, optimized from a control theory perspective. Such networks transiently amplify specific activity states and can be used to reliably execute multidimensional movement patterns. Similar to the experimental observations, these transients must be preceded by a steady-state initialization phase from which the network relaxes back into the background state by way of complex internal dynamics. In our networks, excitation and inhibition are as tightly balanced as recently reported in experiments across several brain areas, suggesting inhibitory control of complex excitatory recurrence as a generic organizational principle in cortex.