Retrospective and prospective persistent activity induced by Hebbian learning in a recurrent cortical network

Dynamic branching in a neural network model for probabilistic prediction of sequences

An important function of the brain is to predict which stimulus is likely to occur based on the perceived cues. The present research studied the branching behavior of a computational network model of populations of excitatory and inhibitory neurons, both analytically and through simulations. Results show how synaptic efficacy, retroactive inhibition and short-term synaptic depression determine the dynamics of selection between different branches predicting sequences of stimuli of different probabilities. Further results show that changes in the probability of the different predictions depend on variations of neuronal gain. Such variations allow the network to optimize the probability of its predictions to changing probabilities of the sequences without changing synaptic efficacy.

Learning Higher-Order Transitional Probabilities in Nonhuman Primates

The extraction of cooccurrences between two events, A and B, is a central learning mechanism shared by all species capable of associative learning. Formally, the cooccurrence of events A and B appearing in a sequence is measured by the transitional probability (TP) between these events, and it corresponds to the probability of the second stimulus given the first (i.e., p(B|A)). In the present study, nonhuman primates (Guinea baboons, Papio papio) were exposed to a serial version of the XOR (i.e., exclusive-OR), in which they had to process sequences of three stimuli: A, B, and C. In this manipulation, first-order TPs (i.e., AB and BC) were uninformative due to their transitional probabilities being equal to .5 (i.e., p(B|A) = p(C|B) = .5), while second-order TPs were fully predictive of the upcoming stimulus (i.e., p(C|AB) = 1). In Experiment 1, we found that baboons were able to learn second-order TPs, while no learning occurred on first-order TPs. In Experiment 2, this pattern of results was replicated, and a final test ruled out an alternative interpretation in terms of proximity to the reward. These results indicate that a nonhuman primate species can learn a nonlinearly separable problem such as the XOR. They also provide fine-grained empirical data to test models of statistical learning on the interaction between the learning of different orders of TPs. Recent bioinspired models of associative learning are also introduced as promising alternatives to the modeling of statistical learning mechanisms.

Thunderstruck: The ACDC model of flexible sequences and rhythms in recurrent neural circuits

Adaptive sequential behavior is a hallmark of human cognition. In particular, humans can learn to produce precise spatiotemporal sequences given a certain context. For instance, musicians can not only reproduce learned action sequences in a context-dependent manner, they can also quickly and flexibly reapply them in any desired tempo or rhythm without overwriting previous learning. Existing neural network models fail to account for these properties. We argue that this limitation emerges from the fact that sequence information (i.e., the position of the action) and timing (i.e., the moment of response execution) are typically stored in the same neural network weights. Here, we augment a biologically plausible recurrent neural network of cortical dynamics to include a basal ganglia-thalamic module which uses reinforcement learning to dynamically modulate action. This “associative cluster-dependent chain” (ACDC) model modularly stores sequence and timing information in distinct loci of the network. This feature increases computational power and allows ACDC to display a wide range of temporal properties (e.g., multiple sequences, temporal shifting, rescaling, and compositionality), while still accounting for several behavioral and neurophysiological empirical observations. Finally, we apply this ACDC network to show how it can learn the famous “Thunderstruck” song intro and then flexibly play it in a “bossa nova” rhythm without further training.

How do humans flexibly adapt action sequences? For instance, musicians can learn a song and quickly speed up or slow down the tempo, or even play the song following a completely different rhythm (e.g., a rock song using a bossa nova rhythm). In this work, we build a biologically plausible network of cortico-basal ganglia interactions that explains how this temporal flexibility may emerge in the brain. Crucially, our model factorizes sequence order and action timing, respectively represented in cortical and basal ganglia dynamics. This factorization allows full temporal flexibility, i.e. the timing of a learned action sequence can be recomposed without interfering with the order of the sequence. As such, our model is capable of learning asynchronous action sequences, and flexibly shift, rescale, and recompose them, while accounting for biological data.

Metastable attractors explain the variable timing of stable behavioral action sequences

The timing of self-initiated actions shows large variability even when they are executed in stable, well-learned sequences. Could this mix of reliability and stochasticity arise within the same neural circuit? We trained rats to perform a stereotyped sequence of self-initiated actions and recorded neural ensemble activity in secondary motor cortex (M2), which is known to reflect trial-by-trial action-timing fluctuations. Using hidden Markov models, we established a dictionary between activity patterns and actions. We then showed that metastable attractors, representing activity patterns with a reliable sequential structure and large transition timing variability, could be produced by reciprocally coupling a high-dimensional recurrent network and a low-dimensional feedforward one. Transitions between attractors relied on correlated variability in this mesoscale feedback loop, predicting a specific structure of low-dimensional correlations that were empirically verified in M2 recordings. Our results suggest a novel mesoscale network motif based on correlated variability supporting naturalistic animal behavior.

Associative memory model with arbitrary Hebbian length

Conversion of temporal to spatial correlations in the cortex is one of the most intriguing functions in the brain. The learning at synapses triggering the correlation conversion can take place in a wide integration window, whose influence on the correlation conversion remains elusive. Here we propose a generalized associative memory model of pattern sequences, in which pattern separations within an arbitrary Hebbian length are learned. The model can be analytically solved, and predicts that a small Hebbian length can already significantly enhance the correlation conversion, i.e., the stimulus-induced attractor can be highly correlated with a significant number of patterns in the stored sequence, thereby facilitating state transitions in the neural representation space. Moreover, an anti-Hebbian component is able to reshape the energy landscape of memories, akin to the memory regulation function during sleep. Our work thus establishes the fundamental connection between associative memory, Hebbian length, and correlation conversion in the brain.

Statistical learning of unbalanced exclusive-or temporal sequences in humans

A pervasive issue in statistical learning has been to determine the parameters of regularity extraction. Our hypothesis was that the extraction of transitional probabilities can prevail over frequency if the task involves prediction. Participants were exposed to four repeated sequences of three stimuli (XYZ) with each stimulus corresponding to the position of a red dot on a touch screen that participants were required to touch sequentially. The temporal and spatial structure of the positions corresponded to a serial version of the exclusive-or (XOR) that allowed testing of the respective effect of frequency and first- and second-order transitional probabilities. The XOR allowed the first-order transitional probability to vary while being not completely related to frequency and to vary while the second-order transitional probability was fixed (p(Z|X, Y) = 1). The findings show that first-order transitional probability prevails over frequency to predict the second stimulus from the first and that it also influences the prediction of the third item despite the presence of second-order transitional probability that could have offered a certain prediction of the third item. These results are particularly informative in light of statistical learning models.

On Language and Thought: Bilingual Experience Influences Semantic Associations

Language can influence cognition in domains as varied as temporal processing, spatial categorization, and color perception (Casasanto & Boroditsky, 2008; Levinson & Wilkins, 2006; Winawer et al., 2007). Here, we provide converging behavioral and neural evidence that bilingual experience can change semantic associations. In Experiment 1, Spanish- and English-speaking bilinguals rated semantically unrelated picture pairs (e.g., cloud-present) as significantly more related in meaning than English monolinguals. Experiment 2 demonstrated that bilinguals who were highly proficient in Spanish and English rated both semantically related (e.g., student-teacher) and unrelated picture pairs (e.g., wall-fruit) as more related than monolinguals and low-proficiency bilinguals. Experiment 3 added ERP measures to provide a more sensitive test of the bilingual effect on semantic ratings, which was assessed through the use of linguistic stimuli (related and unrelated words instead of pictures) and a different bilingual population (Korean-English bilinguals). Bilingualism was associated with a significantly smaller N400 effect (i.e., N400 for unrelated - related), suggesting that bilinguals processed related and unrelated pairs more similarly than monolinguals; this result was coupled with a non-significant behavioral trend of bilinguals judging unrelated words as more related than monolinguals did. Across the three experiments, results show that bilingual experience can influence perceived semantic associations. We propose that bilinguals' denser and more interconnected phonological, orthographic and lexical systems may change the links between semantic concepts. Such an account is consistent with connectionist models of language that allow for phonological and lexical influences on conceptual representations, with implications for models of bilingual language processing.

Neuronal mechanisms for sequential activation of memory items: Dynamics and reliability

In this article we present a biologically inspired model of activation of memory items in a sequence. Our model produces two types of sequences, corresponding to two different types of cerebral functions: activation of regular or irregular sequences. The switch between the two types of activation occurs through the modulation of biological parameters, without altering the connectivity matrix. Some of the parameters included in our model are neuronal gain, strength of inhibition, synaptic depression and noise. We investigate how these parameters enable the existence of sequences and influence the type of sequences observed. In particular we show that synaptic depression and noise drive the transitions from one memory item to the next and neuronal gain controls the switching between regular and irregular (random) activation.

Unsupervised Learning of Persistent and Sequential Activity

Two strikingly distinct types of activity have been observed in various brain structures during delay periods of delayed response tasks: Persistent activity (PA), in which a sub-population of neurons maintains an elevated firing rate throughout an entire delay period; and Sequential activity (SA), in which sub-populations of neurons are activated sequentially in time. It has been hypothesized that both types of dynamics can be “learned” by the relevant networks from the statistics of their inputs, thanks to mechanisms of synaptic plasticity. However, the necessary conditions for a synaptic plasticity rule and input statistics to learn these two types of dynamics in a stable fashion are still unclear. In particular, it is unclear whether a single learning rule is able to learn both types of activity patterns, depending on the statistics of the inputs driving the network. Here, we first characterize the complete bifurcation diagram of a firing rate model of multiple excitatory populations with an inhibitory mechanism, as a function of the parameters characterizing its connectivity. We then investigate how an unsupervised temporally asymmetric Hebbian plasticity rule shapes the dynamics of the network. Consistent with previous studies, we find that for stable learning of PA and SA, an additional stabilization mechanism is necessary. We show that a generalized version of the standard multiplicative homeostatic plasticity (Renart et al., 2003; Toyoizumi et al., 2014) stabilizes learning by effectively masking excitatory connections during stimulation and unmasking those connections during retrieval. Using the bifurcation diagram derived for fixed connectivity, we study analytically the temporal evolution and the steady state of the learned recurrent architecture as a function of parameters characterizing the external inputs. Slow changing stimuli lead to PA, while fast changing stimuli lead to SA. Our network model shows how a network with plastic synapses can stably and flexibly learn PA and SA in an unsupervised manner.

A Temporal Signal-Processing Circuit Based on Spiking Neuron and Synaptic Learning

Time is a continuous, homogeneous, one-way, and independent signal that cannot be modified by human will. The mechanism of how the brain processes temporal information remains elusive. According to previous work, time-keeping in medial premotor cortex (MPC) is governed by four kinds of ramp cell populations (Merchant et al., 2011). We believe that these cell populations participate in temporal information processing in MPC. Hence, in this the present study, we present a model that uses spiking neuron, including these cell populations, to construct a complete circuit for temporal processing. By combining the time-adaptive drift-diffusion model (TDDM) with the transmission of impulse information between neurons, this new model is able to successfully reproduce the result of synchronization-continuation tapping task (SCT). We also discovered that the neurons that we used exhibited some of the firing properties of time-related neurons detected by electrophysiological experiments in other studies. Therefore, we believe that our model reflects many of the physiological of neural circuits in the biological brain and can explain some of the phenomena in the temporal-perception process.

Spatiotemporal discrimination in attractor networks with short-term synaptic plasticity

We demonstrate that a randomly connected attractor network with dynamic synapses can discriminate between similar sequences containing multiple stimuli suggesting such networks provide a general basis for neural computations in the brain. The network contains units representing assemblies of pools of neurons, with preferentially strong recurrent excitatory connections rendering each unit bi-stable. Weak interactions between units leads to a multiplicity of attractor states, within which information can persist beyond stimulus offset. When a new stimulus arrives, the prior state of the network impacts the encoding of the incoming information, with short-term synaptic depression ensuring an itinerancy between sets of active units. We assess the ability of such a network to encode the identity of sequences of stimuli, so as to provide a template for sequence recall, or decisions based on accumulation of evidence. Across a range of parameters, such networks produce the primacy (better final encoding of the earliest stimuli) and recency (better final encoding of the latest stimuli) observed in human recall data and can retain the information needed to make a binary choice based on total number of presentations of a specific stimulus. Similarities and differences in the final states of the network produced by different sequences lead to predictions of specific errors that could arise when an animal or human subject generalizes from training data, when the training data comprises a subset of the entire stimulus repertoire. We suggest that such networks can provide the general purpose computational engines needed for us to solve many cognitive tasks.

Distinct Dynamics of Striatal and Prefrontal Neural Activity During Temporal Discrimination

The frontal cortex-basal ganglia circuit plays an important role in interval timing. We examined neuronal discharges in the dorsomedial and dorsolateral striatum (DMS and DLS) in rats performing a temporal categorization task and compared them with previously recorded neuronal activity in the medial prefrontal cortex (mPFC). All three structures conveyed significant temporal information, but striatal neurons seldom showed the prolonged, full-interval spanning ramping activity frequently observed in the mPFC. Instead, the majority fired briefly during sample intervals. Also, the precision of neural time decoding became progressively worse with increasing time duration in the mPFC, but not in the striatum. With the caveat that mPFC and striatal units were recorded from different animals, our results suggest that the striatum and mPFC convey temporal information via distinct neural processes.

Learning the meaning of new stimuli increases the cross-correlated activity of prefrontal neurons

The prefrontal cortex (PF) has a key role in learning rules and generating associations between stimuli and responses also called conditional motor learning. Previous studies in PF have examined conditional motor learning at the single cell level but not the correlation of discharges between neurons at the ensemble level. In the present study, we recorded from two rhesus monkeys in the dorsolateral and the mediolateral parts of the prefrontal cortex to address the role of correlated firing of simultaneously recorded pairs during conditional motor learning. We trained two rhesus monkeys to associate three stimuli with three response targets, such that each stimulus was mapped to only one response. We recorded the neuronal activity of the same neuron pairs during learning of new associations and with already learned associations. In these tasks after a period of fixation, a visual instruction stimulus appeared centrally and three potential response targets appeared in three positions: right, left, and up from center. We found a higher number of neuron pairs significantly correlated and higher cross-correlation coefficients during stimulus presentation in the new than in the familiar mapping task. These results demonstrate that learning affects the PF neural correlation structure.

Brain mechanisms of visual long-term memory retrieval in primates

Memorizing events or objects and retrieving them from memory are essential for daily life. Historically, memory processing was studied in neuropsychology, in which patients provided us with insights into the brain mechanisms underlying memory. Psychological hypotheses about memory processing have been further investigated using neuroscience techniques, such as functional imaging and electrophysiology. In this article, I briefly summarize recent findings on multi-scale neural circuitry for memory at the scale of single neurons and cortical layers as well as inter-area and whole-brain interactions. The key idea which connects multi-scale neural circuits is how neuronal assemblies utilize the frequency of communication between neurons, cortical layers, and brain areas. Using findings and ideas from other cognitive function studies, I discuss the plausible communication between neurons involved in memory.

Learning to Generate Sequences with Combination of Hebbian and Non-hebbian Plasticity in Recurrent Spiking Neural Networks

Synaptic Plasticity, the foundation for learning and memory formation in the human brain, manifests in various forms. Here, we combine the standard spike timing correlation based Hebbian plasticity with a non-Hebbian synaptic decay mechanism for training a recurrent spiking neural model to generate sequences. We show that inclusion of the adaptive decay of synaptic weights with standard STDP helps learn stable contextual dependencies between temporal sequences, while reducing the strong attractor states that emerge in recurrent models due to feedback loops. Furthermore, we show that the combined learning scheme suppresses the chaotic activity in the recurrent model substantially, thereby enhancing its' ability to generate sequences consistently even in the presence of perturbations.

Latching dynamics in neural networks with synaptic depression

Prediction is the ability of the brain to quickly activate a target concept in response to a related stimulus (prime). Experiments point to the existence of an overlap between the populations of the neurons coding for different stimuli, and other experiments show that prime-target relations arise in the process of long term memory formation. The classical modelling paradigm is that long term memories correspond to stable steady states of a Hopfield network with Hebbian connectivity. Experiments show that short term synaptic depression plays an important role in the processing of memories. This leads naturally to a computational model of priming, called latching dynamics; a stable state (prime) can become unstable and the system may converge to another transiently stable steady state (target). Hopfield network models of latching dynamics have been studied by means of numerical simulation, however the conditions for the existence of this dynamics have not been elucidated. In this work we use a combination of analytic and numerical approaches to confirm that latching dynamics can exist in the context of a symmetric Hebbian learning rule, however lacks robustness and imposes a number of biologically unrealistic restrictions on the model. In particular our work shows that the symmetry of the Hebbian rule is not an obstruction to the existence of latching dynamics, however fine tuning of the parameters of the model is needed.

Semantic integration by pattern priming: experiment and cortical network model

Neural network models describe semantic priming effects by way of mechanisms of activation of neurons coding for words that rely strongly on synaptic efficacies between pairs of neurons. Biologically inspired Hebbian learning defines efficacy values as a function of the activity of pre- and post-synaptic neurons only. It generates only pair associations between words in the semantic network. However, the statistical analysis of large text databases points to the frequent occurrence not only of pairs of words (e.g., "the way") but also of patterns of more than two words (e.g., "by the way"). The learning of these frequent patterns of words is not reducible to associations between pairs of words but must take into account the higher level of coding of three-word patterns. The processing and learning of pattern of words challenges classical Hebbian learning algorithms used in biologically inspired models of priming. The aim of the present study was to test the effects of patterns on the semantic processing of words and to investigate how an inter-synaptic learning algorithm succeeds at reproducing the experimental data. The experiment manipulates the frequency of occurrence of patterns of three words in a multiple-paradigm protocol. Results show for the first time that target words benefit more priming when embedded in a pattern with the two primes than when only associated with each prime in pairs. A biologically inspired inter-synaptic learning algorithm is tested that potentiates synapses as a function of the activation of more than two pre- and post-synaptic neurons. Simulations show that the network can learn patterns of three words to reproduce the experimental results.

Spontaneous emergence of fast attractor dynamics in a model of developing primary visual cortex

Recent evidence suggests that neurons in primary sensory cortex arrange into competitive groups, representing stimuli by their joint activity rather than as independent feature analysers. A possible explanation for these results is that sensory cortex implements attractor dynamics, although this proposal remains controversial. Here we report that fast attractor dynamics emerge naturally in a computational model of a patch of primary visual cortex endowed with realistic plasticity (at both feedforward and lateral synapses) and mutual inhibition. When exposed to natural images (but not random pixels), the model spontaneously arranges into competitive groups of reciprocally connected, similarly tuned neurons, while developing realistic, orientation-selective receptive fields. Importantly, the same groups are observed in both stimulus-evoked and spontaneous (stimulus-absent) activity. The resulting network is inhibition-stabilized and exhibits fast, non-persistent attractor dynamics. Our results suggest that realistic plasticity, mutual inhibition and natural stimuli are jointly necessary and sufficient to generate attractor dynamics in primary sensory cortex.

Sensory cortices represent stimuli through joint activity of competing neuronal assemblies. Here the authors show that a model of visual cortex with plastic feedforward and recurrent synapses, exposed to natural images, spontaneously develops attractor dynamics between groups of similarly tuned neurons.

On the relationship between persistent delay activity, repetition enhancement and priming

Human efficiency in processing incoming stimuli (in terms of speed and/or accuracy) is typically enhanced by previous exposure to the same, or closely related stimuli—a phenomenon referred to as priming. In spite of the large body of knowledge accumulated in behavioral studies about the conditions conducive to priming, and its relationship with other forms of memory, the underlying neuronal correlates of priming are still under debate. The idea has repeatedly been advanced that a major neuronal mechanism supporting behaviorally-expressed priming is repetition suppression, a widespread reduction of spiking activity upon stimulus repetition which has been routinely exposed by single-unit recordings in non-human primates performing delayed-response, as well as passive fixation tasks. This proposal is mainly motivated by the observation that, in human fMRI studies, priming is associated to a significant reduction of the BOLD signal (widely interpreted as a proxy of the level of spiking activity) upon stimulus repetition. Here, we critically re-examine a large part of the electrophysiological literature on repetition suppression in non-human primates and find that repetition suppression is systematically accompanied by stimulus-selective delay period activity, together with repetition enhancement, an increase of spiking activity upon stimulus repetition in small neuronal populations. We argue that repetition enhancement constitutes a more viable candidate for a putative neuronal substrate of priming, and propose a minimal framework that links together, mechanistically and functionally, repetition suppression, stimulus-selective delay activity and repetition enhancement.

Synchronization patterns suggest different functional organization in parietal reach region and dorsal premotor cortex

The parietal reach region (PRR) and dorsal premotor cortex (PMd) form part of the fronto-parietal reach network. While neural selectivity profiles of single-cell activity in these areas can be remarkably similar, other data suggest that both areas serve different computational functions in visually guided reaching. Here we test the hypothesis that different neural functional organizations characterized by different neural synchronization patterns might be underlying the putatively different functional roles. We use cross-correlation analysis on single-unit activity (SUA) and multiunit activity (MUA) to determine the prevalence of synchronized neural ensembles within each area. First, we reliably find synchronization in PRR but not in PMd. Second, we demonstrate that synchronization in PRR is present in different cognitive states, including "idle" states prior to task-relevant instructions and without neural tuning. Third, we show that local field potentials (LFPs) in PRR but not PMd are characterized by an increased power and spike field coherence in the beta frequency range (12-30 Hz), further indicating stronger synchrony in PRR compared with PMd. Finally, we show that neurons with similar tuning properties tend to be correlated in their random spike rate fluctuations in PRR but not in PMd. Our data support the idea that PRR and PMd, despite striking similarity in single-cell tuning properties, are characterized by unequal local functional organization, which likely reflects different network architectures to support different functional roles within the fronto-parietal reach network.

Inter-synaptic learning of combination rules in a cortical network model

Selecting responses in working memory while processing combinations of stimuli depends strongly on their relations stored in long-term memory. However, the learning of XOR-like combinations of stimuli and responses according to complex rules raises the issue of the non-linear separability of the responses within the space of stimuli. One proposed solution is to add neurons that perform a stage of non-linear processing between the stimuli and responses, at the cost of increasing the network size. Based on the non-linear integration of synaptic inputs within dendritic compartments, we propose here an inter-synaptic (IS) learning algorithm that determines the probability of potentiating/depressing each synapse as a function of the co-activity of the other synapses within the same dendrite. The IS learning is effective with random connectivity and without either a priori wiring or additional neurons. Our results show that IS learning generates efficacy values that are sufficient for the processing of XOR-like combinations, on the basis of the sole correlational structure of the stimuli and responses. We analyze the types of dendrites involved in terms of the number of synapses from pre-synaptic neurons coding for the stimuli and responses. The synaptic efficacy values obtained show that different dendrites specialize in the detection of different combinations of stimuli. The resulting behavior of the cortical network model is analyzed as a function of inter-synaptic vs. Hebbian learning. Combinatorial priming effects show that the retrospective activity of neurons coding for the stimuli trigger XOR-like combination-selective prospective activity of neurons coding for the expected response. The synergistic effects of inter-synaptic learning and of mixed-coding neurons are simulated. The results show that, although each mechanism is sufficient by itself, their combined effects improve the performance of the network.

Heterogeneous attractor cell assemblies for motor planning in premotor cortex

Cognitive functions like motor planning rely on the concerted activity of multiple neuronal assemblies underlying still elusive computational strategies. During reaching tasks, we observed stereotyped sudden transitions (STs) between low and high multiunit activity of monkey dorsal premotor cortex (PMd) predicting forthcoming actions on a single-trial basis. Occurrence of STs was observed even when movement was delayed or successfully canceled after a stop signal, excluding a mere substrate of the motor execution. An attractor model accounts for upward STs and high-frequency modulations of field potentials, indicative of local synaptic reverberation. We found in vivo compelling evidence that motor plans in PMd emerge from the coactivation of such attractor modules, heterogeneous in the strength of local synaptic self-excitation. Modules with strong coupling early reacted with variable times to weak inputs, priming a chain reaction of both upward and downward STs in other modules. Such web of "flip-flops" rapidly converged to a stereotyped distributed representation of the motor program, as prescribed by the long-standing theory of associative networks.

Synaptic encoding of temporal contiguity

Often we need to perform tasks in an environment that changes stochastically. In these situations it is important to learn the statistics of sequences of events in order to predict the future and the outcome of our actions. The statistical description of many of these sequences can be reduced to the set of probabilities that a particular event follows another event (temporal contiguity). Under these conditions, it is important to encode and store in our memory these transition probabilities. Here we show that for a large class of synaptic plasticity models, the distribution of synaptic strengths encodes transitions probabilities. Specifically, when the synaptic dynamics depend on pairs of contiguous events and the synapses can remember multiple instances of the transitions, then the average synaptic weights are a monotonic function of the transition probabilities. The synaptic weights converge to the distribution encoding the probabilities also when the correlations between consecutive synaptic modifications are considered. We studied how this distribution depends on the number of synaptic states for a specific model of a multi-state synapse with hard bounds. In the case of bistable synapses, the average synaptic weights are a smooth function of the transition probabilities and the accuracy of the encoding depends on the learning rate. As the number of synaptic states increases, the average synaptic weights become a step function of the transition probabilities. We finally show that the information stored in the synaptic weights can be read out by a simple rate-based neural network. Our study shows that synapses encode transition probabilities under general assumptions and this indicates that temporal contiguity is likely to be encoded and harnessed in almost every neural circuit in the brain.

Synaptic potentiation facilitates memory-like attractor dynamics in cultured in vitro hippocampal networks

Collective rhythmic dynamics from neurons is vital for cognitive functions such as memory formation but how neurons self-organize to produce such activity is not well understood. Attractor-based computational models have been successfully implemented as a theoretical framework for memory storage in networks of neurons. Additionally, activity-dependent modification of synaptic transmission is thought to be the physiological basis of learning and memory. The goal of this study is to demonstrate that using a pharmacological treatment that has been shown to increase synaptic strength within in vitro networks of hippocampal neurons follows the dynamical postulates theorized by attractor models. We use a grid of extracellular electrodes to study changes in network activity after this perturbation and show that there is a persistent increase in overall spiking and bursting activity after treatment. This increase in activity appears to recruit more “errant” spikes into bursts. Phase plots indicate a conserved activity pattern suggesting that a synaptic potentiation perturbation to the attractor leaves it unchanged. Lastly, we construct a computational model to demonstrate that these synaptic perturbations can account for the dynamical changes seen within the network.

Biased associative representations in parietal cortex

Neurons in cortical sensory areas respond selectively to sensory stimuli, and the preferred stimulus typically varies among neurons so as to continuously span the sensory space. However, some neurons reflect sensory features that are learned or task dependent. For example, neurons in the lateral intraparietal area (LIP) reflect learned associations between visual stimuli. One might expect that roughly even numbers of LIP neurons would prefer each set of associated stimuli. However, in two associative learning experiments and a perceptual decision experiment, we found striking asymmetries: nearly all neurons recorded from an animal had a similar order of preference among associated stimuli. Behavioral factors could not account for these neuronal biases. A recent computational study proposed that population-firing patterns in parietal cortex have one-dimensional dynamics on long timescales, a possible consequence of recurrent connections that could drive persistent activity. One-dimensional dynamics would predict the biases in selectivity that we observed.

Early dynamics of the semantic priming shift

Semantic processing of sequences of words requires the cognitive system to keep several word meanings simultaneously activated in working memory with limited capacity. The real- time updating of the sequence of word meanings relies on dynamic changes in the associates to the words that are activated. Protocols involving two sequential primes report a semantic priming shift from larger priming of associates to the first prime to larger priming of associates to the second prime, in a range of long SOAs (stimulus-onset asynchronies) between the second prime and the target. However, the possibility for an early semantic priming shift is still to be tested, and its dynamics as a function of association strength remain unknown. Three multiple priming experiments are proposed that cross-manipulate association strength between each of two successive primes and a target, for different values of short SOAs and prime durations. Results show an early priming shift ranging from priming of associates to the first prime only to priming of strong associates to the first prime and all of the associates to the second prime. We investigated the neural basis of the early priming shift by using a network model of spike frequency adaptive cortical neurons (e.g., Deco & Rolls, 2005), able to code different association strengths between the primes and the target. The cortical network model provides a description of the early dynamics of the priming shift in terms of pro-active and retro-active interferences within populations of excitatory neurons regulated by fast and unselective inhibitory feedback.

Combined effects of LTP/LTD and synaptic scaling in formation of discrete and line attractors with persistent activity from non-trivial baseline

In this article, we analyze combined effects of LTP/LTD and synaptic scaling and study the creation of persistent activity from a periodic or chaotic baseline attractor. The bifurcations leading to the creation of new attractors have been detailed; this was achieved using a mean field approximation. Attractors encoding persistent activity can notably appear via generalized period-doubling bifurcations, tangent bifurcations of the second iterates or boundary crises, after which the basins of attraction become irregular. Synaptic scaling is shown to maintain the coexistence of a state of persistent activity and the baseline. According to the rate of change of the external inputs, different types of attractors can be formed: line attractors for rapidly changing external inputs and discrete attractors for constant external inputs.

Population-wide distributions of neural activity during perceptual decision-making

Cortical activity involves large populations of neurons, even when it is limited to functionally coherent areas. Electrophysiological recordings, on the other hand, involve comparatively small neural ensembles, even when modern-day techniques are used. Here we review results which have started to fill the gap between these two scales of inquiry, by shedding light on the statistical distributions of activity in large populations of cells. We put our main focus on data recorded in awake animals that perform simple decision-making tasks and consider statistical distributions of activity throughout cortex, across sensory, associative, and motor areas. We transversally review the complexity of these distributions, from distributions of firing rates and metrics of spike-train structure, through distributions of tuning to stimuli or actions and of choice signals, and finally the dynamical evolution of neural population activity and the distributions of (pairwise) neural interactions. This approach reveals shared patterns of statistical organization across cortex, including: (i) long-tailed distributions of activity, where quasi-silence seems to be the rule for a majority of neurons; that are barely distinguishable between spontaneous and active states; (ii) distributions of tuning parameters for sensory (and motor) variables, which show an extensive extrapolation and fragmentation of their representations in the periphery; and (iii) population-wide dynamics that reveal rotations of internal representations over time, whose traces can be found both in stimulus-driven and internally generated activity. We discuss how these insights are leading us away from the notion of discrete classes of cells, and are acting as powerful constraints on theories and models of cortical organization and population coding.

Stress-induced impairment of a working memory task: role of spiking rate and spiking history predicted discharge

Stress, pervasive in society, contributes to over half of all work place accidents a year and over time can contribute to a variety of psychiatric disorders including depression, schizophrenia, and post-traumatic stress disorder. Stress impairs higher cognitive processes, dependent on the prefrontal cortex (PFC) and that involve maintenance and integration of information over extended periods, including working memory and attention. Substantial evidence has demonstrated a relationship between patterns of PFC neuron spiking activity (action-potential discharge) and components of delayed-response tasks used to probe PFC-dependent cognitive function in rats and monkeys. During delay periods of these tasks, persistent spiking activity is posited to be essential for the maintenance of information for working memory and attention. However, the degree to which stress-induced impairment in PFC-dependent cognition involves changes in task-related spiking rates or the ability for PFC neurons to retain information over time remains unknown. In the current study, spiking activity was recorded from the medial PFC of rats performing a delayed-response task of working memory during acute noise stress (93 db). Spike history-predicted discharge (SHPD) for PFC neurons was quantified as a measure of the degree to which ongoing neuronal discharge can be predicted by past spiking activity and reflects the degree to which past information is retained by these neurons over time. We found that PFC neuron discharge is predicted by their past spiking patterns for nearly one second. Acute stress impaired SHPD, selectively during delay intervals of the task, and simultaneously impaired task performance. Despite the reduction in delay-related SHPD, stress increased delay-related spiking rates. These findings suggest that neural codes utilizing SHPD within PFC networks likely reflects an additional important neurophysiological mechanism for maintenance of past information over time. Stress-related impairment of this mechanism is posited to contribute to the cognition-impairing actions of stress.

Dynamics of the semantic priming shift: behavioral experiments and cortical network model

Multiple semantic priming processes between several related and/or unrelated words are at work during the processing of sequences of words. Multiple priming generates rich dynamics of effects depending on the relationship between the target word and the first and/or second prime previously presented. The experimental literature suggests that during the on-line processing of the primes, the activation can shift from associates to the first prime to associates to the second prime. Though the semantic priming shift is central to the on-line and rapid updating of word meanings in the working memory, its precise dynamics are still poorly understood and it is still a challenge to model how it functions in the cerebral cortex. Four multiple priming experiments are proposed that cross-manipulate delays and association strength between the primes and the target. Results show for the first time that association strength determines complex dynamics of the semantic priming shift, ranging from an absence of a shift to a complete shift. A cortical network model of spike frequency adaptive neuron populations is proposed to account for the non-continuous evolution of the priming shift over time. It allows linking the dynamics of the priming shift assessed at the behavioral level to the non-linear dynamics of the firing rates of neurons populations.

Robust Working Memory in an Asynchronously Spiking Neural Network Realized with Neuromorphic VLSI

We demonstrate bistable attractor dynamics in a spiking neural network implemented with neuromorphic VLSI hardware. The on-chip network consists of three interacting populations (two excitatory, one inhibitory) of leaky integrate-and-fire (LIF) neurons. One excitatory population is distinguished by strong synaptic self-excitation, which sustains meta-stable states of “high” and “low”-firing activity. Depending on the overall excitability, transitions to the “high” state may be evoked by external stimulation, or may occur spontaneously due to random activity fluctuations. In the former case, the “high” state retains a “working memory” of a stimulus until well after its release. In the latter case, “high” states remain stable for seconds, three orders of magnitude longer than the largest time-scale implemented in the circuitry. Evoked and spontaneous transitions form a continuum and may exhibit a wide range of latencies, depending on the strength of external stimulation and of recurrent synaptic excitation. In addition, we investigated “corrupted” “high” states comprising neurons of both excitatory populations. Within a “basin of attraction,” the network dynamics “corrects” such states and re-establishes the prototypical “high” state. We conclude that, with effective theoretical guidance, full-fledged attractor dynamics can be realized with comparatively small populations of neuromorphic hardware neurons.

Representational switching by dynamical reorganization of attractor structure in a network model of the prefrontal cortex

The prefrontal cortex (PFC) plays a crucial role in flexible cognitive behavior by representing task relevant information with its working memory. The working memory with sustained neural activity is described as a neural dynamical system composed of multiple attractors, each attractor of which corresponds to an active state of a cell assembly, representing a fragment of information. Recent studies have revealed that the PFC not only represents multiple sets of information but also switches multiple representations and transforms a set of information to another set depending on a given task context. This representational switching between different sets of information is possibly generated endogenously by flexible network dynamics but details of underlying mechanisms are unclear. Here we propose a dynamically reorganizable attractor network model based on certain internal changes in synaptic connectivity, or short-term plasticity. We construct a network model based on a spiking neuron model with dynamical synapses, which can qualitatively reproduce experimentally demonstrated representational switching in the PFC when a monkey was performing a goal-oriented action-planning task. The model holds multiple sets of information that are required for action planning before and after representational switching by reconfiguration of functional cell assemblies. Furthermore, we analyzed population dynamics of this model with a mean field model and show that the changes in cell assemblies' configuration correspond to those in attractor structure that can be viewed as a bifurcation process of the dynamical system. This dynamical reorganization of a neural network could be a key to uncovering the mechanism of flexible information processing in the PFC.

The prefrontal cortex plays a highly flexible role in various cognitive tasks e.g., decision making and action planning. Neurons in the prefrontal cortex exhibit flexible representation or selectivity for task relevant information and are involved in working memory with sustained activity, which can be modeled as attractor dynamics. Moreover, recent experiments revealed that prefrontal neurons not only represent parametric or discrete sets of information but also switch the representation and transform a set of information to another set in order to match the context of the required task. However, underlying mechanisms of this flexible representational switching are unknown. Here we propose a dynamically reorganizable attractor network model in which short-term modulation of the synaptic connections reconfigures the structure of neural attractors by assembly and disassembly of a network of cells to produce flexible attractor dynamics. On the basis of computer simulation as well as theoretical analysis, we showed that this model reproduced experimentally demonstrated representational switching, and that switching on certain characteristic axes defining neural dynamics well describes the essence of the representational switching. This model has the potential to provide unique insights about the flexible information representations and processing in the cortical network.

How does the brain rapidly learn and reorganize view-invariant and position-invariant object representations in the inferotemporal cortex?

All primates depend for their survival on being able to rapidly learn about and recognize objects. Objects may be visually detected at multiple positions, sizes, and viewpoints. How does the brain rapidly learn and recognize objects while scanning a scene with eye movements, without causing a combinatorial explosion in the number of cells that are needed? How does the brain avoid the problem of erroneously classifying parts of different objects together at the same or different positions in a visual scene? In monkeys and humans, a key area for such invariant object category learning and recognition is the inferotemporal cortex (IT). A neural model is proposed to explain how spatial and object attention coordinate the ability of IT to learn invariant category representations of objects that are seen at multiple positions, sizes, and viewpoints. The model clarifies how interactions within a hierarchy of processing stages in the visual brain accomplish this. These stages include the retina, lateral geniculate nucleus, and cortical areas V1, V2, V4, and IT in the brain's What cortical stream, as they interact with spatial attention processes within the parietal cortex of the Where cortical stream. The model builds upon the ARTSCAN model, which proposed how view-invariant object representations are generated. The positional ARTSCAN (pARTSCAN) model proposes how the following additional processes in the What cortical processing stream also enable position-invariant object representations to be learned: IT cells with persistent activity, and a combination of normalizing object category competition and a view-to-object learning law which together ensure that unambiguous views have a larger effect on object recognition than ambiguous views. The model explains how such invariant learning can be fooled when monkeys, or other primates, are presented with an object that is swapped with another object during eye movements to foveate the original object. The swapping procedure is predicted to prevent the reset of spatial attention, which would otherwise keep the representations of multiple objects from being combined by learning. Li and DiCarlo (2008) have presented neurophysiological data from monkeys showing how unsupervised natural experience in a target swapping experiment can rapidly alter object representations in IT. The model quantitatively simulates the swapping data by showing how the swapping procedure fools the spatial attention mechanism. More generally, the model provides a unifying framework, and testable predictions in both monkeys and humans, for understanding object learning data using neurophysiological methods in monkeys, and spatial attention, episodic learning, and memory retrieval data using functional imaging methods in humans.

Synaptic plasticity and connectivity requirements to produce stimulus-pair specific responses in recurrent networks of spiking neurons

Animals must respond selectively to specific combinations of salient environmental stimuli in order to survive in complex environments. A task with these features, biconditional discrimination, requires responses to select pairs of stimuli that are opposite to responses to those stimuli in another combination. We investigate the characteristics of synaptic plasticity and network connectivity needed to produce stimulus-pair neural responses within randomly connected model networks of spiking neurons trained in biconditional discrimination. Using reward-based plasticity for synapses from the random associative network onto a winner-takes-all decision-making network representing perceptual decision-making, we find that reliably correct decision making requires upstream neurons with strong stimulus-pair selectivity. By chance, selective neurons were present in initial networks; appropriate plasticity mechanisms improved task performance by enhancing the initial diversity of responses. We find long-term potentiation of inhibition to be the most beneficial plasticity rule by suppressing weak responses to produce reliably correct decisions across an extensive range of networks.

Molecular mechanisms of cognitive and behavioral comorbidities of epilepsy in children

Intellectual and developmental disabilities (IDDs) such as autistic spectrum disorders (ASDs) and epilepsies are heterogeneous disorders that have diverse etiologies and pathophysiologies. The high rate of co-occurrence of these disorders, however, suggests potentially shared underlying mechanisms. A number of well-known genetic disorders share epilepsy, intellectual disability, and autism as prominent phenotypic features, including tuberous sclerosis complex, Rett syndrome, and fragile X syndrome. In addition, mutations of several genes involved in neurodevelopment, including ARX, DCX, neuroligins, and neuropilin 2 have been identified in children with epilepsy, IDDs, ASDs, or a combination of thereof. Finally, in animal models, early life seizures can result in cellular and molecular changes that could contribute to learning and behavioral disabilities. Increased understanding of the common genetic, molecular, and cellular mechanisms of IDDs, ASDs, and epilepsy may provide insight into their underlying pathophysiology and elucidate new therapeutic approaches for these conditions.

Epilepsy and autism spectrum disorders: are there common developmental mechanisms?

Autistic spectrum disorders (ASD) and epilepsies are heterogeneous disorders that have diverse etiologies and pathophysiologies. The high rate of co-occurrence of these disorders suggest potentially shared underlying mechanisms. A number of well-known genetic disorders share epilepsy and autism as prominent phenotypic features, including tuberous sclerosis, Rett syndrome, and fragile X. In addition, mutations of several genes involved in neurodevelopment, including ARX, DCX, neuroligins and neuropilin2 have been identified in children with epilepsy, ASD or often both. Finally, in animal models, early-life seizures can result in cellular and molecular changes that could contribute to learning and behavioral disabilities as seen in ASD. Increased understanding of the common genetic, molecular and cellular mechanisms of ASD and epilepsy may provide insight into their underlying pathophysiology and elucidate new therapeutic approaches of both conditions.

Distinct effects of perceptual quality on auditory word recognition, memory formation and recall in a neural model of sequential memory

Adults with sensory impairment, such as reduced hearing acuity, have impaired ability to recall identifiable words, even when their memory is otherwise normal. We hypothesize that poorer stimulus quality causes weaker activity in neurons responsive to the stimulus and more time to elapse between stimulus onset and identification. The weaker activity and increased delay to stimulus identification reduce the necessary strengthening of connections between neurons active before stimulus presentation and neurons active at the time of stimulus identification. We test our hypothesis through a biologically motivated computational model, which performs item recognition, memory formation and memory retrieval. In our simulations, spiking neurons are distributed into pools representing either items or context, in two separate, but connected winner-takes-all (WTA) networks. We include associative, Hebbian learning, by comparing multiple forms of spike-timing-dependent plasticity (STDP), which strengthen synapses between coactive neurons during stimulus identification. Synaptic strengthening by STDP can be sufficient to reactivate neurons during recall if their activity during a prior stimulus rose strongly and rapidly. We find that a single poor quality stimulus impairs recall of neighboring stimuli as well as the weak stimulus itself. We demonstrate that within the WTA paradigm of word recognition, reactivation of separate, connected sets of non-word, context cells permits reverse recall. Also, only with such coactive context cells, does slowing the rate of stimulus presentation increase recall probability. We conclude that significant temporal overlap of neural activity patterns, absent from individual WTA networks, is necessary to match behavioral data for word recall.

A computational model of Basal Ganglia and its role in memory retrieval in rewarded visual memory tasks

Visual working memory (WM) tasks involve a network of cortical areas such as inferotemporal, medial temporal and prefrontal cortices. We suggest here to investigate the role of the basal ganglia (BG) in the learning of delayed rewarded tasks through the selective gating of thalamocortical loops. We designed a computational model of the visual loop linking the perirhinal cortex, the BG and the thalamus, biased by sustained representations in prefrontal cortex. This model learns concurrently different delayed rewarded tasks that require to maintain a visual cue and to associate it to itself or to another visual object to obtain reward. The retrieval of visual information is achieved through thalamic stimulation of the perirhinal cortex. The input structure of the BG, the striatum, learns to represent visual information based on its association to reward, while the output structure, the substantia nigra pars reticulata, learns to link striatal representations to the disinhibition of the correct thalamocortical loop. In parallel, a dopaminergic cell learns to associate striatal representations to reward and modulates learning of connections within the BG. The model provides testable predictions about the behavior of several areas during such tasks, while providing a new functional organization of learning within the BG, putting emphasis on the learning of the striatonigral connections as well as the lateral connections within the substantia nigra pars reticulata. It suggests that the learning of visual WM tasks is achieved rapidly in the BG and used as a teacher for feedback connections from prefrontal cortex to posterior cortices.

Trace and contextual fear conditioning require neural activity and NMDA receptor-dependent transmission in the medial prefrontal cortex

The contribution of the medial prefrontal cortex (mPFC) to the formation of memory is a subject of considerable recent interest. Notably, the mechanisms supporting memory acquisition in this structure are poorly understood. The mPFC has been implicated in the acquisition of trace fear conditioning, a task that requires the association of a conditional stimulus (CS) and an aversive unconditional stimulus (UCS) across a temporal gap. In both rat and human subjects, frontal regions show increased activity during the trace interval separating the CS and UCS. We investigated the contribution of prefrontal neural activity in the rat to the acquisition of trace fear conditioning using microinfusions of the gamma-aminobutyric acid type A (GABA(A)) receptor agonist muscimol. We also investigated the role of prefrontal N-methyl-d-aspartate (NMDA) receptor-mediated signaling in trace fear conditioning using the NMDA receptor antagonist 2-amino-5-phosphonovaleric acid (APV). Temporary inactivation of prefrontal activity with muscimol or blockade of NMDA receptor-dependent transmission in mPFC impaired the acquisition of trace, but not delay, conditional fear responses. Simultaneously acquired contextual fear responses were also impaired in drug-treated rats exposed to trace or delay, but not unpaired, training protocols. Our results support the idea that synaptic plasticity within the mPFC is critical for the long-term storage of memory in trace fear conditioning.

Determinants of multiple semantic priming: a meta-analysis and spike frequency adaptive model of a cortical network

Recall and language comprehension while processing sequences of words involves multiple semantic priming between several related and/or unrelated words. Accounting for multiple and interacting priming effects in terms of underlying neuronal structure and dynamics is a challenge for current models of semantic priming. Further elaboration of current models requires a quantifiable and reliable account of the simplest case of multiple priming resulting from two primes on a target. The meta-analytic approach offers a better understanding of the experimental data from studies on multiple priming regarding the additivity pattern of priming. The meta-analysis points to the effects of prime-target stimuli onset asynchronies on the pattern of underadditivity, overadditivity, or strict additivity of converging activation from multiple primes. The modeling approach is then constrained by results of the meta-analysis. We propose a model of a cortical network embedding spike frequency adaptation, which allows frequency and time-dependent modulation of neural activity. Model results give a comprehensive understanding of the meta-analysis results in terms of dynamics of neuron populations. They also give predictions regarding how stimuli intensities, association strength, and spike frequency adaptation influence multiple priming effects.

Semantic priming in a cortical network model

Contextual recall in humans relies on the semantic relationships between items stored in memory. These relationships can be probed by priming experiments. Such experiments have revealed a rich phenomenology on how reaction times depend on various factors such as strength and nature of associations, time intervals between stimulus presentations, and so forth. Experimental protocols on humans present striking similarities with pair association task experiments in monkeys. Electrophysiological recordings of cortical neurons in such tasks have found two types of task-related activity, "retrospective" (related to a previously shown stimulus), and "prospective" (related to a stimulus that the monkey expects to appear, due to learned association between both stimuli). Mathematical models of cortical networks allow theorists to understand the link between the physiology of single neurons and synapses, and network behavior giving rise to retrospective and/or prospective activity. Here, we show that this type of network model can account for a large variety of priming effects. Furthermore, the model allows us to interpret semantic priming differences between the two hemispheres as depending on a single association strength parameter.

Attractors and noise: twin drivers of decisions and multistability

Perceptual decisions are made not only during goal-directed behavior such as choice tasks, but also occur spontaneously while multistable stimuli are being viewed. In both contexts, the formation of a perceptual decision is best captured by noisy attractor dynamics. Noise-driven attractor transitions can accommodate a wide range of timescales and a hierarchical arrangement with "nested attractors" harbors even more dynamical possibilities. The attractor framework seems particularly promising for understanding higher-level mental states that combine heterogeneous information from a distributed set of brain areas.

Bistable perception modeled as competing stochastic integrations at two levels

We propose a novel explanation for bistable perception, namely, the collective dynamics of multiple neural populations that are individually meta-stable. Distributed representations of sensory input and of perceptual state build gradually through noise-driven transitions in these populations, until the competition between alternative representations is resolved by a threshold mechanism. The perpetual repetition of this collective race to threshold renders perception bistable. This collective dynamics - which is largely uncoupled from the time-scales that govern individual populations or neurons - explains many hitherto puzzling observations about bistable perception: the wide range of mean alternation rates exhibited by bistable phenomena, the consistent variability of successive dominance periods, and the stabilizing effect of past perceptual states. It also predicts a number of previously unsuspected relationships between observable quantities characterizing bistable perception. We conclude that bistable perception reflects the collective nature of neural decision making rather than properties of individual populations or neurons.

A fluctuation-driven mechanism for slow decision processes in reverberant networks

The spike activity of cells in some cortical areas has been found to be correlated with reaction times and behavioral responses during two-choice decision tasks. These experimental findings have motivated the study of biologically plausible winner-take-all network models, in which strong recurrent excitation and feedback inhibition allow the network to form a categorical choice upon stimulation. Choice formation corresponds in these models to the transition from the spontaneous state of the network to a state where neurons selective for one of the choices fire at a high rate and inhibit the activity of the other neurons. This transition has been traditionally induced by an increase in the external input that destabilizes the spontaneous state of the network and forces its relaxation to a decision state. Here we explore a different mechanism by which the system can undergo such transitions while keeping the spontaneous state stable, based on an escape induced by finite-size noise from the spontaneous state. This decision mechanism naturally arises for low stimulus strengths and leads to exponentially distributed decision times when the amount of noise in the system is small. Furthermore, we show using numerical simulations that mean decision times follow in this regime an exponential dependence on the amplitude of noise. The escape mechanism provides thus a dynamical basis for the wide range and variability of decision times observed experimentally.

Universal memory mechanism for familiarity recognition and identification

Macaque monkeys were tested on a delayed-match-to-multiple-sample task, with either a limited set of well trained images (in randomized sequence) or with never-before-seen images. They performed much better with novel images. False positives were mostly limited to catch-trial image repetitions from the preceding trial. This result implies extremely effective one-shot learning, resembling Standing's finding that people detect familiarity for 10,000 once-seen pictures (with 80% accuracy) (Standing, 1973). Familiarity memory may differ essentially from identification, which embeds and generates contextual information. When encountering another person, we can say immediately whether his or her face is familiar. However, it may be difficult for us to identify the same person. To accompany the psychophysical findings, we present a generic neural network model reproducing these behaviors, based on the same conservative Hebbian synaptic plasticity that generates delay activity identification memory. Familiarity becomes the first step toward establishing identification. Adding an inter-trial reset mechanism limits false positives for previous-trial images. The model, unlike previous proposals, relates repetition-recognition with enhanced neural activity, as recently observed experimentally in 92% of differential cells in prefrontal cortex, an area directly involved in familiarity recognition. There may be an essential functional difference between enhanced responses to novel versus to familiar images: The maximal signal from temporal cortex is for novel stimuli, facilitating additional sensory processing of newly acquired stimuli. The maximal signal for familiar stimuli arising in prefrontal cortex facilitates the formation of selective delay activity, as well as additional consolidation of the memory of the image in an upstream cortical module.