Deciphering the hippocampal polyglot: the hippocampus as a path integration system

New and distinct hippocampal place codes are generated in a new environment during septal inactivation

The hippocampus generates distinct neural codes to disambiguate similar experiences, a process thought to underlie episodic memory function. Entorhinal grid cells provide a prominent spatial signal to hippocampus, and changes in their firing pattern could thus generate a distinct spatial code in each context. We examined whether we would preclude the emergence of new spatial representations in a novel environment during muscimol inactivation of the medial septal area, a manipulation known to disrupt theta oscillations and grid cell firing. We found that new, highly distinct configurations of place fields emerged immediately and remained stable during the septal inactivation. The new place code persisted when theta oscillations had recovered. Theta rhythmicity and feedforward input from grid cell networks were thus not required to generate new spatial representations in the hippocampus.

Spatial representations of place cells in darkness are supported by path integration and border information

Effective spatial navigation is enabled by reliable reference cues that derive from sensory information from the external environment, as well as from internal sources such as the vestibular system. The integration of information from these sources enables dead reckoning in the form of path integration. Navigation in the dark is associated with the accumulation of errors in terms of perception of allocentric position and this may relate to error accumulation in path integration. We assessed this by recording from place cells in the dark under circumstances where spatial sensory cues were suppressed. Spatial information content, spatial coherence, place field size, and peak and infield firing rates decreased whereas sparsity increased following exploration in the dark compared to the light. Nonetheless it was observed that place field stability in darkness was sustained by border information in a subset of place cells. To examine the impact of encountering the environment’s border on navigation, we analyzed the trajectory and spiking data gathered during navigation in the dark. Our data suggest that although error accumulation in path integration drives place field drift in darkness, under circumstances where border contact is possible, this information is integrated to enable retention of spatial representations.

Grid cells and cortical representation

One of the grand challenges in neuroscience is to comprehend neural computation in the association cortices, the parts of the cortex that have shown the largest expansion and differentiation during mammalian evolution and that are thought to contribute profoundly to the emergence of advanced cognition in humans. In this Review, we use grid cells in the medial entorhinal cortex as a gateway to understand network computation at a stage of cortical processing in which firing patterns are shaped not primarily by incoming sensory signals but to a large extent by the intrinsic properties of the local circuit.

Are new place representations independent of theta and path integration?

Brandon et al. (2014) show that the formation of place cell representations in new environments is preserved under septal inactivation, and is thus likely independent of the hippocampal theta rhythm and, by implication, the firing of entorhinal grid cells and the process of path integration.

Bayesian integration of information in hippocampal place cells

Accurate spatial localization requires a mechanism that corrects for errors, which might arise from inaccurate sensory information or neuronal noise. In this paper, we propose that Hippocampal place cells might implement such an error correction mechanism by integrating different sources of information in an approximately Bayes-optimal fashion. We compare the predictions of our model with physiological data from rats. Our results suggest that useful predictions regarding the firing fields of place cells can be made based on a single underlying principle, Bayesian cue integration, and that such predictions are possible using a remarkably small number of model parameters.

Crosstalk and transitions between multiple spatial maps in an attractor neural network model of the hippocampus: collective motion of the activity

The dynamics of a neural model for hippocampal place cells storing spatial maps is studied. In the absence of external input, depending on the number of cells and on the values of control parameters (number of environments stored, level of neural noise, average level of activity, connectivity of place cells), a "clump" of spatially localized activity can diffuse or remains pinned due to crosstalk between the environments. In the single-environment case, the macroscopic coefficient of diffusion of the clump and its effective mobility are calculated analytically from first principles and corroborated by numerical simulations. In the multienvironment case the heights and the widths of the pinning barriers are analytically characterized with the replica method; diffusion within one map is then in competition with transitions between different maps. Possible mechanisms enhancing mobility are proposed and tested.

Space in the brain: how the hippocampal formation supports spatial cognition

Over the past four decades, research has revealed that cells in the hippocampal formation provide an exquisitely detailed representation of an animal's current location and heading. These findings have provided the foundations for a growing understanding of the mechanisms of spatial cognition in mammals, including humans. We describe the key properties of the major categories of spatial cells: place cells, head direction cells, grid cells and boundary cells, each of which has a characteristic firing pattern that encodes spatial parameters relating to the animal's current position and orientation. These properties also include the theta oscillation, which appears to play a functional role in the representation and processing of spatial information. Reviewing recent work, we identify some themes of current research and introduce approaches to computational modelling that have helped to bridge the different levels of description at which these mechanisms have been investigated. These range from the level of molecular biology and genetics to the behaviour and brain activity of entire organisms. We argue that the neuroscience of spatial cognition is emerging as an exceptionally integrative field which provides an ideal test-bed for theories linking neural coding, learning, memory and cognition.

Oscillatory neurocomputing with ring attractors: a network architecture for mapping locations in space onto patterns of neural synchrony

Theories of neural coding seek to explain how states of the world are mapped onto states of the brain. Here, we compare how an animal's location in space can be encoded by two different kinds of brain states: population vectors stored by patterns of neural firing rates, versus synchronization vectors stored by patterns of synchrony among neural oscillators. It has previously been shown that a population code stored by spatially tuned ‘grid cells’ can exhibit desirable properties such as high storage capacity and strong fault tolerance; here it is shown that similar properties are attainable with a synchronization code stored by rhythmically bursting ‘theta cells’ that lack spatial tuning. Simulations of a ring attractor network composed from theta cells suggest how a synchronization code might be implemented using fewer neurons and synapses than a population code with similar storage capacity. It is conjectured that reciprocal connections between grid and theta cells might control phase noise to correct two kinds of errors that can arise in the code: path integration and teleportation errors. Based upon these analyses, it is proposed that a primary function of spatially tuned neurons might be to couple the phases of neural oscillators in a manner that allows them to encode spatial locations as patterns of neural synchrony.

Selection of preconfigured cell assemblies for representation of novel spatial experiences

Internal representations about the external world can be driven by the external stimuli or can be internally generated in their absence. It has been a matter of debate whether novel stimuli from the external world are instructive over the brain network to create de novo representations or, alternatively, are selecting from existing pre-representations hosted in preconfigured brain networks. The hippocampus is a brain area necessary for normal internally generated spatial-temporal representations and its dysfunctions have resulted in anterograde amnesia, impaired imagining of new experiences, and hallucinations. The compressed temporal sequence of place cell activity in the rodent hippocampus serves as an animal model of internal representation of the external space. Based on our recent results on the phenomenon of novel place cell sequence preplay, we submit that the place cell sequence of a novel spatial experience is determined, in part, by a selection of a set of cellular firing sequences from a repertoire of existing temporal firing sequences in the hippocampal network. Conceptually, this indicates that novel stimuli from the external world select from their pre-representations rather than create de novo our internal representations of the world.

Development of schemas revealed by prior experience and NMDA receptor knock-out

Prior experience accelerates acquisition of novel, related information through processes like assimilation into mental schemas, but the underlying neuronal mechanisms are poorly understood. We investigated the roles that prior experience and hippocampal CA3 N-Methyl-D-aspartate receptor (NMDAR)-dependent synaptic plasticity play in CA1 place cell sequence encoding and learning during novel spatial experiences. We found that specific representations of de novo experiences on linear environments were formed on a framework of pre configured network activity expressed in the preceding sleep and were rapidly, flexibly adjusted via NMDAR-dependent activity. This prior experience accelerated encoding of subsequent experiences on contiguous or isolated novel tracks, significantly decreasing their NMDAR-dependence. Similarly, de novo learning of an alternation task was facilitated by CA3 NMDARs; this experience accelerated subsequent learning of related tasks, independent of CA3 NMDARs, consistent with a schema-based learning. These results reveal the existence of distinct neuronal encoding schemes which could explain why hippocampal dysfunction results in anterograde amnesia while sparing recollection of old, schema-based memories.

DOI:http://dx.doi.org/10.7554/eLife.01326.001

Learning is an inherent feature of the living animals. During development and childhood we learn a large repertoire of items that we encounter for the first time in our life, such as the names of things and how to perform certain tasks. This de novo learning process takes a relatively long time and generally requires repeated exposures to the particular features of the external world that are being learned. Later in life, when we are exposed to novel but related features, we acquire this new information much faster. For instance, if a child learns to associate various odors with various locations around the home—such as associating the smell of bread with the kitchen and the smell air freshener with the bathroom—they will find it easier to make new odor-place associations outside the home, such as associating gasoline with gas stations.

It is thought that the de novo learning process is achieved when the newly acquired information is being consolidated and transferred into long-term memory storage within networks of neurons in the brain. The process of consolidation is believed to lead to the formation of mental schemas that can accelerate learning of novel but related information. Although the concepts of mental schema and related learning are widely used in psychology and education, their underlying neuronal mechanisms are poorly understood.

The formation of new memories depends on a part of the brain called the hippocampus and involves changes in the strength of the connectivity between groups of neurons in a process called synaptic plasticity. In particular, the interaction between a chemical called glutamate, which is released by sender neurons, and proteins called NMDA receptors (which bind the glutamate molecules) on receiver neurons have a central role in synaptic plasticity. Recently, based on experiments with rodents, it has been proposed that the hippocampus is also crucial for the formation of the mental schemas that can accelerate the learning of new spatial association tasks, such as the odor-place associations described above.

Now, Dragoi and Tonegawa reveal that the NMDA receptor in a key subregion of the hippocampus is also involved in the de novo learning of spatial tasks. Using repeated exposures to novel spatial experiences and genetic techniques to block the NMDA receptors in this subregion in mice, Dragoi and Tonegawa discovered that de novo learning involves synaptic plasticity in the hippocampus and, possibly, other regions of the brain. This de novo learning, in turn, enables subsequent spatial learning to be accelerated, even when the NMDA receptors are absent. These results reveal that de novo learning, and related learning processes such as accelerated learning, are underpinned by a number of different mechanisms in the brain, which could help explain why damage to the hippocampus prevents the formation of new memories while preserving other forms of memory and learning.

DOI:http://dx.doi.org/10.7554/eLife.01326.002

Acute stress and hippocampal output: exploring dorsal CA1 and subicular synaptic plasticity simultaneously in anesthetized rats

The Cornu Ammonis-1 (CA1) subfield and subiculum (SUB) serve as major output structures of the hippocampal formation. Exploring forms of synaptic plasticity simultaneously within these two output regions may improve understanding of the dynamics of hippocampal circuitry and information transfer between hippocampal and cortical brain regions. Using a novel dual-channel electrophysiological preparation in urethane-anesthetized adult male Sprague-Dawley rats in vivo, we examined the effects of acute restraint stress (30 min) on short- and long-term forms of synaptic plasticity in both CA1 and SUB by stimulating the CA3 region. Paired-pulse facilitation was disrupted in SUB but not CA1 in the dual-channel experiments following exposure to acute stress. Disruptions in CA1 PPF were evident in subsequent single-channel experiments with a more anterior recording site. Acute stress disrupted long-term potentiation induced by high-frequency stimulation (10 bursts of 20 pulses at 200 Hz) in both CA1 and SUB. Low-frequency stimulation (900 pulses at 1 Hz) did not alter CA1 plasticity while a late-developing potentiation was evident in SUB that was disrupted following exposure to acute stress. These findings highlight differences in the sensitivity to acute stress for distinct forms of synaptic plasticity within synapses in hippocampal output regions. The findings are discussed in relation to normal and aberrant forms of hippocampal-cortical information processing.

Spatial memory tasks in rodents: what do they model?

The analysis of spatial learning and memory in rodents is commonly used to investigate the mechanisms underlying certain forms of human cognition and to model their dysfunction in neuropsychiatric and neurodegenerative diseases. Proper interpretation of rodent behavior in terms of spatial memory and as a model of human cognitive functions is only possible if various navigation strategies and factors controlling the performance of the animal in a spatial task are taken into consideration. The aim of this review is to describe the experimental approaches that are being used for the study of spatial memory in rats and mice and the way that they can be interpreted in terms of general memory functions. After an introduction to the classification of memory into various categories and respective underlying neuroanatomical substrates, I explain the concept of spatial memory and its measurement in rats and mice by analysis of their navigation strategies. Subsequently, I describe the most common paradigms for spatial memory assessment with specific focus on methodological issues relevant for the correct interpretation of the results in terms of cognitive function. Finally, I present recent advances in the use of spatial memory tasks to investigate episodic-like memory in mice.

Fear conditioning alters neuron-specific hippocampal place field stability via the basolateral amygdala

It is well established that physical changes to an environment result in plasticity of hippocampal place cell activity, while in the absence of changes, place fields are remarkably stable. Manipulations of a rat's perception of the environment without physically changing the environment also result in plasticity of place cell firing. Here, we tested the hypothesis that a rat's perception of an environment could be changed by introducing an auditory fear-conditioned stimulus (CS) to a previously neutral environment, inducing plasticity of hippocampal place fields. First, stable place fields were isolated for rats exploring a radial-arm maze in one environment, and then the rats were fear-conditioned to an auditory CS in a completely separate environment. Later, the CS was specifically paired once with a location in the previously neutral radial-arm maze, either within the given neuron's place field (in-field) or an area outside of the place field (out-of-field). A single, paired presentation of the CS with a location in-field for a specific place cell disrupted the stability of that neuron's place field, whereas pairing the CS with a location out-of-field did not affect place field stability. We further showed that this place field disruption for a CS presented in-field was mediated by inputs from the basolateral amygdala (BLA). Temporarily inactivating the BLA immediately post-CS re-exposure attenuated the CS-induced place field destabilization. Our results show neuron-specific conditional plasticity for actively firing hippocampal place cells, and that the BLA mediates this plasticity when an emotionally arousing or fear-related CS is used.

Crosstalk and transitions between multiple spatial maps in an attractor neural network model of the hippocampus: phase diagram

We study the stable phases of an attractor neural network model, with binary units, for hippocampal place cells encoding one-dimensional (1D) or 2D spatial maps or environments. Different maps correspond to random allocations (permutations) of the place fields. Based on replica calculations we show that, below critical levels for the noise in the neural response and for the number of environments, the network activity is spatially localized in one environment. For high noise and loads the network activity extends over space, either uniformly or with spatial heterogeneities due to the crosstalk between the maps, and memory of environments is lost. Remarkably the spatially localized regime is very robust against the neural noise until it reaches its critical level. Numerical simulations are in excellent quantitative agreement with our theoretical predictions.

Hippocampal "time cells": time versus path integration

Recent studies have reported the existence of hippocampal "time cells," neurons that fire at particular moments during periods when behavior and location are relatively constant. However, an alternative explanation of apparent time coding is that hippocampal neurons "path integrate" to encode the distance an animal has traveled. Here, we examined hippocampal neuronal firing patterns as rats ran in place on a treadmill, thus "clamping" behavior and location, while we varied the treadmill speed to distinguish time elapsed from distance traveled. Hippocampal neurons were strongly influenced by time and distance, and less so by minor variations in location. Furthermore, the activity of different neurons reflected integration over time and distance to varying extents, with most neurons strongly influenced by both factors and some significantly influenced by only time or distance. Thus, hippocampal neuronal networks captured both the organization of time and distance in a situation where these dimensions dominated an ongoing experience.

Medial entorhinal grid cells and head direction cells rotate with a T-maze more often during less recently experienced rotations

Prior studies of head direction (HD) cells indicate strong landmark control over the preferred firing direction of these cells, with few studies exhibiting shifts away from local reference frames over time. We recorded spiking activity of grid and HD cells in the medial entorhinal cortex of rats, testing correlations of local environmental cues with the spatial tuning curves of these cells' firing fields as animals performed continuous spatial alternation on a T-maze that shared the boundaries of an open-field arena. The environment was rotated into configurations the animal had either seen or not seen in the past recording week. Tuning curves of both cell types demonstrated commensurate shifts of tuning with T-maze rotations during less recent rotations, more so than recent rotations. This strongly suggests that animals are shifting their reference frame away from the local environmental cues over time, learning to use a different reference frame more likely reliant on distal or idiothetic cues. In addition, grid fields demonstrated varying levels of "fragmentation" on the T-maze. The propensity for fragmentation does not depend on grid spacing and grid score, nor animal trajectory, indicating the cognitive treatment of environmental subcompartments is likely driven by task demands.

Memory, navigation and theta rhythm in the hippocampal-entorhinal system

Theories on the functions of the hippocampal system are based largely on two fundamental discoveries: the amnestic consequences of removing the hippocampus and associated structures in the famous patient H.M. and the observation that spiking activity of hippocampal neurons is associated with the spatial position of the rat. In the footsteps of these discoveries, many attempts were made to reconcile these seemingly disparate functions. Here we propose that mechanisms of memory and planning have evolved from mechanisms of navigation in the physical world and hypothesize that the neuronal algorithms underlying navigation in real and mental space are fundamentally the same. We review experimental data in support of this hypothesis and discuss how specific firing patterns and oscillatory dynamics in the entorhinal cortex and hippocampus can support both navigation and memory.

Memory on time

Considerable recent work has shown that the hippocampus is critical for remembering the order of events in distinct experiences, a defining feature of episodic memory. Correspondingly, hippocampal neuronal activity can 'replay' sequential events in memories and hippocampal neuronal ensembles represent a gradually changing temporal context signal. Most strikingly, single hippocampal neurons - called time cells - encode moments in temporally structured experiences much as the well-known place cells encode locations in spatially structured experiences. These observations bridge largely disconnected literatures on the role of the hippocampus in episodic memory and spatial mapping, and suggest that the fundamental function of the hippocampus is to establish spatio-temporal frameworks for organizing memories.

What is comparable in comparative cognition?

To understand how complex, or 'advanced' various forms of cognition are, and to compare them between species for evolutionary studies, we need to understand the diversity of neural-computational mechanisms that may be involved, and to identify the genetic changes that are necessary to mediate changes in cognitive functions. The same overt cognitive capacity might be mediated by entirely different neural circuitries in different species, with a many-to-one mapping between behavioural routines, computations and their neural implementations. Comparative behavioural research needs to be complemented with a bottom-up approach in which neurobiological and molecular-genetic analyses allow pinpointing of underlying neural and genetic bases that constrain cognitive variation. Often, only very minor differences in circuitry might be needed to generate major shifts in cognitive functions and the possibility that cognitive traits arise by convergence or parallel evolution needs to be taken seriously. Hereditary variation in cognitive traits between individuals of a species might be extensive, and selection experiments on cognitive traits might be a useful avenue to explore how rapidly changes in cognitive abilities occur in the face of pertinent selection pressures.

How vision and movement combine in the hippocampal place code

How do external environmental and internal movement-related information combine to tell us where we are? We examined the neural representation of environmental location provided by hippocampal place cells while mice navigated a virtual reality environment in which both types of information could be manipulated. Extracellular recordings were made from region CA1 of head-fixed mice navigating a virtual linear track and running in a similar real environment. Despite the absence of vestibular motion signals, normal place cell firing and theta rhythmicity were found. Visual information alone was sufficient for localized firing in 25% of place cells and to maintain a local field potential theta rhythm (but with significantly reduced power). Additional movement-related information was required for normally localized firing by the remaining 75% of place cells. Trials in which movement and visual information were put into conflict showed that they combined nonlinearly to control firing location, and that the relative influence of movement versus visual information varied widely across place cells. However, within this heterogeneity, the behavior of fully half of the place cells conformed to a model of path integration in which the presence of visual cues at the start of each run together with subsequent movement-related updating of position was sufficient to maintain normal fields.

Head direction cell activity in the anterodorsal thalamus requires intact supragenual nuclei

Neural activity in several limbic areas varies as a function of the animal's head direction (HD) in the horizontal plane. Lesions of the vestibular periphery abolish this HD cell signal, suggesting an essential role for vestibular afference in HD signal generation. The organization of brain stem pathways conveying vestibular information to the HD circuit is poorly understood; however, recent anatomical work has identified the supragenual nucleus (SGN) as a putative relay. To test this hypothesis, we made lesions of the SGN in rats and screened for HD cells in the anterodorsal thalamus. In animals with complete bilateral lesions, the overall number of HD cells was significantly reduced relative to control animals. In animals with unilateral lesions of the SGN, directional activity was present, but the preferred firing directions of these cells were unstable and less influenced by the rotation of an environmental landmark. In addition, we found that preferred directions displayed large directional shifts when animals foraged for food in a darkened environment and when they were navigating from a familiar environment to a novel one, suggesting that the SGN plays a critical role in projecting essential self-motion (idiothetic) information to the HD cell circuit.

Profound retrograde but absence of anterograde amnesia for cued place learning in rats with hippocampal lesions

Previous studies in our lab have shown that slight modifications in the spatial reference memory procedure can overcome the deficit in spatial learning typically observed in rats with hippocampal damage. However, it is unknown if memory acquired under such training circumstances is spared after hippocampal lesions. With this aim a four-arm plus-shaped maze and a spatial reference memory paradigm were used, in which the goal arm was doubly marked: by an intramaze cue (a piece of sandpaper positioned on the floor of the arm) and by the extramaze constellation of stimuli around the maze. Experiment 1 replicated previous findings showing that hippocampally damaged rats can learn a place response just as well as the controls when the intramaze cue is present during the training, but they are unable to do so in the absence of the intramaze signal. When the learning procedure was doubly signaled, a transfer test performed 24h after the end of acquisition demonstrated that lesioned rats showed perfect memory for the goal arm when the intramaze cue was removed. Experiment 2 investigated the effect of hippocampal damage 1 day after the learning. Results showed that regardless of the training procedure employed (with or without the intramaze cue), hippocampal lesions produced a profound retrograde amnesia. Thus, although the absence of anterograde amnesia suggests that structures other that the hippocampus can take charge of the acquisition, the presence of retrograde amnesia indicates the critical role of the normal hippocampus in the long-term formation of allocentric information.

The hormone therapy, Premarin, impairs hippocampus-dependent spatial learning and memory and reduces activation of new granule neurons in response to memory in female rats

Estrogens have been implicated as possible therapeutic agents for improving cognition in postmenopausal women and have been linked to neurodegenerative disorders such as Alzheimer's disease. However, the utility of Premarin (Wyeth Pharmaceuticals, Markham, ON, Canada), a conjugated equine estrogen and the most commonly prescribed hormone therapy, has recently been questioned. The purpose of this study was to investigate the effects of Premarin at 2 different doses (10 or 20 μg) on hippocampus-dependent spatial learning and memory, hippocampal neurogenesis, and new neuronal activation using a rodent model of surgical menopause. Rats were treated daily with subcutaneous injections of Premarin and trained on the spatial working/reference memory version of the radial arm maze. Premarin impaired spatial reference and working learning and memory, increased hippocampal neurogenesis, but either decreased or increased activation of new neurons in response to memory retrieval as indexed by the expression of the immediate early gene product zif268, depending on the maturity of cells examined. This activation of new neurons was related to impaired performance in Premarin-treated but not control-treated female rats. These results indicate that Premarin may be impairing hippocampus-dependent learning and memory by negatively altering the neurogenic environment in the dentate gyrus thus disrupting normal activity of new neurons.

The neuroscience of learning: beyond the Hebbian synapse

From the traditional perspective of associative learning theory, the hypothesis linking modifications of synaptic transmission to learning and memory is plausible. It is less so from an information-processing perspective, in which learning is mediated by computations that make implicit commitments to physical and mathematical principles governing the domains where domain-specific cognitive mechanisms operate. We compare the properties of associative learning and memory to the properties of long-term potentiation, concluding that the properties of the latter do not explain the fundamental properties of the former. We briefly review the neuroscience of reinforcement learning, emphasizing the representational implications of the neuroscientific findings. We then review more extensively findings that confirm the existence of complex computations in three information-processing domains: probabilistic inference, the representation of uncertainty, and the representation of space. We argue for a change in the conceptual framework within which neuroscientists approach the study of learning mechanisms in the brain.

Experience-dependent recruitment of Arc expression in multiple systems during rest

The patterns of ensemble activity in the hippocampal formation during wakeful, attentive behavior are recapitulated during subsequent resting states. This replay of activity has also been found in several brain regions across many species, indicating a very general biological phenomenon. Concomitantly, transcription of immediate-early genes (IEGs) such as Arc also reoccurs in the same hippocampal neurons, suggesting that IEGs contribute to "off-line" consolidation. If continued IEG expression during rest reflects a correlate of ensemble replay, then the same generality should be observed in IEG transcription patterns. This hypothesis was tested by examining Arc in F344 rats engaging in spatial exploration alongside a rest episode. The probability that an individual neuron participates in "constitutive" Arc expression during rest is increased by recent experience in multiple cortical regions as well as across the septal and temporal poles of the hippocampus, consistent with memory trace reactivation. That is, neurons that were recently active during spatial exploration are preferentially recruited into further Arc expression during subsequent rest. The continued Arc expression, however, occurs in only a small fraction of the cells that were engaged in transcription during previous behavior. This fraction is greatest in CA3 and progressively decreases in CA1, superficial, and deep cortical layers and is consistent with the idea that consolidation occurs rapidly in the hippocampus (centering on the CA3 recurrent network) while changes are much more gradual in neocortical synaptic networks.

Functional split between parietal and entorhinal cortices in the rat

Posterior parietal cortex (PPC) and medial entorhinal cortex (MEC) are important elements of the neural circuit for space, but whether representations in these areas are controlled by the same factors is unknown. We recorded single units simultaneously in PPC and MEC of freely foraging rats and found that a subset of PPC cells are tuned to specific modes of movement irrespective of the animals' location or heading, whereas grid cells in MEC expressed static spatial maps. The behavioral correlates of PPC cells switched completely when the same animals ran in a spatially structured maze or when they ran similar stereotypic sequences in an open arena. Representations in PPC were similar in identical mazes in different rooms where grid cells completely realigned their firing fields. The data suggest that representations in PPC are determined by the organization of actions while cells in MEC are driven by spatial inputs.

Activity dynamics and behavioral correlates of CA3 and CA1 hippocampal pyramidal neurons

The CA3 and CA1 pyramidal neurons are the major principal cell types of the hippocampus proper. The strongly recurrent collateral system of CA3 cells and the largely parallel-organized CA1 neurons suggest that these regions perform distinct computations. However, a comprehensive comparison between CA1 and CA3 pyramidal cells in terms of firing properties, network dynamics, and behavioral correlations is sparse in the intact animal. We performed large-scale recordings in the dorsal hippocampus of rats to quantify the similarities and differences between CA1 (n > 3,600) and CA3 (n > 2,200) pyramidal cells during sleep and exploration in multiple environments. CA1 and CA3 neurons differed significantly in firing rates, spike burst propensity, spike entrainment by the theta rhythm, and other aspects of spiking dynamics in a brain state-dependent manner. A smaller proportion of CA3 than CA1 cells displayed prominent place fields, but place fields of CA3 neurons were more compact, more stable, and carried more spatial information per spike than those of CA1 pyramidal cells. Several other features of the two cell types were specific to the testing environment. CA3 neurons showed less pronounced phase precession and a weaker position versus spike-phase relationship than CA1 cells. Our findings suggest that these distinct activity dynamics of CA1 and CA3 pyramidal cells support their distinct computational roles.

The role of visual experience for the neural basis of spatial cognition

Blindness often results in the adaptive neural reorganization of the remaining modalities, producing sharper auditory and haptic behavioral performance. Yet, non-visual modalities might not be able to fully compensate for the lack of visual experience as in the case of congenital blindness. For example, developmental visual experience seems to be necessary for the maturation of multisensory neurons for spatial tasks. Additionally, the ability of vision to convey information in parallel might be taken into account as the main attribute that cannot be fully compensated by the spared modalities. Therefore, the lack of visual experience might impair all spatial tasks that require the integration of inputs from different modalities, such as having to represent a set of objects on the basis of the spatial relationships among the objects, rather than the spatial relationship that each object has with oneself. Here we integrate behavioral and neural evidence to conclude that visual experience is necessary for the neural development of normal spatial cognition.

Framing spatial cognition: neural representations of proximal and distal frames of reference and their roles in navigation

The most common behavioral test of hippocampus-dependent, spatial learning and memory is the Morris water task, and the most commonly studied behavioral correlate of hippocampal neurons is the spatial specificity of place cells. Despite decades of intensive research, it is not completely understood how animals solve the water task and how place cells generate their spatially specific firing fields. Based on early work, it has become the accepted wisdom in the general neuroscience community that distal spatial cues are the primary sources of information used by animals to solve the water task (and similar spatial tasks) and by place cells to generate their spatial specificity. More recent research, along with earlier studies that were overshadowed by the emphasis on distal cues, put this common view into question by demonstrating primary influences of local cues and local boundaries on spatial behavior and place-cell firing. This paper first reviews the historical underpinnings of the "standard" view from a behavioral perspective, and then reviews newer results demonstrating that an animal's behavior in such spatial tasks is more strongly controlled by a local-apparatus frame of reference than by distal landmarks. The paper then reviews similar findings from the literature on the neurophysiological correlates of place cells and other spatially correlated cells from related brain areas. A model is proposed by which distal cues primarily set the orientation of the animal's internal spatial coordinate system, via the head direction cell system, whereas local cues and apparatus boundaries primarily set the translation and scale of that coordinate system.

Lateral entorhinal neurons are not spatially selective in cue-rich environments

The hippocampus is a brain region that is critical for spatial learning, context-dependent memory, and episodic memory. It receives major inputs from the medial entorhinal cortex (MEC) and the lateral EC (LEC). MEC neurons show much greater spatial firing than LEC neurons in a recording chamber with a single, salient landmark. The MEC cells are thought to derive their spatial tuning through path integration, which permits spatially selective firing in such a cue-deprived environment. In accordance with theories that postulate two spatial mapping systems that provide input to the hippocampus-an internal, path-integration system and an external, landmark-based system-it was possible that LEC neurons can also convey a spatial signal, but that the signal requires multiple landmarks to define locations, rather than movement integration. To test this hypothesis, neurons from the MEC and LEC were recorded as rats foraged for food in cue-rich environments. In both environments, LEC neurons showed little spatial specificity, whereas many MEC neurons showed a robust spatial signal. These data strongly support the notion that the MEC and LEC convey fundamentally different types of information to the hippocampus, in terms of their spatial firing characteristics, under various environmental and behavioral conditions.

Place cells, grid cells, attractors, and remapping

Place and grid cells are thought to use a mixture of external sensory information and internal attractor dynamics to organize their activity. Attractor dynamics may explain both why neurons react coherently following sufficiently large changes to the environment (discrete attractors) and how firing patterns move smoothly from one representation to the next as an animal moves through space (continuous attractors). However, some features of place cell behavior, such as the sometimes independent responsiveness of place cells to environmental change (called “remapping”), seem hard to reconcile with attractor dynamics. This paper suggests that the explanation may be found in an anatomical separation of the two attractor systems coupled with a dynamic contextual modulation of the connection matrix between the two systems, with new learning being back-propagated into the matrix. Such a scheme could explain how place cells sometimes behave coherently and sometimes independently.

Grid cells, place cells, and geodesic generalization for spatial reinforcement learning

Reinforcement learning (RL) provides an influential characterization of the brain's mechanisms for learning to make advantageous choices. An important problem, though, is how complex tasks can be represented in a way that enables efficient learning. We consider this problem through the lens of spatial navigation, examining how two of the brain's location representations--hippocampal place cells and entorhinal grid cells--are adapted to serve as basis functions for approximating value over space for RL. Although much previous work has focused on these systems' roles in combining upstream sensory cues to track location, revisiting these representations with a focus on how they support this downstream decision function offers complementary insights into their characteristics. Rather than localization, the key problem in learning is generalization between past and present situations, which may not match perfectly. Accordingly, although neural populations collectively offer a precise representation of position, our simulations of navigational tasks verify the suggestion that RL gains efficiency from the more diffuse tuning of individual neurons, which allows learning about rewards to generalize over longer distances given fewer training experiences. However, work on generalization in RL suggests the underlying representation should respect the environment's layout. In particular, although it is often assumed that neurons track location in Euclidean coordinates (that a place cell's activity declines "as the crow flies" away from its peak), the relevant metric for value is geodesic: the distance along a path, around any obstacles. We formalize this intuition and present simulations showing how Euclidean, but not geodesic, representations can interfere with RL by generalizing inappropriately across barriers. Our proposal that place and grid responses should be modulated by geodesic distances suggests novel predictions about how obstacles should affect spatial firing fields, which provides a new viewpoint on data concerning both spatial codes.

Computational models of grid cells

Grid cells are space-modulated neurons with periodic firing fields. In moving animals, the multiple firing fields of an individual grid cell form a triangular pattern tiling the entire space available to the animal. Collectively, grid cells are thought to provide a context-independent metric representation of the local environment. Since the discovery of grid cells in 2005, a number of models have been proposed to explain the formation of spatially repetitive firing patterns as well as the conversion of these signals to place signals one synapse downstream in the hippocampus. The present article reviews the most recent developments in our understanding of how grid patterns are generated, maintained, and transformed, with particular emphasis on second-generation computational models that have emerged during the past 2-3 years in response to criticism and new data.

Neural systems analysis of decision making during goal-directed navigation

The ability to make adaptive decisions during goal-directed navigation is a fundamental and highly evolved behavior that requires continual coordination of perceptions, learning and memory processes, and the planning of behaviors. Here, a neurobiological account for such coordination is provided by integrating current literatures on spatial context analysis and decision-making. This integration includes discussions of our current understanding of the role of the hippocampal system in experience-dependent navigation, how hippocampal information comes to impact midbrain and striatal decision making systems, and finally the role of the striatum in the implementation of behaviors based on recent decisions. These discussions extend across cellular to neural systems levels of analysis. Not only are key findings described, but also fundamental organizing principles within and across neural systems, as well as between neural systems functions and behavior, are emphasized. It is suggested that studying decision making during goal-directed navigation is a powerful model for studying interactive brain systems and their mediation of complex behaviors.

Models of place and grid cell firing and theta rhythmicity

Neuronal firing in the hippocampal formation (HF) of freely moving rodents shows striking examples of spatialorganization in the form of place, directional, boundary vector and grid cells. The firing of place and grid cells shows an intriguing form of temporal organization known as 'theta phase precession'. We review the mechanisms underlying theta phase precession of place cell firing, ranging from membrane potential oscillations to recurrent connectivity, and the relevant intra-cellular and extra-cellular data. We then consider the use of these models to explain the spatial structure of grid cell firing, and review the relevant intra-cellular and extra-cellular data. Finally, we consider the likely interaction between place cells, grid cells and boundary vector cells in estimating self-location as a compromise between path-integration and environmental information.

Neuroinflammation and the plasticity-related immediate-early gene Arc

Neurons exist within a microenvironment that significantly influences their function and survival. While there are many environmental factors that can potentially impact neuronal function, activation of the innate immune system (microglia) is an important element common to many neurological and pathological conditions associated with memory loss. Learning and memory processes rely on the ability of neurons to alter their transcriptional programs in response to synaptic input. Recent advances in cell-based imaging of plasticity-related immediate-early gene (IEG) expression have provided a tool to investigate plasticity-related changes across multiple brain regions. The activity-regulated, cytoskeleton-associated IEG Arc is a regulator of protein synthesis-dependent forms of synaptic plasticity, which are essential for memory formation. Visualisation of Arc provides cellular level resolution for the mapping of neuronal networks. Chronic activation of the innate immune system alters Arc activity patterns, and this may be a mechanism by which it induces the cognitive dysfunction frequently associated with neuroinflammatory conditions. This review discusses the use of Arc expression during activation of the innate immune system as a valid marker of altered plasticity and a predictor of cognitive dysfunction.

Changes in reward contingency modulate the trial-to-trial variability of hippocampal place cells

Pyramidal cells in the rodent hippocampus often exhibit clear spatial tuning. Theories of hippocampal function suggest that these "place cells" implement multiple, independent neural representations of position (maps), based on different reference frames or environmental features. Consistent with the "multiple maps" theory, previous studies have shown that manipulating spatial factors related to task performance modulates the within-session variability (overdispersion) of cells in the hippocampus. However, the influence of changes in reward contingency on overdispersion has not been examined. To test this, we first trained rats to collect food from three feeders positioned around a circular track (task(1)). When subjects were proficient, the reward contingency was altered such that every other feeder delivered food (task(2)). We recorded ensembles of hippocampal neurons as rats performed both tasks. Place cell overdispersion was high during task(1) but decreased significantly during task(2), and this increased reliability could not be accounted for by changes in running speed or familiarity with the task. Intuitively, decreased variability might be expected to improve neural representations of position. To test this, we used Bayesian decoding of hippocampal spike trains to estimate subjects' location. Neither the amount of probability decoded to subjects' position (local probability) nor the difference between estimated position and true location (decoding accuracy) differed between tasks. However, we found that hippocampal ensembles were significantly more self-consistent during task(2) performance. These results suggest that changes in task demands can affect the firing statistics of hippocampal neurons, leading to changes in the properties of decoded neural representations.

Activation of immobility-related hippocampal theta by cholinergic septohippocampal neurons during vestibular stimulation

The vestibular system has been suggested to participate in spatial navigation, a function ascribed to the hippocampus. Vestibular stimulation during spatial navigation activates a hippocampal theta rhythm (4-10 Hz), which may enhance spatial processing and motor response. We hypothesize that a cholinergic, atropine-sensitive theta is generated during passive whole-body rotation in freely behaving rats. Hippocampal EEGs were recorded by implanted electrodes in CA1 while rats were rotated on a vertical axis, for a minute or longer, at different angular velocities. Rotation induced a continuous hippocampal theta rhythm while the rat was immobile, in both light and dark conditions. Theta peak frequency showed a significant increase during high (50-70 rpm) as compared with a lower (20-49 rpm) rotational velocity. Rotation-induced theta was abolished by muscarinic receptor antagonist atropine sulfate (50 mg/kg i.p.) but not by atropine methyl nitrate (50 mg/kg i.p.), which did not pass the blood-brain barrier. Theta was attenuated in rats in which cholinergic neurons in the medial septum (MS) were lesioned with 192 IgG-saporin (0.14 μg in 0.4 μl), as confirmed by depletion of MS cells immunoreactive to choline acetyltransferase and an absence of acetylcholinesterase staining in the hippocampus. Bilateral lesion of the vestibular receptors by sodium arsanilate (30 mg in 0.1 ml, intratympanically) also attenuated the rotation-induced theta rhythm. In intact rats, field excitatory postsynaptic potentials (fEPSPs) in CA1 evoked by commissural stimulation were smaller during walking or rotation as compared with during immobility. Modulation of fEPSP was absent following atropine sulfate in intact rats and in 192 IgG-saporin lesion rats. In summary, this is the first report of a continuous atropine-sensitive hippocampal theta in the rat induced by vestibular stimulation during rotation, and accompanied by cholinergic modulation of hippocampal synaptic transmission. Vestibular-activated septohippocampal cholinergic activity could be an important component in sensorimotor processing and spatial memory.

Phase precession and variable spatial scaling in a periodic attractor map model of medial entorhinal grid cells with realistic after-spike dynamics

We present a model that describes the generation of the spatial (grid fields) and temporal (phase precession) properties of medial entorhinal cortical (MEC) neurons by combining network and intrinsic cellular properties. The model incorporates network architecture derived from earlier attractor map models, and is implemented in 1D for simplicity. Periodic driving of conjunctive (position × head-direction) layer-III MEC cells at theta frequency with intensity proportional to the rat's speed, moves an 'activity bump' forward in network space at a corresponding speed. The addition of prolonged excitatory currents and simple after-spike dynamics resembling those observed in MEC stellate cells (for which new data are presented) accounts for both phase precession and the change in scale of grid fields along the dorso-ventral axis of MEC. Phase precession in the model depends on both synaptic connectivity and intrinsic currents, each of which drive neural spiking either during entry into, or during exit out of a grid field. Thus, the model predicts that the slope of phase precession changes between entry into and exit out of the field. The model also exhibits independent variation in grid spatial period and grid field size, which suggests possible experimental tests of the model.

Control of anterodorsal thalamic head direction cells by environmental boundaries: comparison with conflicting distal landmarks

Experiments were conducted to determine whether environmental boundaries exert preferential control over the tuning of head direction (HD) cells. In each experiment, HD cells were recorded in the rat anterodorsal thalamus while they foraged for randomly scattered food in trapezoid- and rectangle-shaped environments. After an initial recording session, each environment was rotated 90°, and changes in the preferred firing directions of HD cells were monitored. Rats were disoriented before each test session to prevent the use of self-movement cues to maintain orientation from one session to the next. In Experiment 1, we demonstrate that HD cell tuning consistently shifted in register with the trapezoid shaped enclosure, but was more variable in the rectangle shaped environment. In Experiments 2 and 3, we show that the strong control by the trapezoid persists in the presence of one clearly visible distal landmark, but not when three or more distal landmarks, including view of the recording room, are present. Together, the results indicate that distinct environmental boundaries exert strong stimulus control over HD cell orientation. However, this geometric control can be overridden with a sufficient number of salient distal landmarks. These results stand in contrast to the view that information from geometric cues usually takes precedence over information from landmark cues.

Performance-related increases in hippocampal N-acetylaspartate (NAA) induced by spatial navigation training are restricted to BDNF Val homozygotes

Recent evidence indicates experience-dependent brain volume changes in humans, but the functional and histological nature of such changes is unknown. Here, we report that adult men performing a cognitively demanding spatial navigation task every other day over 4 months display increases in hippocampal N-acetylaspartate (NAA) as measured with magnetic resonance spectroscopy. Unlike measures of brain volume, changes in NAA are sensitive to metabolic and functional aspects of neural and glia tissue and unlikely to reflect changes in microvasculature. Training-induced changes in NAA were, however, absent in carriers of the Met substitution in the brain-derived neurotrophic factor (BDNF) gene, which is known to reduce activity-dependent secretion of BDNF. Among BDNF Val homozygotes, increases in NAA were strongly related to the degree of practice-related improvement in navigation performance and normalized to pretraining levels 4 months after the last training session. We conclude that changes in demands on spatial navigation can alter hippocampal NAA concentrations, confirming epidemiological studies suggesting that mental experience may have direct effects on neural integrity and cognitive performance. BDNF genotype moderates these plastic changes, in line with the contention that gene-context interactions shape the ontogeny of complex phenotypes.

Neural syntax: cell assemblies, synapsembles, and readers

A widely discussed hypothesis in neuroscience is that transiently active ensembles of neurons, known as "cell assemblies," underlie numerous operations of the brain, from encoding memories to reasoning. However, the mechanisms responsible for the formation and disbanding of cell assemblies and temporal evolution of cell assembly sequences are not well understood. I introduce and review three interconnected topics, which could facilitate progress in defining cell assemblies, identifying their neuronal organization, and revealing causal relationships between assembly organization and behavior. First, I hypothesize that cell assemblies are best understood in light of their output product, as detected by "reader-actuator" mechanisms. Second, I suggest that the hierarchical organization of cell assemblies may be regarded as a neural syntax. Third, constituents of the neural syntax are linked together by dynamically changing constellations of synaptic weights ("synapsembles"). The existing support for this tripartite framework is reviewed and strategies for experimental testing of its predictions are discussed.

A manifold of spatial maps in the brain

Two neural systems are known to encode self-location in the brain: Place cells in the hippocampus encode unique locations in unique environments, whereas grid cells, border cells and head-direction cells in the parahippocampal cortex provide a universal metric for mapping positions and directions in all environments. These systems have traditionally been studied in very simple environments; however, natural environments are compartmentalized, nested and variable in time. Recent studies indicate that hippocampal and entorhinal spatial maps reflect this complexity. The maps fragment into interconnected, rapidly changing and tightly coordinated submaps. Plurality, fast dynamics and dynamic grouping are optimal for a brain system thought to exploit large pools of stored information to guide behavior on a second-by-second time frame in the animal's natural habitat.