Contribution of hippocampal place cell activity to learning and formation of goal-directed navigation in rats

Neural circuit dynamics of drug-context associative learning in the mouse hippocampus

The environmental context associated with previous drug consumption is a potent trigger for drug relapse. However, the mechanism by which neural representations of context are modified to incorporate information associated with drugs of abuse remains unknown. Using longitudinal calcium imaging in freely behaving mice, we find that unlike the associative learning of natural reward, drug-context associations for psychostimulants and opioids are encoded in a specific subset of hippocampal neurons. After drug conditioning, these neurons weakened their spatial coding for the non-drug paired context, resulting in an orthogonal representation for the drug versus non-drug context that was predictive of drug-seeking behavior. Furthermore, these neurons were selected based on drug-spatial experience and were exclusively tuned to animals' allocentric position. Together, this work reveals how drugs of abuse alter the hippocampal circuit to encode drug-context associations and points to the possibility of targeting drug-associated memory in the hippocampus.

Goal discrimination in hippocampal nonplace cells when place information is ambiguous

SignificanceGoal-directed spatial navigation has been found to rely on hippocampal neurons that are spatially modulated. We show that "nonplace" cells without significant spatial modulation play a role in discriminating goals when environmental cues for goals are ambiguous. This nonplace cell activity is performance-dependent and is modulated by gamma oscillations. Finally, nonplace cell goal discrimination coding fails in a mouse model of Alzheimer's disease (AD). Together, these results show that nonplace cell firing can signal unique task-relevant information when spatial information is ambiguous; these signals depend on performance and are absent in a mouse model of AD.

Spatial goal coding in the hippocampal formation

The mammalian hippocampal formation contains several distinct populations of neurons involved in representing self-position and orientation. These neurons, which include place, grid, head direction, and boundary-vector cells, are thought to collectively instantiate cognitive maps supporting flexible navigation. However, to flexibly navigate, it is necessary to also maintain internal representations of goal locations, such that goal-directed routes can be planned and executed. Although it has remained unclear how the mammalian brain represents goal locations, multiple neural candidates have recently been uncovered during different phases of navigation. For example, during planning, sequential activation of spatial cells may enable simulation of future routes toward the goal. During travel, modulation of spatial cells by the prospective route, or by distance and direction to the goal, may allow maintenance of route and goal-location information, supporting navigation on an ongoing basis. As the goal is approached, an increased activation of spatial cells may enable the goal location to become distinctly represented within cognitive maps, aiding goal localization. Lastly, after arrival at the goal, sequential activation of spatial cells may represent the just-taken route, enabling route learning and evaluation. Here, we review and synthesize these and other evidence for goal coding in mammalian brains, relate the experimental findings to predictions from computational models, and discuss outstanding questions and future challenges.

Navigating for reward

An organism's survival can depend on its ability to recall and navigate to spatial locations associated with rewards, such as food or a home. Accumulating research has revealed that computations of reward and its prediction occur on multiple levels across a complex set of interacting brain regions, including those that support memory and navigation. However, how the brain coordinates the encoding, recall and use of reward information to guide navigation remains incompletely understood. In this Review, we propose that the brain's classical navigation centres - the hippocampus and the entorhinal cortex - are ideally suited to coordinate this larger network by representing both physical and mental space as a series of states. These states may be linked to reward via neuromodulatory inputs to the hippocampus-entorhinal cortex system. Hippocampal outputs can then broadcast sequences of states to the rest of the brain to store reward associations or to facilitate decision-making, potentially engaging additional value signals downstream. This proposal is supported by recent advances in both experimental and theoretical neuroscience. By discussing the neural systems traditionally tied to navigation and reward at their intersection, we aim to offer an integrated framework for understanding navigation to reward as a fundamental feature of many cognitive processes.

Do hippocampal pyramidal cells respond to nonspatial stimuli?

There are currently a number of theories of rodent hippocampal function. They fall into two major groups that differ in the role they impute to space in hippocampal information processing. On one hand, the cognitive map theory sees space as crucial and central, with other types of nonspatial information embedded in a primary spatial framework. On the other hand, most other theories see the function of the hippocampal formation as broader, treating all types of information as equivalent and concentrating on the processes carried out irrespective of the specific material being represented, stored, and manipulated. One crucial difference, therefore, is the extent to which theories see hippocampal pyramidal cells as representing nonspatial information independently of a spatial framework. Studies have reported the existence of single hippocampal unit responses to nonspatial stimuli, both to simple sensory inputs as well as to more complex stimuli such as objects, conspecifics, rewards, and time, and these findings been interpreted as evidence in favor of a broader hippocampal function. Alternatively, these nonspatial responses might actually be feature-in-place signals where the spatial nature of the response has been masked by the fact that the objects or features were only presented in one location or one spatial context. In this article, we argue that when tested in multiple locations, the hippocampal response to nonspatial stimuli is almost invariably dependent on the animal's location. Looked at collectively, the data provide strong support for the cognitive map theory.

Adult neurogenesis augmentation attenuates anhedonia and HPA axis dysregulation in a mouse model of chronic stress and depression

Major depressive disorder is a common debilitating mental health problem that represents one of the leading causes of disability. Up to date, the therapeutic targets and approaches are still limited. Adult hippocampal neurogenesis (AHN) has been proposed as a critical contributor to the pathophysiology and treatment of depression, altering the hippocampal control over stress response at network, neuroendocrine and behavioral levels. These findings together have suggested that manipulating AHN may be a promising therapeutic strategy for depression. To investigate this question, we assessed whether increasing adult neurogenesis would be sufficient to produce antidepressant-like effects at behavioral and neuroendocrine levels in a mouse model of depression; the unpredictable chronic mild stress (UCMS). For this purpose, we used a bi-transgenic mouse line (iBax) in which AHN increase was induced by deletion of the pro-apoptotic gene Bax from the neural progenitors following the tamoxifen-dependent action of CreERT2 recombinases. UCMS induced a syndrome that is reminiscent of depression-like states, including anhedonia (cookie test), physical changes (coat deterioration, reduced weight gain), anxiety-like behaviors (higher latency in the novelty-supressed feeding -NSF- test), passive stress-coping behaviors (immobility in the forced swim test -FST-) and a blunted hypothalamo-pituitary-adrenal (HPA) axis reactivity to acute stress in addition to AHN decrease. Tamoxifen injection reversed the AHN decrease as well as partly counteracted UCMS effects on the cookie test and HPA axis but not for the coat state, weight gain, NSF test and FST. Taken together, our results suggest that a strategy directing at increasing AHN may be able to alleviate some depression-related behavioral and neuroendocrine dimensions of UCMS, such as anhedonia and HPA axis reactivity deficits, but may be hardly sufficient to produce a complete recovery.

Hippocampal spatial memory representations in mice are heterogeneously stable

The population of hippocampal neurons actively coding space continually changes across days as mice repeatedly perform tasks. Many hippocampal place cells become inactive while other previously silent neurons become active, challenging the idea that stable behaviors and memory representations are supported by stable patterns of neural activity. Active cell replacement may disambiguate unique episodes that contain overlapping memory cues, and could contribute to reorganization of memory representations. How active cell replacement affects the evolution of representations of different behaviors within a single task is unknown. We trained mice to perform a delayed nonmatching to place task over multiple weeks, and performed calcium imaging in area CA1 of the dorsal hippocampus using head-mounted miniature microscopes. Cells active on the central stem of the maze "split" their calcium activity according to the animal's upcoming turn direction (left or right), the current task phase (study or test), or both task dimensions, even while spatial cues remained unchanged. We found that, among reliably active cells, different splitter neuron populations were replaced at unequal rates, resulting in an increasing number of cells modulated by turn direction and a decreasing number of cells with combined modulation by both turn direction and task phase. Despite continual reorganization, the ensemble code stably segregated these task dimensions. These results show that hippocampal memories can heterogeneously reorganize even while behavior is unchanging.

Differences in reward biased spatial representations in the lateral septum and hippocampus

The lateral septum (LS), which is innervated by the hippocampus, is known to represent spatial information. However, the details of place representation in the LS, and whether this place information is combined with reward signaling, remains unknown. We simultaneously recorded from rat CA1 and caudodorsal lateral septum in rat during a rewarded navigation task and compared spatial firing in the two areas. While LS place cells are less numerous than in hippocampus, they are similar to the hippocampus in field size and number of fields per cell, but with field shape and center distributions that are more skewed toward reward. Spike cross-correlations between the hippocampus and LS are greatest for cells that have reward-proximate place fields, suggesting a role for the LS in relaying task-relevant hippocampal spatial information to downstream areas, such as the VTA.

Conjunctive reward-place coding properties of dorsal distal CA1 hippocampus cells

Autonomous motivated spatial navigation in animals or robots requires the association between spatial location and value. Hippocampal place cells are involved in goal-directed spatial navigation and the consolidation of spatial memories. Recently, Gauthier and Tank (Neuron 99(1):179-193, 2018. https://doi.org/10.1016/j.neuron.2018.06.008) have identified a subpopulation of hippocampal cells selectively activated in relation to rewarded goals. However, the relationship between these cells' spiking activity and goal representation remains elusive. We analyzed data from experiments in which rats underwent five consecutive tasks in which reward locations and spatial context were manipulated. We found CA1 populations with properties continuously ranging from place cells to reward cells. Specifically, we found typical place cells insensitive to reward locations, reward cells that only fired at correct rewarded feeders in each task regardless of context, and "hybrid cells" that responded to spatial locations and change of reward locations. Reward cells responded mostly to the reward delivery rather than to its expectation. In addition, we found a small group of neurons that transitioned between place and reward cells properties within the 5-task session. We conclude that some pyramidal cells (if not all) integrate both spatial and reward inputs to various degrees. These results provide insights into the integrative coding properties of CA1 pyramidal cells, focusing on their abilities to carry both spatial and reward information in a mixed and plastic manner. This conjunctive coding property prompts a re-thinking of current computational models of spatial navigation in which hippocampal spatial and subcortical value representations are independent.

The hippocampus encodes delay and value information during delay-discounting decision making

The hippocampus, a region critical for memory and spatial navigation, has been implicated in delay discounting, the decline in subjective reward value when a delay is imposed. However, how delay information is encoded in the hippocampus is poorly understood. Here, we recorded from CA1 of mice performing a delay-discounting decision-making task, where delay lengths, delay positions, and reward amounts were changed across sessions, and identified subpopulations of CA1 neurons that increased or decreased their firing rate during long delays. The activity of both delay-active and -suppressed cells reflected delay length, delay position, and reward amount; but manipulating reward amount differentially impacted the two populations, suggesting distinct roles in the valuation process. Further, genetic deletion of the N-methyl-D-aspartate (NMDA) receptor in hippocampal pyramidal cells impaired delay-discount behavior and diminished delay-dependent activity in CA1. Our results suggest that distinct subclasses of hippocampal neurons concertedly support delay-discounting decisions in a manner that is dependent on NMDA receptor function.

Single-Neuron Representations of Spatial Targets in Humans

The hippocampus and surrounding medial-temporal-lobe (MTL) structures are critical for both memory and spatial navigation, but we do not fully understand the neuronal representations used to support these behaviors. Much research has examined how the MTL neurally represents spatial information, such as with "place cells" that represent an animal's current location or "head-direction cells" that code for an animal's current heading. In addition to behaviors that require an animal to attend to the current spatial location, navigating to remote destinations is a common part of daily life. To examine the neural basis of these behaviors, we recorded single-neuron activity from neurosurgical patients playing Treasure Hunt, a virtual-reality spatial-memory task. By analyzing how the activity of these neurons related to behavior in Treasure Hunt, we found that the firing rates of many MTL neurons during navigation significantly changed depending on the position of the current spatial target. In addition, we observed neurons whose firing rates during navigation were tuned to specific heading directions in the environment, and others whose activity changed depending on the timing within the trial. By showing that neurons in our task represent remote locations rather than the subject's own position, our results suggest that the human MTL can represent remote spatial information according to task demands.

Neural Representation of Overlapping Path Segments and Reward Acquisitions in the Monkey Hippocampus

Disambiguation of overlapping events is thought to be the hallmark of episodic memory. Recent rodent studies have reported that when navigating overlapping path segments in the different routes place cell activity in the same overlapping path segments were remapped according to different goal locations in different routes. However, it is unknown how hippocampal neurons disambiguate reward delivery in overlapping path segments in different routes. In the present study, we recorded monkey hippocampal neurons during performance of three virtual navigation (VN) tasks in which a monkey alternately navigated two different routes that included overlapping path segments (common central hallway) and acquired rewards in the same locations in overlapping path segments by manipulating a joystick. The results indicated that out of 106 hippocampal neurons, 57 displayed place-related activity (place-related neurons), and 18 neurons showed route-dependent activity in the overlapping path segments, consistent with a hippocampal role in the disambiguation of overlapping path segments. Moreover, 75 neurons showed neural correlates to reward delivery (reward-related neurons), whereas 56 of these 75 reward-related neurons showed route-dependent reward-related activity in the overlapping path segments. The ensemble activity of reward-related neurons represented reward delivery, locations, and routes in the overlapping path segments. In addition, ensemble activity patterns of hippocampal neurons more distinctly represented overlapping path segments than non-overlapping path segments. The present results provide neurophysiological evidence of disambiguation in the monkey hippocampus, consistent with a hippocampal role in episodic memory, and support a recent computational model of "neural differentiation," in which overlapping items are better represented by repeated retrieval with competitive learning.

Validating the theoretical bases of sleep reactivation during sharp-wave ripples and their association with emotional valence

Sleep is important for memory consolidation, and an abundant literature suggests that reactivation in the hippocampus during sleep is instrumental to this process. Yet, the current interpretation of activity during sharp-waves ripples (SWRs), as replay of wake experiences, relies on hypotheses that, while widely accepted, have only recently begun to be tested directly. Moreover, this theory has been mainly studied in the context of pure spatial learning, and it is still not clear how emotional valence can fit into this conceptual framework when considering reward- or punishment-based learning. In this review, we will present recent experimental arguments validating the interpretation of sleep replay as reactivation of awake experiences and examine the evidence showing that the emotional valence is also replayed during sleep in a coordinated fashion with hippocampal SWRs. Finally, we will detail recent experiments showing that brain-computer interfaces can be used to modify the emotional valence associated with sleep replay.

Anterior cingulate cortex encoding of effortful behavior

An animal’s ability to assess the value of their behaviors to minimize energy use while maximizing goal achievement is critical to its survival. The anterior cingulate cortex (ACC) has been previously shown to play a critical role in this behavioral optimization process, especially when animals are faced with effortful behaviors. In the present study, we designed a novel task to investigate the role of the ACC in evaluating behaviors that varied in effort but all resulted in the same outcome. We recorded single unit activity from the ACC as rats ran back and forth in a shuttle box that could be tilted to different tilt angles (0, 15, and 25°) to manipulate effort. Overall, a majority of ACC neurons showed selective firing to specific effort conditions. During effort expenditure, ACC units showed a consistent firing rate bias toward the downhill route compared with the more difficult uphill route, regardless of the tilt angle of the apparatus. Once rats completed a run and received their fixed reward, ACC units also showed a clear firing rate preference for the single condition with the highest relative value (25° downhill). To assess effort preferences, we used a choice version of our task and confirmed that rats prefer downhill routes to uphill routes when given the choice. Overall, these results help to elucidate the functional role of the ACC in monitoring and evaluating effortful behaviors that may then bias decision-making toward behaviors with the highest utility.

NEW & NOTEWORTHY We developed a novel effort paradigm to investigate how the anterior cingulate cortex (ACC) responds to behaviors with varied degrees of physical effort and how changes in effort influence the ACC’s evaluation of behavioral outcomes. Our results provide evidence for a wider role of the ACC in its ability to motivate effortful behaviors and evaluate the outcome of multiple behaviors within an environment.

Insensitivity of Place Cells to the Value of Spatial Goals in a Two-Choice Flexible Navigation Task

Hippocampal place cells show position-specific activity thought to reflect a self-localization signal. Several reports also point to some form of goal encoding by place cells. We investigated this by asking whether they also encode the value of spatial goals, which is crucial information for optimizing goal-directed navigation. We used a continuous place navigation task in which male rats navigate to one of two (freely chosen) unmarked locations and wait, triggering the release of reward, which is then located and consumed elsewhere. This allows sampling of place fields and dissociates spatial goal from reward consumption. The two goals varied in the amount of reward provided, allowing assessment of whether the rats factored goal value into their navigational choice and of possible neural correlates of this value. Rats successfully learned the task, indicating goal localization, and they preferred higher-value goals, indicating processing of goal value. Replicating previous findings, there was goal-related activity in the out-of-field firing of CA1 place cells, with a ramping-up of firing rate during the waiting period, but no general overrepresentation of goals by place fields, an observation that we extended to CA3 place cells. Importantly, place cells were not modulated by goal value. This suggests that dorsal hippocampal place cells encode space independently of its associated value despite the effect of that value on spatial behavior. Our findings are consistent with a model of place cells in which they provide a spontaneously constructed value-free spatial representation rather than encoding other navigationally relevant but nonspatial information.SIGNIFICANCE STATEMENT We investigated whether hippocampal place cells, which compute a self-localization signal, also encode the relative value of places, which is essential information for optimal navigation. When choosing between two spatial goals of different value, rats preferred the higher-value goal. We saw out-of-field goal firing in place cells, replicating previous observations that the cells are influenced by the goal, but their activity was not modulated by the value of these goals. Our results suggest that place cells do not encode all of the navigationally relevant aspects of a place, but instead form a value-free "map" that links to such aspects in other parts of the brain.

Remembering rewarding futures: A simulation-selection model of the hippocampus

Despite tremendous progress, the neural circuit dynamics underlying hippocampal mnemonic processing remain poorly understood. We propose a new model for hippocampal function-the simulation-selection model-based on recent experimental findings and neuroecological considerations. Under this model, the mammalian hippocampus evolved to simulate and evaluate arbitrary navigation sequences. Specifically, we suggest that CA3 simulates unexperienced navigation sequences in addition to remembering experienced ones, and CA1 selects from among these CA3-generated sequences, reinforcing those that are likely to maximize reward during offline idling states. High-value sequences reinforced in CA1 may allow flexible navigation toward a potential rewarding location during subsequent navigation. We argue that the simulation-selection functions of the hippocampus have evolved in mammals mostly because of the unique navigational needs of land mammals. Our model may account for why the mammalian hippocampus has evolved not only to remember, but also to imagine episodes, and how this might be implemented in its neural circuits.

Hippocampal CA1 activity correlated with the distance to the goal and navigation performance

Coding the distance to a future goal is an important function of a neural system supporting navigation. While some evidence indicates the hippocampus increases activity with proximity to the goal, others have found activity to decrease with proximity. To explore goal distance coding in the hippocampus we recorded from CA1 hippocampal place cells in rats as they navigated to learned goals in an event arena with a win-stay lose-shift rule. CA1 activity was positively correlated with the distance - decreasing with proximity to the goal. The stronger the correlation between distance to the goal and CA1 activity, the more successful navigation was in a given task session. Acceleration, but not speed, was also correlated with the distance to the goal. However, the relationship between CA1 activity and navigation performance was independent of variation in acceleration and variation in speed. These results help clarify the situations in which CA1 activity encodes navigationally relevant information and the extent to which it relates to behavior.

Spatial Representation of Hippocampal Place Cells in a T-Maze with an Aversive Stimulation

The hippocampus contains place cells representing spaces in an environment, and these place cells have been suggested to play a fundamental role in the formation of a cognitive map for spatial processing. However, how alterations in the firing patterns of place cells in response to aversive events encode the locations tied to these aversive events is unknown. Here, we analyzed spiking patterns of place cell ensembles in the dorsal hippocampal CA1 region of rats performing a T-maze alternation task with an aversive air-puff stimulation applied at a specific location on one side of a trajectory. The intensity of the air puff was adjusted so that the rats decreased their running speed before passing the aversive location. The addition of the aversive stimulus induced reorganization of place cell ensembles on both left and right trajectories with and without the aversive stimulus, respectively. Specifically, the animals showed a more abundant spatial representation in the vicinity of the aversive location. Removing the aversive stimulus induced new spatial firing patterns on both of the trajectories that differed from those both before and during application of the aversive stimulus. These results demonstrate that hippocampal spatial maps are flexibly reorganized to represent particular aversive events.

Distinct hippocampal-cortical memory representations for experiences associated with movement versus immobility

While ongoing experience proceeds continuously, memories of past experience are often recalled as episodes with defined beginnings and ends. The neural mechanisms that lead to the formation of discrete episodes from the stream of neural activity patterns representing ongoing experience are unknown. To investigate these mechanisms, we recorded neural activity in the rat hippocampus and prefrontal cortex, structures critical for memory processes. We show that during spatial navigation, hippocampal CA1 place cells maintain a continuous spatial representation across different states of motion (movement and immobility). In contrast, during sharp-wave ripples (SWRs), when representations of experience are transiently reactivated from memory, movement- and immobility-associated activity patterns are most often reactivated separately. Concurrently, distinct hippocampal reactivations of movement- or immobility-associated representations are accompanied by distinct modulation patterns in prefrontal cortex. These findings demonstrate a continuous representation of ongoing experience can be separated into independently reactivated memory representations.

A Computational Model for Spatial Navigation Based on Reference Frames in the Hippocampus, Retrosplenial Cortex, and Posterior Parietal Cortex

Behavioral studies for humans, monkeys, and rats have shown that, while traversing an environment, these mammals tend to use different frames of reference and frequently switch between them. These frames represent allocentric, egocentric, or route-centric views of the environment. However, combinations of either of them are often deployed. Neurophysiological studies on rats have indicated that the hippocampus, the retrosplenial cortex, and the posterior parietal cortex contribute to the formation of these frames and mediate the transformation between those. In this paper, we construct a computational model of the posterior parietal cortex and the retrosplenial cortex for spatial navigation. We demonstrate how the transformation of reference frames could be realized in the brain and suggest how different brain areas might use these reference frames to form navigational strategies and predict under what conditions an animal might use a specific type of reference frame. Our simulated navigation experiments demonstrate that the model’s results closely resemble behavioral findings in humans and rats. These results suggest that navigation strategies may depend on the animal’s reliance in a particular reference frame and shows how low confidence in a reference frame can lead to fluid adaptation and deployment of alternative navigation strategies. Because of its flexibility, our biologically inspired navigation system may be applied to autonomous robots.

Sublayer-Specific Coding Dynamics during Spatial Navigation and Learning in Hippocampal Area CA1

The mammalian hippocampus is critical for spatial information processing and episodic memory. Its primary output cells, CA1 pyramidal cells (CA1 PCs), vary in genetics, morphology, connectivity, and electrophysiological properties. It is therefore possible that distinct CA1 PC subpopulations encode different features of the environment and differentially contribute to learning. To test this hypothesis, we optically monitored activity in deep and superficial CA1 PCs segregated along the radial axis of the mouse hippocampus and assessed the relationship between sublayer dynamics and learning. Superficial place maps were more stable than deep during head-fixed exploration. Deep maps, however, were preferentially stabilized during goal-oriented learning, and representation of the reward zone by deep cells predicted task performance. These findings demonstrate that superficial CA1 PCs provide a more stable map of an environment, while their counterparts in the deep sublayer provide a more flexible representation that is shaped by learning about salient features in the environment. VIDEO ABSTRACT.

Place cells on a maze encode routes rather than destinations

Hippocampal place cells fire at different rates when a rodent runs through a given location on its way to different destinations. However, it is unclear whether such firing represents the animal’s intended destination or the execution of a specific trajectory. To distinguish between these possibilities, Lister Hooded rats (n = 8) were trained to navigate from a start box to three goal locations via four partially overlapping routes. Two of these led to the same goal location. Of the cells that fired on these two routes, 95.8% showed route-dependent firing (firing on only one route), whereas only two cells (4.2%) showed goal-dependent firing (firing similarly on both routes). In addition, route-dependent place cells over-represented the less discriminable routes, and place cells in general over-represented the start location. These results indicate that place cell firing on overlapping routes reflects the animal’s route, not its goals, and that this firing may aid spatial discrimination.

DOI:http://dx.doi.org/10.7554/eLife.15986.001

How does the brain represent the outside world? One way of answering this question is to study the brains of rats, because the basic plan of a rodent’s brain is similar to that of other mammals, such as humans. For example, the brains of rodents and humans both contain a structure called the hippocampus, which plays important roles in navigation and spatial memory. Cells within the hippocampus called place cells support these processes by firing electrical impulses whenever the animal occupies a specific location.

When a rat runs along a corridor in a maze, its place cells often fire as it approaches a choice point. A given place cell will typically fire before the rat chooses a path leading towards one particular location, but not before choices that lead to other locations. The firing that occurs prior to the choice point is termed “prospective firing”. However, it is not known whether the prospective firing of place cells represents the rat’s final destination, or the specific route the animal takes to get there.

To address this question, Grieves et al. designed a maze in which two different paths from a starting corridor led to the same goal location. If place cells represent the goal location, they should fire whichever route the rat chooses. However, if they represent the specific path the rat takes to the goal, they should fire on one or the other route, but not both.

Grieves et al. found that almost all place cells with prospective activity in the starting corridor fired on a single route, as opposed to firing on both routes to the common goal. This suggests that the prospective firing in the hippocampus reflects the route the animal will take, rather than its intended destination. A future challenge will be to understand how the way the hippocampus codes routes interacts with brain circuits that code for intended goals, and how the activity of these circuits influences the animal’s ability to navigate.

DOI:http://dx.doi.org/10.7554/eLife.15986.002

Neuronal correlates of attention and its disengagement in the superior colliculus of rat

Orienting attention to a new target requires prior disengagement of attention from the current focus. Previous studies indicate that the superior colliculus (SC) plays an important role in attention. However, recordings of responses of SC neurons during attentional disengagement have not yet been reported. Here, we analyzed rat SC neuronal activity during performance of an attention-shift task with and without disengagement. In this task, conditioned stimuli (CSs; right and/or left light-flash or sound) were sequentially presented. To obtain an intracranial self-stimulation reward, rats were required to lick a spout when an infrequent conditioned stimulus appeared (reward trials). In the disengagement reward trials, configural stimuli consisting of an infrequent stimulus and frequent stimulus in the former trials were presented; in the non-disengagement reward trials, only an infrequent stimulus was presented. Of the 186 SC neurons responding to the CSs, 41 showed stronger responses to the CSs in the disengagement reward trials than in the non-disengagement reward trials (disengagement-related neurons). Furthermore, lick latencies in the disengagement reward trials were negatively correlated with response magnitudes to the CSs in half of the disengagement-related neurons. These disengagement-related neurons were located mainly in the deep layers of the SC. Another 70 SC neurons responded to the CSs in both disengagement and non-disengagement reward trials, suggesting that these neurons were involved in attention engagement. Our results suggest complementary mechanisms of attentional shift based on two subpopulations of neurons in the SC.

Hippocampal place cell responses to distal and proximal cue manipulations in dopamine D2 receptor-knockout mice

The human hippocampus is critical for learning and memory. In rodents, hippocampal pyramidal neurons fire in a location-specific manner and form relational representations of environmental cues. The important roles of dopaminergic D1 receptors in learning and in hippocampal neural synaptic plasticity in novel environments have been previously shown. However, the roles of D2 receptors in hippocampal neural plasticity in response to novel and familiar spatial stimuli remain unclear. In order to clarify this issue, we recorded from hippocampal neurons in dopamine D2 receptor-knockout (D2R-KO) mice and their wild-type (WT) littermates during manipulations of distinct spatial cues in familiar and novel environments. Here, we report that D2R-KO mice showed substantial deficits in place-cell properties (number of place cells, intra-field firing rates, spatial tuning, and spatial coherence). Furthermore, although place cells in D2R-KO mice responded to manipulations of distal and proximal cues in both familiar and novel environments in a manner that was similar to place cells in WT mice, place fields were less stable in the D . The axes represent the differences between the peak and the valley of each waveform of EL2 and EL3.2R-KO mice in the familiar environment, but not in the novel environment. The present results suggested that D2 receptors in the hippocampus are important for place response stability. The place-cell properties of D2R-KO mice were similar to aged animals, suggesting that the alterations of place-cell properties in aged animals might be ascribed partly to alterations in the D2R in the HF of aged animals.

Complementary Roles of the Hippocampus and the Dorsomedial Striatum during Spatial and Sequence-Based Navigation Behavior

We investigated the neural bases of navigation based on spatial or sequential egocentric representation during the completion of the starmaze, a complex goal-directed navigation task. In this maze, mice had to swim along a path composed of three choice points to find a hidden platform. As reported previously, this task can be solved by using two hippocampal-dependent strategies encoded in parallel i) the allocentric strategy requiring encoding of the contextual information, and ii) the sequential egocentric strategy requiring temporal encoding of a sequence of successive body movements associated to specific choice points. Mice were trained during one day and tested the following day in a single probe trial to reveal which of the two strategies was spontaneously preferred by each animal. Imaging of the activity-dependent gene c-fos revealed that both strategies are supported by an overlapping network involving the dorsal hippocampus, the dorsomedial striatum (DMS) and the medial prefrontal cortex. A significant higher activation of the ventral CA1 subregion was observed when mice used the sequential egocentric strategy. To investigate the potential different roles of the dorsal hippocampus and the DMS in both types of navigation, we performed region-specific excitotoxic lesions of each of these two structures. Dorsal hippocampus lesioned mice were unable to optimally learn the sequence but improved their performances by developing a serial strategy instead. DMS lesioned mice were severely impaired, failing to learn the task. Our data support the view that the hippocampus organizes information into a spatio-temporal representation, which can then be used by the DMS to perform goal-directed navigation.

Framing spatial cognition: neural representations of proximal and distal frames of reference and their roles in navigation

The most common behavioral test of hippocampus-dependent, spatial learning and memory is the Morris water task, and the most commonly studied behavioral correlate of hippocampal neurons is the spatial specificity of place cells. Despite decades of intensive research, it is not completely understood how animals solve the water task and how place cells generate their spatially specific firing fields. Based on early work, it has become the accepted wisdom in the general neuroscience community that distal spatial cues are the primary sources of information used by animals to solve the water task (and similar spatial tasks) and by place cells to generate their spatial specificity. More recent research, along with earlier studies that were overshadowed by the emphasis on distal cues, put this common view into question by demonstrating primary influences of local cues and local boundaries on spatial behavior and place-cell firing. This paper first reviews the historical underpinnings of the "standard" view from a behavioral perspective, and then reviews newer results demonstrating that an animal's behavior in such spatial tasks is more strongly controlled by a local-apparatus frame of reference than by distal landmarks. The paper then reviews similar findings from the literature on the neurophysiological correlates of place cells and other spatially correlated cells from related brain areas. A model is proposed by which distal cues primarily set the orientation of the animal's internal spatial coordinate system, via the head direction cell system, whereas local cues and apparatus boundaries primarily set the translation and scale of that coordinate system.

A computational model of the hippocampus that represents environmental structure and goal location, and guides movement

Hippocampal place cells (PCs) are believed to represent environmental structure. However, it is unclear how and which brain regions represent goals and guide movements. Recently, another type of cells that fire around a goal was found in rat hippocampus (we designate these cells as goal place cells, GPCs). This suggests that the hippocampus is also involved in goal representation. Assuming that the activities of GPCs depend on the distance to a goal, we propose an adaptive navigation model. By monitoring the population activity of GPCs, the model navigates to shorten the distance to the goal. To achieve the distance-dependent activities of GPCs, plastic connections are assumed between PCs and GPCs, which are modified depending on two reward-triggered activities: activity propagation through PC-PC network representing the topological environmental structure, and the activity of GPCs with different durations. The former activity propagation is regarded as a computational interpretation of "reverse replay" phenomenon found in rat hippocampus. Simulation results confirm that after reaching a goal only once, the model can navigate to the goal along almost the shortest path from arbitrary places in the environment. This indicates that the hippocampus might play a primary role in the representation of not only the environmental structure but also the goal, in addition to guiding the movement. This navigation strategy using the population activity of GPCs is equivalent to the taxis strategy, the simplest and most basic for biological systems. Our model is unique because this simple strategy allows the model to follow the shortest path in the topological map of the environment.

Hippocampal lesions impair rapid learning of a continuous spatial alternation task

The hippocampus is essential for the formation of memories for events, but the specific features of hippocampal neural activity that support memory formation are not yet understood. The ideal experiment to explore this issue would be to monitor changes in hippocampal neural coding throughout the entire learning process, as subjects acquire and use new episodic memories to guide behavior. Unfortunately, it is not clear whether established hippocampally-dependent learning paradigms are suitable for this kind of experiment. The goal of this study was to determine whether learning of the W-track continuous alternation task depends on the hippocampal formation. We tested six rats with NMDA lesions of the hippocampal formation and four sham-operated controls. Compared to controls, rats with hippocampal lesions made a significantly higher proportion of errors and took significantly longer to reach learning criterion. The effect of hippocampal lesion was not due to a deficit in locomotion or motivation, because rats with hippocampal lesions ran well on a linear track for food reward. Rats with hippocampal lesions also exhibited a pattern of perseverative errors during early task experience suggestive of an inability to suppress behaviors learned during pretraining on a linear track. Our findings establish the W-track continuous alternation task as a hippocampally-dependent learning paradigm which may be useful for identifying changes in the neural representation of spatial sequences and reward contingencies as rats learn and apply new task rules.

Do rats really express neophobia towards novel objects? Experimental evidence from exposure to novelty and to an object recognition task in an open space and an enclosed space

Three set of experiments were performed in an enclosed space (open-field) and in an open space (elevated platform). The surface of the open-field and the elevated platform were divided in nine equal squares. Rats were exposed (without previous habituation) in a unique session (experiment 1) or three consecutive sessions (experiment 2) either to an open-field (enclosed space) or to an elevated platform (open space) with and without an object on the centre of the field. In experiment 3, rats were exposed (without previous habituation) either to an enclosed or an open space on five consecutive sessions, one session a day. They were tested in an object recognition test in sessions 1, 3 and 5. In sessions 2 and 4, no objects were present. In experiment 1, we recorded the latency, frequency and duration of entries into different areas of the field. In experiment 3, we recorded the latency, frequency and duration of contacts with objects in addition to entries into different areas of the field. The first experiment demonstrates that rats exposed for the first time to an enclosed or an open space do not express neophobia toward novel objects in the absence of walls that surround an open-field. They crossed frequently into and spent more time in areas occupied with an object than in unoccupied areas. After two sessions of habituation to an empty open space or an empty enclosed space, the latency of first approach to a novel object is reduced while the frequency and duration of approaches are increased. The third experiment on object recognition confirmed that rats do not avoid novel objects; they made frequent visit and spent more time in the corner of the field occupied with an object than in empty corners. Recording of crossings provided detailed information about the patterns of exploratory behavior of rats but failed to reveal discrimination between novel and familiar objects which was evident in both open and enclosed space with recording of contacts with objects on the fifth exposure.

Goal-related activity in hippocampal place cells

Place cells are hippocampal neurons whose discharge is strongly related to a rat's location in its environment. The existence of place cells has led to the proposal that they are part of an integrated neural system dedicated to spatial navigation, an idea supported by the discovery of strong relationships between place cell activity and spatial problem solving. To further understand such relationships, we examined the discharge of place cells recorded while rats solved a place navigation task. We report that, in addition to having widely distributed firing fields, place cells also discharge selectively while the hungry rat waits in an unmarked goal location to release a food pellet. Such firing is not duplicated in other locations outside the main firing field even when the rat's behavior is constrained to be extremely similar to the behavior at the goal. We therefore propose that place cells provide both a geometric representation of the current environment and a reflection of the rat's expectancy that it is located correctly at the goal. This on-line feedback about a critical aspect of navigational performance is proposed to be signaled by the synchronous activity of the large fraction of place cells active at the goal. In combination with other (prefrontal) cells that provide coarse encoding of goal location, hippocampal place cells may therefore participate in a neural network allowing the rat to plan accurate trajectories in space.

Reactivation of behavioral activity during sharp waves: A computational model for two stage hippocampal dynamics

The rodent hippocampus is known to exhibit two very distinctive patterns of activity: theta with place selective cells firing during exploratory behavior and sharp waves (SPWs) associated with collective discharges in the CA3 during slow wave sleep (SWS), inactivity while awake and consummatory behavior. A great deal of evidence has demonstrated that the cells activated during SPWs events are representative of previous behavioral activity, which suggests an important functional role of off-line learning and consolidation for these SPWs events. Supporting this view, forward, and more recently, reverse replay of linear track behavioral sequences have been reported in rodent's hippocampal place cells during SPWs. We demonstrate here that these patterns of reactivation can be successfully reproduced by relying on a computational model of the hippocampus with theta phase precession and synaptic plasticity during theta rhythm. Two mechanisms are proposed to initiate SPWs events: random reactivation in the presence of rapid, irregular subthreshold inputs and place selective cell activations. In 2D navigation computational experiments, rather than observing the perfect replay of experienced pathways, new pathways "experienced during immobility" emerge. This suggests a neural mechanism for shortcut navigation.

Space and context in the temporal cortex

The hippocampus has a critical role in certain kinds of spatial memory processes. Hippocampal "place" cells, fire selectively when an animal is in a particular location within the environment. It is thought that this activity underlies a representation of the environment that can be used for memory-based spatial navigation. But how is this representation constructed and how is it "read"? A simple mechanism, based on place field density across an environment, is described that could allow hippocampal representations to be "read" by other brain regions for the purpose of navigation. The possible influence of activity in neighboring brain regions such as the perirhinal cortex, and pre- and para-subiculum on the construction of the hippocampal spatial representation is then discussed.

The dynamic nature of spatial encoding in the hippocampus

Many hippocampal neurons (place cells) appear to represent a particular location within an environment (their place field). This property would appear to be central to hippocampal involvement in navigation based on spatial memory. Although a navigationally useful representation might also include information about distal goals, having a place field and being able to represent a distal goal would appear to be mutually exclusive place cell properties. Our simulations demonstrate, however, that information about goal direction can be simply derived from the changes in place field density that occur when place fields shift location in a goal-directed manner. Previous reports that place fields respond dynamically to shifts in goal location may, therefore, represent the operation of such a system.

Learning-related development of context-specific neuronal responses to places and events: the hippocampal role in context processing

Contextual information plays a key role in learning and memory. Learned information becomes associated with the context such that the context can cue the relevant memories and behaviors. An extensive literature involving experimental brain lesions has implicated the hippocampus in context processing. However, the neurophysiological mechanisms of context coding are not known. Although "context" has typically been defined in terms of the background cues, recent studies indicate that hippocampal neurons are sensitive to subtle changes in task demands, even in an unchanging environment. Thus, the context may also include non-environmental features of a learning situation. In the present study, hippocampal neuronal activity was recorded while rats learned to approach different reward locations in two contexts. Because all of the training took place in the same environment, the contexts were defined by the task demands rather than by environmental stimuli. Learning to differentiate two such contexts was associated with the development of highly context-specific neuronal firing patterns. These included different place fields in pyramidal neurons and different event (e.g., reward) responses in pyramidal and interneurons. The differential firing patterns did not develop in a control condition that did not involve a context manipulation. The context-specific firing patterns could modulate activity in extrahippocampal structures to prime context-appropriate behavioral responses and memories. These results provide direct support for a context processing role of the hippocampus and suggest that the hippocampus contributes contextual representations to episodic memories.

Spatial firing properties of lateral septal neurons

The present study describes the spatial firing properties of neurons in the lateral septum (LS). LS neuronal activity was recorded in rats as they performed a spatial navigation task in an open field. In this task, the rat acquired an intracranial self-stimulation reward when it entered a certain place, a location that varied randomly from trial to trial. Of 193 neurons recorded in the LS, 81 showed place-related activity. The majority of the tested neurons changed place-related activity when spatial relations between environmental cues were altered by rotating intrafield (proximal) cues. The comparison of place activities between LS place-related neurons recorded in the present study and hippocampal place cells recorded in our previous study, using identical behavioral and recording procedures, revealed that spatial parameters (spatial information content, coherence, and cluster size) were smaller in the LS than in the hippocampus. Of the 193 LS neurons, 86 were influenced by intracranial self-stimulation rewards; 31 of these 86 were also place-related. These results, together with previous anatomical and behavioral observations, suggest that the spatial information sent from the hippocampus to the LS is modulated by and interacts with signals related to reward in the LS.

Topography of Arc/Arg3.1 mRNA expression in the dorsal and ventral hippocampus induced by recent and remote spatial memory recall: dissociation of CA3 and CA1 activation

The understanding of the mechanisms of memory retrieval and its deficits, and the detection of memory underlying neuronal plasticity, is greatly impeded by a lack of precise knowledge of the brain circuitry that underlies the functions of memory. The specific roles of anatomically distinct hippocampal subdivisions in recent and long-term memory retention and recall are essentially unknown. To address these questions, we mapped the expression of Arc/Arg 3.1 mRNA, a neuronal activity marker, in memory retention at multiple rostrocaudal levels of the dentate gyrus, CA3, CA1, subiculum, and lateral and medial entorhinal cortices after a platform search in a water-maze spatial task at 24 h and 1 month compared with swim and naive controls. We found that the entorhinohippocampal neuronal activity underlying the recall of recent and remote spatial memory has an anatomically distributed and time-dependent organization throughout both the dorsal and ventral hippocampus that is subdivision specific. We found a dissociation in the activity of the entorhinal cortex, CA3, and CA1 over a period of memory consolidation. Although CA3, the dorsal hippocampus, and the entorhinal cortex demonstrated the most persistent learning-specific signal during both recent and long-term memory recall, CA1 and the ventral hippocampus displayed the most dramatic signal decline. We determined the coordinates of activity clusters in the hippocampal subdivisions during the platform search and their dynamics over time. Our mapping data suggest that although the level of corticohippocampal interaction is similar during the retrieval of recent and remote spatial memories, the mnemonic function of the hippocampus may have changed, and the activity underlying remote spatial memory could be anatomically segregated within hippocampal subdivisions in small segments.

Dopamine D1 receptors involved in locomotor activity and accumbens neural responses to prediction of reward associated with place

Predicting reward is essential in learning approach behaviors. Dopaminergic activity has been implicated in reward, movement, and cognitive processes, all essential elements in learning. The nucleus accumbens (NAc) receives converging inputs from corticolimbic information-processing areas and from mesolimbic dopamine neurons originating in the ventral tegmental area. Previously, we reported that in mice, a dopamine D2 receptor knockout (D2R-KO) eliminated the prereward inhibitory response, increased place-field size of NAc neurons, and reduced locomotor activity without marked change in intracranial self-stimulation (ICSS) behavior. The present study investigated the specific contribution of dopamine D1 receptor (D1R) in mediating reward, locomotor activity, and spatial associative processes and in regulating NAc neural responses. In contrast to D2R-KO animals, here we find D1R-KO in mice selectively eliminated the prereward excitatory response and decreased place-field size of NAc neurons. Furthermore, D1R-KO impaired ICSS behavior, seriously reduced locomotor activity, and retarded acquisition of a place learning task. Thus, the present results suggest that D1R may be an important determinant in brain stimulation reward (ICSS) and participates in coding for a type of reward prediction of NAc neurons and in spatial learning.

Proof of the mysterious efficacy of ginseng: basic and clinical trials: effects of red ginseng on learning and memory deficits in an animal model of amnesia

Ameliorating effects of red ginseng on learning and memory deficits due to hippocampal lesions and aging were reviewed; the performance of young rats with selective hippocampal lesions with or without red ginseng (p.o.), and aged rats with or without red ginseng (p.o.) in the spatial learning tasks was compared with that of sham-operated or intact young rats. Each rat was tested with 3 types of spatial learning tasks (distance movement task, DMT; random reward place search task, RRPST; and place learning task, PLT) in a circular open field using intracranial self-stimulation (ICSS) as reward. The results in the DMT and RRPST indicated that motivational and motor activity of young rats with hippocampal lesions with and without ginseng and aged rats with and without ginseng were not significantly different from that of control young rats. However, young rats with hippocampal lesions without ginseng and aged rats without ginseng displayed significant deficits in the PLT. Treatment with red ginseng significantly ameliorated place-navigation deficits in young rats with hippocampal lesions in the PLT. Similarly, red ginseng improved performance of aged rats in the PLT. The results, along with previous studies showing significant effects of red ginseng on the central nervous system, suggest that red ginseng ameliorates learning and memory deficits through effects on the central nervous system, partly through effects on the hippocampal formation. However, its mechanisms are still unclear, and further studies are required.

Differential but complementary mnemonic functions of the hippocampus and subiculum

In this study we describe how the hippocampus and subiculum act in concert to encode information in a spatial delayed-nonmatch-to-sample (DNMS) task. This encoding was functionally partitioned between neurons within subiculum and hippocampus to uniquely identify trial-specific information accounting for both spatial and temporal constraints on performance within and between trials. Encoding by subicular neurons in the task was normally accurate and specific, but only if delays were shorter than 15 s, whereas trial-specific information encoded by hippocampal neurons was subject to strong biases from prior trial sequences and was accessible only when delays exceeded 15 s. The two structures operated in a complementary manner to encode information correctly on 75% of all trials using the above strategies. The remaining 25% of trials were at risk due to inherent idiosyncrasies by which hippocampal and subicular neurons encoded information and became errors when the random sequence of trials conflicted with these constraints.

The neuromatrix and the epileptic brain: behavioral and learning preservation in limbic epileptic rats treated with ketamine but not acepromazine

Conceiving the organization of the brain as a "neuromatrix" could provide significant insights into how different injuries to the nervous system could result in very distinct changes in behavior. The use of different pharmacological treatments to combat the deleterious consequences of such injuries is common practice. However, such treatments may have the capacity to alter the configurations of various neuronal circuits that contribute to the "neuromatrix" by selectively preventing damage to some pathways while facilitating the spread of destruction along others. The choice of pharmacological treatment may have profound consequences on the recovery of normal functioning following injury. We examined the behavior of rats treated with one of two potentially neuroprotective agents, the N-methyl-D-aspartate antagonist ketamine and the atypical neuroleptic acepromazine, on seizures induced by lithium-pilocarpine. Rats treated with ketamine following seizure onset were virtually indistinguishable from nonepileptic controls on a variety of behavioral tasks that included tests on learning, memory, and anxiety. In contrast, acepromazine-treated rats showed marked deficits on all learning and behavioral measures tested. These results suggest that administration of ketamine relatively soon after the emergence of epilepsy can prevent many of the cognitive deficits that are commonly found in rats subjected to lithium-pilocarpine-induced seizures. Further clinical testing investigating ketamine as a potential adjunct treatment for epilepsy may be well warranted.