Parallel processing across neural systems: Implications for a multiple memory system hypothesis

Temporal context and latent state inference in the hippocampal splitter signal

The hippocampus is thought to enable the encoding and retrieval of ongoing experience, the organization of that experience into structured representations like contexts, maps, and schemas, and the use of these structures to plan for the future. A central goal is to understand what the core computations supporting these functions are, and how these computations are realized in the collective action of single neurons. A potential access point into this issue is provided by 'splitter cells', hippocampal neurons that fire differentially on the overlapping segment of trajectories that differ in their past and/or future. However, the literature on splitter cells has been fragmented and confusing, owing to differences in terminology, behavioral tasks, and analysis methods across studies. In this review, we synthesize consistent findings from this literature, establish a common set of terms, and translate between single-cell and ensemble perspectives. Most importantly, we examine the combined findings through the lens of two major theoretical ideas about hippocampal function: representation of temporal context and latent state inference. We find that unique signature properties of each of these models are necessary to account for the data, but neither theory, by itself, explains all of its features. Specifically, the temporal gradedness of the splitter signal is strong support for temporal context, but is hard to explain using state models, while its flexibility and task-dependence is naturally accounted for using state inference, but poses a challenge otherwise. These theories suggest a number of avenues for future work, and we believe their application to splitter cells is a timely and informative domain for testing and refining theoretical ideas about hippocampal function.

Phasic stimulation in the nucleus accumbens enhances learning after traumatic brain injury

Traumatic brain injury (TBI) is a significant cause of morbidity and mortality worldwide. Despite improvements in survival, treatments that improve functional outcome remain lacking. There is, therefore, a pressing need to develop novel treatments to improve functional recovery. Here, we investigated task-matched deep-brain stimulation of the nucleus accumbens (NAc) to augment reinforcement learning in a rodent model of TBI. We demonstrate that task-matched deep brain stimulation (DBS) of the NAc can enhance learning following TBI. We further demonstrate that animals receiving DBS exhibited greater behavioral improvement and enhanced neural proliferation. Treated animals recovered to an uninjured behavioral baseline and showed retention of improved performance even after stimulation was stopped. These results provide encouraging early evidence for the potential of NAc DBS to improve functional outcomes following TBI and that its effects may be broad, with alterations in neurogenesis and synaptogenesis.

Response Flexibility: The Role of the Lateral Habenula

The ability to make appropriate decisions that result in an optimal outcome is critical for survival. This process involves assessing the environment as well as integrating prior knowledge about the environment with information about one’s current internal state. There are many neural structures that play critical roles in mediating these processes, but it is not yet known how such information coalesces to influence behavioral output. The lateral habenula (LHb) has often been cited as a structure critical for adaptive and flexible responding when environmental contexts and internal state changes. A challenge, however, has been understanding how LHb promotes response flexibility. In this review, we hypothesize that the LHb enables flexible responding following the integration of context memory and internal state information by signaling downstream brainstem structures known to drive hippocampal theta. In this way, animals respond more flexibly in a task situation not because the LHb selects a particular action, but rather because LHb enhances a hippocampal neural state that is often associated with greater attention, arousal, and exploration. In freely navigating animals, these are essential conditions that are needed to discover and implement appropriate alternative choices and behaviors. As a corollary to our hypothesis, we describe short- and intermediate-term functions of the LHb. Finally, we discuss the effects on the behavior of LHb dysfunction in short- and intermediate-timescales, and then suggest that new therapies may act on the LHb to alleviate the behavioral impairments following long-term LHb disruption.

Space, feature, and risk sensitivity in homing pigeons (Columba livia): Broadening the conversation on the role of the avian hippocampus in memory

David Sherry has been a pioneer in investigating the avian hippocampal formation (HF) and spatial memory. Following on his work and observations that HF is sensitive to the occurrence of reward (food), we were interested in carrying out an exploratory study to investigate possible HF involvement in the representation goal value and risk. Control sham-lesioned and hippocampal-lesioned pigeons were trained in an open field to locate one food bowl containing a constant two food pellets on all trials, and two variable bowls with one containing five pellets on 75% (High Variable) and another on 25% (Low Variable) of their respective trials (High-Variable and Low-Variable bowls were never presented together). One pairing of pigeons learned bowl locations (space); another bowl colors (feature). Trained to color, hippocampal-lesioned pigeons performed as rational agents in their bowl choices and were indistinguishable from the control pigeons, a result consistent with HF regarded as unimportant for non-spatial memory. By contrast, when trained to location, hippocampal-lesioned pigeons differed from the control pigeons. They made more first-choice errors to bowls that never contained food, consistent with a role of HF in spatial memory. Intriguingly, the hippocampal-lesioned pigeons also made fewer first choices to both variable bowls, suggesting that hippocampal lesions resulted in the pigeons becoming more risk averse. Acknowledging that the results are preliminary and further research is needed, the data nonetheless support the general hypothesis that HF-dependent memory representations of space capture properties of reward value and risk, properties that contribute to decision making when confronted with a choice.

Melamine disrupts spatial reversal learning and learning strategy via inhibiting hippocampal BDNF-mediated neural activity

Although several studies showed adverse neurotoxic effects of melamine on hippocampus (HPC)-dependent learning and reversal learning, the evidence for this mechanism is still unknown. We recently demonstrated that intra-hippocampal melamine injection affected the induction of long-term depression, which is associated with novelty acquisition and memory consolidation. Here, we infused melamine into the HPC of rats, and employed behavioral tests, immunoblotting, immunocytochemistry and electrophysiological methods to sought evidence for its effects on cognitive flexibility. Rats with intra-hippocampal infusion of melamine displayed dose-dependent increase in trials to the criterion in reversal learning, with no locomotion or motivation defect. Compared with controls, melamine-treated rats avoided HPC-dependent place strategy. Meanwhile, the learning-induced BDNF level in the HPC neurons was significantly reduced. Importantly, bilateral intra-hippocampal BDNF infusion could effectively mitigate the suppressive effects of melamine on neural correlate with reversal performance, and rescue the strategy bias and reversal learning deficits. Our findings provide first evidence for the effect of melamine on cognitive flexibility and suggest that the reversal learning deficit is due to the inability to use place strategy. Furthermore, the suppressive effects of melamine on BDNF-mediated neural activity could be the mechanism, thus advancing the understanding of compulsive behavior in melamine-induced and other neuropsychiatric disorders.

Interindividual differences in memory system local field potential activity predict behavioral strategy on a dual-solution T-maze

Individuals can use diverse behavioral strategies to navigate their environment including hippocampal-dependent place strategies reliant upon cognitive maps and striatal-dependent response strategies reliant upon egocentric body turns. The existence of multiple memory systems appears to facilitate successful navigation across a wide range of environmental and physiological conditions. The mechanisms by which these systems interact to ultimately generate a unitary behavioral response, however, remain unclear. We trained 20 male, Sprague-Dawley rats on a dual-solution T-maze while simultaneously recording local field potentials that were targeted to the dorsolateral striatum and dorsal hippocampus. Eight rats spontaneously exhibited a place strategy while the remaining 12 rats exhibited a response strategy. Interindividual differences in behavioral strategy were associated with distinct patterns of LFP activity between the dorsolateral striatum and dorsal hippocampus. Specifically, striatal-hippocampal theta activity was in-phase in response rats and out-of-phase in place rats and response rats exhibited elevated striatal-hippocampal coherence across a wide range of frequency bands. These contrasting striatal-hippocampal activity regimes were (a) present during both maze-learning and a 30 min premaze habituation period and (b) could be used to train support vector machines to reliably predict behavioral strategy. Distinct patterns of neuronal activity across multiple memory systems, therefore, appear to bias behavioral strategy selection and thereby contribute to interindividual differences in behavior.

Flexible use of allocentric and egocentric spatial memories activates differential neural networks in mice

Goal-directed navigation can be based on world-centered (allocentric) or body-centered (egocentric) representations of the environment, mediated by a wide network of interconnected brain regions, including hippocampus, striatum and prefrontal cortex. The relative contribution of these regions to navigation from novel or familiar routes, that demand a different degree of flexibility in the use of the stored spatial representations, has not been completely explored. To address this issue, we trained mice to find a reward relying on allocentric or egocentric information, in a modified version of the cross-maze task. Then we used Zif268 expression to map brain activation when well-trained mice were required to find the goal from a novel or familiar location. Successful navigation was correlated with the activation of CA1, posterior-dorsomedial striatum, nucleus accumbens core and infralimbic cortex when allocentric-trained mice needed to use a novel route. Allocentric navigation from a familiar route activated dorsomedial striatum, nucleus accumbens, prelimbic and infralimbic cortex. None of the structures analyzed was significantly activated in egocentric-trained mice, irrespective of the starting position. These data suggest that a flexible use of stored allocentric information, that allows goal finding even from a location never explored during training, induces a shift from fronto-striatal to hippocampal circuits.

CB1 Activity Drives the Selection of Navigational Strategies: A Behavioral and c-Fos Immunoreactivity Study

To promote efficient explorative behaviors, subjects adaptively select spatial navigational strategies based on landmarks or a cognitive map. The hippocampus works alone or in conjunction with the dorsal striatum, both representing the neuronal underpinnings of the navigational strategies organized on the basis of different systems of spatial coordinate integration. The high expression of cannabinoid type 1 (CB₁) receptors in structures related to spatial learning—such as the hippocampus, dorsal striatum and amygdala—renders the endocannabinoid system a critical target to study the balance between landmark- and cognitive map-based navigational strategies. In the present study, mice treated with the CB₁-inverse agonist/antagonist AM251 or vehicle were trained on a Circular Hole Board, a task that could be solved through either navigational strategy. At the end of the behavioral testing, c-Fos immunoreactivity was evaluated in specific nuclei of the hippocampus, dorsal striatum and amygdala. AM251 treatment impaired spatial learning and modified the pattern of the performed navigational strategies as well as the c-Fos immunoreactivity in the hippocampus, dorsal striatum and amygdala. The present findings shed light on the involvement of CB₁ receptors as part of the selection system of the navigational strategies implemented to efficiently solve the spatial problem.

Selective Functional Interaction Between the Lateral Habenula and Hippocampus During Different Tests of Response Flexibility

The lateral habenula (LHb) has been shown to play critical roles in a variety of appetitive tasks (e.g., spatial memory and object recognition) that require animals to flexibly respond to changing task conditions. These types of tasks are known to be dependent on hippocampus (HPC) and/or medial prefrontal cortex (mPFC), suggesting that the LHb contributes to the limbic memory circuit. Here we provide new evidence that the LHb and HPC play distinct but complimentary roles in tasks that require flexible responding to changing task conditions. Experiment 1 tested whether the LHb is needed for the performance of a HPC-dependent maze-based spatial delayed alternation task. The importance of interactions between the LHb and HPC to accomplish the same spatial delayed alternation task was tested in Experiment 2 where the LHb and HPC were disconnected both ipsilaterally and contralaterally. Experiment 3 tested LHb's involvement in a standard behavioral economic task that requires flexible responding (maze-based delayed discounting), a task previously shown to rely on HPC. Results of Experiment 1, revealed that LHb inactivation impairs spatial delayed alternation during asymptotic performance but not during initial learning. Importantly, working memory did not appear to be affected as performance remained above chance levels both during initial learning and asymptotic testing. Experiment 2 showed that ipsilateral and contralateral disconnection of the LHb and HPC led to impaired performance on the spatial delayed alternation task. Impairments were not observed after unilateral inactivation of only one structure. Results of Experiment 3 were similar to our previous report of the effects of HPC inactivation: LHb inactivation impaired delayed discounting. All effects could not be accounted for by changes in reward magnitude discrimination, reward location per se, or sex of the animal. These findings, combined with other recent publications confirms and extends our working hypothesis that the LHb enables adaptive and flexible responding, particularly when established rules must be flexibly applied on a trial by trial basis. Since there are no known direct anatomical connections between LHb and HPC, future research is needed to understand how these structures communicate to enable flexible and rapid responding.

A Dynamic Memory Systems Framework for Sex Differences in Fear Memory

Emerging research demonstrates that a pattern of overlapping but distinct molecular and circuit mechanisms are engaged by males and females during memory tasks. Importantly, sex differences in neural mechanisms and behavioral strategies are evident even when performance on a memory task is similar between females and males. We propose that sex differences in memory may be best understood within a dynamic memory systems framework. Specifically, sex differences in hormonal influences and neural circuit development result in biases in the circuits engaged and the information preferentially stored or retrieved in males and females. By using animal models to understand the neural networks and molecular mechanisms required for memory in both sexes, we can gain crucial insights into sex and gender biases in disorders including post-traumatic stress disorder (PTSD) in humans.

Retrieval of Inhibitory Avoidance Memory Induces Differential Transcription of arc in Striatum, Hippocampus, and Amygdala

Similar to the hippocampus and amygdala, the dorsal striatum is involved in memory retrieval of inhibitory avoidance, a task commonly used to study memory processes. It has been reported that memory retrieval of fear conditioning regulates gene expression of arc and zif268 in the amygdala and the hippocampus, and it is surprising that only limited effort has been made to study the molecular events caused by retrieval in the striatum. To further explore the involvement of immediate early genes in retrieval, we used real-time PCR to analyze arc and zif268 transcription in dorsal striatum, dorsal hippocampus, and amygdala at different time intervals after retrieval of step-through inhibitory avoidance memory. We found that arc expression in the striatum increased 30 min after retrieval while no changes were observed in zif268 in this region. Expression of arc and zif268 also increased in the dorsal hippocampus but the changes were attributed to context re-exposure. Control procedures indicated that in the amygdala, arc and zif268 expression was not dependent on retrieval. Our data indicate that memory retrieval of inhibitory avoidance induces arc gene expression in the dorsal striatum, caused, very likely, by the instrumental component of the task. Striatal arc expression after retrieval may induce structural and functional changes in the neurons involved in this process.

Lost in Time and Space: States of High Arousal Disrupt Implicit Acquisition of Spatial and Sequential Context Information

Biased cognition during high arousal states is a relevant phenomenon in a variety of topics: from the development of post-traumatic stress disorders or stress-triggered addictive behaviors to forensic considerations regarding crimes of passion. Recent evidence indicates that arousal modulates the engagement of a hippocampus-based "cognitive" system in favor of a striatum-based "habit" system in learning and memory, promoting a switch from flexible, contextualized to more rigid, reflexive responses. Existing findings appear inconsistent, therefore it is unclear whether and which type of context processing is disrupted by enhanced arousal. In this behavioral study, we investigated such arousal-triggered cognitive-state shifts in human subjects. We validated an arousal induction procedure (three experimental conditions: violent scene, erotic scene, neutral control scene) using pupillometry (Preliminary Experiment, n = 13) and randomly administered this method to healthy young adults to examine whether high arousal states affect performance in two core domains of contextual processing, the acquisition of spatial (spatial discrimination paradigm; Experiment 1, n = 66) and sequence information (learned irrelevance paradigm; Experiment 2, n = 84). In both paradigms, spatial location and sequences were encoded incidentally and both displacements when retrieving spatial position as well as the predictability of the target by a cue in sequence learning changed stepwise. Results showed that both implicit spatial and sequence learning were disrupted during high arousal states, regardless of valence. Compared to the control group, participants in the arousal conditions showed impaired discrimination of spatial positions and abolished learning of associative sequences. Furthermore, Bayesian analyses revealed evidence against the null models. In line with recent models of stress effects on cognition, both experiments provide evidence for decreased engagement of flexible, cognitive systems supporting encoding of context information in active cognition during acute arousal, promoting reduced sensitivity for contextual details. We argue that arousal fosters cognitive adaptation towards less demanding, more present-oriented information processing, which prioritizes a current behavioral response set at the cost of contextual cues. This transient state of behavioral perseverance might reduce reliance on context information in unpredictable environments and thus represent an adaptive response in certain situations.

The Use of Trace Eyeblink Classical Conditioning to Assess Hippocampal Dysfunction in a Rat Model of Fetal Alcohol Spectrum Disorders

Neonatal rats were administered a relatively high concentration of ethyl alcohol (11.9% v/v) during postnatal days 4-9, a time when the fetal brain undergoes rapid organizational change and is similar to accelerated brain changes that occur during the third trimester in humans. This model of fetal alcohol spectrum disorders (FASDs) produces severe brain damage, mimicking the amount and pattern of binge-drinking that occurs in some pregnant alcoholic mothers. We describe the use of trace eyeblink classical conditioning (ECC), a higher-order variant of associative learning, to assess long-term hippocampal dysfunction that is typically seen in alcohol-exposed adult offspring. At 90 days of age, rodents were surgically prepared with recording and stimulating electrodes, which measured electromyographic (EMG) blink activity from the left eyelid muscle and delivered mild shock posterior to the left eye, respectively. After a 5 day recovery period, they underwent 6 sessions of trace ECC to determine associative learning differences between alcohol-exposed and control rats. Trace ECC is one of many possible ECC procedures that can be easily modified using the same equipment and software, so that different neural systems can be assessed. ECC procedures in general, can be used as diagnostic tools for detecting neural pathology in different brain systems and different conditions that insult the brain.

Impaired novelty acquisition and synaptic plasticity in congenital hyperammonemia caused by hepatic glutamine synthetase deficiency

Genetic defects in ammonia metabolism can produce irreversible damage of the developing CNS causing an impairment of cognitive and motor functions. We investigated alterations in behavior, synaptic plasticity and gene expression in the hippocampus and dorsal striatum of transgenic mice with systemic hyperammonemia resulting from conditional knockout of hepatic glutamine synthetase (LGS-ko). These mice showed reduced exploratory activity and delayed habituation to a novel environment. Field potential recordings from LGS-ko brain slices revealed significantly reduced magnitude of electrically-induced long-term potentiation (LTP) in both CA3-CA1 hippocampal and corticostriatal synaptic transmission. Corticostriatal but not hippocampal slices from LGS-ko brains demonstrated also significant alterations in long-lasting effects evoked by pharmacological activation of glutamate receptors. Real-time RT-PCR revealed distinct patterns of dysregulated gene expression in the hippocampus and striatum of LGS-ko mice: LGS-ko hippocampus showed significantly modified expression of mRNAs for mGluR1, GluN2B subunit of NMDAR, and A1 adenosine receptors while altered expression of mRNAs for D1 dopamine receptors, the M1 cholinoreceptor and the acetylcholine-synthetizing enzyme choline-acetyltransferase was observed in LGS-ko striatum. Thus, inborn systemic hyperammonemia resulted in significant deficits in novelty acquisition and disturbed synaptic plasticity in corticostriatal and hippocampal pathways involved in learning and goal-directed behavior.

Training-induced elevations in extracellular lactate in hippocampus and striatum: Dissociations by cognitive strategy and type of reward

Recent evidence suggests that astrocytes convert glucose to lactate, which is released from the astrocytes and supports learning and memory. This report takes a multiple memory perspective to test the role of astrocytes in cognition using real-time lactate measurements during learning and memory. Extracellular lactate levels in the hippocampus or striatum were determined with lactate biosensors while rats were learning place (hippocampus-sensitive) or response (striatum-sensitive) versions of T-mazes. In the first experiment, rats were trained on the place and response tasks to locate a food reward. Extracellular lactate levels in the hippocampus increased beyond those of feeding controls during place training but not during response training. However, striatal lactate levels did not increase beyond those of controls when rats were trained on either the place or the response version of the maze. Because food ingestion itself increased blood glucose and brain lactate levels, the contribution of feeding may have confounded the brain lactate measures. Therefore, we conducted a second similar experiment using water as the reward. A very different pattern of lactate responses to training emerged when water was used as the task reward. First, provision of water itself did not result in large increases in either brain or blood lactate levels. Moreover, extracellular lactate levels increased in the striatum during response but not place learning, whereas extracellular lactate levels in the hippocampus did not differ across tasks. The findings from the two experiments suggest that the relative engagement of the hippocampus and striatum dissociates not only by task but also by reward type. The divergent lactate responses of the hippocampus and striatum in place and response tasks under different reward conditions may reflect ethological constraints tied to foraging for food and water.

Effects of thalamic hemorrhagic lesions on explicit and implicit learning during the acquisition and retrieval phases in an animal model of central post-stroke pain

Hemorrhagic stroke has many symptoms, including central pain, learning and memory impairments, motor deficits, language problems, emotional disturbances, and social maladjustment. Lesions of the ventral basal complex (VBC) of the thalamus elicit thermal and mechanical hyperalgesia, forming an animal model of central post-stroke pain (CPSP). However, no research has yet examined the involvement of learning and memory in CPSP using an animal model. The present study examined whether VBC lesions affect motor function, conditioned place preference (CPP; implicit memory), and spatial learning (explicit memory) in the acquisition and retrieval phases. The results showed that rats with VBC lesions exhibited thermal hyperalgesia in the acquisition and retrieval phases, indicating that these lesions can induce CPSP. During these phases, the rats with VBC lesions exhibited enhanced (morphine-induced) CPP learning. These lesions did not affect the rats' total distance travelled, time spent, or velocity in the spatial learning tasks. The lesions also did not affect motor function in the rotarod task. Altogether, VBC lesions resulted in CPSP and facilitated CPP (implicit memory). However, the lesions did not affect spatial learning (explicit memory) or motor function. The relationship between CPSP and learning and memory is important for patients who suffer from such central pain. The implications of the present study may provide insights into helping reduce CPSP and its associated symptoms.

Ongoing behavioral state information signaled in the lateral habenula guides choice flexibility in freely moving rats

The lateral habenula (LHb) plays a role in a wide variety of behaviors ranging from maternal care, to sleep, to various forms of cognition. One prominent theory with ample supporting evidence is that the LHb serves to relay basal ganglia and limbic signals about negative outcomes to midbrain monoaminergic systems. This makes it likely that the LHb is critically involved in behavioral flexibility as all of these systems have been shown to contribute when flexible behavior is required. Behavioral flexibility is commonly examined across species and is impaired in various neuropsychiatric conditions including autism, depression, addiction, and schizophrenia; conditions in which the LHb is thought to play a role. Therefore, a thorough examination of the role of the LHb in behavioral flexibility serves multiple functions including understanding possible connections with neuropsychiatric illnesses and additional insight into its role in cognition in general. Here, we assess the LHb’s role in behavioral flexibility through comparisons of the roles its afferent and efferent pathways are known to play. Additionally, we provide new evidence supporting the LHb contributions to behavioral flexibility through organization of specific goal directed actions under cognitively demanding conditions. Specifically, in the first experiment, a majority of neurons recorded from the LHb were found to correlate with velocity on a spatial navigation task and did not change significantly when reward outcomes were manipulated. Additionally, measurements of local field potential (LFP) in the theta band revealed significant changes in power relative to velocity and reward location. In a second set of experiments, inactivation of the LHb with the gamma-aminobutyric acid (GABA) agonists baclofen and muscimol led to an impairment in a spatial/response based repeated probabilistic reversal learning task. Control experiments revealed that this impairment was likely due to the demands of repeated switching behaviors as rats were unimpaired on initial discrimination acquisition or retention of probabilistic learning. Taken together, these novel findings compliment other work discussed supporting a role for the LHb in action selection when cognitive or emotional demands are increased. Finally, we discuss future mechanisms by which a superior understanding of the LHb can be obtained through additional examination of behavioral flexibility tasks.

Activation of matrix metalloproteinase in dorsal hippocampus drives improvement in spatial working memory after intra-VTA nicotine infusion in rats

The hippocampus receives dopaminergic projections from the ventral tegmental area (VTA) and substantia nigra. These inputs appear to provide a modulatory signal that influences hippocampus-dependent behaviors. Enhancements in working memory performance have been previously reported following acute smoking/nicotine exposure. However, the underlying mechanism remains unclear. This study investigated the effects of nicotine on spatial working memory (SWM) and the mechanisms involved. Delayed alternation T-maze task was used to assess SWM. In situ and gel gelatin zymography were used to detect matrix metalloproteinase-9 (MMP-9) in SWM. Systemic or local (intra-VTA) administration of nicotine significantly improves SWM, which was accompanied by increased MMP-9 activity in dorsal hippocampus (dHPC). Intra-dHPC administration of MMP inhibitor FN-439 abolished the memory enhancement induced by intra-VTA nicotine infusion. FN-439 had no effect on locomotor behavior. Our data suggest that intra-VTA nicotine infusion activates MMP-9 in dHPC to improve SWM in rats.

Head west or left, east or right: interactions between memory systems in neurocognitive aging

Cognitive aging is accompanied by decline in multiple domains of memory. Here, we developed a T-maze task that required rats to learn competing hippocampal, and striatal navigation strategies in succession, across days. A final session increased demands on cognitive flexibility and required within-day switching between strategies, emphasizing capacities that engage the prefrontal cortex. Background characterization in young and aged rats used a water maze protocol optimized for individual differences in hippocampal integrity. Consistent with earlier work, young adults acquired place strategies in the T-maze faster than response, whereas the opposite was observed in aged rats with impaired spatial memory. The novel result was that aged animals with preserved spatial memory displayed a qualitatively distinct pattern, acquiring place and response strategies equally rapidly, without disruption when switching between them. Subsequent in situ hybridization for the plasticity-related immediate-early gene Arc revealed that while increasing demands on cognitive flexibility and within-day strategy switching potently engaged the prefrontal cortex in young adult and aged-impaired rats, Arc expression was insensitive in aged rats with normal spatial memory and superior switching abilities. Together, the results indicate that cognitive aging is an emergent property of the interactions between memory systems, and that successful cognitive outcomes reflect a distinct neuroadaptive process rather than a slower rate of aging.

Hippocampus and subregions of the dorsal striatum respond differently to a behavioral strategy change on a spatial navigation task

Goal-directed and habit-based behaviors are driven by multiple but dissociable decision making systems involving several different brain areas, including the hippocampus and dorsal striatum. On repetitive tasks, behavior transitions from goal directed to habit based with experience. Hippocampus has been implicated in initial learning and dorsal striatum in automating behavior, but recent studies suggest that subregions within the dorsal striatum have distinct roles in mediating habit-based and goal-directed behavior. We compared neural activity in the CA1 region of hippocampus with anterior dorsolateral and posterior dorsomedial striatum in rats on a spatial choice task, in which subjects experienced reward delivery changes that forced them to adjust their behavioral strategy. Our results confirm the importance of the hippocampus in evaluating predictive steps during goal-directed behavior, while separate circuits in the basal ganglia integrated relevant information during automation of actions and recognized when new behaviors were needed to continue obtaining rewards.

Integrative hippocampal and decision-making neurocircuitry during goal-relevant predictions and encoding

It has become clear that the hippocampus plays a critical role in the identification of new contexts and for the detection of changes in familiar contexts. The hippocampus accomplishes these goals through a continual process of comparing predicted features of a context or situation to those actually experienced. A mismatch between expected and experienced context expectations is thought to lead to the generation of a context prediction error (Mizumori, 2013) that functionally alerts connected brain areas to alter subsequent decision making and response selection. Little is understood about how hippocampal context analyses impact downstream decision processes. This issue is evaluated here first by comparing the nature of the information represented in hippocampus and decision-related midbrain-striatal structures, while rats perform a hippocampal-dependent spatial memory task in which rewards of different value are found at different locations. In contrast to place-specific and egocentric neural representations, neural representations of goal information are broadly distributed in hippocampal and decision neural circuitry, but they appear in different forms for different brain structures. It is suggested that further researching on how goal information processing occurs in hippocampus and decision neural circuitry may reveal insights into the nature of the interaction between memory and decision systems. The second part of this review describes neural pathways by which hippocampal context information might arrive within the decision circuit. The third section presents a hypothesis that the nature of the interactions between hippocampal and midbrain-striatal circuitry is regulated by the prefrontal cortex.

Choline acetyltransferase in the hippocampus is associated with learning strategy preference in adult male rats

One principle of the multiple memory systems hypothesis posits that the hippocampus-based and striatum-based memory systems compete for control over learning. Consistent with this notion, previous research indicates that the cholinergic system of the hippocampus plays a role in modulating the preference for a hippocampus-based place learning strategy over a striatum-based stimulus--response learning strategy. Interestingly, in the hippocampus, greater activity and higher protein levels of choline acetyltransferase (ChAT), the enzyme that synthesizes acetylcholine, are associated with better performance on hippocampus-based learning and memory tasks. With this in mind, the primary aim of the current study was to determine if higher levels of ChAT and the high-affinity choline uptake transporter (CHT) in the hippocampus were associated with a preference for a hippocampus-based place learning strategy on a task that also could be solved by relying on a striatum-based stimulus--response learning strategy. Results confirmed that levels of ChAT in the dorsal region of the hippocampus were associated with a preference for a place learning strategy on a water maze task that could also be solved by adopting a stimulus-response learning strategy. Consistent with previous studies, the current results support the hypothesis that the cholinergic system of the hippocampus plays a role in balancing competition between memory systems that modulate learning strategy preference.

Dopamine depletion in either the dorsomedial or dorsolateral striatum impairs egocentric Cincinnati water maze performance while sparing allocentric Morris water maze learning

Both egocentric route-based learning and spatial learning, as assessed by the Cincinnati water maze (CWM) and Morris water maze (MWM), respectively, are impaired following an 80% dopamine (DA) loss in the neostriatum after 6-hydroxydopamine (6-OHDA) administration in rats. The dorsolateral striatum (DLS) and the dorsomedial striatum (DMS) are implicated in different navigational learning types, namely the DLS is implicated in egocentric learning while the DMS is implicated in spatial learning. This experiment tested whether selective DA loss through 6-OHDA lesions in the DMS or DLS would impair one or both types of navigation. Both DLS and DMS DA loss significantly impaired route-based CWM learning, without affecting spatial or cued MWM performance. DLS 6-OHDA lesions produced a 75% DA loss in this region, with no changes in other monoamine levels in the DLS or DMS. DMS 6-OHDA lesions produced a 62% DA loss in this region, without affecting other monoamine levels in the DMS or DLS. The results indicate a role for DA in DLS and DMS regions in route-based egocentric but not spatial learning and memory. Spatial learning deficits may require more pervasive monoamine reductions within each region before deficits are exhibited. This is the first study to implicate DLS and DMS DA in route-based egocentric navigation.

Homeostatic regulation of memory systems and adaptive decisions

While it is clear that many brain areas process mnemonic information, understanding how their interactions result in continuously adaptive behaviors has been a challenge. A homeostatic-regulated prediction model of memory is presented that considers the existence of a single memory system that is based on a multilevel coordinated and integrated network (from cells to neural systems) that determines the extent to which events and outcomes occur as predicted. The “multiple memory systems of the brain” have in common output that signals errors in the prediction of events and/or their outcomes, although these signals differ in terms of what the error signal represents (e.g., hippocampus: context prediction errors vs. midbrain/striatum: reward prediction errors). The prefrontal cortex likely plays a pivotal role in the coordination of prediction analysis within and across prediction brain areas. By virtue of its widespread control and influence, and intrinsic working memory mechanisms. Thus, the prefrontal cortex supports the flexible processing needed to generate adaptive behaviors and predict future outcomes. It is proposed that prefrontal cortex continually and automatically produces adaptive responses according to homeostatic regulatory principles: prefrontal cortex may serve as a controller that is intrinsically driven to maintain in prediction areas an experience-dependent firing rate set point that ensures adaptive temporally and spatially resolved neural responses to future prediction errors. This same drive by prefrontal cortex may also restore set point firing rates after deviations (i.e. prediction errors) are detected. In this way, prefrontal cortex contributes to reducing uncertainty in prediction systems. An emergent outcome of this homeostatic view may be the flexible and adaptive control that prefrontal cortex is known to implement (i.e. working memory) in the most challenging of situations. Compromise to any of the prediction circuits should result in rigid and suboptimal decision making and memory as seen in addiction and neurological disease. © 2013 The Authors. Hippocampus Published by Wiley Periodicals, Inc.

Caudate nucleus-dependent navigational strategies are associated with increased use of addictive drugs

This study aimed to investigate the relationship between navigational strategies and the use of abused substances in a sample of healthy young adults. Navigational strategies were assessed with the 4-on-8 virtual maze (4/8VM), a task previously shown to dissociate between hippocampal-dependent spatial navigational strategies and caudate nucleus-dependent stimulus-response navigational strategies. Spatial strategies involve learning the spatial relationships between the landmarks in an environment, while response learning strategies involve learning a rigid set of stimulus-response type associations, e.g., see the tree, turn left. We have shown that spatial learners have increased gray matter and fMRI activity in the hippocampus compared with response learners, while response learners have increased gray matter and fMRI activity in the caudate nucleus. We were interested in the prevalence of use of substances of abuse in spatial and response learners because of the evidence that people who score high on traits such as novelty seeking, sensation seeking, reward seeking, and impulsivity, are more cue-responsive and more likely to use substances of abuse. Since response learners show increased activity and gray matter in the caudate nucleus of the striatum, which is a brain area involved in addiction, we hypothesized that response learners would have a greater use of abused substances than spatial learners. Fifty-five young adults were tested on the 4/8VM and completed a time-line follow-back assessment of drug and alcohol use. We found that response learners had smoked a significantly greater number of cigarettes in their lifetime than spatial learners, were more likely to have used cannabis, and had double the lifetime alcohol consumption. We discuss the possible relationship between substance abuse and response strategies as well as the implications for the hippocampus, risks of neurological and psychiatric disorders, and healthy cognition. © 2013 The Authors. Hippocampus Published by Wiley Periodicals, Inc.

Brain networks underlying navigation in the Cincinnati water maze with external and internal cues

The present study investigated the behavioural performance and the contributions of different brain regions on a spatial task performed by Wistar rats in the Cincinnati water maze (CWM) in two conditions: one where both distal and proximal visual cues were available (CWM-light group, n=7) and another where visual cues were eliminated by testing in complete darkness (CWM-dark group, n=7). There were differences in the behavioural performance. Energetic brain metabolism revealed significant differences in the infralimbic, orbitofrontal cortex and anterodorsal striatum. At the same time different brain networks were found. The CWM-light group showed a relationship between the orbitofrontal cortex and medial septum, whereas the CWM-dark group revealed three different networks involving the prefrontal cortex, ventral striatum, hippocampus and amygdala nuclei. The study shows that brain activation differs in these two conditions.

A role for the lateral dorsal tegmentum in memory and decision neural circuitry

A role for the hippocampus in memory is clear, although the mechanism for its contribution remains a matter of debate. Converging evidence suggests that hippocampus evaluates the extent to which context-defining features of events occur as expected. The consequence of mismatches, or prediction error, signals from hippocampus is discussed in terms of its impact on neural circuitry that evaluates the significance of prediction errors: Ventral tegmental area (VTA) dopamine cells burst fire to rewards or cues that predict rewards (Schultz, Dayan, & Montague, 1997). Although the lateral dorsal tegmentum (LDTg) importantly controls dopamine cell burst firing (Lodge & Grace, 2006) the behavioral significance of the LDTg control is not known. Therefore, we evaluated LDTg functional activity as rats performed a spatial memory task that generates task-dependent reward codes in VTA (Jo, Lee, & Mizumori, 2013; Puryear, Kim, & Mizumori, 2010) and another VTA afferent, the pedunculopontine nucleus (PPTg, Norton, Jo, Clark, Taylor, & Mizumori, 2011). Reversible inactivation of the LDTg significantly impaired choice accuracy. LDTg neurons coded primarily egocentric information in the form of movement velocity, turning behaviors, and behaviors leading up to expected reward locations. A subset of the velocity-tuned LDTg cells also showed high frequency bursts shortly before or after reward encounters, after which they showed tonic elevated firing during consumption of small, but not large, rewards. Cells that fired before reward encounters showed stronger correlations with velocity as rats moved toward, rather than away from, rewarded sites. LDTg neural activity was more strongly regulated by egocentric behaviors than that observed for PPTg or VTA cells that were recorded by Puryear et al. and Norton et al. While PPTg activity was uniquely sensitive to ongoing sensory input, all three regions encoded reward magnitude (although in different ways), reward expectation, and reward encounters. Only VTA encoded reward prediction errors. LDTg may inform VTA about learned goal-directed movement that reflects the current motivational state, and this in turn may guide VTA determination of expected subjective goal values. When combined it is clear the LDTg and PPTg provide only a portion of the information that dopamine cells need to assess the value of prediction errors, a process that is essential to future adaptive decisions and switches of cognitive (i.e. memorial) strategies and behavioral responses.

Brain network function during shifts in learning strategies in portal hypertension animals

Patients with minimal hepatic encephalopathy exhibit early impairments in their ability to shift attentional set. We employed a task-switching protocol to evaluate brain network changes. Strategy switching requires the modification of both the relevant stimulus dimension and the required memory system. Rats were trained in an allocentric (A) and a cue-guided (C) task using a four-arm maze. To examine priming, we changed the order in which the tasks were presented. Five groups of animals were used: a SHAM (sham-operated) A-C group (n=10), a SHAM C-A group (n=8), a PH (portal hypertension) A-C group (n=8), PH C-A group (n=8), and a naïve group (n=10). The triple portal vein ligation method was used to create an animal model of the early evolutive phase of PH. The animals were tested in the four-arm radial water maze in a single 10-trial session each day for six days (three days for the allocentric task and three days for the cue-guided task). The metabolic activities of the brains were studied with cytochrome oxidase histochemistry, and brain network changes were assessed with principal component analysis. The behavioural results revealed significant increases in the numbers of correct choices across training days in all groups studied, and facilitation of the acquisition of the second task was present in the C-A groups. Moreover, different brain network activities were found; in the experimental groups, the performance of A-C switch involved the prefrontal cortex, and the key structures involved in the C-A switch in the other groups were the dentate gyrus of the dorsal hippocampus and the basolateral and central amygdala. These networks have a common nucleus of structures (i.e., the parietal cortex and the dorsal and ventral striatum), whereas other structures were specifically involved in each type of strategy, suggesting that these regions are part of both circuits and may interact with one another during learning.

Dopamine D1/D5 receptors mediate informational saliency that promotes persistent hippocampal long-term plasticity

Dopamine (DA) plays an essential role in the enablement of cognition. It adds color to experience-dependent information storage, conferring salience to the memories that result. At the synaptic level, experience-dependent information storage is enabled by synaptic plasticity, and given its importance for memory formation, it is not surprising that DA comprises a key neuromodulator in the enablement of synaptic plasticity, and particularly of plasticity that persists for longer periods of time: Analogous to long-term memory. The hippocampus, that is a critical structure for the synaptic processing of semantic, episodic, spatial, and declarative memories, is specifically affected by DA, with the D1/D5 receptor proving crucial for hippocampus-dependent memory. Furthermore, D1/D5 receptors are pivotal in conferring the properties of novelty and reward to information being processed by the hippocampus. They also facilitate the expression of persistent forms of synaptic plasticity, and given reports that both long-term potentiation and long-term depression encode different aspects of spatial representations, this suggests that D1/D5 receptors can drive the nature and qualitative content of stored information in the hippocampus. In light of these observations, we propose that D1/D5 receptors gate hippocampal long-term plasticity and memory and are pivotal in conferring the properties of novelty and reward to information being processed by the hippocampus.

The Michelin red guide of the brain: role of dopamine in goal-oriented navigation

Spatial learning has been recognized over the years to be under the control of the hippocampus and related temporal lobe structures. Hippocampal damage often causes severe impairments in the ability to learn and remember a location in space defined by distal visual cues. Such cognitive disabilities are found in Parkinsonian patients. We recently investigated the role of dopamine in navigation in the 6-Hydroxy-dopamine (6-OHDA) rat, a model of Parkinson’s disease (PD) commonly used to investigate the pathophysiology of dopamine depletion (Retailleau et al., 2013). We demonstrated that dopamine (DA) is essential to spatial learning as its depletion results in spatial impairments. Our results showed that the behavioral effect of DA depletion is correlated with modification of the neural encoding of spatial features and decision making processes in hippocampus. However, the origin of these alterations in the neural processing of the spatial information needs to be clarified. It could result from a local effect: dopamine depletion disturbs directly the processing of relevant spatial information at hippocampal level. Alternatively, it could result from a more distributed network effect: dopamine depletion elsewhere in the brain (entorhinal cortex, striatum, etc.) modifies the way hippocampus processes spatial information. Recent experimental evidence in rodents, demonstrated indeed, that other brain areas are involved in the acquisition of spatial information. Amongst these, the cortex—basal ganglia (BG) loop is known to be involved in reinforcement learning and has been identified as an important contributor to spatial learning. In particular, it has been shown that altered activity of the BG striatal complex can impair the ability to perform spatial learning tasks. The present review provides a glimpse of the findings obtained over the past decade that support a dialog between these two structures during spatial learning under DA control.

Activity-dependent gene expression in honey bee mushroom bodies in response to orientation flight

The natural history of adult worker honey bees (Apis mellifera) provides an opportunity to study the molecular basis of learning in an ecological context. Foragers must learn to navigate between the hive and floral locations that may be up to miles away. Young pre-foragers prepare for this task by performing orientation flights near the hive, during which they begin to learn navigational cues such as the appearance of the hive, the position of landmarks, and the movement of the sun. Despite well-described spatial learning and navigation behavior, there is currently limited information on the neural basis of insect spatial learning. We found that Egr, an insect homolog of Egr-1, is rapidly and transiently upregulated in the mushroom bodies in response to orientation. This result is the first example of an Egr-1 homolog acting as a learning-related immediate-early gene in an insect and also demonstrates that honey bee orientation uses a molecular mechanism that is known to be involved in many other forms of learning. This transcriptional response occurred both in naïve bees and in foragers induced to re-orient. Further experiments suggest that visual environmental novelty, rather than exercise or memorization of specific visual cues, acts as the stimulus for Egr upregulation. Our results implicate the mushroom bodies in spatial learning and emphasize the deep conservation of Egr-related pathways in experience-dependent plasticity.

DREAM/calsenilin/KChIP3 modulates strategy selection and estradiol-dependent learning and memory

Downstream regulatory element antagonist modulator (DREAM)/calsenilin(C)/K⁺ channel interacting protein 3 (KChIP3) is a multifunctional Ca²⁺-binding protein highly expressed in the hippocampus that inhibits hippocampus-sensitive memory and synaptic plasticity in male mice. Initial studies in our lab suggested opposing effects of DR/C/K3 expression in female mice. Fluctuating hormones that occur during the estrous cycle may affect these results. In this study, we hypothesized that DR/C/K3 interacts with 17β-estradiol, the primary estrogen produced by the ovaries, to play a role in hippocampus function. We investigated the role of estradiol and DR/C/K3 in learning strategy in ovariectomized (OVX) female mice. OVX WT and DR/C/K3 knockout (KO) mice were given three injections of vehicle (sesame oil) or 17β-estradiol benzoate (0.25 mg in 100 mL sesame oil) 48, 24, and 2 h before training and testing. DR/C/K3 and estradiol had a time-dependent effect on strategy use in the female mice. Male KO mice exhibited enhanced place strategy relative to WT 24 h after pre-exposure. Fear memory formation was significantly reduced in intact female KO mice relative to intact WT mice, and OVX reduced fear memory formation in the WT, but had no effect in the KO mice. Long-term potentiation in hippocampus slices from female mice was enhanced by circulating ovarian hormones in both WT and DR/C/K3 KO mice. Paired-pulse depression was not affected by ovarian hormones but was reduced in DR/C/K3 KO mice. These results provide the first evidence that DR/C/K3 plays a timing-dependent role in estradiol regulation of learning, memory, and plasticity.

Context prediction analysis and episodic memory

Events that happen at a particular place and time come to define our episodic memories. Extensive experimental and clinical research illustrate that the hippocampus is central to the processing of episodic memories, and this is in large part due to its analysis of context information according to spatial and temporal references. In this way, hippocampus defines ones expectations for a given context as well as detects errors in predicted contextual features. The detection of context prediction errors is hypothesized to distinguished events into meaningful epochs that come to be recalled as separate episodic memories. The nature of the spatial and temporal context information processed by hippocampus is described, as is a hypothesis that the apparently self-regulatory nature of hippocampal context processing may ultimately be mediated by natural homeostatic operations and plasticity. Context prediction errors by hippocampus are suggested to be valued by the midbrain dopamine system, the output of which is ultimately fed back to hippocampus to update memory-driven context expectations for future events. Thus, multiple network functions (both within and outside hippocampus) combine to result in adaptive episodic memories.

Contextual behavior and neural circuits

Animals including humans engage in goal-directed behavior flexibly in response to items and their background, which is called contextual behavior in this review. Although the concept of context has long been studied, there are differences among researchers in defining and experimenting with the concept. The current review aims to provide a categorical framework within which not only the neural mechanisms of contextual information processing but also the contextual behavior can be studied in more concrete ways. For this purpose, we categorize contextual behavior into three subcategories as follows by considering the types of interactions among context, item, and response: contextual response selection, contextual item selection, and contextual item–response selection. Contextual response selection refers to the animal emitting different types of responses to the same item depending on the context in the background. Contextual item selection occurs when there are multiple items that need to be chosen in a contextual manner. Finally, when multiple items and multiple contexts are involved, contextual item–response selection takes place whereby the animal either chooses an item or inhibits such a response depending on item–context paired association. The literature suggests that the rhinal cortical regions and the hippocampal formation play key roles in mnemonically categorizing and recognizing contextual representations and the associated items. In addition, it appears that the fronto-striatal cortical loops in connection with the contextual information-processing areas critically control the flexible deployment of adaptive action sets and motor responses for maximizing goals. We suggest that contextual information processing should be investigated in experimental settings where contextual stimuli and resulting behaviors are clearly defined and measurable, considering the dynamic top-down and bottom-up interactions among the neural systems for contextual behavior.

Making memories matter

This article reviews some of the neuroendocrine bases by which emotional events regulate brain mechanisms of learning and memory. In laboratory rodents, there is extensive evidence that epinephrine influences memory processing through an inverted-U relationship, at which moderate levels enhance and high levels impair memory. These effects are, in large part, mediated by increases in blood glucose levels subsequent to epinephrine release, which then provide support for the brain processes engaged by learning and memory. These brain processes include augmentation of neurotransmitter release and of energy metabolism, the latter apparently including a key role for astrocytic glycogen. In addition to up- and down-regulation of learning and memory in general, physiological concomitants of emotion and arousal can also switch the neural system that controls learning at a particular time, at once improving some attributes of learning and impairing others in a manner that results in a change in the strategy used to solve a problem.

Age-associated changes in the hippocampal-ventral striatum-ventral tegmental loop that impact learning, prediction, and context discrimination

Studies of the neural mechanisms of navigation and context discrimination have generated a powerful heuristic for understanding how neural codes, circuits, and computations contribute to accurate behavior as animals traverse and learn about spatially extended environments. It is assumed that memories are updated as a result of spatial experience. The mechanism, however, for such a process is not clear. Here we suggest that one revealing approach to study this issue is to integrate our knowledge about limbic system mediated navigation and context discrimination with knowledge about how midbrain neural circuitry mediates decision-making. This perspective should lead to new and specific neural theories about how choices that we make during navigation determine what information is ultimately learned and remembered. This same circuitry may be involved when past experiences come to bias future spatial perceptions and response selection. With old age come not only important changes in limbic system operations, but also significant decline in the function of midbrain regions that underlie accurate and efficient decisions. Thus, suboptimal accuracy of spatial context-based decision-making may be, at least in part, responsible for the common observation of spatial memory decline in old age.

Functional differences in the backward shifts of CA1 and CA3 place fields in novel and familiar environments

Insight into the processing dynamics and other neurophysiological properties of different hippocampal subfields is critically important for understanding hippocampal function. In this study, we compared shifts in the center of mass (COM) of CA3 and CA1 place fields in a familiar and completely novel environment. Place fields in CA1 and CA3 were simultaneously recorded as rats ran along a closed loop track in a familiar room followed by a session in a completely novel room. This process was repeated each day over a 4-day period. CA3 place fields shifted backward (opposite to the direction of motion of the rat) only in novel environments. This backward shift gradually diminished across days, as the novel environment became more familiar with repeated exposures. Conversely, CA1 place fields shifted backward across all days in both familiar and novel environments. Prior studies demonstrated that CA1 place fields on average do not exhibit a backward shift during the first exposure to an environment in which the familiar cues are rearranged into a novel configuration, although CA3 place fields showed a strong backward shift. Under the completely novel conditions of the present study, no dissociation was observed between CA3 and CA1 during the first novel session (although a strong dissociation was observed in the familiar sessions and the later novel sessions). In summary, this is the first study to use simultaneous recordings in CA1 and CA3 to compare place field COM shift and other associated properties in truly novel and familiar environments. This study further demonstrates functional differentiation between CA1 and CA3 as the plasticity of CA1 place fields is affected differently by exposure to a completely novel environment in comparison to an altered, familiar environment, whereas the plasticity of CA3 place fields is affected similarly during both types of environmental novelty.

The match/mismatch of visuo-spatial cues between acquisition and retrieval contexts influences the expression of response vs. place memory in rats

Animals can perform goal-directed tasks by using response cues or place cues. The underlying memory systems are occasionally presented as competing. Using the double-H maze test (Pol-Bodetto et al.), we trained rats for response learning and, 24 h later, tested their memory in a 60-s probe trial using a new start place. A modest shift of the start place (translation: 60-cm to the left) provided a high misleading potential, whereas a marked shift (180° rotation; shift to the opposite) provided a low misleading potential. We analyzed each rat's first arm choice (to assess response vs. place memory retrieval) and its subsequent search for the former platform location (to assess the persistence in place memory or the shift from response to place memory). After the translation, response memory-based behavior was found in more than 90% rats (24/26). After the rotation, place memory-based behavior was observed in 50% rats, the others showing response memory or failing. Rats starting to use response cues were nevertheless able to subsequently shift to place ones. A posteriori behavioral analyses showed more and longer stops in rats starting their probe trial on the basis of place (vs. response) cues. These observations qualify the idea of competing memory systems for responses and places and are compatible with that of a cooperation between both systems according to principles of match/mismatch computation (at the start of a probe trial) and of error-driven adjustment (during the ongoing probe trial).

Where is my reward and how do I get it? Interaction between the hippocampus and the basal ganglia during spatial learning

Spatial learning has been recognized over the years to be under the control of the hippocampus and related temporal lobe structures. Hippocampal damage often causes severe impairments in the ability to learn and remember a location in space defined by distal visual cues. Recent experimental evidence in rodents demonstrates, however, that other brain areas might also be involved in the acquisition of spatial information. Amongst these, the cortex--basal ganglia loop is known to be involved in reinforcement learning and has been identified as an important contributor to spatial learning. In particular, it has been shown that altered activity of the basal ganglia striatal complex can impair the ability to perform spatial learning tasks. Until recently, little was known about how the basal ganglia and the hippocampus interact and how their activities evolve during learning. The present review, focusing on rodent studies, provides a glimpse of the findings obtained over the past decade that support a dialog between these two structures during spatial learning. Based on these studies, we propose a new functional spatial decision network with three separate loops encompassing hippocampus and specific basal ganglia regions. Each of the three loops serves a different aspect of spatial decision making and all three are linked by their mutual connections and are under the control of the dopaminergic learning signal.

Neural systems analysis of decision making during goal-directed navigation

The ability to make adaptive decisions during goal-directed navigation is a fundamental and highly evolved behavior that requires continual coordination of perceptions, learning and memory processes, and the planning of behaviors. Here, a neurobiological account for such coordination is provided by integrating current literatures on spatial context analysis and decision-making. This integration includes discussions of our current understanding of the role of the hippocampal system in experience-dependent navigation, how hippocampal information comes to impact midbrain and striatal decision making systems, and finally the role of the striatum in the implementation of behaviors based on recent decisions. These discussions extend across cellular to neural systems levels of analysis. Not only are key findings described, but also fundamental organizing principles within and across neural systems, as well as between neural systems functions and behavior, are emphasized. It is suggested that studying decision making during goal-directed navigation is a powerful model for studying interactive brain systems and their mediation of complex behaviors.