Extensive training and hippocampus or striatum lesions: effect on place and response strategies

Why do individuals with Williams syndrome or Down syndrome fail the Weather Prediction Task?

Williams syndrome (WS) and Down syndrome (DS) are two neurodevelopmental disorders with distinct genetic origins characterized by mild to moderate intellectual disability. Individuals with WS or DS exhibit impaired hippocampus-dependent place learning and enhanced striatum-dependent spatial response learning. Here, we used the Weather Prediction Task (WPT), which can be solved using hippocampus- or striatum-dependent learning strategies, to determine whether individuals with WS or DS exhibit similar profiles outside the spatial domain. Only 10% of individuals with WS or DS solved the WPT. We further assessed whether a concurrent memory task could promote reliance on procedural learning to solve the WPT in individuals with WS but found that the concurrent task did not improve performance. To understand how the probabilistic cue-outcome associations influences WPT performance, and whether individuals with WS or DS can ignore distractors, we assessed performance using a visual learning task with differing reward contingencies, and a modified WPT with unpredictive cues. Both probabilistic feedback and distractors negatively impacted the performance of individuals with WS or DS. These findings are consistent with deficits in hippocampus-dependent learning and executive functions, and reveal the importance of congruent feedback and the minimization of distractors to optimize learning in these two populations.

A map of spatial navigation for neuroscience

Spatial navigation has received much attention from neuroscientists, leading to the identification of key brain areas and the discovery of numerous spatially selective cells. Despite this progress, our understanding of how the pieces fit together to drive behavior is generally lacking. We argue that this is partly caused by insufficient communication between behavioral and neuroscientific researchers. This has led the latter to under-appreciate the relevance and complexity of spatial behavior, and to focus too narrowly on characterizing neural representations of space-disconnected from the computations these representations are meant to enable. We therefore propose a taxonomy of navigation processes in mammals that can serve as a common framework for structuring and facilitating interdisciplinary research in the field. Using the taxonomy as a guide, we review behavioral and neural studies of spatial navigation. In doing so, we validate the taxonomy and showcase its usefulness in identifying potential issues with common experimental approaches, designing experiments that adequately target particular behaviors, correctly interpreting neural activity, and pointing to new avenues of research.

Ventral hippocampus lesions and allocentric spatial memory in the radial maze: Anterograde and retrograde deficits

Although the dorsal hippocampus (DHip) has been clearly implicated in spatial learning and memory, there is currently debate as to whether the ventral hippocampus (VHip) is also necessary in allocentric-based navigation tasks. To differentiate between these two subregions of the hippocampal dorsoventral axis, we examined the effect of neurotoxic lesions to the DHip and VHip in different learning situations, using a four-arm plus-shaped maze. In experiment 1 a spatial reference memory task was used, with results showing an acquisition deficit in DHip-lesioned rats but perfect learning in VHip-lesioned rats. However, in experiment 2 an acquisition deficit was found in VHip-lesioned rats using a doubly marked training protocol. In this case the position of the goal arm during training was marked simultaneously by the extramaze constellation of stimuli around the maze and an intramaze cue. The main results indicated that DHip and VHip groups presented significantly more allocentric errors in the probe test than the control rats. In experiments 3 and 4, animals with their brains still intact learned, respectively, a spatial reference memory task or a purely cue-guided navigation task, and DHip and VHip lesions were made 2-3 days after reaching learning criterion. Results indicated a profound retrograde deficit in both lesioned groups but only with regard to allocentric information. So, depending on the training protocol used, our results point to increased integration and cooperation throughout the hippocampal dorsoventral axis when allocentric learning and memory is involved. These data support the existence of a functional continuum from the dorsal to the ventral hippocampus.

Spatial goal coding in the hippocampal formation

The mammalian hippocampal formation contains several distinct populations of neurons involved in representing self-position and orientation. These neurons, which include place, grid, head direction, and boundary-vector cells, are thought to collectively instantiate cognitive maps supporting flexible navigation. However, to flexibly navigate, it is necessary to also maintain internal representations of goal locations, such that goal-directed routes can be planned and executed. Although it has remained unclear how the mammalian brain represents goal locations, multiple neural candidates have recently been uncovered during different phases of navigation. For example, during planning, sequential activation of spatial cells may enable simulation of future routes toward the goal. During travel, modulation of spatial cells by the prospective route, or by distance and direction to the goal, may allow maintenance of route and goal-location information, supporting navigation on an ongoing basis. As the goal is approached, an increased activation of spatial cells may enable the goal location to become distinctly represented within cognitive maps, aiding goal localization. Lastly, after arrival at the goal, sequential activation of spatial cells may represent the just-taken route, enabling route learning and evaluation. Here, we review and synthesize these and other evidence for goal coding in mammalian brains, relate the experimental findings to predictions from computational models, and discuss outstanding questions and future challenges.

Post-Training Sleep Modulates Topographical Relearning-Dependent Resting State Activity

Continuation of experience-dependent neural activity during offline sleep and wakefulness episodes is a critical component of memory consolidation. Using functional magnetic resonance imaging (fMRI), offline consolidation effects have been evidenced probing behavioural and neurophysiological changes during memory retrieval, i.e., in the context of task practice. Resting state fMRI (rsfMRI) further allows investigating the offline evolution of recently learned information without the confounds of online task-related effects. We used rsfMRI to investigate sleep-related changes in seed-based resting functional connectivity (FC) and amplitude of low frequency fluctuations (ALFF) after spatial navigation learning and relearning. On Day 1, offline resting state activity was measured immediately before and after topographical learning in a virtual town. On Day 4, it was measured again before and after relearning in an extended version of the town. Navigation-related activity was also recorded during target retrieval, i.e., online. Participants spent the first post-training night under regular sleep (RS) or sleep deprivation (SD) conditions. Results evidence FC and ALFF changes in task-related neural networks, indicating the continuation of navigation-related activity in the resting state. Although post-training sleep did not modulate behavioural performance, connectivity analyses evidenced increased FC after post-training SD between navigation-related brain structures during relearning in the extended environment. These results suggest that memory traces were less efficiently consolidated after post-learning SD, eventually resulting in the use of compensatory brain resources to link previously stored spatial elements with the newly presented information.

Place vs. Response Learning: History, Controversy, and Neurobiology

The present article provides a historical review of the place and response learning plus-maze tasks with a focus on the behavioral and neurobiological findings. The article begins by reviewing the conflict between Edward C. Tolman's cognitive view and Clark L. Hull's stimulus-response (S-R) view of learning and how the place and response learning plus-maze tasks were designed to resolve this debate. Cognitive learning theorists predicted that place learning would be acquired faster than response learning, indicating the dominance of cognitive learning, whereas S-R learning theorists predicted that response learning would be acquired faster, indicating the dominance of S-R learning. Here, the evidence is reviewed demonstrating that either place or response learning may be dominant in a given learning situation and that the relative dominance of place and response learning depends on various parametric factors (i.e., amount of training, visual aspects of the learning environment, emotional arousal, et cetera). Next, the neurobiology underlying place and response learning is reviewed, providing strong evidence for the existence of multiple memory systems in the mammalian brain. Research has indicated that place learning is principally mediated by the hippocampus, whereas response learning is mediated by the dorsolateral striatum. Other brain regions implicated in place and response learning are also discussed in this section, including the dorsomedial striatum, amygdala, and medial prefrontal cortex. An exhaustive review of the neurotransmitter systems underlying place and response learning is subsequently provided, indicating important roles for glutamate, dopamine, acetylcholine, cannabinoids, and estrogen. Closing remarks are made emphasizing the historical importance of the place and response learning tasks in resolving problems in learning theory, as well as for examining the behavioral and neurobiological mechanisms of multiple memory systems. How the place and response learning tasks may be employed in the future for examining extinction, neural circuits of memory, and human psychopathology is also briefly considered.

The Hippocampus and Dorsolateral Striatum Integrate Distinct Types of Memories through Time and Space, Respectively

Several decades of research have established that different kinds of memories result from the activity of discrete neural networks. Studying how these networks process information in experiments that target specific types of mnemonic representations has provided deep insights into memory architecture and its neural underpinnings. However, in natural settings reality confronts organisms with problems that are not neatly compartmentalized. Thus, a critical problem in memory research that still needs to be addressed is how distinct types of memories are ultimately integrated. Here we demonstrate how two memory networks, the hippocampus and dorsolateral striatum, may accomplish such a goal. The hippocampus supports memory for facts and events, collectively known as declarative memory and often studied as spatial memory in rodents. The dorsolateral striatum provides the basis for habits that are assessed in stimulus-response types of tasks. Expanding previous findings, the current work revealed that in male Long-Evans rats, the hippocampus and dorsolateral striatum use time and space in distinct and largely complementary ways to integrate spatial and habitual representations. Specifically, the hippocampus supported both types of memories when they were formed in temporal juxtaposition, even if the learning took place in different environments. In contrast, the lateral striatum supported both types of memories if they were formed in the same environment, even at temporally distinct points. These results reveal for the first time that by using fundamental aspects of experience in specific ways, the hippocampus and dorsolateral striatum can transcend their attributed roles in information storage.SIGNIFICANCE STATEMENT The current paradigm in memory research postulates that different types of memories reflected in separate types of behavioral strategies result from activity in distinct neural circuits. However, recent data have shown that when rats concurrently acquired in the same environment of hippocampal-dependent spatial navigation and striatal-dependent approach of a visual cue, each of the two types of memories became dependent on both the hippocampus and dorsolateral striatum. The current work reveals that the hippocampus and dorsolateral striatum use distinct and complementary principles to integrate different types of memories in time and space: the hippocampus integrates memories formed in temporal proximity, while the lateral striatum integrates memories formed in the same space.

Interindividual differences in memory system local field potential activity predict behavioral strategy on a dual-solution T-maze

Individuals can use diverse behavioral strategies to navigate their environment including hippocampal-dependent place strategies reliant upon cognitive maps and striatal-dependent response strategies reliant upon egocentric body turns. The existence of multiple memory systems appears to facilitate successful navigation across a wide range of environmental and physiological conditions. The mechanisms by which these systems interact to ultimately generate a unitary behavioral response, however, remain unclear. We trained 20 male, Sprague-Dawley rats on a dual-solution T-maze while simultaneously recording local field potentials that were targeted to the dorsolateral striatum and dorsal hippocampus. Eight rats spontaneously exhibited a place strategy while the remaining 12 rats exhibited a response strategy. Interindividual differences in behavioral strategy were associated with distinct patterns of LFP activity between the dorsolateral striatum and dorsal hippocampus. Specifically, striatal-hippocampal theta activity was in-phase in response rats and out-of-phase in place rats and response rats exhibited elevated striatal-hippocampal coherence across a wide range of frequency bands. These contrasting striatal-hippocampal activity regimes were (a) present during both maze-learning and a 30 min premaze habituation period and (b) could be used to train support vector machines to reliably predict behavioral strategy. Distinct patterns of neuronal activity across multiple memory systems, therefore, appear to bias behavioral strategy selection and thereby contribute to interindividual differences in behavior.

Testosterone replacement causes dose-dependent improvements in spatial memory among aged male rats

Testosterone has been shown to have dose-dependent effects on spatial memory in males, but the effects of aging upon this relationship remain unclear. Additionally, the mechanism by which testosterone regulates memory is unknown, but may involve changes in brain-derived neurotrophic factor (BDNF) within specific brain regions. We tested the effects of age and testosterone on spatial memory among male rats using two spatial memory tasks: an object-location memory task (OLMT) and the radial-arm maze (RAM). Castration had minimal effect on performance on the RAM, but young rats (2 months) performed significantly fewer working memory errors than aged rats (20 months), and aged rats performed significantly fewer reference memory errors. Both age and castration impaired performance on the OLMT, with only the young rats with intact gonads successfully performing the task. Subsequent experiments involved daily injections of either drug vehicle or one of four doses of testosterone propionate (0.125, 0.250, 0.500, and 1.00 mg/rat) given to castrated aged males. On the RAM, a low physiological dose (0.125 mg) and high doses (0.500-1.000 mg) of testosterone improved working memory, while an intermediate dose (0.250 mg) did not. On the OLMT, only the 0.250 mg T group showed a significant increase in exploration ratios from the exposure trials to the testing trials, indicating that this group remembered the position of the objects. Brain tissue (prefrontal cortex, hippocampus, and striatum) was collected from all subjects to assay BDNF. We found no evidence that testosterone influenced BDNF, indicating that it is unlikely that testosterone regulates spatial memory through changes in BDNF levels.

Healthy versus Entorhinal Cortical Atrophy Identification in Asymptomatic APOE4 Carriers at Risk for Alzheimer's Disease

Early detection of Alzheimer’s disease (AD) has been challenging as current biomarkers are invasive and costly. Strong predictors of future AD diagnosis include lower volume of the hippocampus and entorhinal cortex, as well as the ɛ4 allele of the Apolipoprotein E gene (APOE) gene. Therefore, studying functions that are critically mediated by the hippocampus and entorhinal cortex, such as spatial memory, in APOE ɛ4 allele carriers, may be key to the identification of individuals at risk of AD, prior to the manifestation of cognitive impairments. Using a virtual navigation task developed in-house, specifically designed to assess spatial versus non-spatial strategies, the current study is the first to differentiate functional and structural differences within APOE ɛ4 allele carriers. APOE ɛ4 allele carriers that predominantly use non-spatial strategies have decreased fMRI activity in the hippocampus and increased atrophy in the hippocampus, entorhinal cortex, and fimbria compared to APOE ɛ4 allele carriers who use spatial strategies. In contrast, APOE ɛ4 allele carriers who use spatial strategies have grey matter levels comparable to non-APOE ɛ4 allele carriers. Furthermore, in a leave-one-out analysis, grey matter in the entorhinal cortex could predict navigational strategy with 92% accuracy.

Memory systems 2018 - Towards a new paradigm

The multiple memory systems theory (MMS) postulates that the brain stores information based on the independent and parallel activity of a number of modules, each with distinct properties, dynamics, and neural basis. Much of the evidence for this theory comes from dissociation studies indicating that damage to restricted brain areas cause selective types of memory deficits. MMS has been the prevalent paradigm in memory research for more than thirty years, even as it has been adjusted several times to accommodate new data. However, recent empirical results indicating that the memory systems are not always dissociable constitute a challenge to fundamental tenets of the current theory because they suggest that representations formed by individual memory systems can contribute to more than one type of memory-driven behavioral strategy. This problem can be addressed by applying a dynamic network perspective to memory architecture. According to this view, memory networks can reconfigure or transiently couple in response to environmental demands. Within this context, the neural network underlying a specific memory system can act as an independent unit or as an integrated component of a higher order meta-network. This dynamic network model proposes a way in which empirical evidence that challenges the idea of distinct memory systems can be incorporated within a modular memory architecture. The model also provides a framework to account for the complex interactions among memory systems demonstrated at the behavioral level. Advances in the study of dynamic networks can generate new ideas to experimentally manipulate and control memory in basic or clinical research.

Low-Resolution Place and Response Learning Capacities in Down Syndrome

Down syndrome (DS), the most common genetic cause of intellectual disability, results from the partial or complete triplication of chromosome 21. Individuals with DS are impaired at using a high-resolution, allocentric spatial representation to learn and remember discrete locations in a controlled environment. Here, we assessed the capacity of individuals with DS to perform low-resolution spatial learning, depending on two competing memory systems: (1) the place learning system, which depends on the hippocampus and creates flexible relational representations of the environment; and (2) the response learning system, which depends on the striatum and creates fixed stimulus-response representations of behavioral actions. Individuals with DS exhibited a preservation of the low-resolution spatial learning capacities subserved by these two systems. In place learning, although the average performance of individuals with DS was lower than that of typically developing (TD) mental age (MA)-matched children and TD young adults, the number of individuals with DS performing above chance level did not differ from TD children. In response learning, the average performance of individuals with DS was lower than that of TD adults, but it did not differ from that of TD children. Moreover, the number of individuals with DS performing above chance level did not differ from TD adults, and was higher than that of TD children. In sum, whereas low-resolution place learning appears relatively preserved in individuals with DS, response learning appears facilitated. Our findings are consistent with the hypothesis that the neural pathways supporting low-resolution place learning and response learning are relatively preserved in DS.

Hippocampal-caudate nucleus interactions support exceptional memory performance

Participants of the annual World Memory Championships regularly demonstrate extraordinary memory feats, such as memorising the order of 52 playing cards in 20 s or 1000 binary digits in 5 min. On a cognitive level, memory athletes use well-known mnemonic strategies, such as the method of loci. However, whether these feats are enabled solely through the use of mnemonic strategies or whether they benefit additionally from optimised neural circuits is still not fully clarified. Investigating 23 leading memory athletes, we found volumes of their right hippocampus and caudate nucleus were stronger correlated with each other compared to matched controls; both these volumes positively correlated with their position in the memory sports world ranking. Furthermore, we observed larger volumes of the right anterior hippocampus in athletes. Complementing these structural findings, on a functional level, fMRI resting state connectivity of the anterior hippocampus to both the posterior hippocampus and caudate nucleus predicted the athletes rank. While a competitive interaction between hippocampus and caudate nucleus is often observed in normal memory function, our findings suggest that a hippocampal-caudate nucleus cooperation may enable exceptional memory performance. We speculate that this cooperation reflects an integration of the two memory systems at issue-enabling optimal combination of stimulus-response learning and map-based learning when using mnemonic strategies as for example the method of loci.

Impaired Spatial Memory and Enhanced Habit Memory in a Rat Model of Post-traumatic Stress Disorder

High levels of emotional arousal can impair spatial memory mediated by the hippocampus, and enhance stimulus-response (S-R) habit memory mediated by the dorsolateral striatum (DLS). The present study was conducted to determine whether these memory systems may be similarly affected in an animal model of post-traumatic stress disorder (PTSD). Sprague-Dawley rats were subjected to a “single-prolonged stress” (SPS) procedure and 1 week later received training in one of two distinct versions of the plus-maze: a hippocampus-dependent place learning task or a DLS-dependent response learning task. Results indicated that, relative to non-stressed control rats, SPS rats displayed slower acquisition in the place learning task and faster acquisition in the response learning task. In addition, extinction of place learning and response learning was impaired in rats exposed to SPS, relative to non-stressed controls. The influence of SPS on hippocampal spatial memory and DLS habit memory observed in the present study may be relevant to understanding some common features of PTSD, including hippocampal memory deficits, habit-like avoidance responses to trauma-related stimuli, and greater likelihood of developing drug addiction and alcoholism.

Dissociation of spatial memory systems in Williams syndrome

Williams syndrome (WS), a genetic deletion syndrome, is characterized by severe visuospatial deficits affecting performance on both tabletop spatial tasks and on tasks which assess orientation and navigation. Nevertheless, previous studies of WS spatial capacities have ignored the fact that two different spatial memory systems are believed to contribute parallel spatial representations supporting navigation. The place learning system depends on the hippocampal formation and creates flexible relational representations of the environment, also known as cognitive maps. The spatial response learning system depends on the striatum and creates fixed stimulus-response representations, also known as habits. Indeed, no study assessing WS spatial competence has used tasks which selectively target these two spatial memory systems. Here, we report that individuals with WS exhibit a dissociation in their spatial abilities subserved by these two memory systems. As compared to typically developing (TD) children in the same mental age range, place learning performance was impaired in individuals with WS. In contrast, their spatial response learning performance was facilitated. Our findings in individuals with WS and TD children suggest that place learning and response learning interact competitively to control the behavioral strategies normally used to support human spatial navigation. Our findings further suggest that the neural pathways supporting place learning may be affected by the genetic deletion that characterizes WS, whereas those supporting response learning may be relatively preserved. The dissociation observed between these two spatial memory systems provides a coherent theoretical framework to characterize the spatial abilities of individuals with WS, and may lead to the development of new learning strategies based on their facilitated response learning abilities.

Spatial cognition in mice and rats: similarities and differences in brain and behavior

The increasing use of mice models in cognitive tasks that were originally designed for rats raises crucial questions about cross-species comparison in the study of spatial cognition. The present review focuses on the major neuroethological differences existing between mice and rats, with particular attention given to the neurophysiological basis of space coding. While little difference is found in the basic properties of space representation in these two species, it appears that the stability of this representation changes more drastically over time in mice than in rats. We consider several hypotheses dealing with attentional, perceptual, and genetic aspects and offer some directions for future research that might help in deciphering hippocampal function in learning and memory processes. WIREs Cogn Sci 2016, 7:406-421. doi: 10.1002/wcs.1411 For further resources related to this article, please visit the WIREs website.

Mice Lacking GPR88 Show Motor Deficit, Improved Spatial Learning, and Low Anxiety Reversed by Delta Opioid Antagonist

BACKGROUND

GPR88 is an orphan G protein coupled receptor highly enriched in the striatum, and previous studies have focused on GPR88 function in striatal physiology. The receptor is also expressed in other brain areas, and here we examined whether GPR88 function extends beyond striatal-mediated responses.

METHODS

We created Gpr88 knockout mice and examined both striatal and extrastriatal regions at molecular and cellular levels. We also tested striatum-, hippocampus-, and amygdala-dependent behaviors in Gpr88(-/-) mice using extensive behavioral testing.

RESULTS

We found increased G protein coupling for delta opioid receptor (DOR) and mu opioid, but not other Gi/o coupled receptors, in the striatum of Gpr88 knockout mice. We also found modifications in gene transcription, dopamine and serotonin contents, and dendritic morphology inside and outside the striatum. Behavioral testing confirmed striatal deficits (hyperactivity, stereotypies, motor impairment in rotarod). In addition, mutant mice performed better in spatial tasks dependent on hippocampus (Y-maze, novel object recognition, dual solution cross-maze) and also showed markedly reduced levels of anxiety (elevated plus maze, marble burying, novelty suppressed feeding). Strikingly, chronic blockade of DOR using naltrindole partially improved motor coordination and normalized spatial navigation and anxiety of Gpr88(-/-) mice.

CONCLUSIONS

We demonstrate that GPR88 is implicated in a large repertoire of behavioral responses that engage motor activity, spatial learning, and emotional processing. Our data also reveal functional antagonism between GPR88 and DOR activities in vivo. The therapeutic potential of GPR88 therefore extends to cognitive and anxiety disorders, possibly in interaction with other receptor systems.

Hippocampus NMDA receptors selectively mediate latent extinction of place learning

Extinction of maze learning may be achieved with or without the animal performing the previously acquired response. In typical "response extinction," animals are given the opportunity to make the previously acquired approach response toward the goal location of the maze without reinforcement. In "latent extinction," animals are not given the opportunity to make the previously acquired response and instead are confined to the previous goal location without reinforcement. Previous evidence indicates that the effectiveness of these protocols may depend on the type of memory being extinguished. Thus, one aim of the present study was to further examine the effectiveness of response and latent extinction protocols across dorsolateral striatum (DLS)-dependent response learning and hippocampus-dependent place learning tasks. In addition, previous neural inactivation experiments indicate a selective role for the hippocampus in latent extinction, but have not investigated the precise neurotransmitter mechanisms involved. Thus, the present study also examined whether latent extinction of place learning might depend on NMDA receptor activity in the hippocampus. In experiment 1, adult male Long-Evans rats were trained in a response learning task in a water plus-maze, in which animals were reinforced to make a consistent body-turn response to reach an invisible escape platform. Results indicated that response extinction, but not latent extinction, was effective at extinguishing memory in the response learning task. In experiment 2, rats were trained in a place learning task, in which animals were reinforced to approach a consistent spatial location containing the hidden escape platform. In experiment 2, animals also received intra-hippocampal infusions of the NMDA receptor antagonist 2-amino-5-phosphopentanoic acid (AP5; 5.0 or 7.5 ug/0.5 µg) or saline vehicle immediately before response or latent extinction training. Results indicated that both extinction protocols were effective at extinguishing memory in the place learning task. In addition, intra-hippocampal AP5 (7.5 µg) impaired latent extinction, but not response extinction, suggesting that hippocampal NMDA receptors are selectively involved in latent extinction. © 2016 Wiley Periodicals, Inc.

Delta Opioid Receptors: Learning and Motivation

Delta opioid receptor (DOR) displays a unique, highly conserved, structure and an original pattern of distribution in the central nervous system, pointing to a distinct and specific functional role among opioid peptide receptors. Over the last 15 years, in vivo pharmacology and genetic models have allowed significant advances in the understanding of this role. In this review, we will focus on the involvement of DOR in modulating different types of hippocampal- and striatal-dependent learning processes as well as motor function, motivation, and reward. Remarkably, DOR seems to play a key role in balancing hippocampal and striatal functions, with major implications for the control of cognitive performance and motor function under healthy and pathological conditions.

The Memory System Engaged During Acquisition Determines the Effectiveness of Different Extinction Protocols

Previous research indicates that extinction of rodent maze behavior may occur without explicit performance of the previously acquired response. In latent extinction, confining an animal to a previously rewarded goal location without reinforcement is typically sufficient to produce extinction of maze learning. However, previous studies have not determined whether latent extinction may be successfully employed to extinguish all types of memory acquired in the maze, or whether only specific types of memory may be vulnerable to latent extinction. The present study examined whether latent extinction may be effective across two plus-maze tasks that depend on anatomically distinct neural systems. Adult male Long-Evans rats were trained in a hippocampus-dependent place learning task (Experiment 1), in which animals were trained to approach a consistent spatial location for food reward. A separate group of rats were trained in a dorsolateral striatum-dependent response learning task (Experiment 2), in which animals were trained to make a consistent egocentric body-turn response for food reward. Following training, animals received response extinction or latent extinction. For response extinction, animals were given the opportunity to execute the original running approach response toward the empty food cup. For latent extinction, animals were confined to the original goal locations with the empty food cup, thus preventing them from making the original running approach response. Results indicate that, relative to no extinction, latent extinction was effective at extinguishing memory in the place learning task, but remained ineffective in the response learning task. In contrast, typical response extinction remained very effective at extinguishing memory in both place and response learning tasks. The present findings confirm that extinction of maze learning may occur with or without overt performance of the previously acquired response, but that the effectiveness of latent extinction may depend on the type of memory being extinguished. The findings suggest that behavioral treatments modeled after response extinction protocols may be especially useful in alleviating human psychopathologies involving striatum-dependent memory processes (e.g., drug addiction and relapse).

A new biomarker to examine the role of hippocampal function in the development of spatial reorientation in children: a review

Spatial navigation is an adaptive skill that involves determining the route to a particular goal or location, and then traveling that path. A major component of spatial navigation is spatial reorientation, or the ability to reestablish a sense of direction after being disoriented. The hippocampus is known to be critical for navigating, and has more recently been implicated in reorienting in adults, but relatively little is known about the development of the hippocampus in relation to these large-scale spatial abilities in children. It has been established that, compared to school-aged children, preschool children tend to perform poorly on certain spatial reorientation tasks, suggesting that their hippocampi may not be mature enough to process the demands of such a task. Currently, common techniques used to examine underlying brain activity, such as electroencephalography (EEG) and functional magnetic resonance imaging (fMRI), are not suitable for examining hippocampal development in young children. In the present paper, we argue instead for the use of eyeblink conditioning (EBC), a relatively under-utilized, inexpensive, and safe method that is easy to implement in developing populations. In addition, EBC has a well defined neural circuitry, which includes the hippocampus, making it an ideal tool to indirectly measure hippocampal functioning in young children. In this review, we will evaluate the literature on EBC and its relation to hippocampal development, and discuss the possibility of using EBC as an objective measure of associative learning in relation to large-scale spatial skills. We support the use of EBC as a way to indirectly access hippocampal function in typical and atypical populations in order to characterize the neural substrates associated with the development of spatial reorientation abilities in early childhood. As such, EBC is a potential, simple biomarker for success in tasks that require the hippocampus, including spatial reorientation.

Parallel processing of information about location in the amygdala, entorhinal cortex and hippocampus

The conditioned cue preference paradigm was used to study how rats use extra-maze cues to discriminate between 2 adjacent arms on an 8-arm radial maze, a situation in which most of the same cues can be seen from both arms but only one arm contains food. Since the food-restricted rats eat while passively confined on the food-paired arm no responses are reinforced, so the discrimination is due to Pavlovian stimulus-reward (or outcome) learning. Consistent with other evidence that rats must move around in an environment to acquire a spatial map, we found that learning the adjacent arms CCP (ACCP) required a minimum amount of active exploration of the maze with no reinforcers present prior to passive pairing of the extra-maze cues with the food reinforcer, an instance of latent learning. Temporary inactivation of the hippocampus during the pre-exposure sessions had no effect on ACCP learning, confirming other evidence that the hippocampus is not involved in latent learning. A series of experiments indentified a circuit involving fimbria-fornix and dorsal entorhinal cortex as the neural basis of latent learning in this situation. In contrast, temporary inactivation of the entorhinal cortex or hippocampus during passive training or during testing blocked ACCP learning and expression, respectively, suggesting that these two structures co-operate in using spatial information to learn the location of food on the maze during passive pairing and to express this combined information during testing. In parallel with these processes we found that the amygdala processes information leading to an equal tendency to enter both adjacent arms (even though only one was paired with food) suggesting that the stimulus information available to this structure is not sufficiently precise to discriminate between the ambiguous cues visible from the adjacent arms. Expression of the ACCP in normal rats depends on hippocampus-based learning to avoid the unpaired arm which competes with the amygdala-based tendency to enter that arm. In contrast, there is cooperation between amygdala- and hippocampus-based tendencies to enter the food-paired arm. These independent forms of learning contribute to the rat's ability to discriminate among spatial locations using ambiguous extra-maze cues.

Dissociation between dorsal and ventral hippocampal theta oscillations during decision-making

Hippocampal theta oscillations are postulated to support mnemonic processes in humans and rodents. Theta oscillations facilitate encoding and spatial navigation, but to date, it has been difficult to dissociate the effects of volitional movement from the cognitive demands of a task. Therefore, we examined whether volitional movement or cognitive demands exerted a greater modulating factor over theta oscillations during decision-making. Given the anatomical, electrophysiological, and functional dissociations along the dorsal-ventral axis, theta oscillations were simultaneously recorded in the dorsal and ventral hippocampus in rats trained to switch between place and motor-response strategies. Stark differences in theta characteristics were found between the dorsal and ventral hippocampus in frequency, power, and coherence. Theta power increased in the dorsal, but decreased in the ventral hippocampus, during the decision-making epoch. Interestingly, the relationship between running speed and theta power was uncoupled during the decision-making epoch, a phenomenon limited to the dorsal hippocampus. Theta frequency increased in both the dorsal and ventral hippocampus during the decision epoch, although this effect was greater in the dorsal hippocampus. Despite these differences, ventral hippocampal theta was responsive to the navigation task; theta frequency, power, and coherence were all affected by cognitive demands. Theta coherence increased within the dorsal hippocampus during the decision-making epoch on all three tasks. However, coherence selectively increased throughout the hippocampus (dorsal to ventral) on the task with new hippocampal learning. Interestingly, most results were consistent across tasks, regardless of hippocampal-dependent learning. These data indicate increased integration and cooperation throughout the hippocampus during information processing.

Conflict between place and response navigation strategies: effects on vicarious trial and error (VTE) behaviors

Navigation can be accomplished through multiple decision-making strategies, using different information-processing computations. A well-studied dichotomy in these decision-making strategies compares hippocampal-dependent "place" and dorsal-lateral striatal-dependent "response" strategies. A place strategy depends on the ability to flexibly respond to environmental cues, while a response strategy depends on the ability to quickly recognize and react to situations with well-learned action-outcome relationships. When rats reach decision points, they sometimes pause and orient toward the potential routes of travel, a process termed vicarious trial and error (VTE). VTE co-occurs with neurophysiological information processing, including sweeps of representation ahead of the animal in the hippocampus and transient representations of reward in the ventral striatum and orbitofrontal cortex. To examine the relationship between VTE and the place/response strategy dichotomy, we analyzed data in which rats were cued to switch between place and response strategies on a plus maze. The configuration of the maze allowed for place and response strategies to work competitively or cooperatively. Animals showed increased VTE on trials entailing competition between navigational systems, linking VTE with deliberative decision-making. Even in a well-learned task, VTE was preferentially exhibited when a spatial selection was required, further linking VTE behavior with decision-making associated with hippocampal processing.

Hippocampus-dependent place learning enables spatial flexibility in C57BL6/N mice

Spatial navigation is a fundamental capability necessary in everyday life to locate food, social partners, and shelter. It results from two very different strategies: (1) place learning which enables for flexible way finding and (2) response learning that leads to a more rigid “route following.” Despite the importance of knockout techniques that are only available in mice, little is known about mice' flexibility in spatial navigation tasks. Here we demonstrate for C57BL6/N mice in a water-cross maze (WCM) that only place learning enables spatial flexibility and relearning of a platform position, whereas response learning does not. This capability depends on an intact hippocampal formation, since hippocampus lesions by ibotenic acid (IA) disrupted relearning. In vivo manganese-enhanced magnetic resonance imaging revealed a volume loss of ≥60% of the hippocampus as a critical threshold for relearning impairments. In particular the changes in the left ventral hippocampus were indicative of relearning deficits. In summary, our findings establish the importance of hippocampus-dependent place learning for spatial flexibility and provide a first systematic analysis on spatial flexibility in mice.

Integrating cortico-limbic-basal ganglia architectures for learning model-based and model-free navigation strategies

Behavior in spatial navigation is often organized into map-based (place-driven) vs. map-free (cue-driven) strategies; behavior in operant conditioning research is often organized into goal-directed vs. habitual strategies. Here we attempt to unify the two. We review one powerful theory for distinct forms of learning during instrumental conditioning, namely model-based (maintaining a representation of the world) and model-free (reacting to immediate stimuli) learning algorithms. We extend these lines of argument to propose an alternative taxonomy for spatial navigation, showing how various previously identified strategies can be distinguished as “model-based” or “model-free” depending on the usage of information and not on the type of information (e.g., cue vs. place). We argue that identifying “model-free” learning with dorsolateral striatum and “model-based” learning with dorsomedial striatum could reconcile numerous conflicting results in the spatial navigation literature. From this perspective, we further propose that the ventral striatum plays key roles in the model-building process. We propose that the core of the ventral striatum is positioned to learn the probability of action selection for every transition between states of the world. We further review suggestions that the ventral striatal core and shell are positioned to act as “critics” contributing to the computation of a reward prediction error for model-free and model-based systems, respectively.

Kv4 potassium channels modulate hippocampal EPSP-spike potentiation and spatial memory in rats

Kv4 channels regulate the backpropagation of action potentials (b-AP) and have been implicated in the modulation of long-term potentiation (LTP). Here we showed that blockade of Kv4 channels by the scorpion toxin AmmTX3 impaired reference memory in a radial maze task. In vivo, AmmTX3 intracerebroventricular (i.c.v.) infusion increased and stabilized the EPSP-spike (E-S) component of LTP in the dentate gyrus (DG), with no effect on basal transmission or short-term plasticity. This increase in E-S potentiation duration could result from the combination of an increase in excitability of DG granular cells with a reduction of GABAergic inhibition, leading to a strong reduction of input specificity. Radioactive in situ hybridization (ISH) was used to evaluate the amounts of Kv4.2 and Kv4.3 mRNA in brain structures at different stages of a spatial learning task in naive, pseudoconditioned, and conditioned rats. Significant differences in Kv4.2 and Kv4.3 mRNA levels were observed between conditioned and pseudoconditioned rats. Kv4.2 and Kv4.3 mRNA levels were transiently up-regulated in the striatum, nucleus accumbens, retrosplenial, and cingulate cortices during early stages of learning, suggesting an involvement in the switch from egocentric to allocentric strategies. Spatial learning performance was positively correlated with the levels of Kv4.2 and Kv4.3 mRNAs in several of these brain structures. Altogether our findings suggest that Kv4 channels could increase the signal-to-noise ratio during information acquisition, thereby allowing a better encoding of the memory trace.