Multiple memory systems: the power of interactions

Anterograde versus Retrograde Effects of Damage to Identified Learning and Memory Systems during Acquisition, Retention, and Re-Acquisition of an Instrumental Visual Discrimination Task: Dorsal Striatum, Perirhinal Cortex, and Hippocampus

BACKGROUND

The goal of these experiments was to determine which learning and memory system(s) were necessary for the retention of visual discriminations and subsequent acquisition of a second problem. The dorsal striatum should be involved in the acquisition and expression of this task based on previous work implicating this region in instrumental learning and memory processes. The perirhinal cortex has been implicated in learning and memory processes associated with visual information like objects, and pictures and may also play a role in the acquisition and/or retention of visual discriminations. As there is no clear spatial/relational component to the task, the hippocampus should not be involved.

METHODS

Rats were trained on a two-choice visual discrimination task to criterion performance after which they received lesions to portions of the dorsal striatum (dorso-medial or dorso-lateral striatum) and medial temporal lobe (perirhinal cortex or hippocampus). After surgical recovery, the rats were tested for retention of the original discrimination, followed by training on a second problem on the same task.

RESULTS

The results showed that dorsal medial striatal lesions produced a retrograde deficit on picture discrimination, but dorsal lateral striatum lesions did not. Neither dorsal striatal lesion produced a deficit on acquisition of a second problem. Perirhinal cortex did not seem to make an essential contribution to the retention of the original discrimination or acquisition of the second problem. Surprisingly, subjects with hippocampal damage were severely impaired but eventually re-learned the discrimination. Damage to the hippocampus had no impact on acquisition of a second problem.

CONCLUSIONS

Taken together, the results of the present experiments show that the dorsomedial striatum and the hippocampus may support performance on this instrumental task if intact during acquisition but is not required for acquisition of a new problem. The implications of this pattern of results for our understanding of the organization of learning and memory in mammals is discussed.

Contemporary neurocognitive models of memory: A descriptive comparative analysis

The great complexity involved in the study of memory has given rise to numerous hypotheses and models associated with various phenomena at different levels of analysis. This has allowed us to delve deeper in our knowledge about memory but has also made it difficult to synthesize and integrate data from different lines of research. In this context, this work presents a descriptive comparative analysis of contemporary models that address the structure and function of multiple memory systems. The main goal is to outline a panoramic view of the key elements that constitute these models in order to visualize both the current state of research and possible future directions. The elements that stand out from different levels of analysis are distributed neural networks, hierarchical organization, predictive coding, homeostasis, and evolutionary perspective.

When and how do children solve the Weather Prediction Task?

The Weather Prediction Task (WPT) can be solved by adults using several strategies dependent on different memory systems. One developmental study reported that 8-12-year-old children can solve WPT-like tasks but, because of inadequate analyses, the cognitive processes involved in solving the task have not been established. The present study aimed to determine at what age children can first solve the WPT and identify the strategies used by children of different ages. We tested 3-12-year-old typically developing children and 20-30-year-old adults on a modified WPT. We performed detailed analyses of performance for each pattern of cue-outcome associations to decipher the strategies used by participants. None of the 3-5.5-year-old children solved the task. About one third of 5.5-7.5-year-old children performed above chance, relying only on the two most predictive cues. In contrast, about 80% of 7.5-12-year-old children performed above chance, relying on a conditional hierarchical strategy. Similar to 20-30-year-old adults, 7.5-12-year-old children considered the highly predictive cues primarily and the less predictive cues secondarily. These findings indicate that the learning strategies used to solve the WPT evolve from middle to late childhood and reflect an increasing ability to use a conditional strategy concomitant with the development of the hippocampus-dependent memory system.

A map of spatial navigation for neuroscience

Spatial navigation has received much attention from neuroscientists, leading to the identification of key brain areas and the discovery of numerous spatially selective cells. Despite this progress, our understanding of how the pieces fit together to drive behavior is generally lacking. We argue that this is partly caused by insufficient communication between behavioral and neuroscientific researchers. This has led the latter to under-appreciate the relevance and complexity of spatial behavior, and to focus too narrowly on characterizing neural representations of space-disconnected from the computations these representations are meant to enable. We therefore propose a taxonomy of navigation processes in mammals that can serve as a common framework for structuring and facilitating interdisciplinary research in the field. Using the taxonomy as a guide, we review behavioral and neural studies of spatial navigation. In doing so, we validate the taxonomy and showcase its usefulness in identifying potential issues with common experimental approaches, designing experiments that adequately target particular behaviors, correctly interpreting neural activity, and pointing to new avenues of research.

Chronic alcohol consumption shifts learning strategies and synaptic plasticity from hippocampus to striatum-dependent pathways

Introduction

The hippocampus and striatum have dissociable roles in memory and are necessary for spatial and procedural/cued learning, respectively. Emotionally charged, stressful events promote the use of striatal- over hippocampus-dependent learning through the activation of the amygdala. An emerging hypothesis suggests that chronic consumption of addictive drugs similarly disrupt spatial/declarative memory while facilitating striatum-dependent associative learning. This cognitive imbalance could contribute to maintain addictive behaviors and increase the risk of relapse.

Methods

We first examined, in C57BL/6 J male mice, whether chronic alcohol consumption (CAC) and alcohol withdrawal (AW) might modulate the respective use of spatial vs. single cue-based learning strategies, using a competition protocol in the Barnes maze task. We then performed in vivo electrophysiological studies in freely moving mice to assess learning-induced synaptic plasticity in both the basolateral amygdala (BLA) to dorsal hippocampus (dCA1) and BLA to dorsolateral striatum (DLS) pathways.

Results

We found that both CAC and early AW promote the use of cue-dependent learning strategies, and potentiate plasticity in the BLA → DLS pathway while reducing the use of spatial memory and depressing BLA → dCA1 neurotransmission.

Discussion

These results support the view that CAC disrupt normal hippocampo-striatal interactions, and suggest that targeting this cognitive imbalance through spatial/declarative task training could be of great help to maintain protracted abstinence in alcoholic patients.

Compensatory cognition in neurological diseases and aging: A review of animal and human studies

Specialized individual circuits in the brain are recruited for specific functions. Interestingly, multiple neural circuitries continuously compete with each other to acquire the specialized function. However, the dominant among them compete and become the central neural network for that particular function. For example, the hippocampal principal neural circuitries are the dominant networks among many which are involved in learning processes. But, in the event of damage to the principal circuitry, many times, less dominant networks compensate for the primary network. This review highlights the psychopathologies of functional loss and the aspects of functional recuperation in the absence of the hippocampus.

Delaying feedback compensates for impaired reinforcement learning in developmental dyslexia

A theoretical framework suggests that developmental dyslexia is characterized by abnormalities in brain structures underlying the procedural learning and memory systems while the declarative learning and memory systems are presumed to remain intact or even enhanced (Procedural Deficit Hypothesis). This notion has been supported by a substantial body of research, which focused on each system independently. However, less attention has been paid to interactions between these memory systems which may provide insights as to learning situations and conditions in which learning in dyslexia can be improved. The current study was undertaken to examine these important but unresolved issues. To this end, probabilistic reinforcement learning and episodic memory tasks were examined in participants with dyslexia and neurotypicals simultaneously within a single task. Feedback timing presentation was manipulated, building on prior research indicating that delaying feedback timing shifts striatal-based probabilistic learning, to become more hippocampal-dependent. It was hypothesized that if the procedural learning and memory systems are impaired in dyslexia, performance will be impaired under conditions that encourage procedural memory engagement (immediate feedback trials) but not under conditions that promote declarative memory processing (long delayed feedback trials). It was also predicted that the ability to incidentally acquire episodic information would be preserved in dyslexia. The results supported these predictions. Participants with dyslexia were impaired in probabilistic learning of cue-outcome associations compared to neurotypicals in an immediate feedback condition, but not when feedback on choices was presented after a long delay. Furthermore, participants with dyslexia demonstrated similar performance to neurotypicals in a task requiring incidental episodic memory formation. These findings attest to a dissociation between procedural-based and declarative-based learning in developmental dyslexia within a single task, a finding that adds discriminative validity to the Procedural Deficit Hypothesis. Just as important, the present findings suggest that training conditions designed to shift the load from midbrain/striatal systems to declarative memory mechanisms have the potential to compensate for impaired learning in developmental dyslexia.

Changes in Representation of Thalamic Projection Neurons within Prefrontal-Thalamic-Hippocampal Circuitry in a Rat Model of Third Trimester Binge Drinking

Alcohol exposure (AE) during the third trimester of pregnancy-a period known as the brain growth spurt (BGS)-could result in a diagnosis of a fetal alcohol spectrum disorder (FASD), a hallmark of which is impaired executive functioning (EF). Coordinated activity between prefrontal cortex and hippocampus is necessary for EF and thalamic nucleus reuniens (Re), which is required for prefrontal-hippocampal coordination, is damaged following high-dose AE during the BGS. The current experiment utilized high-dose AE (5.25 g/kg/day) during the BGS (i.e., postnatal days 4-9) of Long-Evans rat pups. AE reduces the number of neurons in Re into adulthood and selectively alters the proportion of Re neurons that simultaneously innervate both medial prefrontal cortex (mPFC) and ventral hippocampus (vHPC). The AE-induced change unique to Re→(mPFC + vHPC) projection neurons (neuron populations that innervate either mPFC or vHPC individually were unchanged) is not mediated by reduction in neuron number. These data are the first to examine mPFC-Re-HPC circuit connectivity in a rodent model of FASD, and suggest that both short-term AE-induced neuron loss and long-term changes in thalamic connectivity may be two distinct (but synergistic) mechanisms by which developmental AE can alter mPFC-Re-vHPC circuitry and impair EF throughout the lifespan.

Resistance, vulnerability and resilience: A review of the cognitive cerebellum in aging and neurodegenerative diseases

In the context of neurodegeneration and aging, the cerebellum is an enigma. Genetic markers of cellular aging in cerebellum accumulate more slowly than in the rest of the brain, and it generates unknown factors that may slow or even reverse neurodegenerative pathology in animal models of Alzheimer's Disease (AD). Cerebellum shows increased activity in early AD and Parkinson's disease (PD), suggesting a compensatory function that may mitigate early symptoms of neurodegenerative pathophysiology. Perhaps most notably, different parts of the brain accumulate neuropathological markers of AD in a recognized progression and generally, cerebellum is the last brain region to do so. Taken together, these data suggest that cerebellum may be resistant to certain neurodegenerative mechanisms. On the other hand, in some contexts of accelerated neurodegeneration, such as that seen in chronic traumatic encephalopathy (CTE) following repeated traumatic brain injury (TBI), the cerebellum appears to be one of the most susceptible brain regions to injury and one of the first to exhibit signs of pathology. Cerebellar pathology in neurodegenerative disorders is strongly associated with cognitive dysfunction. In neurodegenerative or neurological disorders associated with cerebellar pathology, such as spinocerebellar ataxia, cerebellar cortical atrophy, and essential tremor, rates of cognitive dysfunction, dementia and neuropsychiatric symptoms increase. When the cerebellum shows AD pathology, such as in familial AD, it is associated with earlier onset and greater severity of disease. These data suggest that when neurodegenerative processes are active in the cerebellum, it may contribute to pathological behavioral outcomes. The cerebellum is well known for comparing internal representations of information with observed outcomes and providing real-time feedback to cortical regions, a critical function that is disturbed in neuropsychiatric disorders such as intellectual disability, schizophrenia, dementia, and autism, and required for cognitive domains such as working memory. While cerebellum has reciprocal connections with non-motor brain regions and likely plays a role in complex, goal-directed behaviors, it has proven difficult to establish what it does mechanistically to modulate these behaviors. Due to this lack of understanding, it's not surprising to see the cerebellum reflexively dismissed or even ignored in basic and translational neuropsychiatric literature. The overarching goals of this review are to answer the following questions from primary literature: When the cerebellum is affected by pathology, is it associated with decreased cognitive function? When it is intact, does it play a compensatory or protective role in maintaining cognitive function? Are there theoretical frameworks for understanding the role of cerebellum in cognition, and perhaps, illnesses characterized by cognitive dysfunction? Understanding the role of the cognitive cerebellum in neurodegenerative diseases has the potential to offer insight into origins of cognitive deficits in other neuropsychiatric disorders, which are often underappreciated, poorly understood, and not often treated.

Are Owls and Larks Different When it Comes to Aggression? Genetics, Neurobiology, and Behavior

This review focuses on the contribution of circadian rhythms to aggression with a multifaceted approach incorporating genetics, neural networks, and behavior. We explore the hypothesis that chronic circadian misalignment is contributing to increased aggression. Genes involved in both circadian rhythms and aggression are discussed as a possible mechanism for increased aggression that might be elicited by circadian misalignment. We then discuss the neural networks underlying aggression and how dysregulation in the interaction of these networks evoked by circadian rhythm misalignment could contribute to aggression. The last section of this review will present recent human correlational data demonstrating the association between chronotype and/or circadian misalignment with aggression. With circadian rhythms and aggression being a burgeoning area of study, we hope that this review initiates more interest in this promising and topical area.

Hippocampal Damage Causes Retrograde Amnesia and Slower Acquisition of a Cue-Place Discrimination in a Concurrent Cue-Place Water Task in Rats

Explanations of memory-guided navigation in rodents typically suggest that cue- and place-based navigations are independent aspects of behavior and neurobiology. The results of many experiments show that hippocampal damage causes both anterograde and retrograde amnesia (AA; RA) for place memory, but only RA for cue memory. In the present experiments, we used a concurrent cue-place water task (CWT) to study the effects of hippocampal damage before or after training on cue- and place-guided navigation, and how cue and place memory interact in damaged and control rats. We found that damaging the hippocampus before training caused a delay in the expression of cue-place navigation strategies relative to intact control animals; surprisingly, place navigation strategies emerged following pre-training hippocampal damage. With additional training, both control and damaged rats used local cues to navigate in the CWT. Damaged animals also show minor impairments in latency to navigate to the correct cue following a cue contingency reversal. By contrast to these anterograde effects, damage made after training causes RA for cue choice accuracy and latency to navigate to the correct cue. In addition, the extent of hippocampal damage predicted impairments in choice accuracy when lesions were made after training. These data extend previous work on the role of the hippocampus in cue and place memory-guided navigation, and show that the hippocampus plays an important role in both aspects of memory and navigation when present during the learning experience.

Aversive learning strengthens episodic memory in both adolescents and adults

Adolescence is often filled with positive and negative emotional experiences that may change how individuals remember and respond to stimuli in their environment. In adults, aversive events can both enhance memory for associated stimuli as well as generalize to enhance memory for unreinforced but conceptually related stimuli. The present study tested whether learned aversive associations similarly lead to better memory and generalization across a category of stimuli in adolescents. Participants completed an olfactory Pavlovian category conditioning task in which trial-unique exemplars from one of two categories were partially reinforced with an aversive odor. Participants then returned 24 h later to complete a recognition memory test. We found better corrected recognition memory for the reinforced versus the unreinforced category of stimuli in both adults and adolescents. Further analysis revealed that enhanced recognition memory was driven specifically by better memory for the reinforced exemplars. Autonomic arousal during learning was also related to subsequent memory. These findings build on previous work in adolescent and adult humans and rodents showing comparable acquisition of aversive Pavlovian conditioned responses across age groups and demonstrate that memory for stimuli with an acquired aversive association is enhanced in both adults and adolescents.

Drug-Induced Glucocorticoids and Memory for Substance Use

The biological stress response of the body forms one of the foundations of adaptive behavior, including promoting (and impairing) different forms of memory. This response transcends stressful experiences and underlies reactions to challenges and even reinforcers such as addictive substances. Nevertheless, drug-induced stress responses are rarely incorporated into models of addiction. We propose here that drug-induced stress responses (particularly glucocorticoids) play a crucial role in addictive behavior by modulating the formation of memories for substance-use experiences. We review the contributions of amygdala-, striatum-, and hippocampus-based memory systems to addiction, and reveal common effects of addictive drugs and acute stress on these different memories. We suggest that the contributions of drug-induced stress responses to memory may provide insights into the mechanisms driving addictive behavior.

Object, spatial and social recognition testing in a single test paradigm

Animals have the ability to process information about an object or a conspecific's physical features and location, and alter its behavior when such information is updated. In the laboratory, the object, spatial and social recognition are often studied in separate tasks, making them unsuitable to study the potential dissociations and interactions among various types of recognition memories. The present study introduced a single paradigm to detect the object and spatial recognition, and social recognition of a familiar and novel conspecific. Specifically, male and female Sprague-Dawley adult (>75 days old) or preadolescent (25-28 days old) rats were tested with two objects and one social partner in an open-field arena for four 10-min sessions with a 20-min inter-session interval. After the first sample session, a new object replaced one of the sampled objects in the second session, and the location of one of the old objects was changed in the third session. Finally, a new social partner was introduced in the fourth session and replaced the familiar one. Exploration time with each stimulus was recorded and measures for the three recognitions were calculated based on the discrimination ratio. Overall results show that adult and preadolescent male and female rats spent more time exploring the social partner than the objects, showing a clear preference for social stimulus over nonsocial one. They also did not differ in their abilities to discriminate a new object, a new location and a new social partner from a familiar one, and to recognize a familiar conspecific. Acute administration of MK-801 (a NMDA receptor antagonist, 0.025 and 0.10 mg/kg, i.p.) after the sample session dose-dependently reduced the total time spent on exploring the social partner and objects in the adult rats, and had a significantly larger effect in the females than in the males. MK-801 also dose-dependently increased motor activity. However, it did not alter the object, spatial and social recognitions. These findings indicate that the new triple recognition paradigm is capable of recording the object, spatial location and social recognition together and revealing potential sex and age differences. This paradigm is also useful for the study of object and social exploration concurrently and can be used to evaluate cognition-altering drugs in various stages of recognition memories.

Using a memory systems lens to view the effects of estrogens on cognition: Implications for human health

Understanding the organizing and activating effects of gonadal steroids on adult physiology can guide insight into sex differences in and hormonal influences on health and disease, ranging from diabetes and other metabolic disorders, emotion and stress regulation, substance abuse, pain perception, immune function and inflammation, to cognitive function and dysfunction accompanying neurological disorders. Because the brain is highly sensitive to many forms of estrogens, it is not surprising that many adult behaviors, including cognitive function, are modulated by estrogens. Estrogens are known for their facilitating effects on learning and memory, but it is becoming increasingly clear that they also can impair learning and memory of some classes of tasks and may do so through direct actions on specific neural systems. This review takes a multiple memory systems approach to understanding how estrogens can at the same time enhance hippocampus-sensitive place learning and impair striatum-sensitive response learning by exploring the role estrogen receptor signaling may play in the opposing cognitive effects of estrogens. Accumulating evidence suggests that neither receptor subtype nor the timing of treatment, i.e. rapid vs slow, explain the bidirectional effects of estrogens on different types of learning. New findings pointing to neural metabolism and the provision of energy substrates by astrocytes as a candidate mechanism for cognitive enhancement and impairment are discussed.

Interactions of spatial strategies producing generalization gradient and blocking: A computational approach

We present a computational model of spatial navigation comprising different learning mechanisms in mammals, i.e., associative, cognitive mapping and parallel systems. This model is able to reproduce a large number of experimental results in different variants of the Morris water maze task, including standard associative phenomena (spatial generalization gradient and blocking), as well as navigation based on cognitive mapping. Furthermore, we show that competitive and cooperative patterns between different navigation strategies in the model allow to explain previous apparently contradictory results supporting either associative or cognitive mechanisms for spatial learning. The key computational mechanism to reconcile experimental results showing different influences of distal and proximal cues on the behavior, different learning times, and different abilities of individuals to alternatively perform spatial and response strategies, relies in the dynamic coordination of navigation strategies, whose performance is evaluated online with a common currency through a modular approach. We provide a set of concrete experimental predictions to further test the computational model. Overall, this computational work sheds new light on inter-individual differences in navigation learning, and provides a formal and mechanistic approach to test various theories of spatial cognition in mammals.

Role of the lateral habenula in memory through online processing of information

Our memory abilities, whether they involve short-term working memory or long-term episodic or procedural memories, are essential for our well-being, our capacity to adapt to constraints of our environment and survival. Therefore, several key brain regions and neurotransmitter systems are engaged in the processing of sensory information to either maintain such information in working memory so that it will quickly be used, and/or participate in the elaboration and storage of enduring traces useful for longer periods of time. Animal research has recently attracted attention on the lateral habenula which, as shown in rodents and non-human primates, seems to process information stemming in the main regions involved in memory processing, e.g., the medial prefrontal cortex, the hippocampus, the amygdala, the septal region, the basal ganglia, and participates in the control of key memory-related neurotransmitters systems, i.e., dopamine, serotonin, acetylcholine. Recently, the lateral habenula has been involved in working and spatial reference memories, in rodents, likely by participating in online processing of contextual information. In addition, several behavioral studies strongly suggest that it is also involved in the processing of the emotional valance of incoming information in order to adapt to particularly stressful situations. Therefore, the lateral habenula appears like a key region at the interface between cognition and emotion to participate in the selection of appropriate behaviors.

Learning relative values in the striatum induces violations of normative decision making

To decide optimally between available options, organisms need to learn the values associated with these options. Reinforcement learning models offer a powerful explanation of how these values are learnt from experience. However, human choices often violate normative principles. We suggest that seemingly counterintuitive decisions may arise as a natural consequence of the learning mechanisms deployed by humans. Here, using fMRI and a novel behavioural task, we show that, when suddenly switched to novel choice contexts, participants' choices are incongruent with values learnt by standard learning algorithms. Instead, behaviour is compatible with the decisions of an agent learning how good an option is relative to an option with which it had previously been paired. Striatal activity exhibits the characteristics of a prediction error used to update such relative option values. Our data suggest that choices can be biased by a tendency to learn option values with reference to the available alternatives.

Low lifetime stress exposure is associated with reduced stimulus-response memory

Exposure to stress throughout life can cumulatively influence later health, even among young adults. The negative effects of high cumulative stress exposure are well-known, and a shift from episodic to stimulus–response memory has been proposed to underlie forms of psychopathology that are related to high lifetime stress. At the other extreme, effects of very low stress exposure are mixed, with some studies reporting that low stress leads to better outcomes, while others demonstrate that low stress is associated with diminished resilience and negative outcomes. However, the influence of very low lifetime stress exposure on episodic and stimulus–response memory is unknown. Here we use a lifetime stress assessment system (STRAIN) to assess cumulative lifetime stress exposure and measure memory performance in young adults reporting very low and moderate levels of lifetime stress exposure. Relative to moderate levels of stress, very low levels of lifetime stress were associated with reduced use and retention (24 h later) of stimulus–response (SR) associations, and a higher likelihood of using context memory. Further, computational modeling revealed that participants with low levels of stress exhibited worse expression of memory for SR associations than those with moderate stress. These results demonstrate that very low levels of stress exposure can have negative effects on cognition.

Training-induced elevations in extracellular lactate in hippocampus and striatum: Dissociations by cognitive strategy and type of reward

Recent evidence suggests that astrocytes convert glucose to lactate, which is released from the astrocytes and supports learning and memory. This report takes a multiple memory perspective to test the role of astrocytes in cognition using real-time lactate measurements during learning and memory. Extracellular lactate levels in the hippocampus or striatum were determined with lactate biosensors while rats were learning place (hippocampus-sensitive) or response (striatum-sensitive) versions of T-mazes. In the first experiment, rats were trained on the place and response tasks to locate a food reward. Extracellular lactate levels in the hippocampus increased beyond those of feeding controls during place training but not during response training. However, striatal lactate levels did not increase beyond those of controls when rats were trained on either the place or the response version of the maze. Because food ingestion itself increased blood glucose and brain lactate levels, the contribution of feeding may have confounded the brain lactate measures. Therefore, we conducted a second similar experiment using water as the reward. A very different pattern of lactate responses to training emerged when water was used as the task reward. First, provision of water itself did not result in large increases in either brain or blood lactate levels. Moreover, extracellular lactate levels increased in the striatum during response but not place learning, whereas extracellular lactate levels in the hippocampus did not differ across tasks. The findings from the two experiments suggest that the relative engagement of the hippocampus and striatum dissociates not only by task but also by reward type. The divergent lactate responses of the hippocampus and striatum in place and response tasks under different reward conditions may reflect ethological constraints tied to foraging for food and water.

Morphine Reward Promotes Cue-Sensitive Learning: Implication of Dorsal Striatal CREB Activity

Different parallel neural circuits interact and may even compete to process and store information: whereas stimulus-response (S-R) learning critically depends on the dorsal striatum (DS), spatial memory relies on the hippocampus (HPC). Strikingly, despite its potential importance for our understanding of addictive behaviors, the impact of drug rewards on memory systems dynamics has not been extensively studied. Here, we assessed long-term effects of drug- vs food reinforcement on the subsequent use of S-R vs spatial learning strategies and their neural substrates. Mice were trained in a Y-maze cue-guided task, during which either food or morphine injections into the ventral tegmental area (VTA) were used as rewards. Although drug- and food-reinforced mice learned the Y-maze task equally well, drug-reinforced mice exhibited a preferential use of an S-R learning strategy when tested in a water-maze competition task designed to dissociate cue-based and spatial learning. This cognitive bias was associated with a persistent increase in the phosphorylated form of cAMP response element-binding protein phosphorylation (pCREB) within the DS, and a decrease of pCREB expression in the HPC. Pharmacological inhibition of striatal PKA pathway in drug-rewarded mice limited the morphine-induced increase in levels of pCREB in DS and restored a balanced use of spatial vs cue-based learning. Our findings suggest that drug (opiate) reward biases the engagement of separate memory systems toward a predominant use of the cue-dependent system via an increase in learning-related striatal pCREB activity. Persistent functional imbalance between striatal and hippocampal activity could contribute to the persistence of addictive behaviors, or counteract the efficiency of pharmacological or psychotherapeutic treatments.

Are nonclinical obsessive-compulsive symptoms associated with bias toward habits?

In a sample of student volunteers (N=93), we found that obsessive-compulsive symptoms (although not hoarding) were associated with overreliance on stimulus-response habits at the expense of goal-directed control during instrumental responding. Only checking symptoms were associated with bias toward habits after negative affect was controlled for. Further research is warranted to examine if overreliance on habits represents an aberrant learning process that confers risk for obsessive-compulsive psychopathology.

Interaction between basal ganglia and limbic circuits in learning and memory processes

Hippocampus and striatum play distinctive roles in memory processes since declarative and non-declarative memory systems may act independently. However, hippocampus and striatum can also be engaged to function in parallel as part of a dynamic system to integrate previous experience and adjust behavioral responses. In these structures the formation, storage, and retrieval of memory require a synaptic mechanism that is able to integrate multiple signals and to translate them into persistent molecular traces at both the corticostriatal and hippocampal/limbic synapses. The best cellular candidate for this complex synthesis is represented by long-term potentiation (LTP). A common feature of LTP expressed in these two memory systems is the critical requirement of convergence and coincidence of glutamatergic and dopaminergic inputs to the dendritic spines of the neurons expressing this form of synaptic plasticity. In experimental models of Parkinson's disease abnormal accumulation of α-synuclein affects these two memory systems by altering two major synaptic mechanisms underlying cognitive functions in cholinergic striatal neurons, likely implicated in basal ganglia dependent operative memory, and in the CA1 hippocampal region, playing a central function in episodic/declarative memory processes.

Aging, but not tau pathology, impacts olfactory performances and somatostatin systems in THY-Tau22 mice

Somatostatin (SOM) cortical levels decline in Alzheimer's disease (AD) in correlation with cognitive impairment severity, the latter being closely related to the presence of neurofibrillary tangles. Impaired olfaction is another hallmark of AD tightly related to tau pathology in the olfactory pathways. Recent studies showed that SOM modulates olfactory processing, suggesting that alterations in SOM levels participate to olfactory deficits in AD. Herein, we first observed that human olfactory peduncle and cortex are enriched in SOM cells and fibers, in aged postmortem brains. Then, the possible link between SOM alterations and olfactory deficits was evaluated by exploring the impact of age and tau hyperphosphorylation on olfactory SOM networks and behavioral performances in THY-Tau22 mice, a tauopathy transgenic model. Distinct molecular repertoires of SOM peptide and receptors were associated to sensory or cortical olfactory processing structures. Aging mainly affected SOM neurotransmission in piriform and entorhinal cortex in wild-type mice, although olfactory performances decreased. However, no further olfactory impairment was evidenced in THY-Tau22 mice until 12 months although tau pathology early affected olfactory cortical structures. Thus, tau hyperphosphorylation per se has a limited impact on olfactory performances in THY-Tau22 mice.

How does a specific learning and memory system in the mammalian brain gain control of behavior?

This review addresses a fundamental, yet poorly understood set of issues in systems neuroscience. The issues revolve around conceptualizations of the organization of learning and memory in the mammalian brain. One intriguing, and somewhat popular, conceptualization is the idea that there are multiple learning and memory systems in the mammalian brain and they interact in different ways to influence and/or control behavior. This approach has generated interesting empirical and theoretical work supporting this view. One issue that needs to be addressed is how these systems influence or gain control of voluntary behavior. To address this issue, we clearly specify what we mean by a learning and memory system. We then review two types of processes that might influence which memory system gains control of behavior. One set of processes are external factors that can affect which system controls behavior in a given situation including task parameters like the kind of information available to the subject, types of training experience, and amount of training. The second set of processes are brain mechanisms that might influence what memory system controls behavior in a given situation including executive functions mediated by the prefrontal cortex; switching mechanisms mediated by ascending neurotransmitter systems, the unique role of the hippocampus during learning. The issue of trait differences in control of different learning and memory systems will also be considered in which trait differences in learning and memory function are thought to potentially emerge from differences in level of prefrontal influence, differences in plasticity processes, differences in ascending neurotransmitter control, differential access to effector systems like motivational and motor systems. Finally, we present scenarios in which different mechanisms might interact. This review was conceived to become a jumping off point for new work directed at understanding these issues. The outcome of this work, in combination with other approaches, might improve understanding of the mechanisms of volition in human and non-human animals.

Annual research review: The neurobehavioral development of multiple memory systems--implications for childhood and adolescent psychiatric disorders

Extensive evidence indicates that mammalian memory is organized into multiple brains systems, including a 'cognitive' memory system that depends on the hippocampus and a stimulus-response 'habit' memory system that depends on the dorsolateral striatum. Dorsal striatal-dependent habit memory may in part influence the development and expression of some human psychopathologies, particularly those characterized by strong habit-like behavioral features. The present review considers this hypothesis as it pertains to psychopathologies that typically emerge during childhood and adolescence. These disorders include Tourette syndrome, attention-deficit/hyperactivity disorder, obsessive-compulsive disorder, eating disorders, and autism spectrum disorders. Human and nonhuman animal research shows that the typical development of memory systems comprises the early maturation of striatal-dependent habit memory and the relatively late maturation of hippocampal-dependent cognitive memory. We speculate that the differing rates of development of these memory systems may in part contribute to the early emergence of habit-like symptoms in childhood and adolescence. In addition, abnormalities in hippocampal and striatal brain regions have been observed consistently in youth with these disorders, suggesting that the aberrant development of memory systems may also contribute to the emergence of habit-like symptoms as core pathological features of these illnesses. Considering these disorders within the context of multiple memory systems may help elucidate the pathogenesis of habit-like symptoms in childhood and adolescence, and lead to novel treatments that lessen the habit-like behavioral features of these disorders.

Peripheral and intra-dorsolateral striatum injections of the cannabinoid receptor agonist WIN 55,212-2 impair consolidation of stimulus-response memory

The endocannabinoid system plays a major role in modulating memory. In the present study, we examined whether cannabinoid agonists influence the consolidation of stimulus-response/habit memory, a form of memory dependent upon the dorsolateral striatum (DLS). In Experiment 1, rats were trained in a cued platform water maze task in which animals were released from different start points and in order to escape had to find a cued platform which was moved to various spatial locations across trials. Immediately following training, rats received an i.p. injection of the cannabinoid receptor agonist WIN 55,212-2 (1 or 3mg/kg) or a vehicle solution. In Experiment 2, rats were trained in a forced-response version of the water plus-maze task in which a consistent body-turn response was reinforced across trials. Immediately following training, rats received an i.p. injection of WIN 55,212-2 (3 mg/kg) or vehicle. In Experiment 3, rats were trained in the cued platform task and after training received bilateral intra-DLS WIN 55,212-2 (100 ng/.5 μL or 200 ng/.5 μL) or vehicle. In Experiments 1-3, the higher doses of WIN 55,212-2 were associated with significant memory impairments, relative to vehicle-treated controls. The results indicate that peripheral or intra-DLS administration of a cannabinoid receptor agonist impairs consolidation of DLS-dependent memory. The findings are discussed within the context of previous research encompassing cannabinoids and DLS-dependent learning and memory processes, and the possibility that cannabinoids may be used to treat some habit-like human psychopathologies (e.g. posttraumatic stress disorder) is considered.

A secondary working memory challenge preserves primary place strategies despite overtraining

Learning by repetition engages distinct cognitive strategies whose contributions are adjusted with experience. Early in learning, performance relies upon flexible, attentive strategies. With extended practice, inflexible, automatic strategies emerge. This transition is thought fundamental to habit formation and applies to human and animal cognition. In the context of spatial navigation, place strategies are flexible, typically employed early in training, and rely on the spatial arrangement of landmarks to locate a goal. Response strategies are inflexible, become dominant after overtraining, and utilize fixed motor sequences. Although these strategies can operate independently, they have also been shown to interact. However, since previous work has focused on single-choice learning, if and how these strategies interact across sequential choices remains unclear. To test strategy interactions across sequential choices, we utilized various two-choice spatial navigation tasks administered on the Opposing Ts maze, an apparatus for rodents that permits experimental control over strategy recruitment. We found that when a second choice required spatial working memory, the transition to response navigation on the first choice was blocked. Control experiments specified this effect to the cognitive aspects of the secondary task. In addition, response navigation, once established on a single choice, was not reversed by subsequent introduction of a secondary choice reliant on spatial working memory. These results demonstrate that performance strategies interact across choices, highlighting the sensitivity of strategy use to the cognitive demands of subsequent actions, an influence from which overtrained rigid actions may be protected.

Long-term brain and behavioral consequences of early iron deficiency

Early iron deficiency not only affects brain and behavioral function during the period of iron deficiency, it persists long after treatment. The mechanisms include long-term alterations in dopamine metabolism, myelination, and hippocampal structure and function. Recent studies have demonstrated long-term genomic changes, which suggests the regulation of brain function is fundamentally altered.

Disrupting effect of drug-induced reward on spatial but not cue-guided learning: implication of the striatal protein kinase A/cAMP response element-binding protein pathway

The multiple memory systems hypothesis posits that different neural circuits function in parallel and may compete for information processing and storage. For example, instrumental conditioning would depend on the striatum, whereas spatial memory may be mediated by a circuit centered on the hippocampus. However, the nature of the task itself is not sufficient to select durably one system over the other. In this study, we investigated the effects of natural and pharmacological rewards on the selection of a particular memory system during learning. We compared the effects of food- or drug-induced activation of the reward system on cue-guided versus spatial learning using a Y-maze discrimination task. Drug-induced reward severely impaired the acquisition of a spatial discrimination task but spared the cued version of the task. Immunohistochemical analysis of the phosphorylated form of the cAMP response element binding (CREB) protein and c-Fos expression induced by behavioral testing revealed that the spatial deficit was associated with a decrease of both markers within the hippocampus and the prefrontal cortex. In contrast, drug reward potentiated the cued learning-induced CREB phosphorylation within the dorsal striatum. Administration of the protein kinase A inhibitor 8-Bromo-adenosine-3',5'-cyclic monophosphorothioate Rp isomer (Rp-cAMPS) into the dorsal striatum before training completely reversed the drug-induced spatial deficit and restored CREB phosphorylation levels within the hippocampus and the prefrontal cortex. Therefore, drug-induced striatal hyperactivity may underlie the declarative memory deficit reported here. This mechanism could represent an important early step toward the development of addictive behaviors by promoting conditioning to the detriment of more flexible forms of memory.

Functional interaction between the dorsal hippocampus and the striatum in visual discrimination learning

The hippocampus and the striatum have traditionally been considered as part of different and independent memory systems. However, there is evidence that supports a functional interaction between the hippocampus and the dorsal striatum at least in particular learning tasks. Here, we evaluated the functional contribution of both brain regions in a visual discrimination learning task using cytochrome c oxidase (CO) quantitative histochemistry. Compared with other brain metabolic mapping techniques, CO activity reflects steady-state neuronal energy demand. Rats were trained for 6 days in a water T-maze to find a hidden escape platform associated with an intramaze visual cue. A control group of animals swam for an equivalent amount of time compared as the trained group but without any escape platform available. After finishing the behavioral task, CO activity was measured in subdivisions of the dorsal hippocampus and the dorsal striatum in both groups. Results show significantly higher CO activity in the CA1 area and the dentate gyrus of the dorsal hippocampus in the trained rats compared with the control group. In addition, a significant negative functional cross-correlation between area CA1 of the dorsal hippocampus and the anterodorsal striatum was found. Our results support current theories on competitive interaction of different memory systems during visual discrimination learning.

Comparative neuroscience of stimulant-induced memory dysfunction: role for neurogenesis in the adult hippocampus

The discovery that the addictive drugs impair neurogenesis in the adult hippocampus has prompted the elaboration of new biological hypotheses to explain addiction and drug-induced cognitive dysfunction. Considerable evidence now implicates the process of adult neurogenesis in at least some critical components of hippocampal-dependent memory function. In experimental models, psychomotor stimulant drugs produce alterations in the rate of birth, survival, maturation and functional integration of adult-born hippocampal neurons. Thus some of the deleterious consequences of drug abuse on memory could result from the neurotoxic actions of drugs on adult hippocampal neurogenesis. In this review, we will first summarize preclinical and clinical literature on the disruptive effects of drugs such as cocaine and ecstasy in the areas of learning, memory and attention. We will also summarize data that document the widespread effects of stimulant drugs on progenitor activity and precursor incorporation in the adult dentate gyrus. Finally, we will examine evidence that supports the involvement of hippocampal neurogenesis in specific aspects of learning and memory function and we will consider critically the hypothesis that some of the negative consequences of drug abuse on cognition might be ascribed to deficits in adult hippocampal neurogenesis. Evidence suggests that stimulant abuse impacts negatively on at least four areas of memory/cognitive function that may be influenced by adult hippocampal neurogenesis: contextual memory, spatial memory, working memory and cognitive flexibility.

Path planning versus cue responding: a bio-inspired model of switching between navigation strategies

In this article, we describe a new computational model of switching between path-planning and cue-guided navigation strategies. It is based on three main assumptions: (i) the strategies are mediated by separate memory systems that learn independently and in parallel; (ii) the learning algorithms are different in the two memory systems-the cue-guided strategy uses a temporal-difference (TD) learning rule to approach a visible goal, whereas the path-planning strategy relies on a place-cell-based graph-search algorithm to learn the location of a hidden goal; (iii) a strategy selection mechanism uses TD-learning rule to choose the most successful strategy based on past experience. We propose a novel criterion for strategy selection based on the directions of goal-oriented movements suggested by the different strategies. We show that the selection criterion based on this "common currency" is capable of choosing the best among TD-learning and planning strategies and can be used to solve navigational tasks in continuous state and action spaces. The model has been successfully applied to reproduce rat behavior in two water-maze tasks in which the two strategies were shown to interact. The model was used to analyze competitive and cooperative interactions between different strategies during these tasks as well as relative influence of different types of sensory cues.

Cooperation between hippocampal somatostatin receptor subtypes 4 and 2: functional relevance in interactive memory systems

The hippocampal somatostatin (sst) receptor subtype 4 (sst(4)) modulates memory formation by diminishing hippocampus-based spatial function while enhancing striatum-dependent behaviors. sst(4)-mediated regulations on neuronal activity in the hippocampus appear to depend on both competitive and cooperative interactions with sst receptor subtype 2 (sst(2)). Here, we investigated whether interactions with sst(2) receptors are required for sst(4)-mediated effects on hippocampus-dependent spatial memory and striatum-dependent cued memory in a water maze paradigm. Competition was assessed in mice by intrahippocampal injections of the sst(4) agonist L-803,087 alone or combined with sst(2) agonists (L-779,976 or octreotide). Effects of L-803,087 were also tested in sst(2) knockout mice to assess for receptor cooperation. Finally, sst(2a) and sst(4) localizations within hippocampal subregions were analyzed by immunohistochemistry and expression levels of sst(2a) and sst(2b) were quantified by real-time qPCR. Hippocampal injections of L-803,087 impaired spatial memory but enhanced cued memory. The latter effect was lost not only in sst(2) knockout mice but also in the presence of sst(2) agonists, whereas the former effect remained unaffected by sst(2) agonists or gene deletion. Octreotide and L-779,976 did not yield memory effects but reduced swim velocity throughout the acquisition trials suggesting that stimulation of sst(2) affected motivation and/or anxiety. sst(2a) and sst(4) were respectively detected in the dentate gyrus (DG) and the CA1 subfield suggesting that their functional interactions are not mediated by direct receptor coupling. Hippocampus sst(2a) expression was 36-fold higher than sst(2b). Possible neural mechanisms and functional significances for interaction between memory systems in relationship with stress-induced changes in hippocampal functions are discussed.

Hippocampus specific iron deficiency alters competition and cooperation between developing memory systems

Iron deficiency (ID) is the most common gestational micronutrient deficiency in the world, targets the fetal hippocampus and striatum and results in long-term behavioral abnormalities. These structures primarily mediate spatial and procedural memory, respectively, in the rodent but have interconnections that result in competition or cooperation during cognitive tasks. We determined whether ID-induced impairment of one alters the function of the other by genetically inducing a 40% reduction of hippocampus iron content in late fetal life in mice and measuring dorsal striatal gene expression and metabolism and the behavioral balance between the two memory systems in adulthood. Slc11a2^hipp/hipp mice had similar striatum iron content, but 18% lower glucose and 44% lower lactate levels, a 30% higher phosphocreatine:creatine ratio, and reduced iron transporter gene expression compared to wild type (WT) littermates, implying reduced striatal metabolic function. Slc11a2^hipp/hipp mice had longer mean escape times on a cued task paradigm implying impaired procedural memory. Nevertheless, when hippocampal and striatal memory systems were placed in competition using a Morris Water Maze task that alternates spatial navigation and visual cued responses during training, and forces a choice between hippocampal and striatal strategies during probe trials, Slc11a2^hipp/hipp mice used the hippocampus-dependent response less often (25%) and the visual cued response more often (75%) compared to WT littermates that used both strategies approximately equally. Hippocampal ID not only reduces spatial recognition memory performance but also affects systems that support procedural memory, suggesting an altered balance between memory systems.

Activating a memory system focuses connectivity toward its central structure

This report investigates in what way functional connectivity may explain how two memory systems that share almost all their structures, can function as separate systems. The first series of experiments was aimed at demonstrating the reliability of our experimental design by showing that acquisition of the spatial version of a water cross-maze task (stimulus-stimulus associations) was impaired by dorsal hippocampal lesions whereas the cue version (stimulus-reinforcement association) was altered by amygdala lesion. Then, we evaluated how these two tasks induce different patterns of connectivity. The connectivity was evaluated by calculating the correlations between the zif-268 immunoreactivity of 22 structures composing the hippocampus and the amygdala systems. We designed a new statistical procedure to demonstrate double dissociations on the basis of brain regional intercorrelations. Our data show that the correlations between the hippocampus and the other structures of the memory system are higher in the place-learning group compared to the cue-learning group, whereas they are enhanced with the amygdala in the latter group compared to the former. This demonstrates that the activation of a memory system consists in the focusing of functional connectivity toward the central structure of the system. This may explain how several memory systems can share the same structures while remaining independent.

Hippocampal SSTR4 somatostatin receptors control the selection of memory strategies

RATIONALE

Somatostatin (SS14) has been implicated in various cognitive disorders, and converging evidence from animal studies suggests that SS14 neurons differentially regulate hippocampal- and striatal-dependent memory formation. Four SS14 receptor subtypes (SSTR1-4) are expressed in the hippocampus, but their respective roles in memory processes remain to be determined.

OBJECTIVES

In the present study, effects of selective SSTR1-4 agonists on memory formation were assessed in a water-maze task which can engage either hippocampus-dependent "place" and/or striatum-dependent "cue" memory formation.

MATERIALS AND METHODS

Mice received an intrahippocampal injection of one of each of the selective agonists and were then trained to locate an escape platform based on either distal cues (place memory) or a visible proximal cue (cue memory). Retention was tested 24 h later on probe trials aimed at identifying which memory strategy was preferentially retained.

RESULTS

Both SS14 and the SSTR4 agonist (L-803,087) dramatically impaired place memory formation in a dose-dependent manner, whereas SSTR1 (L-797,591), SSTR2 (L-779,976), or SSTR3 (L-796,778) agonists did not yield any behavioral effects. However, unlike SS14, the SSTR4 agonist also dose-dependently enhanced cue-based memory formation. This effect was confirmed in another striatal-dependent memory task, the bar-pressing task, where L-803,087 improved memory of the instrumental response, whereas SS14 was once again ineffective.

CONCLUSIONS

These data suggest that hippocampal SSTR4 are selectively involved in the selection of memory strategies by switching from the use of hippocampus-based multiple associations to the use of simple dorsal striatum-based behavioral responses. Possible neural mechanisms and functional implications are discussed.