The dorsolateral striatum selectively mediates extinction of habit memory

Intense training prevents the amnestic effect of inactivation of dorsomedial striatum and induces high resistance to extinction

A large body of evidence has shown that treatments that interfere with memory consolidation become ineffective when animals are subjected to an intense learning experience; this effect has been observed after systemic and local administration of amnestic drugs into several brain areas, including the striatum. However, the effects of amnestic treatments on the process of extinction after intense training have not been studied. Previous research demonstrated increased spinogenesis in the dorsomedial striatum, but not in the dorsolateral striatum after intense training, indicating that the dorsomedial striatum is involved in the protective effect of intense training. To investigate this issue, male Wistar rats, previously trained with low, moderate, or high levels of foot shock, were used to study the effect of tetrodotoxin inactivation of dorsomedial striatum on memory consolidation and subsequent extinction of inhibitory avoidance. Performance of the task was evaluated during seven extinction sessions. Tetrodotoxin produced a marked deficit of memory consolidation of inhibitory avoidance trained with low and moderate intensities of foot shock, but normal consolidation occurred when a relatively high foot shock was used. The protective effect of intense training was long-lasting, as evidenced by the high resistance to extinction exhibited throughout the extinction sessions. We discuss the possibility that increased dendritic spinogenesis in dorsomedial striatum may underly this protective effect, and how this mechanism may be related to the resilient memory typical of post-traumatic stress disorder (PTSD).

Changes in the dopaminergic circuitry and adult neurogenesis linked to reinforcement learning in corvids

The caudolateral nidopallium (NCL, an analog of the prefrontal cortex) is known to be involved in learning, memory, and discrimination in corvids (a songbird), whereas the involvement of other brain regions in these phenomena is not well explored. We used house crows (Corvus splendens) to explore the neural correlates of learning and decision-making by initially training them on a shape discrimination task followed by immunohistochemistry to study the immediate early gene expression (Arc), a dopaminoceptive neuronal marker (DARPP-32, Dopamine- and cAMP-regulated phosphoprotein, Mr 32 kDa) to understand the involvement of the reward pathway and an immature neuronal marker (DCX, doublecortin) to detect learning-induced changes in adult neurogenesis. We performed neuronal counts and neuronal tracing, followed by morphometric analyses. Our present results have demonstrated that besides NCL, other parts of the caudal nidopallium (NC), avian basal ganglia, and intriguingly, vocal control regions in house crows are involved in visual discrimination. We have also found that training on the visual discrimination task can be correlated with neurite pruning in mature dopaminoceptive neurons and immature DCX-positive neurons in the NC of house crows. Furthermore, there is an increase in the incorporation of new neurons throughout NC and the medial striatum which can also be linked to learning. For the first time, our results demonstrate that a combination of structural changes in mature and immature neurons and adult neurogenesis are linked to learning in corvids.

Snapping Out of Autopilot: Overriding Habits in Real Time and the Role of Ventrolateral Prefrontal Cortex

Habits allow environmental and interoceptive cues to trigger behavior in an automatized fashion, making them liable to deployment in inappropriate or outdated contexts. Over the long term, repeated failure of a once-adaptive habit to satisfy current goals produces extinction learning that suppresses the habit's execution. Less attention has been afforded to the mechanisms underlying real-time habit suppression: the capacity to stop the execution of a cued habit that is goal conflicting. Here, I first posit a model by which goal-relevant stimuli can (a) bring unfolding habits and their projected outcomes into awareness, (b) prompt evaluation of the habit outcome with respect to current goals, and (c) trigger cessation of the habit response if it is determined to be goal conflicting. Second, I propose a modified stop-signal task to test this model of goal-directed stopping of habit execution. Finally, I marshal evidence indicating that the ventrolateral prefrontal cortex, situated at the nexus of salience detection, action-plan assessment, and motor inhibition networks, is uniquely positioned to coordinate the overriding of habitual behaviors in real time. In sum, this perspective presents a testable model and candidate neurobiological substrate for our capacity to "snap out of autopilot" and override goal-conflicting habits in real time.

NMDA receptor blockade in the dorsolateral striatum impairs consolidation but not retrieval of habit memory

The present study investigated whether N-methyl-d-aspartate (NMDA) receptors in the dorsolateral striatum (DLS) mediate consolidation and retrieval of habit memory. Adult male Long-Evans rats were trained in a response learning version of a water plus-maze task in which rats were reinforced to make a habitual and consistent body-turn response at the maze choice point in order to mount a hidden escape platform. Prior research indicates that acquisition, consolidation, and retrieval in this task requires DLS function. The present study consisted of two experiments. In Experiment 1, rats received intra-DLS post-training injections of the NMDA receptor antagonist 2-amino-5- phosphonopentanoic acid (AP5; 2 µg/side) to examine the role of NMDA receptors in consolidation of habit memory. In Experiment 2, different groups of rats received a single pre-retrieval injection of AP5 in the DLS (AP5; 2 µg/side) during the last day of maze training to examine the potential role of NMDA receptors in retrieval of habit memory. Results indicated that post-training intra-DLS AP5 injections impaired memory consolidation. However, administration of AP5 at the same dose that impaired consolidation had no effect on memory retrieval. The findings are consistent with previous research indicating a role for NMDA receptors in the DLS in memory consolidation, and suggest that NMDA-dependent synaptic activity in the DLS may not be a critical component of habit memory retrieval.

Corticosterone in the dorsolateral striatum facilitates the extinction of stimulus-response memory

Glucocorticoid hormones are crucially involved in modulating mnemonic processing of stressful or emotionally arousing experiences. They are known to enhance the consolidation of new memories, including those that extinguish older memories. In this study, we investigated whether glucocorticoids facilitate the extinction of a striatum-dependent, and behaviorally more rigid, stimulus-response memory. For this, male rats were initially trained for six days on a stimulus-response task in a T-maze to obtain a reward after making an egocentric right-turn body response, regardless of the starting position in this maze. This training phase was followed by three extinction sessions in which right-turn body responses were not reinforced. Corticosterone administration into the dorsolateral region of the striatum after the first extinction session dose-dependently enhanced the consolidation of extinction memory: Rats administered the higher dose of corticosterone (30 ng), but not lower doses (5 or 10 ng), exhibited significantly fewer right-turn body responses and had longer latencies compared to vehicle-treated animals on the second and third extinction sessions. Co-administration of the glucocorticoid receptor antagonist RU 486 (10 ng) prevented the corticosterone effect, indicating that glucocorticoids enhance the extinction of stimulus-response memory via activation of the glucocorticoid receptor. Corticosterone administration into the dorsomedial striatum did not affect extinction memory. These findings indicate that stress-response mechanisms involving corticosterone actions in the dorsolateral striatum facilitate the extinction of stimulus-response memory that might allow for the development of an opportune behavioral strategy.

Place vs. Response Learning: History, Controversy, and Neurobiology

The present article provides a historical review of the place and response learning plus-maze tasks with a focus on the behavioral and neurobiological findings. The article begins by reviewing the conflict between Edward C. Tolman's cognitive view and Clark L. Hull's stimulus-response (S-R) view of learning and how the place and response learning plus-maze tasks were designed to resolve this debate. Cognitive learning theorists predicted that place learning would be acquired faster than response learning, indicating the dominance of cognitive learning, whereas S-R learning theorists predicted that response learning would be acquired faster, indicating the dominance of S-R learning. Here, the evidence is reviewed demonstrating that either place or response learning may be dominant in a given learning situation and that the relative dominance of place and response learning depends on various parametric factors (i.e., amount of training, visual aspects of the learning environment, emotional arousal, et cetera). Next, the neurobiology underlying place and response learning is reviewed, providing strong evidence for the existence of multiple memory systems in the mammalian brain. Research has indicated that place learning is principally mediated by the hippocampus, whereas response learning is mediated by the dorsolateral striatum. Other brain regions implicated in place and response learning are also discussed in this section, including the dorsomedial striatum, amygdala, and medial prefrontal cortex. An exhaustive review of the neurotransmitter systems underlying place and response learning is subsequently provided, indicating important roles for glutamate, dopamine, acetylcholine, cannabinoids, and estrogen. Closing remarks are made emphasizing the historical importance of the place and response learning tasks in resolving problems in learning theory, as well as for examining the behavioral and neurobiological mechanisms of multiple memory systems. How the place and response learning tasks may be employed in the future for examining extinction, neural circuits of memory, and human psychopathology is also briefly considered.

Molecular and circuit mechanisms regulating cocaine memory

Risk of relapse is a major challenge in the treatment of substance use disorders. Several types of learning and memory mechanisms are involved in substance use and have implications for relapse. Associative memories form between the effects of drugs and the surrounding environmental stimuli, and exposure to these stimuli during abstinence causes stress and triggers drug craving, which can lead to relapse. Understanding the neural underpinnings of how these associations are formed and maintained will inform future advances in treatment practices. A large body of research has expanded our knowledge of how associative memories are acquired and consolidated, how they are updated through reactivation and reconsolidation, and how competing extinction memories are formed. This review will focus on the vast literature examining the mechanisms of cocaine Pavlovian associative memories with an emphasis on the molecular memory mechanisms and circuits involved in the consolidation, reconsolidation, and extinction of these memories. Additional research elucidating the specific signaling pathways, mechanisms of synaptic plasticity, and epigenetic regulation of gene expression in the circuits involved in associative learning will reveal more distinctions between consolidation, reconsolidation, and extinction learning that can be applied to the treatment of substance use disorders.

Threat-induced modulation of hippocampal and striatal memory systems during navigation of a virtual environment

The brain is composed of multiple memory systems that mediate distinct types of navigation. The hippocampus is important for encoding and retrieving allocentric spatial cognitive maps, while the dorsal striatum mediates procedural memories based on stimulus-response (S-R) associations. These memory systems are differentially affected by emotional arousal. In particular, rodent studies show that stress typically impairs hippocampal spatial memory while it spares or sometimes enhances striatal S-R memory. The influence of emotional arousal on these separate navigational memory systems has received less attention in human subjects. We investigated the effect of dynamic changes in anticipatory anxiety on hippocampal spatial and dorsal striatal S-R memory systems while participants attempted to solve a virtual eight-arm radial maze. In Experiment 1, participants completed a hippocampus-dependent spatial version of the eight-arm radial maze that required allocentric spatial memory to successfully navigate the environment. In Experiment 2, participants completed a dorsal striatal S-R version of the maze where no allocentric spatial cues were present, requiring the use of S-R navigation. Anticipatory anxiety was modulated via threat of receiving an unpleasant electrical shock to the wrist during memory retrieval. Results showed that threat of shock was associated with more errors and increased use of non-spatial navigational strategies in the hippocampal spatial task, but did not influence memory performance in the striatal S-R task. Findings indicate a dissociation regarding the influence of anticipatory anxiety on memory systems that has implications for understanding how fear and anxiety contribute to memory-related symptoms in human psychopathologies.

There Is More Than One Kind of Extinction Learning

The view that different kinds of memory are mediated by dissociable neural systems has received extensive experimental support. Dissociations between memory systems are usually observed during initial acquisition, consolidation, and retrieval of memory, however increasing evidence also indicates a role for multiple memory systems in extinction behavior. The present article reviews a recent series of maze learning experiments that provide evidence for a multiple memory systems approach to extinction learning and memory. Evidence is described indicating that: (1) the hippocampus and dorsolateral striatum (DLS) mediate different kinds of extinction learning; (2) the effectiveness of different extinction protocols depends on the kind of memory being extinguished; and (3) whether a neural system is involved in extinction is also determined by the extinction protocol and kind of memory undergoing extinction. Based on these findings, a novel hypothetical model regarding the role of multiple memory systems in extinction is presented. In addition, the relevance of this multiple memory systems approach to other learning paradigms involving extinction (i.e., extinction of conditioned fear) and for treating human psychopathologies characterized by maladaptive memories (e.g., drug addiction and relapse) is briefly considered.

Serotonin transporter inhibition and 5-HT2C receptor activation drive loss of cocaine-induced locomotor activation in DAT Val559 mice

Dopamine (DA) signaling dysfunction is believed to contribute to multiple neuropsychiatric disorders including attention-deficit/hyperactivity disorder (ADHD). The rare DA transporter (DAT) coding substitution Ala559Val found in subjects with ADHD, bipolar disorder and autism, promotes anomalous DA efflux in vitro and, in DAT Val559 mice, leads to increased reactivity to imminent handling, waiting impulsivity, and enhanced motivation for reward. Here, we report that, in contrast to amphetamine and methylphenidate, which induce significant locomotor activation, cocaine administration to these mice elicits no locomotor effects, despite retention of conditioned place preference (CPP). Additionally, cocaine fails to elevate extracellular DA. Given that amphetamine and methylphenidate, unlike cocaine, lack high-affinity interactions with the serotonin (5-HT) transporter (SERT), we hypothesized that the lack of cocaine-induced hyperlocomotion in DAT Val559 mice arises from SERT blockade and augmented 5-HT signaling relative to cocaine actions on wildtype animals. Consistent with this idea, the SERT blocker fluoxetine abolished methylphenidate-induced locomotor activity in DAT Val559 mice, mimicking the effects seen with cocaine. Additionally, a cocaine analog (RTI-113) with greater selectivity for DAT over SERT retains locomotor activation in DAT Val559 mice. Furthermore, genetic elimination of high-affinity cocaine interactions at SERT in DAT Val559 mice, or specific inhibition of 5-HT_2C receptors in these animals, restored cocaine-induced locomotion, but did not restore cocaine-induced elevations of extracellular DA. Our findings reveal a significant serotonergic plasticity arising in the DAT Val559 model that involves enhanced 5-HT_2C signaling, acting independently of striatal DA release, capable of suppressing the activity of cocaine-sensitive motor circuits.

Molecular mechanisms underlying striatal synaptic plasticity: relevance to chronic alcohol consumption and seeking

The striatum, the input structure of the basal ganglia, is a major site of learning and memory for goal-directed actions and habit formation. Spiny projection neurons of the striatum integrate cortical, thalamic, and nigral inputs to learn associations, with cortico-striatal synaptic plasticity as a learning mechanism. Signaling molecules implicated in synaptic plasticity are altered in alcohol withdrawal, which may contribute to overly strong learning and increased alcohol seeking and consumption. To understand how interactions among signaling molecules produce synaptic plasticity, we implemented a mechanistic model of signaling pathways activated by dopamine D1 receptors, acetylcholine receptors, and glutamate. We use our novel, computationally efficient simulator, NeuroRD, to simulate stochastic interactions both within and between dendritic spines. Dopamine release during theta burst and 20-Hz stimulation was extrapolated from fast-scan cyclic voltammetry data collected in mouse striatal slices. Our results show that the combined activity of several key plasticity molecules correctly predicts the occurrence of either LTP, LTD, or no plasticity for numerous experimental protocols. To investigate spatial interactions, we stimulate two spines, either adjacent or separated on a 20-μm dendritic segment. Our results show that molecules underlying LTP exhibit spatial specificity, whereas 2-arachidonoylglycerol exhibits a spatially diffuse elevation. We also implement changes in NMDA receptors, adenylyl cyclase, and G protein signaling that have been measured following chronic alcohol treatment. Simulations under these conditions suggest that the molecular changes can predict changes in synaptic plasticity, thereby accounting for some aspects of alcohol use disorder.

Recent Insights into Corticostriatal Circuit Mechanisms underlying Habits: Invited review for Current Opinions in Behavioral Sciences

Habits have been studied for decades, but it was not until recent years that experiments began to elucidate the underlying cellular and circuit mechanisms. The latest experiments have been enabled by advances in cell-type specific monitoring and manipulation of activity in large neuronal populations. Here we will review recent efforts to understand the neural substrates underlying habit formation, focusing on rodent studies on corticostriatal circuits.

Impaired Spatial Memory and Enhanced Habit Memory in a Rat Model of Post-traumatic Stress Disorder

High levels of emotional arousal can impair spatial memory mediated by the hippocampus, and enhance stimulus-response (S-R) habit memory mediated by the dorsolateral striatum (DLS). The present study was conducted to determine whether these memory systems may be similarly affected in an animal model of post-traumatic stress disorder (PTSD). Sprague-Dawley rats were subjected to a “single-prolonged stress” (SPS) procedure and 1 week later received training in one of two distinct versions of the plus-maze: a hippocampus-dependent place learning task or a DLS-dependent response learning task. Results indicated that, relative to non-stressed control rats, SPS rats displayed slower acquisition in the place learning task and faster acquisition in the response learning task. In addition, extinction of place learning and response learning was impaired in rats exposed to SPS, relative to non-stressed controls. The influence of SPS on hippocampal spatial memory and DLS habit memory observed in the present study may be relevant to understanding some common features of PTSD, including hippocampal memory deficits, habit-like avoidance responses to trauma-related stimuli, and greater likelihood of developing drug addiction and alcoholism.

Stress-Induced Reduction of Dorsal Striatal D2 Dopamine Receptors Prevents Retention of a Newly Acquired Adaptive Coping Strategy

The inability to learn an adaptive coping strategy in a novel stressful condition leads to dysfunctional stress coping, a marker of mental disturbances. This study tested the involvement of dorsal striatal dopamine receptors in the dysfunctional coping with the Forced Swim test fostered by a previous experience of reduced food availability. Adult male mice were submitted to a temporary (12 days) reduction of food availability [food-restricted (FR)] or continuously free-fed (FF). Different groups of FF and FR mice were used to evaluate: (1) dorsal striatal mRNA levels of the two isoforms of the dopamine D2 receptor (D2S, D2L). (2) Forced Swim-induced c-fos expression in the dorsal striatum; (3) acquisition and 24 h retention of passive coping with Forced Swim. Additional groups of FF mice were tested for 24 h retention of passive coping acquired during a first experience with Forced Swim immediately followed by intra-striatal infusion of vehicle or two doses of the dopamine D2/D3 receptors antagonist sulpiride or the D1/D5 receptors antagonist SCH23390. Previous restricted feeding selectively reduced mRNA levels of both D2 isoforms and abolished Forced Swim-induced c-fos expression in the left Dorsolateral Striatum and selectively prevented 24 h retention of the coping strategy acquired in a first experience of Forced Swim. Finally, temporary blockade of left Dorsolateral Striatum D2/D3 receptors immediately following the first Forced Swim experience selectively reproduced the behavioral effect of restricted feeding in FF mice. In conclusion, the present results demonstrate that mice previously exposed to a temporary reduction of food availability show low striatal D2 receptors, a known marker of addiction-associated aberrant neuroplasticity, as well as liability to relapse into maladaptive stress coping strategies. Moreover, they offer strong support to a causal relationship between reduction of D2 receptors in the left Dorsolateral Striatum and impaired consolidation of newly acquired adaptive coping.