Disconnection of the entorhinal cortex and dorsomedial striatum impairs the sensitivity to instrumental contingency degradation

Grid cells: the missing link in understanding Parkinson's disease?

The mechanisms underlying Parkinson's disease (PD) are complex and not fully understood, and the box-and-arrow model among other current models present significant challenges. This paper explores the potential role of the allocentric brain and especially its grid cells in several PD motor symptoms, including bradykinesia, kinesia paradoxa, freezing of gait, the bottleneck phenomenon, and their dependency on cueing. It is argued that central hubs, like the locus coeruleus and the pedunculopontine nucleus, often narrowly interpreted in the context of PD, play an equally important role in governing the allocentric brain as the basal ganglia. Consequently, the motor and secondary motor (e.g., spatially related) symptoms of PD linked with dopamine depletion may be more closely tied to erroneous computation by grid cells than to the basal ganglia alone. Because grid cells and their associated central hubs introduce both spatial and temporal information to the brain influencing velocity perception they may cause bradykinesia or hyperkinesia as well. In summary, PD motor symptoms may primarily be an allocentric disturbance resulting from virtual faulty computation by grid cells revealed by dopamine depletion in PD.

The learning of prospective and retrospective cognitive maps within neural circuits

Brain circuits are thought to form a "cognitive map" to process and store statistical relationships in the environment. A cognitive map is commonly defined as a mental representation that describes environmental states (i.e., variables or events) and the relationship between these states. This process is commonly conceptualized as a prospective process, as it is based on the relationships between states in chronological order (e.g., does reward follow a given state?). In this perspective, we expand this concept on the basis of recent findings to postulate that in addition to a prospective map, the brain forms and uses a retrospective cognitive map (e.g., does a given state precede reward?). In doing so, we demonstrate that many neural signals and behaviors (e.g., habits) that seem inflexible and non-cognitive can result from retrospective cognitive maps. Together, we present a significant conceptual reframing of the neurobiological study of associative learning, memory, and decision making.

Search for solutions, learning, simulation, and choice processes in suicidal behavior

Suicide may be viewed as an unfortunate outcome of failures in decision processes. Such failures occur when the demands of a crisis exceed a person's capacity to (i) search for options, (ii) learn and simulate possible futures, and (iii) make advantageous value‐based choices. Can individual‐level decision deficits and biases drive the progression of the suicidal crisis? Our overview of the evidence on this question is informed by clinical theory and grounded in reinforcement learning and behavioral economics. Cohort and case–control studies provide strong evidence that limited cognitive capacity and particularly impaired cognitive control are associated with suicidal behavior, imposing cognitive constraints on decision‐making. We conceptualize suicidal ideation as an element of impoverished consideration sets resulting from a search for solutions under cognitive constraints and mood‐congruent Pavlovian influences, a view supported by mostly indirect evidence. More compelling is the evidence of impaired learning in people with a history of suicidal behavior. We speculate that an inability to simulate alternative futures using one's model of the world may undermine alternative solutions in a suicidal crisis. The hypothesis supported by the strongest evidence is that the selection of suicide over alternatives is facilitated by a choice process undermined by randomness. Case–control studies using gambling tasks, armed bandits, and delay discounting support this claim. Future experimental studies will need to uncover real‐time dynamics of choice processes in suicidal people. In summary, the decision process framework sheds light on neurocognitive mechanisms that facilitate the progression of the suicidal crisis.

This article is categorized under:

Economics > Individual Decision‐Making

Psychology > Emotion and Motivation

Psychology > Learning

Neuroscience > Behavior

Whole-Brain Mapping of Direct Inputs to Dopamine D1 and D2 Receptor-Expressing Medium Spiny Neurons in the Posterior Dorsomedial Striatum

The posterior dorsomedial striatum (pDMS) is mainly composed of medium spiny neurons (MSNs) expressing either dopamine D1 receptors (D1Rs) or D2Rs. Activation of these two MSN types produces opposing effects on addictive behaviors. However, it remains unclear whether pDMS D1-MSNs or D2-MSNs receive afferent inputs from different brain regions or whether the extrastriatal afferents express distinct dopamine receptors. To assess whether these afferents also contained D1Rs or D2Rs, we generated double transgenic mice, in which D1R-expressing and D2R-expressing neurons were fluorescently labeled. We used rabies virus-mediated retrograde tracing in these mice to perform whole-brain mapping of direct inputs to D1-MSNs or D2-MSNs in the pDMS. We found that D1-MSNs preferentially received inputs from the secondary motor, secondary visual, and cingulate cortices, whereas D2-MSNs received inputs from the primary motor and primary sensory cortices, and the thalamus. We also discovered that the bed nucleus of the stria terminalis (BNST) and the central nucleus of the amygdala (CeA) contained abundant D2R-expressing, but few D1R-expressing, neurons in a triple transgenic mouse model. Remarkably, although limited D1R or D2R expression was observed in extrastriatal neurons that projected to D1-MSNs or D2-MSNs, we found that cortical structures preferentially contained D1R-expressing neurons that projected to D1-MSNs or D2-MSNs, while the thalamus, substantia nigra pars compacta (SNc), and BNST had more D2R-expressing cells that projected to D2-MSNs. Taken together, these findings provide a foundation for future understanding of the pDMS circuit and its role in action selection and reward-based behaviors.

Accelerated habitual learning resulting from L-dopa exposure in rats is prevented by N-acetylcysteine

Instrumental actions are initially goal-directed and driven by their associated outcome. However, with repeated experience habitual actions develop which are automated and efficient, as they are instead driven by antecedent stimuli. Dopamine is thought to facilitate the transition from goal-directed to habitual actions. This idea has been largely derived from evidence that psychostimulants accelerate the development of habitual actions. In the current study, we examined the impact of L-dopa (levodopa or L-dihydroxyphenylalanine), which also potentiates dopamine activity, on habitual learning. L-dopa was systemically administered prior to training rats to press a lever for a food outcome. When tested, L-dopa exposed animals were insensitive to changes in the value of the food outcome, and hence demonstrated accelerated habitual behavioral control compared to control animals that remained goal directed. We also showed that when N-acetylcysteine (NAC), an antioxidant and regulator of glutamate activity, was co-administered with L-dopa, it prevented the transition to habitual behavior; an effect demonstrated previously for cocaine. Therefore, this study establishes similarities between L-dopa and psychostimulants in both the development and prevention of habitual actions, and supports the notion that excess dopamine potentiates habitual learning. This finding extends the limited existing knowledge of the impact of L-dopa on learning and behavior, and has implications for neurological disorders where L-dopa is the primary treatment.

Selective Deficits in Contingency-Driven Ethanol Seeking Following Chronic Ethanol Exposure in Male Mice

BACKGROUND

People with alcohol use disorders exhibit an overreliance on habitual response strategies which may result from a history of chronic alcohol exposure. Although habits are defined by behavior that persists despite changes in outcome value and in action-outcome relationships, most research investigating the effects of ethanol exposure on habits has focused only on outcome devaluation. A clear understanding of the effects of chronic alcohol exposure on the ability to flexibly update behavior may provide insight into the behavioral deficits that characterize alcohol use disorders.

METHODS

To dissociate the effects of chronic intermittent ethanol (CIE) exposure on contingency-mediated sucrose versus ethanol seeking, adult male C57Bl/6J mice were assigned to 2 separate experiments. In the first experiment, mice were trained to self-administer ethanol prior to 2 cycles of interleaved CIE exposure by vapor inhalation. In a second experiment, mice were trained to self-administer sucrose and ethanol in separate training sessions prior to 4 cycles of interleaved CIE. The use of contingencies to mediate reward seeking was assessed using a contingency degradation paradigm.

RESULTS

In mice trained to self-administer only ethanol, 2 weeks of CIE resulted in escalated self-administration. At this time point, CIE-exposed mice, but not air-exposed controls, exhibited ethanol seeking that was insensitive to changes in action-outcome contingency, consistent with habitual ethanol seeking. In mice trained to self-administer ethanol and sucrose rewards in sequential sessions, no escalation in self-administration across 4 weeks of CIE was observed. Under these conditions, neither Air- nor CIE-exposed mice reduced ethanol seeking in response to contingency degradation. In contrast, sucrose seeking remained goal-directed.

CONCLUSIONS

Our results suggest that chronic ethanol exposure impairs contingency-driven ethanol seeking more readily than sucrose-seeking behavior. Further, these findings indicate that the transition from contingency-mediated ethanol seeking occurs more rapidly than for sucrose seeking under similar ethanol exposure conditions.

Treating a novel plasticity defect rescues episodic memory in Fragile X model mice

Episodic memory, a fundamental component of human cognition, is significantly impaired in autism. We believe we report the first evidence for this problem in the Fmr1-knockout (KO) mouse model of Fragile X syndrome and describe potentially treatable underlying causes. The hippocampus is critical for the formation and use of episodes, with semantic (cue identity) information relayed to the structure via the lateral perforant path (LPP). The unusual form of synaptic plasticity expressed by the LPP (lppLTP) was profoundly impaired in Fmr1-KOs relative to wild-type mice. Two factors contributed to this defect: (i) reduced GluN1 subunit levels in synaptic NMDA receptors and related currents, and (ii) impaired retrograde synaptic signaling by the endocannabinoid 2-arachidonoylglycerol (2-AG). Studies using a novel serial cue paradigm showed that episodic encoding is dependent on both the LPP and the endocannabinoid receptor CB₁, and is strikingly impaired in Fmr1-KOs. Enhancing 2-AG signaling rescued both lppLTP and learning in the mutants. Thus, two consequences of the Fragile-X mutation converge on plasticity at one site in hippocampus to prevent encoding of a basic element of cognitive memory. Collectively, the results suggest a clinically plausible approach to treatment.

Regulation of actions and habits by ventral hippocampal trkB and adolescent corticosteroid exposure

In humans and rodents, stress promotes habit-based behaviors that can interfere with action-outcome decision-making. Further, developmental stressor exposure confers long-term habit biases across rodent-primate species. Despite these homologies, mechanisms remain unclear. We first report that exposure to the primary glucocorticoid corticosterone (CORT) in adolescent mice recapitulates multiple neurobehavioral consequences of stressor exposure, including long-lasting biases towards habit-based responding in a food-reinforced operant conditioning task. In both adolescents and adults, CORT also caused a shift in the balance between full-length tyrosine kinase receptor B (trkB) and a truncated form of this neurotrophin receptor, favoring the inactive form throughout multiple corticolimbic brain regions. In adolescents, phosphorylation of the trkB substrate extracellular signal-regulated kinase 42/44 (ERK42/44) in the ventral hippocampus was also diminished, a long-term effect that persisted for at least 12 wk. Administration of the trkB agonist 7,8-dihydroxyflavone (7,8-DHF) during adolescence at doses that stimulated ERK42/44 corrected long-lasting corticosterone-induced behavioral abnormalities. Meanwhile, viral-mediated overexpression of truncated trkB in the ventral hippocampus reduced local ERK42/44 phosphorylation and was sufficient to induce habit-based and depression-like behaviors. Together, our findings indicate that ventral hippocampal trkB is essential to goal-directed action selection, countering habit-based behavior otherwise facilitated by developmental stress hormone exposure. They also reveal an early-life sensitive period during which trkB-ERK42/44 tone determines long-term behavioral outcomes.

Modulation of cue-triggered reward seeking by cholinergic signaling in the dorsomedial striatum

The dorsomedial striatum (DMS) has been strongly implicated in flexible, outcome-based decision making, including the outcome-specific Pavlovian-to-instrumental transfer effect (PIT), which measures the tendency for a reward-predictive cue to preferentially motivate actions that have been associated with the predicted reward over actions associated with different rewards. Although the neurochemical underpinnings of this effect are not well understood, there is growing evidence that striatal acetylcholine signaling may play an important role. This study investigated this hypothesis by assessing the effects of intra-DMS infusions of the nicotinic antagonist mecamylamine or the muscarinic antagonist scopolamine on expression of specific PIT in rats. These treatments produced dissociable behavioral effects. Mecamylamine infusions enhanced rats' tendency to use specific cue-elicited outcome expectations to select whichever action was trained with the predicted outcome, relative to their performance when tested after vehicle infusions. In contrast, scopolamine infusions appeared to render instrumental performance insensitive to this motivational influence of reward-paired cues. These drug treatments had no detectable effect on conditioned food cup approach behavior, indicating that they selectively perturbed cue-guided action selection without producing more wide-ranging alterations in behavioral control. Our findings reveal an important role for DMS acetylcholine signaling in modulating the impact of cue-evoked reward expectations on instrumental action selection.

Adolescent Maturational Transitions in the Prefrontal Cortex and Dopamine Signaling as a Risk Factor for the Development of Obesity and High Fat/High Sugar Diet Induced Cognitive Deficits

Adolescence poses as both a transitional period in neurodevelopment and lifestyle practices. In particular, the developmental trajectory of the prefrontal cortex (PFC), a critical region for behavioral control and self-regulation, is enduring, not reaching functional maturity until the early 20 s in humans. Furthermore, the neurotransmitter dopamine is particularly abundant during adolescence, tuning the brain to rapidly learn about rewards and regulating aspects of neuroplasticity. Thus, adolescence is proposed to represent a period of vulnerability towards reward-driven behaviors such as the consumption of palatable high fat and high sugar diets. This is reflected in the increasing prevalence of obesity in children and adolescents as they are the greatest consumers of “junk foods”. Excessive consumption of diets laden in saturated fat and refined sugars not only leads to weight gain and the development of obesity, but experimental studies with rodents indicate they evoke cognitive deficits in learning and memory process by disrupting neuroplasticity and altering reward processing neurocircuitry. Consumption of these high fat and high sugar diets have been reported to have a particularly pronounced impact on cognition when consumed during adolescence, demonstrating a susceptibility of the adolescent brain to enduring cognitive deficits. The adolescent brain, with heightened reward sensitivity and diminished behavioral control compared to the mature adult brain, appears to be a risk for aberrant eating behaviors that may underpin the development of obesity. This review explores the neurodevelopmental changes in the PFC and mesocortical dopamine signaling that occur during adolescence, and how these potentially underpin the overconsumption of palatable food and development of obesogenic diet-induced cognitive deficits.

Hippocampus and subregions of the dorsal striatum respond differently to a behavioral strategy change on a spatial navigation task

Goal-directed and habit-based behaviors are driven by multiple but dissociable decision making systems involving several different brain areas, including the hippocampus and dorsal striatum. On repetitive tasks, behavior transitions from goal directed to habit based with experience. Hippocampus has been implicated in initial learning and dorsal striatum in automating behavior, but recent studies suggest that subregions within the dorsal striatum have distinct roles in mediating habit-based and goal-directed behavior. We compared neural activity in the CA1 region of hippocampus with anterior dorsolateral and posterior dorsomedial striatum in rats on a spatial choice task, in which subjects experienced reward delivery changes that forced them to adjust their behavioral strategy. Our results confirm the importance of the hippocampus in evaluating predictive steps during goal-directed behavior, while separate circuits in the basal ganglia integrated relevant information during automation of actions and recognized when new behaviors were needed to continue obtaining rewards.

GABAAα1-mediated plasticity in the orbitofrontal cortex regulates context-dependent action selection

An essential aspect of goal-directed action selection is differentiating between behaviors that are more, or less, likely to be reinforced. Habits, by contrast, are stimulus-elicited behaviors insensitive to action-outcome contingencies and are considered an etiological factor in several neuropsychiatric disorders. Thus, isolating the neuroanatomy and neurobiology of goal-directed action selection on the one hand, and habit formation on the other, is critical. Using in vivo viral-mediated gene silencing, we knocked down Gabra1 in the orbitofrontal prefrontal cortex (oPFC) in mice, decreasing oPFC GABAAα1 expression, as well as expression of the synaptic marker PSD-95. Mice expressing Green Fluorescent Protein or Gabra1 knockdown in the adjacent M2 motor cortex served as comparison groups. Using instrumental response training followed by action-outcome contingency degradation, we then found that oPFC GABAAα1 deficiency impaired animals' ability to differentiate between actions that were more or less likely to be reinforced, though sensitivity to outcome devaluation and extinction were intact. Meanwhile, M2 GABAAα1 deficiency enhanced sensitivity to action-outcome relationships. Behavioral abnormalities following oPFC GABAAα1 knockdown were rescued by testing mice in a distinct context relative to that in which they had been initially trained. Together, our findings corroborate evidence that chronic GABAAα1 deficiency remodels cortical synapses and suggest that neuroplasticity within the healthy oPFC gates the influence of reward-related contextual stimuli. These stimuli might otherwise promote maladaptive habit-based behavioral response strategies that contribute to-or exacerbate-neuropsychiatric illness.

Habitual alcohol seeking: modeling the transition from casual drinking to addiction

The transition from goal-directed actions to habitual ethanol seeking models the development of addictive behavior that characterizes alcohol use disorders. The progression to habitual ethanol-seeking behavior occurs more rapidly than for natural rewards, suggesting that ethanol may act on habit circuit to drive the loss of behavioral flexibility. This review will highlight recent research that has focused on the formation and expression of habitual ethanol seeking, and the commonalities and distinctions between ethanol and natural reward-seeking habits, with the goal of highlighting important, understudied research areas that we believe will lead toward the development of novel treatment and prevention strategies for uncontrolled drinking.

Translational studies of goal-directed action as a framework for classifying deficits across psychiatric disorders

The ability to learn contingencies between actions and outcomes in a dynamic environment is critical for flexible, adaptive behavior. Goal-directed actions adapt to changes in action-outcome contingencies as well as to changes in the reward-value of the outcome. When networks involved in reward processing and contingency learning are maladaptive, this fundamental ability can be lost, with detrimental consequences for decision-making. Impaired decision-making is a core feature in a number of psychiatric disorders, ranging from depression to schizophrenia. The argument can be developed, therefore, that seemingly disparate symptoms across psychiatric disorders can be explained by dysfunction within common decision-making circuitry. From this perspective, gaining a better understanding of the neural processes involved in goal-directed action, will allow a comparison of deficits observed across traditional diagnostic boundaries within a unified theoretical framework. This review describes the key processes and neural circuits involved in goal-directed decision-making using evidence from animal studies and human neuroimaging. Select studies are discussed to outline what we currently know about causal judgments regarding actions and their consequences, action-related reward evaluation, and, most importantly, how these processes are integrated in goal-directed learning and performance. Finally, we look at how adaptive decision-making is impaired across a range of psychiatric disorders and how deepening our understanding of this circuitry may offer insights into phenotypes and more targeted interventions.

Adolescent stimulation of D2 receptors alters the maturation of dopamine-dependent goal-directed behavior

Adolescence is a period of high sensitivity to drugs and rewards, characterized by the immaturity of decision-making abilities. A chronic stimulation of reward systems during this period might constitute a factor of vulnerability to the development of psychiatric disorders. However, the long-term consequences of such an exposure have seldom been explored. Here, we investigate at the adult age the effects of chronic dopamine (DA) stimulation during adolescence on both the maturation of DA systems and the cognitive processes underlying goal-directed actions. We first demonstrate that chronic stimulation of D2 receptors by quinpirole during adolescence alters the development of DA systems. This treatment has particularly prominent effects on the mesocortical DA pathway where it decreases DA fibers density, DA concentration, and DA receptors expression. Furthermore, we show that quinpirole-treated rats exhibit specific impairments in instrumental goal-directed behavior, as they fail to adapt their action when action-outcome relationships change in a contingency degradation procedure. These results therefore highlight the vulnerability of DA system and prefrontal areas to prolonged stimulation during adolescence, and its potential long-term impact on cognitive functions.

Updating of action-outcome associations is prevented by inactivation of the posterior pedunculopontine tegmental nucleus

•

The pedunculopontine tegmental nucleus is essential for action–outcome learning.

•

Sensitivity to instrumental contingency degradation is blocked by PPTg inactivation.

•

Inactivation of PPTg does not change performance of previously learnt operant tasks.

•

This is the first demonstration of a role for brainstem in action–outcome learning.

•

Learning functions of basal ganglia extend into the deepest parts of the circuitry.

The pedunculopontine tegmental nucleus (PPTg) is in a pivotal position between the basal ganglia and brainstem: it is able to influence and regulate all levels of basal ganglia and corticostriatal activity as well as being a key component of brainstem reticular and motor control circuitry. Consistent with its anatomical position, the PPTg has previously been shown to process rapid, salient sensory input, is a target for Parkinson’s disease treatments and has been implicated in associative learning. We explicitly investigated the role of the posterior pPPTg (pPPTg) in action–outcome processes, where actions are performed with the goal-directed aim of obtaining an anticipated outcome. We assessed rats’ sensitivity to degradation of the contingency between actions (lever pressing) and outcomes (food reward) during either inactivation of pPPTg by microinjection of the GABA agonist muscimol or control infusions of saline. In response to the degradation of contingency between lever press and food reward, saline treated rats rapidly reduced rates of lever pressing whereas muscimol treated rats (pPPTg inactivation) maintained previous lever pressing rates. In contrast, when the contingency between lever press and food reward was unchanged saline and muscimol treated rats maintained their previous rates of lever pressing. This shows that the pPPTg is critically required for updating associations between actions and outcomes, but not in the continued performance of previously learned associations. These results are consistent with a role for the PPTg in ‘higher-order’ associative learning and are the first to demonstrate a brainstem role in action–outcome learning.

K-ATP channels in dopamine substantia nigra neurons control bursting and novelty-induced exploration

Phasic activation of the dopamine (DA) midbrain system in response to unexpected reward or novelty is critical for adaptive behavioral strategies. This activation of DA midbrain neurons occurs via a synaptically triggered switch from low-frequency background spiking to transient high-frequency burst firing. We found that, in medial DA neurons of the substantia nigra (SN), activity of ATP-sensitive potassium (K-ATP) channels enabled NMDA-mediated bursting in vitro as well as spontaneous in vivo burst firing in anesthetized mice. Cell-selective silencing of K-ATP channel activity in medial SN DA neurons revealed that their K-ATP channel-gated burst firing was crucial for novelty-dependent exploratory behavior. We also detected a transcriptional upregulation of K-ATP channel and NMDA receptor subunits, as well as high in vivo burst firing, in surviving SN DA neurons from Parkinson's disease patients, suggesting that burst-gating K-ATP channel function in DA neurons affects phenotypes in both disease and health.

Striatal dopamine depletion in rats produces variable effects on contingency detection: task-related influences

Dopamine (DA) depletion of the posterior dorsomedial striatum (pDMS) can impair the capability of rats to detect changes in the causal efficacy of actions. Here we sought to characterize in more detail the effects of pDMS DA depletions on contingency detection as a function of different contingency degradation training protocols. In experiment 1, sham controls and rats with pDMS DA depletions received limited contingency degradation training (4 days) that involved an invariable and high degree of degradation to one of two contingencies controlling instrumental choice behaviour. The results demonstrated that lesioned rats were insensitive to contingency manipulations both during contingency degradation training and in the subsequent extinction test. Experiment 2 further indicated that rats with pDMS DA depletion subjected to extended contingency degradation training (12 days) became sensitive to contingency manipulations during the training phase but not in the subsequent extinction test. In experiment 3, an extended but more complex contingency degradation training protocol (12 days) was used that involved a gradual shift from a low to an intermediate and a high degree of contingency degradation rather than a high and invariable degree of contingency degradation as in experiments 1 and 2. Notably, lesioned rats were sensitive to contingency manipulations both during the contingency degradation training phase and in the subsequent extinction test. Thus, pDMS DA depletions can impair the capability to detect changes in the causal efficacy of actions; however, the occurrence and pattern of impairments depend on the contingency degradation training protocol being used.

Distinct Changes in CREB Phosphorylation in Frontal Cortex and Striatum During Contingent and Non-Contingent Performance of a Visual Attention Task

The cyclic-adenosine monophosphate response element-binding protein (CREB) family of transcription factors has been implicated in numerous forms of behavioral plasticity. We investigated CREB phosphorylation along some nodes of corticostriatal circuitry such as frontal cortex (FC) and dorsal (caudate-putamen, CPu) and ventral (nucleus accumbens, NAC) striatum in response to the contingent or non-contingent performance of the five-choice serial reaction time task (5-CSRTT) used to assess visuospatial attention. Three experimental manipulations were used; an attentional performance group (contingent, "master"), a group trained previously on the task but for whom the instrumental contingency coupling responding with stimulus detection and reward was abolished (non-contingent, "yoked") and a control group matched for food deprivation and exposure to the test apparatus (untrained). Rats trained on the 5-CSRTT (both master and yoked) had higher levels of CREB protein in the FC, CPu, and NAC compared to untrained controls. Despite the divergent behavior of "master" and "yoked" rats CREB activity in the FC was not substantially different. In rats performing the 5-CSRTT ("master"), CREB activity was completely abolished in the CPu whereas in the NAC it remained unchanged. In contrast, CREB phosphorylation in CPu and NAC increased only when the contingency changed from goal-dependent to goal-independent reinforcement ("yoked"). The present results indicate that up-regulation of CREB protein expression across cortical and striatal regions possibly reflects the extensive instrumental learning and performance whereas increased CREB activity in striatal regions may signal the unexpected change in the relationship between instrumental action and reinforcement.

The role of dopamine in the dorsomedial striatum in general and outcome-selective Pavlovian-instrumental transfer

Pavlovian stimuli predictive of appetitive outcomes can influence the selection and initiation of instrumental behaviour. For instance, Pavlovian stimuli can act to enhance those actions with which they share an outcome, but not others with which they do not share an outcome, a phenomenon termed outcome-selective Pavlovian-instrumental transfer (PIT). Furthermore, Pavlovian stimuli can invigorate an action by inducing a general appetitive arousal that elevates instrumental responding, a phenomenon termed general PIT. The dorsomedial striatum has been implicated in outcome-selective, but not general PIT. However, the role of dopamine (DA) signals in this subregion in mediating PIT is unknown. Here we examined in rats the effects of a 6-hydroxydopamine-induced DA depletion of the anterior (aDMS) or posterior (pDMS) subregion of the dorsomedial striatum on outcome-selective and general PIT as well as on instrumental performance on a FR-5 schedule (five lever presses earned one pellet). Results demonstrate that aDMS and pDMS DA depletions compromised the rate of responding on a FR-5 schedule, suggesting that DA signals in the dorsomedial striatum are necessary to maintain high rates of instrumental responding. By contrast, aDMS and pDMS DA depletions did not affect general PIT, suggesting that DA signals in the dorsomedial striatum do not mediate general activating effects of reward-predictive stimuli to invigorate instrumental responding. Furthermore, aDMS DA depletions did not impair outcome-selective PIT, while pDMS DA depletions had no or only minor effects. Thus, DA signals in the DMS may not be involved in mediating the specific cueing effects of reward-predictive stimuli.

The role of dopamine in the dorsomedial striatum in place and response learning

The posterior subregion of the dorsomedial striatum (pDMS) has been implicated in spatial learning. Here we investigated the role of dopamine (DA) signals in the pDMS in place and response learning using a T-maze task. Rats subjected to a DA depletion of the pDMS and sham controls were trained for 7 days to retrieve food from the west arm of the maze starting from the south, that is to make a left turn at the choice point. On day 8, a probe test was given in which the starting arm was inserted as the north arm. On days 9-16 animals received further training, and on day 17, a second probe test was performed. We examined whether animals responded on probe tests according to a response strategy (left turn at choice point) or to a place strategy (right turn at choice point). Our results revealed that, unlike sham controls, rats with a pDMS DA depletion preferentially used a response rather than a place strategy already on the first probe test. These findings provide further support for a role of the pDMS in spatially guided behavior and indicate that DA signals in the pDMS are critical for the use of a place strategy.