Appetitive instrumental learning requires coincident activation of NMDA and dopamine D1 receptors within the medial prefrontal cortex

Episodic Memory formation: A review of complex Hippocampus input pathways

Memories of everyday experiences involve the encoding of a rich and dynamic representation of present objects and their contextual features. Traditionally, the resulting mnemonic trace is referred to as Episodic Memory, i.e. the "what", "where" and "when" of a lived episode. The journey for such memory trace encoding begins with the perceptual data of an experienced episode handled in sensory brain regions. The information is then streamed to cortical areas located in the ventral Medio Temporal Lobe, which produces multi-modal representations concerning either the objects (in the Perirhinal cortex) or the spatial and contextual features (in the parahippocampal region) of the episode. Then, this high-level data is gated through the Entorhinal Cortex and forwarded to the Hippocampal Formation, where all the pieces get bound together. Eventually, the resulting encoded neural pattern is relayed back to the Neocortex for a stable consolidation. This review will detail these different stages and provide a systematic overview of the major cortical streams toward the Hippocampus relevant for Episodic Memory encoding.

Alcohol and cannabinoid binges and daily exposure to nicotine in adolescent/young adult rats induce sex-dependent long-term appetitive instrumental learning impairment

Adolescence is a critical developmental period, concerning anatomical, neurochemical and behavioral changes. Moreover, adolescents are more sensitive to the long-term deleterious effects of drug abuse. Binge-like consumption of alcohol and marijuana, along with tobacco smoking, is a dangerous pattern often observed in adolescents during weekends. Nevertheless, the long-term effect of their adolescent co-exposure has not been yet experimentally investigated. Long-Evans adolescent male (n = 20) and female (n = 20) rats from postnatal day 30 (P30) until P60 were daily treated with nicotine (0.3 mg/kg, i.p.), and, on two consecutive 'binging days' per week (for a total of eight times), received an intragastric ethanol solution (3 g/kg) and an intraperitoneal (i.p.) dose of cannabinoid 1/2 receptor agonist WIN55,212-2 (1.2 mg/kg). These rats were tested after treatment discontinuation at > P90 for associative food-rewarded operant learning in the two-lever conditioning chambers for six consecutive days on a fixed ratio 1 (FR1) schedule followed by another six days of daily FR2 schedule testing, after 42 days rest. We found the main effects of sex x treatment interactions in FR1 but not in FR2 experiments. Treated females show attenuated operant responses for food pellets during all FR1 and the FR2 schedule, whilst the treated males show an impairment in FR2 but not in the FR1 schedule. Moreover, the treated females' percentage of learners was significantly lower than female controls in FR1 while treated males were lower than controls in FR2. Our findings suggest that intermittent adolescent abuse of common drugs, such as alcohol and marijuana, and chronic tobacco exposure can cause significant long-term effects on motivation for natural reinforcers later in adulthood in both sexes. Females appear to be sensitive earlier to the deleterious effects of adolescent polydrug abuse, with both sexes having an increased likelihood of developing lifelong brain alterations.

The role of dopamine and endocannabinoid systems in prefrontal cortex development: Adolescence as a critical period

The prefrontal cortex plays a central role in the control of complex cognitive processes including action control and decision making. It also shows a specific pattern of delayed maturation related to unique behavioral changes during adolescence and allows the development of adult cognitive processes. The adolescent brain is extremely plastic and critically vulnerable to external insults. Related to this vulnerability, adolescence is also associated with the emergence of numerous neuropsychiatric disorders involving alterations of prefrontal functions. Within prefrontal microcircuits, the dopamine and the endocannabinoid systems have widespread effects on adolescent-specific ontogenetic processes. In this review, we highlight recent advances in our understanding of the maturation of the dopamine system and the endocannabinoid system in the prefrontal cortex during adolescence. We discuss how they interact with GABA and glutamate neurons to modulate prefrontal circuits and how they can be altered by different environmental events leading to long-term neurobiological and behavioral changes at adulthood. Finally, we aim to identify several future research directions to help highlight gaps in our current knowledge on the maturation of these microcircuits.

A high-performance genetically encoded fluorescent indicator for in vivo cAMP imaging

cAMP is a key second messenger that regulates diverse cellular functions including neural plasticity. However, the spatiotemporal dynamics of intracellular cAMP in intact organisms are largely unknown due to low sensitivity and/or brightness of current genetically encoded fluorescent cAMP indicators. Here, we report the development of the new circularly permuted GFP (cpGFP)-based cAMP indicator G-Flamp1, which exhibits a large fluorescence increase (a maximum ΔF/F0 of 1100% in HEK293T cells), decent brightness, appropriate affinity (a Kd of 2.17 μM) and fast response kinetics (an association and dissociation half-time of 0.20 and 0.087 s, respectively). Furthermore, the crystal structure of the cAMP-bound G-Flamp1 reveals one linker connecting the cAMP-binding domain to cpGFP adopts a distorted β-strand conformation that may serve as a fluorescence modulation switch. We demonstrate that G-Flamp1 enables sensitive monitoring of endogenous cAMP signals in brain regions that are implicated in learning and motor control in living organisms such as fruit flies and mice.

A behavioural correlate of the synaptic eligibility trace in the nucleus accumbens

Reward reinforces the association between a preceding sensorimotor event and its outcome. Reinforcement learning (RL) theory and recent brain slice studies explain the delayed reward action such that synaptic activities triggered by sensorimotor events leave a synaptic eligibility trace for 1 s. The trace produces a sensitive period for reward-related dopamine to induce synaptic plasticity in the nucleus accumbens (NAc). However, the contribution of the synaptic eligibility trace to behaviour remains unclear. Here we examined a reward-sensitive period to brief pure tones with an accurate measurement of an effective timing of water reward in head-fixed Pavlovian conditioning, which depended on the plasticity-related signaling in the NAc. We found that the reward-sensitive period was within 1 s after the pure tone presentation and optogenetically-induced presynaptic activities at the NAc, showing that the short reward-sensitive period was in conformity with the synaptic eligibility trace in the NAc. These findings support the application of the synaptic eligibility trace to construct biologically plausible RL models.

The Signaling and Pharmacology of the Dopamine D1 Receptor

The dopamine D1 receptor (D1R) is a Gα_s/olf-coupled GPCR that is expressed in the midbrain and forebrain, regulating motor behavior, reward, motivational states, and cognitive processes. Although the D1R was initially identified as a promising drug target almost 40 years ago, the development of clinically useful ligands has until recently been hampered by a lack of suitable candidate molecules. The emergence of new non-catechol D1R agonists, biased agonists, and allosteric modulators has renewed clinical interest in drugs targeting this receptor, specifically for the treatment of motor impairment in Parkinson's Disease, and cognitive impairment in neuropsychiatric disorders. To develop better therapeutics, advances in ligand chemistry must be matched by an expanded understanding of D1R signaling across cell populations in the brain, and in disease states. Depending on the brain region, the D1R couples primarily to either Gα_s or Gα_olf through which it activates a cAMP/PKA-dependent signaling cascade that can regulate neuronal excitability, stimulate gene expression, and facilitate synaptic plasticity. However, like many GPCRs, the D1R can signal through multiple downstream pathways, and specific signaling signatures may differ between cell types or be altered in disease. To guide development of improved D1R ligands, it is important to understand how signaling unfolds in specific target cells, and how this signaling affects circuit function and behavior. In this review, we provide a summary of D1R-directed signaling in various neuronal populations and describe how specific pathways have been linked to physiological and behavioral outcomes. In addition, we address the current state of D1R drug development, including the pharmacology of newly developed non-catecholamine ligands, and discuss the potential utility of D1R-agonists in Parkinson's Disease and cognitive impairment.

Maturation of Corticolimbic Functional Connectivity During Sensitive Periods of Brain Development

The maturation of key corticolimbic structures and the prefrontal cortex during sensitive periods of brain development from early life through adolescence is crucial for the acquisition of a variety of cognitive and affective processes associated with adult behavior. In this chapter, we first review how key cellular and circuit level changes during adolescence dictate the development of the prefrontal cortex and its capacity to integrate contextual and emotional information from the ventral hippocampus and the amygdala. We further discuss how afferent transmission from ventral hippocampal and amygdala inputs displays unique age-dependent trajectories that directly impact prefrontal functional maturation through adolescence. We conclude by proposing that time-sensitive strengthening of specific corticolimbic synapses is a critical contributing factor for the protracted maturation of cognitive and emotional regulation by the prefrontal cortex.

The strength of reward-related learning depends on the degree of activation of ventral tegmental area dopamine neurons

We tested whether (1) the capacity of a reward-associated conditioned stimulus (CS) to cause conditioned activation of ventral tegmental area (VTA) dopamine (DA) neurons is associated with its capacity to elicit conditioned approach responses and (2) whether the acquisition of these capacities by a CS requires N-methyl-D-aspartate (NMDA) and muscarinic acetylcholine (mACh) receptor stimulation. Rats were trained to emit a conditioned approach response to a light CS that was previously paired with food and were treated systemically with scopolamine (a mACh receptor antagonist) or MK-801 (an NMDA receptor antagonist) either prior to each conditioning session (during which animals experienced paired CS and food presentations) or prior to the conditioned approach (CS-only) test. Brains were harvested after the CS-only test and processed for tyrosine hydroxylase (TH) (DA cells) and c-fos in the VTA. When animals received scopolamine or MK-801 treatment prior to conditioning sessions we observed significantly fewer TH-labeled (i.e., DA) cells in the VTA that expressed c-fos and significantly less conditioned approach responding during the CS-only test. Further analysis showed a correlation between the number of VTA DA cells activated and the number of conditioned approach responses. Treatments made prior to the CS-only test did not affect responding. Altogether these results suggest that the degree to which a CS elicits conditioned approach depends partially on the degree to which the CS activates VTA DA cells and that the acquisition of both of these capacities by a CS requires mACh and NMDA receptor stimulation.

Neuronal connections of the central amygdalar nucleus with refeeding-activated brain areas in rats

Following fasting, satiety is accompanied by neuronal activation in brain areas including the central amygdalar nucleus (CEA). Since CEA is known to inhibit food intake, we hypothesized that CEA contributes to the termination of meal during refeeding. To better understand the organization of this satiety-related circuit, the interconnections of the CEA with refeeding-activated neuronal groups were elucidated using retrograde (cholera toxin-β subunit, CTB) and anterograde (phaseolus vulgaris leucoagglutinin, PHA-L) tracers in male rats. C-Fos-immunoreactivity was used as marker of neuronal activation. The refeeding-activated input of the CEA primarily originated from the paraventricular thalamic, parasubthalamic and parabrachial nuclei. Few CTB-c-Fos double-labeled neurons were detected in the prefrontal cortex, lateral hypothalamic area, nucleus of the solitary tract (NTS) and the bed nuclei of the stria terminalis (BNST). Only few refeeding-activated proopiomelanocortin-producing neurons of the arcuate nucleus projected to the CEA. Anterograde tract tracing revealed a high density of PHAL-labeled axons contacted with refeeding-activated neurons in the BNST, lateral hypothalamic area, parasubthalamic, paraventricular thalamic and parabrachial nuclei and NTS; a low density of labeled axons was found in the paraventricular hypothalamic nucleus. Chemogenetic activation of the medial CEA (CEAm) inhibited food intake during the first hour of refeeding, while activation of lateral CEA had no effect. These data demonstrate the existence of reciprocal connections between the CEA and distinct refeeding-activated hypothalamic, thalamic and brainstem nuclei, suggesting the importance of short feedback loops in the regulation of satiety and importance of the CEAm in the regulation of food intake during refeeding.

A Polygenic Risk Score of glutamatergic SNPs associated with schizophrenia predicts attentional behavior and related brain activity in healthy humans

Multiple genetic variations impact on risk for schizophrenia. Recent analyses by the Psychiatric Genomics Consortium (PGC2) identified 128 SNPs genome-wide associated with the disorder. Furthermore, attention and working memory deficits are core features of schizophrenia, are heritable and have been associated with variation in glutamatergic neurotransmission. Based on this evidence, in a sample of healthy volunteers, we used SNPs associated with schizophrenia in PGC2 to construct a Polygenic-Risk-Score (PRS) reflecting the cumulative risk for schizophrenia, along with a Polygenic-Risk-Score including only SNPs related to genes implicated in glutamatergic signaling (Glu-PRS). We performed Factor Analysis for dimension reduction of indices of cognitive performance. Furthermore, both PRS and Glu-PRS were used as predictors of cognitive functioning in the domains of Attention, Speed of Processing and Working Memory. The association of the Glu-PRS on brain activity during the Variable Attention Control (VAC) task was also explored. Finally, in a second independent sample of healthy volunteers we sought to confirm the association between the Glu-PRS and both performance in the domain of Attention and brain activity during the VAC.We found that performance in Speed of Processing and Working Memory was not associated with any of the Polygenic-Risk-Scores. The Glu-PRS, but not the PRS was associated with Attention and brain activity during the VAC. The specific effects of Glu-PRS on Attention and brain activity during the VAC were also confirmed in the replication sample.Our results suggest a pathway specificity in the relationship between genetic risk for schizophrenia, the associated cognitive dysfunction and related brain processing.

Distinct recruitment of basolateral amygdala-medial prefrontal cortex pathways across Pavlovian appetitive conditioning

Associative learning can enable environmental cues to signal food and stimulate feeding, independent of physiological hunger. Two forebrain regions necessary in cue driven feeding, the basolateral area of the amygdala and the medial prefrontal cortex, communicate via extensive, topographically organized connections. The basolateral nucleus (BLA) sends extensive projections to the prelimbic cortex (PL), and our aim here was to determine if this pathway was selectively recruited during cue-food associative learning. The anterior and posterior basolateral nuclei are recruited during different phases of cue-food learning, and thus we examined whether distinct pathways that originate in these nuclei and project to the PL are differently recruited during early and late stages of learning. To accomplish this we used neuroanatomical tract tracing combined with the detection of Fos induction. To identify projecting neurons within the BLA, prior to training, rats received a retrograde tracer, Fluoro-Gold (FG) into the PL. Rats were given either one or ten sessions of tone-food presentations (Paired group) or tone-only presentations (Control group). The Paired group learned the tone-food association quickly and robustly and had greater Fos induction within the anterior and posterior BLA during early and late learning compared to the Control group. Notably, the Paired group had more double-labeled neurons (FG + Fos) during late training compared to the Control group, specifically in the anterior BLA. This demonstrates selective recruitment of the anterior BLA-PL pathway by late cue-food learning. These findings indicate plasticity and specificity in the BLA-PL pathways across cue-food associative learning.

Impaired glucose tolerance after streptozotocin microinjection into the mediodorsal prefrontal cortex of the rat

The mediodorsal prefrontal cortex (mdPFC) is a key structure of the central glucose-monitoring (GM) neural network. Previous studies indicate that intracerebral streptozotocin (STZ) microinjection-induced destruction of local chemosensory neurons results in feeding and metabolic alterations. The present experiments aimed to examine whether STZ microinjection into the mdPFC causes metabolic deficits. To do so, glucose tolerance test (GTT) and measurements of plasma metabolites were performed in STZ-treated or control rats. Intraperitoneal D-glucose load was delivered 20 min or 4 weeks following the intracerebral microinjection of STZ or saline (acute or subacute GTT, respectively). The STZ-treated rats displayed acute glucose intolerance: at the 120th min of the test, blood glucose level of these rats was significantly higher than that of the ones in the control group. When determining the plasma level of various metabolites, 30 min following the intracerebral STZ or saline microinjection, the triglyceride concentration of the STZ-treated rats was found to be reduced compared with that of the control rats. The GM neurons of the mdPFC are suggested to be involved in the organization of complex metabolic processes by which these chemosensory cells contribute to adaptive control mechanisms of the maintenance of homeostasis.

Relief learning requires a coincident activation of dopamine D1 and NMDA receptors within the nucleus accumbens

Relief learning is the association of a stimulus with the offset of an aversive event. Later, the now conditioned relief stimulus induces appetitive-like behavioral changes. We previously demonstrated that the NMDA receptors within the nucleus accumbens (NAC) are involved in relief learning. The NAC is also important for reward learning and it has been shown that reward learning is mediated by an interaction of accumbal dopamine and NMDA glutamate receptors. Since conditioned relief has reward-like properties, we hypothesized that (a) acquisition of relief learning requires the activation of dopamine D1 receptors in the NAC, and (b) if D1 receptors are involved in this process as expected, a concurrent dopamine D1 and NMDA receptor activation may mediate this learning. The present study tested these hypotheses. Therefore, rats received intra-NAC injections of the dopamine D1 receptor antagonist SCH23390 and the NMDA antagonist AP5, either separately or together, at different time points of a relief conditioning procedure. First, we showed that SCH23390 dose-dependently blocked acquisition and the expression of conditioned relief. Next, we demonstrated that co-injections of SCH23390 and AP5 into the NAC, at doses that were ineffective when applied separately, blocked acquisition but not consolidation or expression of relief learning. Notably, neither of the injections affected the locomotor response of the animals to the aversive stimuli suggesting that their perception is not changed. This data indicates that a co-activation of dopamine D1 and NMDA receptors in the NAC is required for acquisition of relief learning.

Melanocortin 3 Receptor Signaling in Midbrain Dopamine Neurons Increases the Motivation for Food Reward

The central melanocortin (MC) system mediates its effects on food intake via MC3 (MC3R) and MC4 receptors (MC4R). Although the role of MC4R in meal size determination, satiation, food preference, and motivation is well established, the involvement of MC3R in the modulation of food intake has been less explored. Here, we investigated the role of MC3R on the incentive motivation for food, which is a crucial component of feeding behavior. Dopaminergic neurons within the ventral tegmental area (VTA) have a crucial role in the motivation for food. We here report that MC3Rs are expressed on VTA dopaminergic neurons and that pro-opiomelanocortinergic (POMC) neurons in the arcuate nucleus of the hypothalamus (Arc) innervate these VTA dopaminergic neurons. Our findings show that intracerebroventricular or intra-VTA infusion of the selective MC3R agonist γMSH increases responding for sucrose under a progressive ratio schedule of reinforcement, but not free sucrose consumption in rats. Furthermore, ex vivo electrophysiological recordings show increased VTA dopaminergic neuronal activity upon γMSH application. Consistent with a dopamine-mediated effect of γMSH, the increased motivation for sucrose after intra-VTA infusion of γMSH was blocked by pretreatment with the dopamine receptor antagonist α-flupenthixol. Taken together, we demonstrate an Arc POMC projection onto VTA dopaminergic neurons that modulates motivation for palatable food via activation of MC3R signaling.

Mechanisms contributing to prefrontal cortex maturation during adolescence

Adolescence is defined as a transitional period between childhood and adulthood characterized by changes in social interaction and acquisition of mature cognitive abilities. These changes have been associated with the maturation of brain regions involved in the control of motivation, emotion, and cognition. Among these regions, the protracted development of the human prefrontal cortex during adolescence has been proposed to underlie the maturation of cognitive functions and the regulation of affective responses. Studies in animal models allow us to test the causal contribution of specific neural processes in the development of the prefrontal cortex and the acquisition of adult behavior. This review summarizes the cellular and synaptic mechanisms occurring in the rodent prefrontal cortex during adolescence as a model for understanding the changes underlying human prefrontal development.

Activation of Pyramidal Neurons in Mouse Medial Prefrontal Cortex Enhances Food-Seeking Behavior While Reducing Impulsivity in the Absence of an Effect on Food Intake

The medial prefrontal cortex (mPFC) is involved in a wide range of executive cognitive functions, including reward evaluation, decision-making, memory extinction, mood, and task switching. Manipulation of the mPFC has been shown to alter food intake and food reward valuation, but whether exclusive stimulation of mPFC pyramidal neurons (PN), which form the principle output of the mPFC, is sufficient to mediate food rewarded instrumental behavior is unknown. We sought to determine the behavioral consequences of manipulating mPFC output by exciting PN in mouse mPFC during performance of a panel of behavioral assays, focusing on food reward. We found that increasing mPFC pyramidal cell output using designer receptors exclusively activated by designer drugs (DREADD) enhanced performance in instrumental food reward assays that assess food seeking behavior, while sparing effects on affect and food intake. Specifically, activation of mPFC PN enhanced operant responding for food reward, reinstatement of palatable food seeking, and suppression of impulsive responding for food reward. Conversely, activation of mPFC PN had no effect on unconditioned food intake, social interaction, or behavior in an open field. Furthermore, we found that behavioral outcome is influenced by the degree of mPFC activation, with a low drive sufficient to enhance operant responding and a higher drive required to alter impulsivity. Additionally, we provide data demonstrating that DREADD stimulation involves a nitric oxide (NO) synthase dependent pathway, similar to endogenous muscarinic M3 receptor stimulation, a finding that provides novel mechanistic insight into an increasingly widespread method of remote neuronal control.

Strain commonalities and differences in response-outcome decision making in mice

The ability to select between actions that are more vs. less likely to be reinforced is necessary for survival and navigation of a changing environment. A task termed "response-outcome contingency degradation" can be used in the laboratory to determine whether rodents behave according to such goal-directed response strategies. In one iteration of this task, rodents are trained to perform two food-reinforced behaviors, then the predictive relationship between one instrumental response and the associated outcome is modified by providing the reinforcer associated with that response non-contingently. During a subsequent probe test, animals can select between the two trained responses. Preferential engagement of the behavior most likely to be reinforced is considered goal-directed, while non-selective responding is considered a failure in response-outcome conditioning, or "habitual." This test has largely been used with rats, and less so with mice. Here we compiled data collected from several cohorts of mice tested in our lab between 2012 and 2015. Mice were bred on either a C57BL/6 or predominantly BALB/c strain background. We report that both strains of mice can use information acquired as a result of instrumental contingency degradation training to select amongst multiple response options the response most likely to be reinforced. Mice differ, however, during the training sessions when the familiar response-outcome contingency is being violated. BALB/c mice readily generate perseverative or habit-like response strategies when the only available response is unlikely to be reinforced, while C57BL/6 mice more readily inhibit responding. These findings provide evidence of strain differences in response strategies when an anticipated reinforcer is unlikely to be delivered.

Exposure to a diet high in fat attenuates dendritic spine density in the medial prefrontal cortex

A key factor in the development of obesity is the overconsumption of food calorically high in fat. Overconsumption of food high in fat not only promotes weight gain but elicits changes in reward processing. No studies to date have examined whether consumption of a high-fat (HF) diet alters structural plasticity in brain areas critical for reward processing, which may account for persistent changes in behavior and psychological function by reorganizing synaptic connectivity. To test whether dietary fat may induce structural plasticity we placed rats on one of three dietary conditions: ad libitum standard chow (SC), ad libitum 60 % HF (HF-AL), or calorically matched 60 % HF (HF-CM) for 3 weeks and then quantified dendritic spine density and type on basal and apical dendrites of pyramidal cells in layer V of the medial prefrontal cortex (mPFC) and medium spiny neurons (MSNs) of the nucleus accumbens. Our results demonstrate a significant reduction in the density of thin spines on the apical and basal segments of dendrites within the infralimbic, but not prelimbic, mPFC.

Differential effects of clozapine, metoclopramide, haloperidol and risperidone on acquisition and performance of operant responding in rats

RATIONALE

Prior research has not systematically investigated the effects of systemic antipsychotic drugs on operant response acquisition, specifically their behavioural microstructure, reinforcement blunting and relative potency in acquisition compared to performance once operant responding has stabilized.

OBJECTIVES

This study aims to systematically investigate the effects of systemically administered clozapine, metoclopramide, haloperidol and risperidone during free operant response acquisition and performance.

METHODS

Following magazine training, food-restricted male Wistar rats lever pressed for food reward in 15 min daily operant conditioning sessions.

RESULTS

All drugs suppressed operant response acquisition and performance. Risperidone and metoclopramide, but not clozapine or haloperidol, suppressed operant responding more potently during acquisition than performance. The dopamine D2-like receptor antagonists haloperidol and metoclopramide that affect the ventral and dorsal striatum blunted reinforcement and decreased inactive lever presses in acquisition. In contrast, the atypical antipsychotics clozapine and risperidone that affect the ventral striatum and prefrontal cortex failed to decrease inactive lever presses during acquisition, suggesting a possible decision-making deficit. Haloperidol decreased active lever pressing over performance days. The drugs did not appear to affect rats' sensitivity to active lever press outcome, even though they suppressed active lever pressing.

CONCLUSIONS

Results suggest that reinforcement impact during operant acquisition is dependent on dopamine D2 receptors while drugs affecting, among other areas, the prefrontal cortex produce a deficit in ability to suppress inactive lever press responses.

Regionally selective requirement for D1/D5 dopaminergic neurotransmission in the medial prefrontal cortex in object-in-place associative recognition memory

Object-in-place (OiP) memory is critical for remembering the location in which an object was last encountered and depends conjointly on the medial prefrontal cortex, perirhinal cortex, and hippocampus. Here we examined the role of dopamine D₁/D₅ receptor neurotransmission within these brain regions for OiP memory. Bilateral infusion of D₁/D₅ receptor antagonists SCH23390 or SKF83566 into the medial prefrontal cortex, prior to memory acquisition, impaired OiP performance following a 5 min or 1 h delay. Retrieval was unaffected. Intraperirhinal or intrahippocampal infusions of SCH23390 had no effect. These results reveal a selective role for D₁/D₅ receptors in the mPFC during OiP memory encoding.

Dopamine modulation of GABAergic function enables network stability and input selectivity for sustaining working memory in a computational model of the prefrontal cortex

Dopamine modulation of GABAergic transmission in the prefrontal cortex (PFC) is thought to be critical for sustaining cognitive processes such as working memory and decision-making. Here, we developed a neurocomputational model of the PFC that includes physiological features of the facilitatory action of dopamine on fast-spiking interneurons to assess how a GABAergic dysregulation impacts on the prefrontal network stability and working memory. We found that a particular non-linear relationship between dopamine transmission and GABA function is required to enable input selectivity in the PFC for the formation and retention of working memory. Either degradation of the dopamine signal or the GABAergic function is sufficient to elicit hyperexcitability in pyramidal neurons and working memory impairments. The simulations also revealed an inverted U-shape relationship between working memory and dopamine, a function that is maintained even at high levels of GABA degradation. In fact, the working memory deficits resulting from reduced GABAergic transmission can be rescued by increasing dopamine tone and vice versa. We also examined the role of this dopamine-GABA interaction for the termination of working memory and found that the extent of GABAergic excitation needed to reset the PFC network begins to occur when the activity of fast-spiking interneurons surpasses 40 Hz. Together, these results indicate that the capability of the PFC to sustain working memory and network stability depends on a robust interplay of compensatory mechanisms between dopamine tone and the activity of local GABAergic interneurons.

Dopamine receptor signaling in the medial orbital frontal cortex and the acquisition and expression of fructose-conditioned flavor preferences in rats

Systemic dopamine (DA) D1 (SCH23390: SCH) and D2 (raclopride: RAC) antagonists blocked fructose-conditioned flavor preference (CFP) acquisition and expression. Fructose-CFP acquisition was eliminated by medial prefrontal cortex (mPFC) SCH and mPFC or amygdala (AMY) RAC. Fructose-CFP expression was reduced following SCH or RAC in AMY or nucleus accumbens (NAc). The present study examined fructose-CFP acquisition and expression following SCH and RAC in the medial orbital frontal cortex (MOFC), another ventral tegmental area DA target. For fructose-CFP acquisition, five groups of rats received vehicle, SCH (24 or 48 nmol) or RAC (24 or 48 nmol) in the MOFC 0.5h prior to 8 training sessions with one flavor (CS+/Fs) mixed in 8% fructose and 0.2% saccharin, and another flavor (CS-/s) mixed in 0.2% saccharin. In six 2-bottle choice tests in 0.2% saccharin, similar fructose-CFP preferences occurred in groups trained with vehicle (76-77%), SCH24 (69-78%), SCH48 (70-74%) and RAC48 (85-92%). RAC24-trained rats displayed significant CS+ preferences during the first (79%) and third (71%), but not second (58%) test pair. For fructose-CFP expression, rats similarly trained with CS+/Fs and CS- solutions received 2-bottle choice tests following MOFC injections of SCH or RAC (12-48 nmol). CS+ preference expression was significantly reduced by RAC (48 nmol: 58%), but not SCH relative to vehicle (78%). A control group receiving RAC in the dorsolateral prefrontal cortex displayed fructose-CFP expression similar to vehicle. These data demonstrate differential frontal cortical DA mediation of fructose-CFP with mPFC D1 and D2 signaling exclusively mediating acquisition, and MOFC D2 signaling primarily mediating expression.

Late adolescent expression of GluN2B transmission in the prefrontal cortex is input-specific and requires postsynaptic protein kinase A and D1 dopamine receptor signaling

BACKGROUND

Refinement of mature cognitive functions, such as working memory and decision making, typically takes place during adolescence. The acquisition of these functions is linked to the protracted development of the prefrontal cortex (PFC) and dopamine facilitation of glutamatergic transmission. However, the mechanisms that support these changes during adolescence remain elusive.

METHODS

Electrophysiological recordings (in vitro and in vivo) combined with pharmacologic manipulations were employed to determine how N-methyl-D-aspartate transmission in the medial PFC changes during the adolescent transition to adulthood. The relative contribution of GluN2B transmission and its modulation by postsynaptic protein kinase A and D1 receptor signaling were determined in two distinct age groups of rats: postnatal day (P)25 to P40 and P50 to P80.

RESULTS

We found that only N-methyl-D-aspartate receptor transmission onto the apical dendrite of layer V pyramidal neurons undergoes late adolescent remodeling due to a functional emergence of GluN2B function after P40. Both protein kinase A and dopamine D1 receptor signaling are required for the functional expression of GluN2B transmission and to sustain PFC plasticity in response to ventral hippocampal, but not basolateral amygdala, inputs.

CONCLUSIONS

Thus, the late adolescent acquisition of GluN2B function provides a mechanism for dopamine D1-mediated regulation of PFC responses in an input-specific manner.

Dorsal and ventral streams: the distinct role of striatal subregions in the acquisition and performance of goal-directed actions

Considerable evidence suggests that distinct neural processes mediate the acquisition and performance of goal-directed instrumental actions. Whereas a cortical-dorsomedial striatal circuit appears critical for the acquisition of goal-directed actions, a cortical-ventral striatal circuit appears to mediate instrumental performance, particularly the motivational control of performance. Here we review evidence that these distinct mechanisms of learning and performance constitute two distinct 'streams' controlling instrumental conditioning. From this perspective, the regulation of the interaction between these 'streams' becomes a matter of considerable importance. We describe evidence that the basolateral amygdala, which is heavily interconnected with both the dorsal and ventral subregions of the striatum, coordinates this interaction providing input to the final common path to action as a critical component of the limbic-motor interface.

Glucose-conditioned flavor preference learning requires co-activation of NMDA and dopamine D1-like receptors within the amygdala

The role of amygdala (AMY) NMDA receptor signaling and its interaction with dopamine D1-like receptor signaling in glucose-mediated flavor preference learning was investigated. In Experiment 1, rats were trained with a flavor (CS+) paired with intragastric (IG) 8% glucose infusions and a different flavor (CS-) paired with IG water infusions. In the two-bottle tests (Expression), bilateral intra-AMY injections of the NMDA receptor antagonist, AP5 (0, 5 and 10 nmol/brain), did not block the CS+ preference. In Experiment 2, new rats received intra-AMY injections of either vehicle or AP5 (10 nmol), prior to training sessions with CS+/IG glucose and CS-/IG water. In the two-bottle tests without drug treatment, AP5 rats failed to prefer the CS+ flavor (50%). In Experiments 3, new rats were trained as in Experiment 2 except that, during training, half the rats received AP5 injections (5 nmol) in one side of the AMY and SCH23390 (D1-like receptor antagonist, 6 nmol), in the contralateral AMY (Drug/Drug group). The remaining rats received vehicle injections in one side of the AMY and either AP5 (5 nmol) or SCH23390 (6 nmol) in the contralateral AMY (Drug/Vehicle group). The two-bottle choice tests without drug treatment revealed that, unlike the Drug/Vehicle group (85%), the Drug/Drug group failed to prefer the CS+ flavor (50%). These results reveal an essential role for AMY NMDA receptor activation in the acquisition of flavor preference learning induced by the post-oral reinforcing properties of glucose and demonstrate that such learning is based on co-activation of NMDA and DA D1 receptors within this forebrain structure.

The clinical relevance of neuroplasticity in corticostriatal networks during operant learning

Dopamine and glutamate serve crucial functions in neural plasticity, learning and memory, and addiction. Contemporary theories contend that these two, widely-distributed neurotransmitter systems play an integrative role in motivational and associative information processing. Combined signaling of these systems, particularly through the dopamine (DA) D1 and glutamate (Glu) N-methyl-d-aspartate receptors (NMDAR), triggers critical intracellular signaling cascades that lead to changes in chromatin structure, gene expression, synaptic plasticity, and ultimately behavior. Addictive drugs also induce long-term neuroadaptations at the molecular and genomic levels causing structural changes that alter basic connectivity. Indeed, evidence that drugs of abuse engage D1- and NMDA-mediated neuronal cascades shared with normal reward learning provides one of the most important insights from contemporary studies on the neurobiology of addiction. Such drug-induced neuroadaptations likely contribute to abnormal information processing and behavior, resulting in the poor decision-making, loss of control, and compulsivity that characterize addiction. Such features are also common to many other neuropsychiatric disorders. Behavior problems, construed as difficulties associated with operant learning and behavior, present compelling challenges and unique opportunities for their treatment that require further study. The present review highlights the integrative work of Ann E. Kelley and colleagues, demonstrating a critical role not only for NMDAR, D1 receptors (D1R), and their associated signaling cascades, but also for other Glu receptors and protein synthesis in operant learning throughout a cortico-striatal-limbic network. Recent work has extended the impact of appetitive learning to epigenetic processes. A better understanding of these processes will likely assist in discovering therapeutics to engage neural plasticity-related processes and promote functional behavioral adaptations.

Prelimbic and infralimbic neurons signal distinct aspects of appetitive instrumental behavior

It is thought that discrete subregions of the medial prefrontal cortex (mPFC) regulate different aspects of appetitive behavior, however, physiological support for this hypothesis has been lacking. In the present study, we used multichannel single-unit recording to compare the response of neurons in the prelimbic (PL) and infralimbic (IL) subregions of the mPFC, in rats pressing a lever to obtain sucrose pellets on a variable interval schedule of reinforcement (VI-60). Approximately 25% of neurons in both structures exhibited prominent excitatory responses during rewarded, but not unrewarded, lever presses. The time courses of reward responses in PL and IL, however, were markedly different. Most PL neurons exhibited fast and transient responses at the delivery of sucrose pellets, whereas most IL neurons exhibited delayed and prolonged responses associated with the collection of earned sucrose pellets. We further examined the functional significance of reward responses in IL and PL with local pharmacological inactivation. IL inactivation significantly delayed the collection of earned sucrose pellets, whereas PL inactivation produced no discernible effects. These findings support the hypothesis that PL and IL signal distinct aspects of appetitive behavior, and suggest that IL signaling facilitates reward collection.

Persistent effects of prior chronic exposure to corticosterone on reward-related learning and motivation in rodents

BACKGROUND

Repeated or prolonged exposure to stress has profound effects on a wide spectrum of behavioral and neurobiological processes and has been associated with the pathophysiology of depression. The multifaceted nature of this disorder includes despair, anhedonia, diminished motivation, and disrupted cognition, and it has been proposed that depression is also associated with reduced reward-motivated learning. We have previously reported that prior chronic corticosterone exposure to mice produces a lasting depressive-like state that can be reversed by chronic antidepressant treatment.

METHODS

In the present study, we tested the effects of prior chronic exposure to corticosterone (50 μg/ml) administered to rats or to mice in drinking water for 14 days followed by dose-tapering over 9 days.

RESULTS

The exposure to corticosterone produced lasting deficits in the acquisition of reward-related learning tested on a food-motivated instrumental task conducted 10-20 days after the last day of full dose corticosterone exposure. Rats exposed to corticosterone also displayed reduced responding on a progressive ratio schedule of reinforcement when tested on day 21 after exposure. Amitriptyline (200 mg/ml in drinking water) exposure for 14 days to mice produced the opposite effect, enhancing food-motivated instrumental acquisition and performance. Repeated treatment with amitriptyline (5 mg/kg, intraperitoneally; bid) subsequent to corticosterone exposure also prevented the corticosterone-induced deficits in rats.

CONCLUSIONS

These results are consistent with aberrant reward-related learning and motivational processes in depressive states and provide new evidence that stress-induced neuroadaptive alterations in cortico-limbic-striatal brain circuits involved in learning and motivation may play a critical role in aspects of mood disorders.

Age-dependent effects of repeated amphetamine exposure on working memory in rats

Cognitive dysfunction is a hallmark of chronic psychostimulant misuse. Adolescents may have heightened risk of developing drug-induced deficits because their brains are already undergoing widespread changes in anatomy and function as a normal part of development. To address this hypothesis, we performed two sets of experiments where adolescent and young adult rats were pre-exposed to saline or amphetamine (1 or 3mg/kg) and subsequently tested in a prefrontal cortex (PFC)-sensitive working memory task. A total of ten injections of AMPH or saline (in control rats) were given every other day over the course of 19 days. After rats reached adulthood (>90 days old), cognitive performance was assessed using operant-based delayed matching-to-position (DMTP) and delayed nonmatching-to-position (DNMTP) tasks. DNMTP was also assessed following challenges with amphetamine (0.3-1.25mg/kg), and ketamine (5.0-10mg/kg). In experiment one, we also measured the locomotor response following the first and tenth pre-exposure to amphetamine and after an amphetamine challenge given at the conclusion of operant testing. Compared to adult-exposed groups, adolescents were less sensitive to the psychomotor effects of amphetamine. However, they were more vulnerable to exposure-induced cognitive impairments. For example, adolescent-exposed rats displayed delay-dependent deficits in accuracy, increased sensitivity to proactive interference, and required more training to reach criterion. Drug challenges produced deficits in DNMTP performance, but these were not dependent on pre-exposure group. These studies demonstrate age of exposure-dependent effects of amphetamine on cognition in a PFC-sensitive task, suggesting a heightened sensitivity of adolescents to amphetamine-induced neuroplasticity.

Psychostimulants and motivated behavior: arousal and cognition

Motivated, goal-directed behavior requires the coordination of multiple behavioral processes that facilitate interacting with the environment, including arousal, motivation, and executive function. Psychostimulants exert potent modulatory influences on these processes, providing a useful tool for understanding the neurobiology of motivated behavior. The neural mechanisms underlying the reinforcing effects of psychostimulants have been extensively studied over the past 50 years. In contrast, the study of the neurobiology of the arousal-enhancing and executive-modulating actions of psychostimulants was only initiated relatively recently. This latter work identifies a series of dose-dependent actions of psychostimulants within a network of prefrontal cortical and subcortical sites that coordinate the arousal-promoting and cognition-modulating effects of these drugs. These actions are dependent on a variety of catecholamine receptor subtypes, including noradrenergic α1 and α2 receptors and dopaminergic D1 receptors. In the prefrontal cortex, psychostimulants exert inverted-U shaped modulatory actions that are apparent at the levels of the neuron and behavior. Collectively, these observations provide new insight into the neurobiology underlying motivated, goal-directed behavior.

Critical role of NMDA but not opioid receptors in the acquisition of fat-conditioned flavor preferences in rats

Animals learn to prefer flavors associated with the intake of dietary fats such as corn oil (CO) solutions. We previously reported that fat-conditioned flavor preferences in rats were relatively unaffected by systemic treatment with dopamine D1 and D2 antagonsits. The present study examined whether systemic opioid (naltrexone, NTX) or NMDA (MK-801) receptor antagonists altered the acquisition and/or expression of CO-CFP. The CFP was produced by training rats to drink one novel flavor (CS+, e.g., cherry) mixed in a 3.5% CO solution and another flavor (CS-, e.g., grape) in a 0.9% CO solution. In expression studies, food-restricted rats drank these solutions in one-bottle sessions (2 h) over 10 d. Subsequent two-bottle tests with the CS+ and CS- flavors mixed in 0.9% CO solutions occurred 0.5h after systemic administration of vehicle (VEH), NTX (0.1-5 mg/kg) or MK-801 (50-200 μg/kg). Rats displayed a robust CS+ preference following VEH treatment (85-88%) which was significantly though moderately attenuated by NTX (69-70%). The lower doses of MK-801 slightly reduced the CS+ preference; the high dose blocked the CS+ preference (49%) but also markedly reduced overall CS intake. In separate acquisition studies, rats received VEH or NTX (0.1, 0.5, 1mg/kg) or MK-801 (100 μg/kg) 0.5h prior to 1-bottle training trials with CS+/3.5% CO and CS-/0.9% CO training solutions. Additional Limited VEH groups were trained with intakes limited to that of the NTX and MK-801 groups. Subsequent two-bottle CS+ vs. CS- tests were conducted without injections. Significant and persistent CS+ preferences were observed in VEH (77-84%) and Limited VEH (88%) groups. NTX treatment during training failed to block the acquisition of CO-CFP although the magnitude of the CS+ preference was reduced by 0.5 (70%) and 1.0 (72%) mg/kg doses relative to the Limited VEH treatment (88%). In contrast, MK-801 (100 μg/kg) treatment during training blocked the acquisition of the CO-CFP. These data suggest a critical role for NMDA, but not opioid receptor signaling in the acquisition of a fat conditioned flavor preferences, and at best limited involvement of NMDA and opioid receptors in the expression of a previously learned preference.

Potentiation of dopamine D1-like receptor signaling by concomitant activation of δ- and μ-opioid receptors in mouse medial prefrontal cortex

Opioid receptors located in the ventral tegmental area are known to regulate dopamine (DA) release from mesocortical afferents to medial prefrontal cortex (mPFC) but little is known on whether in this cortical region activation of opioid receptors affect DA receptor signaling. In the present study we show that in mouse mPFC concomitant activation of either δ- or μ-opioid receptors, but not κ-opioid receptors, potentiated DA D1-like receptor-induced stimulation of adenylyl cyclase activity through a G protein βγ subunit-dependent mechanism. In tissue slices of mPFC, the combined addition of the opioid agonist leu-enkephalin and the DA D1-like receptor agonist SKF 81297 produced more than additive increase in the phosphorylation state of AMPA and NMDA receptor subunits GluR1 and NR1, respectively. Moreover, in primary cultures of mouse frontal cortex neurons, DA D1-like receptor-induced Ser133 phosphorylation of the transcription factor cyclic AMP responsive element binding protein was potentiated by concurrent stimulation of opioid receptors. Double immunofluorescence analysis of cultured cortical cells indicated that a large percentage of DA D1 receptor positive cells expressed either δ- or μ-opioid receptor immunoreactivity. These data indicate that in mouse mPFC activation of μ- and δ-opioid receptors enhances DA D1-like receptor signaling likely through converging regulatory inputs on βγ-stimulated adenylyl cyclase isoforms. This previously unrecognized synergistic interaction may selectively affect DA D1 transmission at specific postsynaptic sites where the receptors are co-localized and may play a role in prefrontal DA D1 regulation of opioid addiction.

Dopamine signaling in the medial prefrontal cortex and amygdala is required for the acquisition of fructose-conditioned flavor preferences in rats

Systemic administration of dopamine (DA) D1 (SCH23390: SCH) and D2 (raclopride: RAC) antagonists blocked both acquisition and expression of fructose-conditioned flavor preferences (CFP). It is unclear what brain circuits are involved in mediating these effects. The present study investigated DA signaling within the nucleus accumbens shell (NAcS), amygdala (AMY) and medial prefrontal cortex (mPFC) in the acquisition and expression of fructose-CFP. In Experiment 1, separate groups of rats were injected daily in the NAcS or AMY with saline, SCH (24 nmol) or RAC (24 nmol) prior to training sessions with a flavor (CS+) mixed with 8% fructose and 0.2% saccharin (CS+/F) and a different flavor (CS-) mixed with only 0.2% saccharin. In the two-bottle choice tests with 0.2% saccharin, only rats injected with RAC in the AMY failed to acquire a CS+ preference (45-54%). In Experiment 2, new rats were identically trained, but saline, SCH and RAC were injected in the mPFC. In subsequent two-bottle choice tests, SCH- and RAC-treated rats failed to exhibit a CS+ preference (50-56%). In Experiment 3, new rats were trained with CS+/F and CS- without injections. Subsequent two-bottle choice tests were then conducted following bilateral injections of SCH or RAC in the mPFC at total doses of 0, 12, 24 and 48 nmol. Expression of the CS+ preference failed to be affected by either antagonist, indicating that the mPFC is not involved in the maintenance of this preference. These data indicate that the acquisition of fructose-CFP is dependent on DA signaling in the mPFC and AMY.

Changes in nucleus accumbens and neostriatal c-Fos and DARPP-32 immunoreactivity during different stages of food-reinforced instrumental training

Nucleus accumbens is involved in several aspects of instrumental behavior, motivation and learning. Recent studies showed that dopamine (DA) release in the accumbens shell was significantly increased on the first day of training on a fixed ratio (FR) 5 schedule (i.e. the transition from FR1 to FR5) compared with those rats that continued FR1 training, even though the rats on their first day of FR5 training received less food reinforcement than rats continuing on the FR1 schedule. Additionally, the second day of FR5 responding was marked by a significant increase in DA release in accumbens core. The present studies employed immunohistochemical methods to characterize the changes in cellular markers of accumbens and neostriatal neural activity that occur during various stages of food-reinforced FR5 training. c-Fos and DARPP-32 immunoreactivity in accumbens shell was significantly increased on the first day of FR5 training, while core c-Fos and DARPP-32 expression showed large increases on the second day of FR5 training. Additional studies showed that c-Fos and DARPP-32 expression in neostriatum increased after more extensive training. Double-labeling studies with immunofluorescence methods indicated that increases in accumbens c-Fos and DARPP-32 expression were primarily seen in substance-P-positive neurons. These increases in accumbens c-Fos and DARPP-32 immunoreactivity seen during the initial phases of FR training may reflect several factors, including novelty, learning, stress or the presentation of a work-related challenge to the organism. Moreover, it appears that the separate subregions of the striatal complex are differentially activated at distinct phases of instrumental training.

Melanocortin 4 receptor signaling in dopamine 1 receptor neurons is required for procedural memory learning

It is now widely recognized that exposure to palatable foods engages reward circuits that promote over-eating and facilitate the development of obesity. While the melanocortin 4 receptor (MC4R) has previously been shown to regulate food intake and energy expenditure, little is known about its role in food reward. We demonstrate that MC4R is co-expressed with the dopamine 1 receptor (D1R) in the ventral striatum. While MC4R-null mice are hyperphagic and obese, they exhibit impairments in acquisition of operant responding for a high fat reinforcement. Restoration of MC4R signaling in D1R neurons normalizes procedural learning without affecting motivation to obtain high fat diet. MC4R signaling in D1R neurons is also required for learning in a non-food-reinforced version of the cued water maze. Finally, MC4R signaling in neostriatal slices increases phosphorylation of the Thr34 residue of DARPP-32, a protein phosphatase-1 inhibitor that regulates synaptic plasticity. These data identify a novel requirement for MC4R signaling in procedural memory learning.

Glucose-monitoring neurons in the mediodorsal prefrontal cortex

The mediodorsal prefrontal cortex (mdPFC), a key structure of the limbic neural circuitry, plays important roles in the central regulation of feeding. As an integrant part of the forebrain dopamine (DA) system, it performs complex roles via interconnections with various brain areas where glucose-monitoring (GM) neurons have been identified. The main goal of the present experiments was to examine whether similar GM neurons exist in the mediodorsal prefrontal cortex. To search for such chemosensory cells here, and to estimate their involvement in the DA circuitry, extracellular single neuron activity of the mediodorsal prefrontal cortex of anesthetized Wistar and Sprague-Dawley rats was recorded by means of tungsten wire multibarreled glass microelectrodes during microelectrophoretic administration of d-glucose and DA. One fourth of the neurons tested changed in firing rate in response to glucose, thus, proved to be elements of the forebrain GM neural network. DA responsive neurons in the mdPFC were found to represent similar proportion of all cells; the glucose-excited units were shown to display excitatory whereas the glucose-inhibited neurons were demonstrated to exert mainly inhibitory responses to dopamine. The glucose-monitoring neurons of the mdPFC and their distinct DA sensitivity are suggested to be of particular significance in adaptive processes of the central feeding control.

Slow phasic changes in nucleus accumbens dopamine release during fixed ratio acquisition: a microdialysis study

Nucleus accumbens dopamine (DA) is a critical component of the brain circuitry regulating behavioral output during reinforcement-seeking behavior. Several studies have investigated the characteristics of accumbens DA release during the performance of well-learned operant behaviors, but relatively few have focused on the initial acquisition of particular instrumental behaviors or operant schedules. The present experiments focused on the initial acquisition of operant performance on a reinforcement schedule by studying the transition from a fixed ratio 1 (FR1) schedule to another operant schedule with a higher ratio requirement (i.e. fixed ratio 5 [FR5]). Microdialysis sessions were conducted in different groups of rats that were tested on either the FR1 schedule; the first, second, or third day of FR5 training; or after weeks of FR5 training. Consistent with previous studies, well-trained rats performing on the FR5 schedule after weeks of training showed significant increases in extracellular DA in both core and shell subregions of nucleus accumbens during the behavioral session. On the first day of FR5 training, there was a substantial increase in DA release in nucleus accumbens shell (i.e. approximately 300% of baseline). In contrast, accumbens core DA release was greatest on the second day of FR5 training. In parallel experiments, DA release in core and shell subregions did not significantly increase during free consumption of the same high carbohydrate food pellets that were used in the operant experiments, despite the very high levels of food intake in experienced rats. However, in rats exposed to the high-carbohydrate food for the first time, there was a tendency for extracellular DA to show a small increase. These results demonstrate that transient increases in accumbens DA release occur during the initial acquisition of ratio performance, and suggest that core and shell subregions show different temporal patterns during acquisition of instrumental behavior.

Variation of the gene coding for DARPP-32 (PPP1R1B) and brain connectivity during associative emotional learning

Associative emotional learning, which is important for the social emotional functioning of individuals and is often impaired in psychiatric illnesses, is in part mediated by dopamine and glutamate pathways in the brain. The protein DARPP-32 is involved in the regulation of dopaminergic and glutaminergic signaling. Consequently, it has been suggested that the haplotypic variants of the gene PPP1R1B that encodes DARPP-32 are associated with working memory and emotion processing. We hypothesized that PPP1R1B should have a significant influence on the network of brain regions involved in associative emotional learning that are rich in DARPP-32, namely the striatum, prefrontal cortex (comprising the medial frontal gyrus and inferior frontal gyrus (IFG)), amygdala and parahippocampal gyrus (PHG). Dynamic causal models were applied to functional MRI data to investigate how brain connectivity during an associative emotional learning task is affected by different single-nucleotide polymorphisms (SNPs) of PPP1R1B: rs879606, rs907094 and rs3764352. Compared to heterozygotes, homozygotes with GTA alleles displayed increased intrinsic connectivity between the IFG and PHG, as well as increased excitability of the PHG for negative emotional stimuli. We have also elucidated the directionality of these genetic influences. Our data suggest that homozygotes with GTA alleles involve stronger functional connections between brain areas in order to maintain activation of these regions. Homozygotes might engage a greater degree of motivational learning and integration of information to perform the emotional learning task correctly. We conclude that PPP1R1B is associated with the neural network involved in associative emotional learning.

Differential effects of dopamine receptor D1-type and D2-type antagonists and phase of the estrous cycle on social learning of food preferences, feeding, and social interactions in mice

The neurobiological bases of social learning, by which an animal can 'exploit the expertise of others' and avoid the disadvantages of individual learning, are only partially understood. We examined the involvement of the dopaminergic system in social learning by administering a dopamine D1-type receptor antagonist, SCH23390 (0.01, 0.05, and 0.1 mg/kg), or a D2-type receptor antagonist, raclopride (0.1, 0.3, and 0.6 mg/kg), to adult female mice prior to socially learning a food preference. We found that while SCH23390 dose-dependently inhibited social learning without affecting feeding behavior or the ability of mice to discriminate between differently flavored diets, raclopride had the opposite effects, inhibiting feeding but leaving social learning unaffected. We showed that food odor, alone or in a social context, was insufficient to induce a food preference, proving the specifically social nature of this paradigm. The estrous cycle also affected social learning, with mice in proestrus expressing the socially acquired food preference longer than estrous and diestrous mice. This suggests gonadal hormone involvement, which is consistent with known estrogenic regulation of female social behavior and estrogen receptor involvement in social learning. Furthermore, a detailed ethological analysis of the social interactions during which social learning occurs showed raclopride- and estrous phase-induced changes in agonistic behavior, which were not directly related to effects on social learning. Overall, these results suggest a differential involvement of the D1-type and D2-type receptors in the regulation of social learning, feeding, and agonistic behaviors that are likely mediated by different underlying states.

Dopamine and learned food preferences

An early study performed in Bart Hoebel's laboratory suggested that dopamine (DA) signaling in the nucleus accumbens was involved in learned flavor preferences produced by post-oral nutritive feedback. This paper summarizes our studies investigating the role of DA in flavor preference conditioning using selective DA receptor antagonists. Food-restricted rats were trained to prefer a flavored saccharin solution (CS+) paired with intragastric (IG) sugar infusions over a flavored saccharin solution (CS-) paired with water infusions. Systemic injections of a D1-like receptor antagonist (SCH23390), but not a D2-like receptor antagonist (raclopride) during training blocked flavor preference learning. Neither drug prevented the expression of an already learned preference except at high doses that greatly suppressed total intakes. Central sites of action were examined by local microinjections of SCH23390 (12 nmol) during flavor training or testing. Drug infusions in the nucleus accumbens, amygdala, medial prefrontal cortex, or lateral hypothalamus during training blocked or attenuated CS+ flavor conditioning by IG glucose infusions. The same drug dose did not suppress the expression of a learned CS+ preference. The findings suggest that DA signaling within different components of a distributed brain network is involved in sugar-based flavor preferences. A possible role of DA in conditioned increases in flavor acceptance is discussed.