Coincident activation of NMDA and dopamine D1 receptors within the nucleus accumbens core is required for appetitive instrumental learning

Erasing "bad memories": reversing aberrant synaptic plasticity as therapy for neurological and psychiatric disorders

Dopamine modulates corticostriatal plasticity in both the direct and indirect pathways of the cortico-striato-thalamo-cortical (CSTC) loops. These gradual changes in corticostriatal synaptic strengths produce long-lasting changes in behavioral responses. Under normal conditions, these mechanisms enable the selection of the most appropriate responses while inhibiting others. However, under dysregulated dopamine conditions, including a lack of dopamine release or dopamine signaling, these mechanisms could lead to the selection of maladaptive responses and/or the inhibition of appropriate responses in an experience-dependent and task-specific manner. In this review, we propose that preventing or reversing such maladaptive synaptic strengths and erasing such aberrant "memories" could be a disease-modifying therapeutic strategy for many neurological and psychiatric disorders. We review evidence from Parkinson's disease, drug-induced parkinsonism, L-DOPA-induced dyskinesia, obsessive-compulsive disorder, substance use disorders, and depression as well as research findings on animal disease models. Altogether, these studies allude to an emerging theme in translational neuroscience and promising new directions for therapy development. Specifically, we propose that combining pharmacotherapy with behavioral therapy or with deep brain stimulation (DBS) could potentially cause desired changes in specific neural circuits. If successful, one important advantage of correcting aberrant synaptic plasticity is long-lasting therapeutic effects even after treatment has ended. We will also discuss the potential molecular targets for these therapeutic approaches, including the cAMP pathway, proteins involved in synaptic plasticity as well as pathways involved in new protein synthesis. We place special emphasis on RNA binding proteins and epitranscriptomic mechanisms, as they represent a new frontier with the distinct advantage of rapidly and simultaneously altering the synthesis of many proteins locally.

Dopaminergic neurons dynamically update sensory values during olfactory maneuver

Dopaminergic neurons (DANs) drive associative learning to update the value of sensory cues, but their contribution to the assessment of sensory values outside the context of association remains largely unexplored. Here, we show in Drosophila that DANs in the mushroom body encode the innate value of odors and constantly update the current value by inducing plasticity during olfactory maneuver. Our connectome-based network model linking all the way from the olfactory neurons to DANs reproduces the characteristics of DAN responses, proposing a concrete circuit mechanism for computation. Downstream of DANs, odors alone induce value- and dopamine-dependent changes in the activity of mushroom body output neurons, which store the current value of odors. Consistent with this neural plasticity, specific sets of DANs bidirectionally modulate flies' steering in a virtual olfactory environment. Thus, the DAN circuit known for discrete, associative learning also continuously updates odor values in a nonassociative manner.

Cellular bases for reward-related dopamine actions

Dopamine neurons exhibit transient increases and decreases in their firing rate upon reward and punishment for learning. This bidirectional modulation of dopamine dynamics occurs on the order of hundreds of milliseconds, and it is sensitively detected to reinforce the preceding sensorimotor events. These observations indicate that the mechanisms of dopamine detection at the projection sites are of remarkable precision, both in time and concentration. A major target of dopamine projection is the striatum, including the ventral region of the nucleus accumbens, which mainly comprises dopamine D1 and D2 receptor (D1R and D2R)-expressing spiny projection neurons. Although the involvement of D1R and D2R in dopamine-dependent learning has been suggested, the exact cellular bases for detecting transient dopamine signaling remain unclear. This review discusses recent cellular studies on the novel synaptic mechanisms for detecting dopamine transient signals associated with learning. Analyses of behavior based on these mechanisms have further revealed new behavioral aspects that are closely associated with these synaptic mechanisms. Thus, it is gradually possible to mechanistically explain behavioral learning via synaptic and cellular bases in rodents.

Administration of neuropeptide Y into the rat nucleus accumbens shell, but not core, attenuates the motivational impairment from systemic dopamine receptor antagonism by α-flupenthixol

Previous research has demonstrated that dopamine and Neuropeptide Y (NPY) promote motivated behavior, and there is evidence to suggest that they interact within neural circuitry involved in motivation. NPY and dopamine both modulate appetitive motivation towards food through direct actions in the nucleus accumbens (NAc), although how they interact in this region to promote motivation is presently unclear. In this study, we sought to further elucidate the relationship between NAc NPY and dopamine and their effects on motivated behavior. Specifically, we examined whether NAc injections of NPY might reverse behavioral deficits caused by reduced dopamine signaling due to systemic dopamine receptor antagonism. Appetitive motivation was measured using a progressive ratio-2 paradigm. Male Sprague Dawley rats were treated with systemic injections of the dopamine antagonist, α-flupenthixol or a saline vehicle. Two hours following injections, they were administered infusions of NPY (at 0, 156, or 235 pmol) into either the NAc shell (n = 12) or the NAc core (n = 10) and were placed in operant chambers. In both groups, α-flupenthixol impaired performance on the PR-2 task. NPY receptor stimulation of the NAc shell significantly increased both breakpoint and active lever presses during the PR-2 task, and dose-dependently increased responding following systemic dopamine receptor blockade. NPY did not affect appetitive motivation when injected into the NAc core. These data demonstrate that NPY in the NAc shell can improve motivational impairments that result from dopamine antagonism, and that these effects are site specific. These results also suggest that upregulation of NPY in neurodegenerative diseases may possibly buffer early motivational deficits caused by dopamine depletion in Parkinson's and Huntington's disease patients, both of which show increased NPY expression after disease onset.

Alcohol and cannabinoid binges and daily exposure to nicotine in adolescent/young adult rats induce sex-dependent long-term appetitive instrumental learning impairment

Adolescence is a critical developmental period, concerning anatomical, neurochemical and behavioral changes. Moreover, adolescents are more sensitive to the long-term deleterious effects of drug abuse. Binge-like consumption of alcohol and marijuana, along with tobacco smoking, is a dangerous pattern often observed in adolescents during weekends. Nevertheless, the long-term effect of their adolescent co-exposure has not been yet experimentally investigated. Long-Evans adolescent male (n = 20) and female (n = 20) rats from postnatal day 30 (P30) until P60 were daily treated with nicotine (0.3 mg/kg, i.p.), and, on two consecutive 'binging days' per week (for a total of eight times), received an intragastric ethanol solution (3 g/kg) and an intraperitoneal (i.p.) dose of cannabinoid 1/2 receptor agonist WIN55,212-2 (1.2 mg/kg). These rats were tested after treatment discontinuation at > P90 for associative food-rewarded operant learning in the two-lever conditioning chambers for six consecutive days on a fixed ratio 1 (FR1) schedule followed by another six days of daily FR2 schedule testing, after 42 days rest. We found the main effects of sex x treatment interactions in FR1 but not in FR2 experiments. Treated females show attenuated operant responses for food pellets during all FR1 and the FR2 schedule, whilst the treated males show an impairment in FR2 but not in the FR1 schedule. Moreover, the treated females' percentage of learners was significantly lower than female controls in FR1 while treated males were lower than controls in FR2. Our findings suggest that intermittent adolescent abuse of common drugs, such as alcohol and marijuana, and chronic tobacco exposure can cause significant long-term effects on motivation for natural reinforcers later in adulthood in both sexes. Females appear to be sensitive earlier to the deleterious effects of adolescent polydrug abuse, with both sexes having an increased likelihood of developing lifelong brain alterations.

Removal of reinforcement improves instrumental performance in humans by decreasing a general action bias rather than unmasking learnt associations

Performance during instrumental learning is commonly believed to reflect the knowledge that has been acquired up to that point. However, recent work in rodents found that instrumental performance was enhanced during periods when reinforcement was withheld, relative to periods when reinforcement was provided. This suggests that reinforcement may mask acquired knowledge and lead to impaired performance. In the present study, we investigated whether such a beneficial effect of removing reinforcement translates to humans. Specifically, we tested whether performance during learning was improved during non-reinforced relative to reinforced task periods using signal detection theory and a computational modelling approach. To this end, 60 healthy volunteers performed a novel visual go/no-go learning task with deterministic reinforcement. To probe acquired knowledge in the absence of reinforcement, we interspersed blocks without feedback. In these non-reinforced task blocks, we found an increased d', indicative of enhanced instrumental performance. However, computational modelling showed that this improvement in performance was not due to an increased sensitivity of decision making to learnt values, but to a more cautious mode of responding, as evidenced by a reduction of a general response bias. Together with an initial tendency to act, this is sufficient to drive differential changes in hit and false alarm rates that jointly lead to an increased d'. To conclude, the improved instrumental performance in the absence of reinforcement observed in studies using asymmetrically reinforced go/no-go tasks may reflect a change in response bias rather than unmasking latent knowledge.

Catecholaminergic cell type-specific expression of Cre recombinase in knock-in transgenic rats generated by the Combi-CRISPR technology

BACKGROUND

Cell groups containing catecholamines provide a useful model to study the molecular and cellular mechanisms underlying the morphogenesis, physiology, and pathology of the central nervous system. For this purpose, it is necessary to establish a system to induce catecholaminergic group-specific expression of Cre recombinase. Recently, we introduced a gene cassette encoding 2A peptide fused to Cre recombinase into the site between the C-terminus and translational termination codons of the rat tyrosine hydroxylase (TH) open reading frame by the Combi-CRISPR technology, which is a genomic editing method to enable an efficient knock-in (KI) of long DNA sequence into a target site. However, the expression patterns of the transgene and its function as well as the effect of the mutation on the biochemical and behavioral phenotypes in the KI strains have not been characterized yet.

NEW METHOD

We aimed to evaluate the usefulness of TH-Cre KI rats as an experimental model for investigating the structure and function of catecholaminergic neurons in the brain.

RESULTS

We detected cell type-specific expression of Cre recombinase and site-specific recombination activity in the representative catecholaminergic groups in the TH-Cre KI rat strains. In addition, we measured TH protein levels and catecholamine accumulation in the brain regions, as well as motor, reward-related, and anxiety-like behaviors, indicating that catecholamine metabolism and general behavior are apparently normal in these KI rats.

CONCLUSIONS

TH-Cre KI rat strains produced by the Combi-CRISPR system offer a beneficial model to study the molecular and cellular mechanics for the morphogenesis, physiology, and pathology of catecholamine-containing neurons in the brain.

A molecularly defined D1 medium spiny neuron subtype negatively regulates cocaine addiction

The striatum plays a critical role in regulating addiction-related behaviors. The conventional dichotomy model suggests that striatal D1/D2 medium spiny neurons (MSNs) positively/negatively regulate addiction-related behaviors. However, this model does not account for the neuronal heterogeneity and functional diversity of the striatum, and whether MSN subtypes beyond the pan-D1/D2 populations play distinct roles in drug addiction remains unknown. We characterized the role of a tachykinin 2-expressing D1 MSN subtype (Tac2+), present in both rodent and primate striatum, using cocaine addiction mouse models. We found that acute cocaine administration reduces Tac2 neuronal activity, and cocaine conditioning alters neuronal response related to cocaine reward contextual associations. In addition, activation/inhibition of Tac2+ neurons attenuates/promotes cocaine-induced conditioned place preference and cocaine intravenous self-administration. Furthermore, stimulation of the NAc-to-lateral hypothalamic projection of Tac2+ neurons suppresses cocaine reward behavior. Our study reveals an unconventional negative regulatory function of D1 MSNs in drug addiction that operates in a subtype- and projection-specific manner.

Striatal dopamine signals are region specific and temporally stable across action-sequence habit formation

Habits are automatic, inflexible behaviors that develop slowly with repeated performance. Striatal dopamine signaling instantiates this habit-formation process, presumably region specifically and via ventral-to-dorsal and medial-to-lateral signal shifts. Here, we quantify dopamine release in regions implicated in these presumed shifts (ventromedial striatum [VMS], dorsomedial striatum [DMS], and dorsolateral striatum [DLS]) in rats performing an action-sequence task and characterize habit development throughout a 10-week training. Surprisingly, all regions exhibited stable dopamine dynamics throughout habit development. VMS and DLS signals did not differ between habitual and non-habitual animals, but DMS dopamine release increased during action-sequence initiation and decreased during action-sequence completion in habitual rats, whereas non-habitual rats showed opposite effects. Consistently, optogenetic stimulation of DMS dopamine release accelerated habit formation. Thus, we demonstrate that dopamine signals do not shift regionally during habit formation and that dopamine in DMS, but not VMS or DLS, determines habit bias, attributing "habit functions" to a region previously associated exclusively with non-habitual behavior.

Intra-dorsal striatal acetylcholine M1 but not dopaminergic D1 or glutamatergic NMDA receptor antagonists inhibit consolidation of duration memory in interval timing

The striatal beat frequency model assumes that striatal medium spiny neurons encode duration via synaptic plasticity. Muscarinic 1 (M1) cholinergic receptors as well as dopamine and glutamate receptors are important for neural plasticity in the dorsal striatum. Therefore, we investigated the effect of inhibiting these receptors on the formation of duration memory. After sufficient training in a peak interval (PI)-20-s procedure, rats were administered a single or mixed infusion of a selective antagonist for the dopamine D1 receptor (SCH23390, 0.5 µg per side), N-methyl-D-aspartic acid (NMDA)-type glutamate receptor (D-AP5, 3 µg), or M1 receptor (pirenzepine, 10 µg) bilaterally in the dorsal striatum, immediately before initiating a PI-40 s session (shift session). The next day, the rats were tested for new duration memory (40 s) in a session in which no lever presses were reinforced (test session). In the shift session, the performance was comparable irrespective of the drug injected. However, in the test session, the mean peak time (an index of duration memory) of the M1 + NMDA co-blockade group, but not of the D1 + NMDA co-blockade group, was lower than that of the control group (Experiments 1 and 2). In Experiment 3, the effect of the co-blockade of M1 and NMDA receptors was replicated. Moreover, sole blockade of M1 receptors induced the same effect as M1 and NMDA blockade. These results suggest that in the dorsal striatum, the M1 receptor, but not the D1 or NMDA receptors, is involved in the consolidation of duration memory.

A behavioural correlate of the synaptic eligibility trace in the nucleus accumbens

Reward reinforces the association between a preceding sensorimotor event and its outcome. Reinforcement learning (RL) theory and recent brain slice studies explain the delayed reward action such that synaptic activities triggered by sensorimotor events leave a synaptic eligibility trace for 1 s. The trace produces a sensitive period for reward-related dopamine to induce synaptic plasticity in the nucleus accumbens (NAc). However, the contribution of the synaptic eligibility trace to behaviour remains unclear. Here we examined a reward-sensitive period to brief pure tones with an accurate measurement of an effective timing of water reward in head-fixed Pavlovian conditioning, which depended on the plasticity-related signaling in the NAc. We found that the reward-sensitive period was within 1 s after the pure tone presentation and optogenetically-induced presynaptic activities at the NAc, showing that the short reward-sensitive period was in conformity with the synaptic eligibility trace in the NAc. These findings support the application of the synaptic eligibility trace to construct biologically plausible RL models.

Functional dissociation of behavioral effects from acetylcholine and glutamate released from cholinergic striatal interneurons

In the striatum, cholinergic interneurons (CINs) have the ability to release both acetylcholine and glutamate, due to the expression of the vesicular acetylcholine transporter (VAChT) and the vesicular glutamate transporter 3 (VGLUT3). However, the relationship these neurotransmitters have in the regulation of behavior is not fully understood. Here we used reward‐based touchscreen tests in mice to assess the individual and combined contributions of acetylcholine/glutamate co‐transmission in behavior. We found that reduced levels of the VAChT from CINs negatively impacted dopamine signalling in response to reward, and disrupted complex responses in a sequential chain of events. In contrast, diminished VGLUT3 levels had somewhat opposite effects. When mutant mice were treated with haloperidol in a cue‐based task, the drug did not affect the performance of VAChT mutant mice, whereas VGLUT3 mutant mice were highly sensitive to haloperidol. In mice where both vesicular transporters were deleted from CINs, we observed altered reward‐evoked dopaminergic signalling and behavioral deficits that resemble, but were worse, than those in mice with specific loss of VAChT alone. These results demonstrate that the ability to secrete two different neurotransmitters allows CINs to exert complex modulation of a wide range of behaviors.

Astrocytes in Addictive Disorders

Astroglia are key regulators of synaptic function, playing central roles in homeostatic ion buffering, energy dynamics, transmitter uptake, maintenance of neurotransmitter pools, and regulation of synaptic plasticity through release of neuroactive chemicals. Given the myriad of crucial homeostatic and signaling functions attributed to astrocytes and the variety of neurotransmitter receptors expressed by astroglia, they serve as prime cellular candidates for establishing maladaptive synaptic plasticity following drug exposure. Initial studies on astroglia and addiction have placed drug-mediated disruptions in the homeostatic regulation of glutamate as a central aspect of relapse vulnerability. However, the generation of sophisticated tools to study and manipulate astroglia have proven that the interaction between addictive substances, astroglia, and relapse-relevant synaptic plasticity extends far beyond the homeostatic regulation of glutamate. Here we present astroglial systems impacted by drug exposure and discuss how changes in astroglial biology contribute to addiction biology.

Decoding molecular and cellular heterogeneity of mouse nucleus accumbens

The nucleus accumbens (NAc) plays an important role in regulating multiple behaviors, and its dysfunction has been linked to many neural disorders. However, the molecular, cellular and anatomic heterogeneity underlying its functional diversity remains incompletely understood. In this study, we generated a cell census of the mouse NAc using single-cell RNA sequencing and multiplexed error-robust fluorescence in situ hybridization, revealing a high level of cell heterogeneity in this brain region. Here we show that the transcriptional and spatial diversity of neuron subtypes underlie the NAc's anatomic and functional heterogeneity. These findings explain how the seemingly simple neuronal composition of the NAc achieves its highly heterogenous structure and diverse functions. Collectively, our study generates a spatially resolved cell taxonomy for understanding the structure and function of the NAc, which demonstrates the importance of combining molecular and spatial information in revealing the fundamental features of the nervous system.

Opposing roles for striatonigral and striatopallidal neurons in dorsolateral striatum in consolidating new instrumental actions

Comparatively little is known about how new instrumental actions are encoded in the brain. Using whole-brain c-Fos mapping, we show that neural activity is increased in the anterior dorsolateral striatum (aDLS) of mice that successfully learn a new lever-press response to earn food rewards. Post-learning chemogenetic inhibition of aDLS disrupts consolidation of the new instrumental response. Similarly, post-learning infusion of the protein synthesis inhibitor anisomycin into the aDLS disrupts consolidation of the new response. Activity of D1 receptor-expressing medium spiny neurons (D1-MSNs) increases and D2-MSNs activity decreases in the aDLS during consolidation. Chemogenetic inhibition of D1-MSNs in aDLS disrupts the consolidation process whereas D2-MSN inhibition strengthens consolidation but blocks the expression of previously learned habit-like responses. These findings suggest that D1-MSNs in the aDLS encode new instrumental actions whereas D2-MSNs oppose this new learning and instead promote expression of habitual actions.

Neuromodulated Dopamine Plastic Networks for Heterogeneous Transfer Learning with Hebbian Principle

The plastic modifications in synaptic connectivity is primarily from changes triggered by neuromodulated dopamine signals. These activities are controlled by neuromodulation, which is itself under the control of the brain. The subjective brain’s self-modifying abilities play an essential role in learning and adaptation. The artificial neural networks with neuromodulated plasticity are used to implement transfer learning in the image classification domain. In particular, this has application in image detection, image segmentation, and transfer of learning parameters with significant results. This paper proposes a novel approach to enhance transfer learning accuracy in a heterogeneous source and target, using the neuromodulation of the Hebbian learning principle, called NDHTL (Neuromodulated Dopamine Hebbian Transfer Learning). Neuromodulation of plasticity offers a powerful new technique with applications in training neural networks implementing asymmetric backpropagation using Hebbian principles in transfer learning motivated CNNs (Convolutional neural networks). Biologically motivated concomitant learning, where connected brain cells activate positively, enhances the synaptic connection strength between the network neurons. Using the NDHTL algorithm, the percentage of change of the plasticity between the neurons of the CNN layer is directly managed by the dopamine signal’s value. The discriminative nature of transfer learning fits well with the technique. The learned model’s connection weights must adapt to unseen target datasets with the least cost and effort in transfer learning. Using distinctive learning principles such as dopamine Hebbian learning in transfer learning for asymmetric gradient weights update is a novel approach. The paper emphasizes the NDHTL algorithmic technique as synaptic plasticity controlled by dopamine signals in transfer learning to classify images using source-target datasets. The standard transfer learning using gradient backpropagation is a symmetric framework. Experimental results using CIFAR-10 and CIFAR-100 datasets show that the proposed NDHTL algorithm can enhance transfer learning efficiency compared to existing methods.

Integrating the Roles of Midbrain Dopamine Circuits in Behavior and Neuropsychiatric Disease

Dopamine (DA) is a behaviorally and clinically diverse neuromodulator that controls CNS function. DA plays major roles in many behaviors including locomotion, learning, habit formation, perception, and memory processing. Reflecting this, DA dysregulation produces a wide variety of cognitive symptoms seen in neuropsychiatric diseases such as Parkinson’s, Schizophrenia, addiction, and Alzheimer’s disease. Here, we review recent advances in the DA systems neuroscience field and explore the advancing hypothesis that DA’s behavioral function is linked to disease deficits in a neural circuit-dependent manner. We survey different brain areas including the basal ganglia’s dorsomedial/dorsolateral striatum, the ventral striatum, the auditory striatum, and the hippocampus in rodent models. Each of these regions have different reported functions and, correspondingly, DA’s reflecting role in each of these regions also has support for being different. We then focus on DA dysregulation states in Parkinson’s disease, addiction, and Alzheimer’s Disease, emphasizing how these afflictions are linked to different DA pathways. We draw upon ideas such as selective vulnerability and region-dependent physiology. These bodies of work suggest that different channels of DA may be dysregulated in different sets of disease. While these are great advances, the fine and definitive segregation of such pathways in behavior and disease remains to be seen. Future studies will be required to define DA’s necessity and contribution to the functional plasticity of different striatal regions.

Nerve injury alters restraint-induced activation of the basolateral amygdala in male rats

The amygdala is critical for the production of appropriate responses towards emotional or stressful stimuli. It has a characteristic neuronal activation pattern to acute stressors. Chronic pain and acute stress have each been shown to independently modulate the activity of the amygdala. Few studies have investigated the effect of pain or injury, on amygdala activation to acute stress. This study investigated the effects of a neuropathic injury on the activation response of the amygdala to an acute restraint stress. Chronic constriction injury of the right sciatic nerve (CCI) was used to create neuropathic injury and a single brief 15-min acute restraint was used as an emotional/psychological stressor. All rats received cholera toxin B (CTB) retrograde tracer injections into the medial prefrontal cortex (mPFC) to assess if the amygdala to mPFC pathway was specifically regulated by the combination of neuropathic injury and acute stress. To assess differential patterns of activity in amygdala subregions, cFos expression was used as a marker for "acute", restraint triggered neuronal activation, and FosB/ΔFosB expression was used to reveal prolonged neuronal activation/sensitisation triggered by CCI. Restraint resulted in a characteristic increase in cFos expression in the medial amygdala, which was not altered by CCI. Rats with a CCI showed increased cFos expression in the basolateral amygdala (BLA), in response to an acute restraint stress, but not in neurons projecting to the prefrontal cortex. Further, CCI rats showed an increase in FosB/ΔFosB expression which was exclusive to the BLA. This increase likely reflects sensitisation of the BLA as a consequence of nerve injury which may contribute to heightened sensitivity of BLA neurons to acute emotional/ psychological stressors.

Regulation of CREB Phosphorylation in Nucleus Accumbens after Relief Conditioning

Relief learning is the association of environmental cues with the cessation of aversive events. While there is increasing knowledge about the neural circuitry mediating relief learning, the respective molecular pathways are not known. Therefore, the aim of the present study was to examine different putative molecular pathways underlying relief learning. To this purpose, male rats were subjected either to relief conditioning or to a pseudo conditioning procedure. Forty-five minutes or 6 h after conditioning, samples of five different brain regions, namely the prefrontal cortex, nucleus accumbens (NAC), dorsal striatum, dorsal hippocampus, and amygdala, were collected. Using quantitative Western blots, the expression level of CREB, pCREB, ERK1/2, pERK1/2, CaMKIIα, MAP2K, PKA, pPKA, Akt, pAkt, DARPP-32, pDARPP-32, 14-3-3, and neuroligin2 were studied. Our analyses revealed that relief conditioned rats had higher CREB phosphorylation in NAC 6 h after conditioning than pseudo conditioned rats. The data further revealed that this CREB phosphorylation was mainly induced by dopamine D1 receptor-mediated activation of PKA, however, other kinases, downstream of the NMDA receptor, may also contribute. Taken together, the present study suggests that CREB phosphorylation, induced by a combination of different molecular pathways downstream of dopamine D1 and NMDA receptors, is essential for the acquisition and consolidation of relief learning.

Shifting motivational states: The effects of nucleus accumbens dopamine and opioid receptor activation on a modified effort-based choice task

The nucleus accumbens (NAc) is critical for regulating the appetitive and consummatory phases of motivated behavior. These experiments examined the effects of dopamine and opioid receptor manipulations within the NAc during an effort-based choice task that allowed for simultaneous assessment of both phases of motivation. Male Sprague-Dawley rats received bilateral guide cannulas targeting the NAc core and were tested in 1-hr sessions with free access to rat chow and the choice to work for sugar pellets on a progressive ratio 2 (PR2) reinforcement schedule. Individual groups of rats were tested following stimulation or blockade of NAc D1-like or D2-like receptors, stimulation of μ-, δ-, or κ-opioid receptors, or antagonism of opioid receptors. Behavior was examined under ad libitum conditions and following 23-h food restriction. NAc blockade of the D1-like receptors or stimulation of the D2 receptor reduced break point for earning sugar pellets; D2 receptor stimulation also modestly lowered chow intake. NAc μ-opioid receptor stimulation increased intake of the freely-available chow while simultaneously reducing break point for the sugar pellets. In non-restricted conditions, δ-opioid receptor stimulation increased both food intake and breakpoint. There were no effects of stimulating NAc D1 or κ receptors, nor did blocking D2 or opioid receptors affect task behavior. These data support prior literature linking dopamine to appetitive motivational processes, and suggest that μ- and δ-opioid receptors affect food-directed motivation differentially. Specifically, μ-opioid receptors shifted behavior towards consumption, and δ-opioid receptor enhanced both sugar-seeking and consumption of the pabulum chow when animals were not food restricted.

The role of nucleus accumbens CREB attenuation in rescuing low voluntary running behavior in female rats

Given the integral role of nucleus accumbens (NAc) cAMP response element binding protein (CREB) activity in motivational processes, the goal of the current study was to determine whether blunting chronic NAc CREB activity could rescue the low physical activity motivation of female, low voluntary running (LVR) rats. NAc CREB phosphorylation is elevated in these rats, a state previously attributed to deficits in reward valuation. It was recently shown that overexpression of the upstream CREB inhibitor, protein kinase inhibitor alpha (PKIα), increased LVR nightly running by ~threefold. Therefore, the current study addresses the extent to which NAc CREB attenuation influences female LVR and wild-type (WT) wheel-running behavior. Inducible reductions in NAc neuronal activity using Gi-coupled hM4Di DREADDs increased running behavior in LVR, but not in WT, rats. Similarly, site-directed pharmacological inhibition of NAc CREB activity significantly increased LVR nightly running distance and time by ~twofold, with no effect in WT rats. Finally, environmentally enriched LVR rats exhibit higher levels of running compared to socially isolated rats in what appeared to be a CREB-related manner. Considering the positive outcomes of upstream CREB modulation and environmental enrichment on LVR behavior, we believe that blunting NAc CREB activity has the neuromolecular potential to partially reverse low physical activity motivation, as exemplified by the LVR model. The positive physical activity outcome of early life enrichment adds translatable value to human childhood enrichment and highlights its importance on motivational processes later in life.

Dopamine and Addiction

Addiction is commonly identified with habitual nonmedical self-administration of drugs. It is usually defined by characteristics of intoxication or by characteristics of withdrawal symptoms. Such addictions can also be defined in terms of the brain mechanisms they activate; most addictive drugs cause elevations in extracellular levels of the neurotransmitter dopamine. Animals unable to synthesize or use dopamine lack the conditioned reflexes discussed by Pavlov or the appetitive behavior discussed by Craig; they have only unconditioned consummatory reflexes. Burst discharges (phasic firing) of dopamine-containing neurons are necessary to establish long-term memories associating predictive stimuli with rewards and punishers. Independent discharges of dopamine neurons (tonic or pacemaker firing) determine the motivation to respond to such cues. As a result of habitual intake of addictive drugs, dopamine receptors expressed in the brain are decreased, thereby reducing interest in activities not already stamped in by habitual rewards.

Dopamine D2 receptors in discrimination learning and spine enlargement

Dopamine D2 receptors (D2Rs) are densely expressed in the striatum and have been linked to neuropsychiatric disorders such as schizophrenia^1,2. High-affinity binding of dopamine suggests that D2Rs detect transient reductions in dopamine concentration (the dopamine dip) during punishment learning^3-5. However, the nature and cellular basis of D2R-dependent behaviour are unclear. Here we show that tone reward conditioning induces marked stimulus generalization in a manner that depends on dopamine D1 receptors (D1Rs) in the nucleus accumbens (NAc) of mice, and that discrimination learning refines the conditioning using a dopamine dip. In NAc slices, a narrow dopamine dip (as short as 0.4 s) was detected by D2Rs to disinhibit adenosine A_2A receptor (A_2AR)-mediated enlargement of dendritic spines in D2R-expressing spiny projection neurons (D2-SPNs). Plasticity-related signalling by Ca²⁺/calmodulin-dependent protein kinase II and A_2ARs in the NAc was required for discrimination learning. By contrast, extinction learning did not involve dopamine dips or D2-SPNs. Treatment with methamphetamine, which dysregulates dopamine signalling, impaired discrimination learning and spine enlargement, and these impairments were reversed by a D2R antagonist. Our data show that D2Rs refine the generalized reward learning mediated by D1Rs.

rTMS-Induced Changes in Glutamatergic and Dopaminergic Systems: Relevance to Cocaine and Methamphetamine Use Disorders

Cocaine use disorder and methamphetamine use disorder are chronic, relapsing disorders with no US Food and Drug Administration-approved interventions. Repetitive transcranial magnetic stimulation (rTMS) is a non-invasive brain stimulation tool that has been increasingly investigated as a possible therapeutic intervention for substance use disorders. rTMS may have the ability to induce beneficial neuroplasticity in abnormal circuits and networks in individuals with addiction. The aim of this review is to highlight the rationale and potential for rTMS to treat cocaine and methamphetamine dependence: we synthesize the outcomes of studies in healthy humans and animal models to identify and understand the neurobiological mechanisms of rTMS that seem most involved in addiction, focusing on the dopaminergic and glutamatergic systems. rTMS-induced changes to neurotransmitter systems include alterations to striatal dopamine release and metabolite levels, as well as to glutamate transporter and receptor expression, which may be relevant for ameliorating the aberrant plasticity observed in individuals with substance use disorders. We also discuss the clinical studies that have used rTMS in humans with cocaine and methamphetamine use disorders. Many such studies suggest changes in network connectivity following acute rTMS, which may underpin reduced craving following chronic rTMS. We suggest several possible future directions for research relating to the therapeutic potential of rTMS in addiction that would help fill current gaps in the literature. Such research would apply rTMS to animal models of addiction, developing a translational pipeline that would guide evidence-based rTMS treatment of cocaine and methamphetamine use disorder.

Can oxytocin inhibit stress-induced hyperalgesia?

Stress-induced hyperalgesia is a problematic condition that lacks an effective therapeutic measure, and hence impairs health-related quality of life. The regulation of stress by oxytocin (OT) has overlapping effects on pain. OT can alleviate pain directly mainly at the spinal level and the peripheral tissues. Additionally, OT plays an analgesic role by dealing with stress and fear learning. When OT relieves stress by targeting the prefrontal brain regions and the hypothalamic-pituitary-adrenal axis, the body's sensitivity to pain is attenuated. Meanwhile, OT facilitates fear learning and may, in turn, enhance the anticipatory actions to painful stimulation. The unique therapeutic value of OT in patients suffering from stress and stress-related hyperalgesia conditions is worth considering. We reviewed recent advances in animal and human studies involving the effects of OT on stress and pain, and discussed the possible targets of OT within the descending and ascending pathways in the central nervous system. This review provides an overview of the evidence on the role of OT in alleviating stress-induced hyperalgesia.

Adolescence versus adulthood: Differences in basal mesolimbic and nigrostriatal dopamine transmission and response to drugs of abuse

Epidemiological studies have shown that people who begin experimenting drugs of abuse during adolescence are more likely to develop substance use disorders, and the earliest is the beginning of their use, the greatest is the likelihood to become dependent. Understanding the neurobiological changes increasing adolescent vulnerability to drug use is becoming imperative. Although all neurotransmitter systems undergo relevant developmental changes, dopamine system is of particular interest, given its role in a variety of functions related to reward, motivation, and decision making. Thus, in the present study, we investigated differences in mesolimbic and nigrostriatal dopamine transmission between adolescent (5, 6, 7 weeks of age) and adult rats (10-12 weeks of age), in basal conditions and following drug challenge, by using in vivo brain microdialysis. Although no significant difference between adolescents and adults was observed in dopamine basal levels in the nucleus accumbens (NAc)shell and core, reduced DA levels were found in the dorsolateral striatum (DLS) of early and mid-adolescent rats. Adolescent rats showed greater increase of dopamine in the NAc shell following nicotine (0.4 mg/kg), THC (1.0 mg/kg), and morphine (1.0 mg/kg), in the NAc core following nicotine and morphine, and in the DLS following THC, morphine, and cocaine (10 mg/kg). These results, while adding new insight in the development and functionality of the dopamine system during different stages of adolescence, might provide a neurochemical basis for the greater vulnerability of adolescents to drugs of abuse and for the postulated gateway effect of nicotine and THC toward abuse of other illicit substances.

Molecular Plasticity of the Nucleus Accumbens Revisited-Astrocytic Waves Shall Rise

Part of the ventral striatal division, the nucleus accumbens (NAc) drives the circuit activity of an entire macrosystem about reward like a "flagship," signaling and leading diverse conducts. Accordingly, NAc neurons feature complex inhibitory phenotypes that assemble to process circuit inputs and generate outputs by exploiting specific arrays of opposite and/or parallel neurotransmitters, neuromodulatory peptides. The resulting complex combinations enable versatile yet specific forms of accumbal circuit plasticity, including maladaptive behaviors. Although reward signaling and behavior are elaborately linked to neuronal circuit activities, it is plausible to propose whether these neuronal ensembles and synaptic islands can be directly controlled by astrocytes, a powerful modulator of neuronal activity. Pioneering studies showed that astrocytes in the NAc sense citrate cycle metabolites and/or ATP and may induce recurrent activation. We argue that the astrocytic calcium, GABA, and Glu signaling and altered sodium and chloride dynamics fundamentally shape metaplasticity by providing active regulatory roles in the synapse- and network-level flexibility of the NAc.

Neuromodulators and Long-Term Synaptic Plasticity in Learning and Memory: A Steered-Glutamatergic Perspective

The molecular pathways underlying the induction and maintenance of long-term synaptic plasticity have been extensively investigated revealing various mechanisms by which neurons control their synaptic strength. The dynamic nature of neuronal connections combined with plasticity-mediated long-lasting structural and functional alterations provide valuable insights into neuronal encoding processes as molecular substrates of not only learning and memory but potentially other sensory, motor and behavioural functions that reflect previous experience. However, one key element receiving little attention in the study of synaptic plasticity is the role of neuromodulators, which are known to orchestrate neuronal activity on brain-wide, network and synaptic scales. We aim to review current evidence on the mechanisms by which certain modulators, namely dopamine, acetylcholine, noradrenaline and serotonin, control synaptic plasticity induction through corresponding metabotropic receptors in a pathway-specific manner. Lastly, we propose that neuromodulators control plasticity outcomes through steering glutamatergic transmission, thereby gating its induction and maintenance.

Vagal Interoceptive Modulation of Motivated Behavior

In addition to regulating the ingestion and digestion of food, sensory feedback from gut to brain modifies emotional state and motivated behavior by subconsciously shaping cognitive and affective responses to events that bias behavioral choice. This focused review highlights evidence that gut-derived signals impact motivated behavior by engaging vagal afferents and central neural circuits that generally serve to limit or terminate goal-directed approach behaviors, and to initiate or maintain behavioral avoidance.

Basolateral amygdala, nicotinic cholinergic receptors, and nicotine: Pharmacological effects and addiction in animal models and humans

The amygdala is involved in processing incoming information about rewarding stimuli and emotions that denote danger such as anxiety and fear. Bi-directional neural connections between basolateral amygdala (BLA) and brain regions such as nucleus accumbens, prefrontal cortex, hippocampus, and hindbrain regions regulate motivation, cognition, and responses to stress. Altered local regulation of BLA excitability is pivotal to the behavioral disturbances characteristic of posttraumatic stress disorder, and relapse to drug use induced by stress. Herein, we review the physiological regulation of BLA by cholinergic inputs, emphasizing the role of BLA nicotinic receptors. We review BLA-dependent effects of nicotine on cognition, motivated behaviors, and emotional states, including memory, taking and seeking drugs, and anxiety and fear in humans and animal models. The alterations in BLA activity observed in animal studies inform human behavioral and brain imaging research by enabling a more exact understanding of altered BLA function. Converging evidence indicates that cholinergic signaling from basal forebrain projections to local nicotinic receptors is an important physiological regulator of BLA and that nicotine alters BLA function. In essence, BLA is necessary for behavioral responses to stimuli that evoke anxiety and fear; reinstatement of cue-induced drug seeking; responding to second-order cues conditioned to abused drugs; reacquisition of amplified nicotine self-administration due to chronic stress during abstinence; and to promote responding for natural reward.

Overexpression of Protein Kinase Inhibitor Alpha Reverses Rat Low Voluntary Running Behavior

A gene was sought that could reverse low voluntary running distances in a model of low voluntary wheel-running behavior. In order to confirm the low motivation to wheel-run in our model does not result from defects in reward valuation, we employed sucrose preference and conditioned place preference for voluntary wheel-access. We observed no differences between our model and wild-type rats regarding the aforementioned behavioral testing. Instead, low voluntary runners seemed to require less running to obtain similar rewards for low voluntary running levels compared to wild-type rats. Previous work in our lab identified protein kinase inhibitor alpha as being lower in low voluntary running than wild-type rats. Next, nucleus accumbens injections of an adenoviral-associated virus that overexpressed the protein kinase inhibitor alpha gene increased running distance in low voluntary running, but not wild-type rats. Endogenous mRNA levels for protein kinase inhibitor alpha, dopamine receptor D1, dopamine receptor D2, and Fos were all only lower in wild-type rats following overexpression compared to low voluntary runners, suggesting a potential molecular and behavioral resistance in wild-type rats. Utilizing a nucleus accumbens preparation, three intermediate early gene mRNAs increased in low voluntary running slices after dopamine receptor agonist SKF-38393 exposure, while wild-type had no response. In summary, the results suggest that protein kinase inhibitor alpha is a promising gene candidate to partially rescue physical activity in the polygenic model of low voluntary running. Importantly, there were divergent molecular responses to protein kinase inhibitor alpha overexpression in low voluntary runners compared to wild-type rats.

High and low nightly running behavior associates with nucleus accumbens N-Methyl-d-aspartate receptor (NMDAR) NR1 subunit expression and NMDAR functional differences

The extent to which N-Methyl-d-aspartate (NMDA) receptors facilitate the motivation to voluntarily wheel-run in rodents has yet to be determined. In so, we utilized female Wistar rats selectively bred to voluntarily run high (HVR) and low (LVR) nightly distances in order to examine if endogenous differences in nucleus accumbens (NAc) NMDA receptor expression and function underlies the propensity for high or low motivation to voluntarily wheel-run. 12-14 week old HVR and LVR females were used to examine: 1.) NAc mRNA and protein expression of NMDA subunits NR1, NR2A and NR2B; 2.) NMDA current responses in isolated medium spiny neurons (MSNs) and 3.) NMDA-evoked dopamine release in an ex vivo preparation of NAc punches. Expectedly, there was a large divergence in nightly running distance and time between HVR and LVR rats. We saw a significantly higher mRNA and protein expression of NR1 in HVR compared to LVR rats, while seeing no difference in the expression of NR2A or NR2B. There was a greater current response to a 500 ms application of 300 μM of NMDA in medium-spiny neurons isolated from the NAc HVR compared to LVR animals. On average, NMDA-evoked punches (50 μM of NMDA for 10 min) taken from HVR rats retained ∼54% of the dopamine content compared to their bilateral non-evoked sides, while evoked punches from LVR animals showed no statistical decrease in dopamine content compared to their non-evoked sides. Collectively, these data suggest a potential link between NAc NR1 subunit expression as well as NMDA function and the predisposition for nightly voluntary running behavior in rats. In light of the epidemic rise in physical inactivity, these findings have the potential to explain a neuro-molecular mechanism that regulates the motivation to be physically active.

Homeostatic and non-homeostatic controls of feeding behavior: Distinct vs. common neural systems

Understanding the neurobiological controls of feeding behavior is critical in light of the growing obesity pandemic, a phenomenon largely based on excessive caloric consumption. Feeding behavior and its underlying biological substrates are frequently divided in the literature into two separate categories: [1] homeostatic processes involving energy intake based on caloric and other metabolic deficits, and [2] non-homeostatic processes that involve feeding driven by environmental and cognitive factors. The present review summarizes both historic and recent research examining the homeostatic regulation of feeding with specific emphasis on hypothalamic and hindbrain circuitry that monitor and regulate various metabolic signals. Regarding non-homeostatic controls, we highlight higher-order brain structures that integrate feeding-relevant external, interoceptive, and cognitive factors, including sensory cortical processing, learned associations in the hippocampus, and reward-based processing in the nucleus accumbens and interconnected mesolimbic circuitry. Finally, the current review focuses on recent evidence that challenges the traditional view that distinct neural systems regulate homeostatic vs. non-homeostatic controls of feeding behavior. Specifically, we highlight several feeding-related endocrine systems that act on both lower- and higher-order substrates, present evidence for the modulation of learned and cognitive feeding-relevant behaviors by lower-order brain regions, and highlight data showing that apparent homeostatic-based feeding behavior is modulated by higher-order brain regions. Our concluding perspective is that the classic dissociation between homeostatic and non-homeostatic constructs in relation to feeding behavior is limited with regards to understanding the complex integrated neurobiological systems that control energy balance.

Subcortical association with memory performance in schizophrenia: a structural magnetic resonance imaging study

Memory performance is severely impaired in individuals with schizophrenia. Although several studies have reported a relationship between memory performance and hippocampal volume, only a few structural magnetic resonance imaging (MRI) studies have investigated the relationship between memory performance and subcortical structures other than hippocampus in patients with schizophrenia. We investigated the relationship between memory performance and subcortical regional volumes in a large sample of patients with schizophrenia. Participants included 174 patients with schizophrenia and 638 healthy comparison subjects (HCS). The Wechsler Memory Scale-Revised (WMS-R) has three memory indices (verbal immediate recall, visual immediate recall, and delayed recall (verbal plus visual)) and one control neurocognitive index (attention/concentration). We obtained T1-weighted MRI data and measured the bilateral volumes of the hippocampus, amygdala, thalamus, nucleus accumbens (NA), caudate, putamen, and globus pallidus. Patients with schizophrenia had significantly lower scores for all of the indices of the WMS-R than the HCS. They had more severe impairments in verbal immediate recall and delayed recall than in visual immediate recall and attention/concentration. Verbal immediate recall/delayed recall scores in patients with schizophrenia were significantly correlated not only with hippocampal volume (left: r = 0.34; right: r = 0.28/left: r = 0.33; right: r = 0.31), but also with NA volume (left: r = 0.24; right: r = 0.25/left: r = 0.26; right: r = 0.27). The present investigation with a large sample size did not only replicate hippocampal volume and memory association, but also found that NA volume is associated with memory performances in schizophrenia.

Effects of nucleus accumbens oxytocin and its antagonist on social approach behavior

Severe impairment of social interaction is a core symptom of numerous psychiatric disorders. Oxytocin (OT) has been shown to be involved in various aspects of social behavior related to reproduction, but little is known about its effects on nonreproductive social interaction between adults or the neuroanatomical location where OT exerts its action. Here, we examined the nucleus accumbens, a region of the brain containing high levels of the oxytocin receptor (OTR) and comprising an important node in the neural circuitry possibly related to social interaction. Behavioral effects of a local microinfusion of OT (0.1, 1, and 10 ng/side) and an oxytocin receptor antagonist (OTR-A) (1, 10, and 100 ng/side) were evaluated in naturally high social and low social female and male monogamous mandarin voles (Microtus mandarinus) using the social preference paradigm and open-field tests. The results showed that administration of 1 ng/side OT increased social preference; however, this effect was not apparent at lower or higher doses. OT did not alter anxiety-like behavior or total locomotion. Microinfusions of a selective OTR-A at 10 and 100 ng doses reduced social approach behavior; a dose of 1 ng had no effect. In conclusion, our results suggest that accumbal OT and OTR-A regulate social preferences in voles in a dose-dependent manner.

CART neurons in the lateral hypothalamus communicate with the nucleus accumbens shell via glutamatergic neurons in paraventricular thalamic nucleus to modulate reward behavior

Paraventricular thalamic nucleus (PVT) serves as a transit node processing food and drug-associated reward information, but its afferents and efferents have not been fully defined. We test the hypothesis that the CART neurons in the lateral hypothalamus (LH) project to the PVT neurons, which in turn communicate via the glutamatergic fibers with the nucleus accumbens shell (AcbSh), the canonical site for reward. Rats conditioned to self-stimulate via an electrode in the right LH-medial forebrain bundle were used. Intra-PVT administration of CART (55-102) dose-dependently (10-50 ng/rat) lowered intracranial self-stimulation (ICSS) threshold and increased lever press activity, suggesting reward-promoting action of the peptide. However, treatment with CART antibody (intra-PVT) or MK-801 (NMDA antagonist, intra-AcbSh) produced opposite effects. A combination of sub-effective dose of MK-801 (0.01 µg/rat, intra-AcbSh) and effective dose of CART (25 ng/rat, intra-PVT) attenuated CART's rewarding action. Further, we screened the LH-PVT-AcbSh circuit for neuroadaptive changes induced by conditioning experience. A more than twofold increase was noticed in the CART mRNA expression in the LH on the side ipsilateral to the implanted electrode for ICSS. In addition, the PVT of conditioned rats showed a distinct increase in the (a) c-Fos expressing cells and CART fiber terminals, and (b) CART and vesicular glutamate transporter 2 immunostained elements. Concomitantly, the AcbSh showed a striking increase in expression of NMDA receptor subunit NR1. We suggest that CART in LH-PVT and glutamate in PVT-AcbSh circuit might support food-seeking behavior under natural conditions and also store reward memory.

Levodopa treatment and dendritic spine pathology

Parkinson's disease (PD) is a neurodegenerative disorder associated with the progressive loss of nigrostriatal dopaminergic neurons. Levodopa is the most effective treatment for the motor symptoms of PD. However, chronic oral levodopa treatment can lead to various motor and nonmotor complications because of nonphysiological pulsatile dopaminergic stimulation in the brain. Examinations of autopsy cases with PD have revealed a decreased number of dendritic spines of striatal neurons. Animal models of PD have revealed altered density and morphology of dendritic spines of neurons in various brain regions after dopaminergic denervation or dopaminergic denervation plus levodopa treatment, indicating altered synaptic transmission. Recent studies using rodent models have reported dendritic spine head enlargement in the caudate‐putamen, nucleus accumbens, primary motor cortex, and prefrontal cortex in cases where chronic levodopa treatment following dopaminergic denervation induced dyskinesia‐like abnormal involuntary movement. Hypertrophy of spines results from insertion of alpha‐amino‐2,3‐dihydro‐5‐methyl‐3‐oxo‐4‐isoxazolepropanoic acid receptors into the postsynaptic membrane. Such spine enlargement indicates hypersensitivity of the synapse to excitatory inputs and is compatible with a lack of depotentiation, which is an electrophysiological hallmark of levodopa‐induced dyskinesia found in the corticostriatal synapses of dyskinetic animals and the motor cortex of dyskinetic PD patients. This synaptic plasticity may be one of the mechanisms underlying the priming of levodopa‐induced complications such as levodopa‐induced dyskinesia and dopamine dysregulation syndrome. Drugs that could potentially prevent spine enlargement, such as calcium channel blockers, N‐methyl‐D‐aspartate receptor antagonists, alpha‐amino‐2,3‐dihydro‐5‐methyl‐3‐oxo‐4‐isoxazolepropanoic acid receptor antagonists, and metabotropic glutamate receptor antagonists, are candidates for treatment of levodopa‐induced complications in PD. © 2017 The Authors. Movement Disorders published by Wiley Periodicals, Inc. on behalf of International Parkinson and Movement Disorder Society.

Basolateral amygdala and stress-induced hyperexcitability affect motivated behaviors and addiction

The amygdala integrates and processes incoming information pertinent to reward and to emotions such as fear and anxiety that promote survival by warning of potential danger. Basolateral amygdala (BLA) communicates bi-directionally with brain regions affecting cognition, motivation and stress responses including prefrontal cortex, hippocampus, nucleus accumbens and hindbrain regions that trigger norepinephrine-mediated stress responses. Disruption of intrinsic amygdala and BLA regulatory neurocircuits is often caused by dysfunctional neuroplasticity frequently due to molecular alterations in local GABAergic circuits and principal glutamatergic output neurons. Changes in local regulation of BLA excitability underlie behavioral disturbances characteristic of disorders including post-traumatic stress syndrome (PTSD), autism, attention-deficit hyperactivity disorder (ADHD) and stress-induced relapse to drug use. In this Review, we discuss molecular mechanisms and neural circuits that regulate physiological and stress-induced dysfunction of BLA/amygdala and its principal output neurons. We consider effects of stress on motivated behaviors that depend on BLA; these include drug taking and drug seeking, with emphasis on nicotine-dependent behaviors. Throughout, we take a translational approach by integrating decades of addiction research on animal models and human trials. We show that changes in BLA function identified in animal addiction models illuminate human brain imaging and behavioral studies by more precisely delineating BLA mechanisms. In summary, BLA is required to promote responding for natural reward and respond to second-order drug-conditioned cues; reinstate cue-dependent drug seeking; express stress-enhanced reacquisition of nicotine intake; and drive anxiety and fear. Converging evidence indicates that chronic stress causes BLA principal output neurons to become hyperexcitable.

Circuit Mechanisms of Sensorimotor Learning

The relationship between the brain and the environment is flexible, forming the foundation for our ability to learn. Here we review the current state of our understanding of the modifications in the sensorimotor pathway related to sensorimotor learning. We divide the process into three hierarchical levels with distinct goals: (1) sensory perceptual learning, (2) sensorimotor associative learning, and (3) motor skill learning. Perceptual learning optimizes the representations of important sensory stimuli. Associative learning and the initial phase of motor skill learning are ensured by feedback-based mechanisms that permit trial-and-error learning. The later phase of motor skill learning may primarily involve feedback-independent mechanisms operating under the classic Hebbian rule. With these changes under distinct constraints and mechanisms, sensorimotor learning establishes dedicated circuitry for the reproduction of stereotyped neural activity patterns and behavior.

Central GLP-1 receptor activation modulates cocaine-evoked phasic dopamine signaling in the nucleus accumbens core

Drugs of abuse increase the frequency and magnitude of brief (1-3s), high concentration (phasic) dopamine release events in terminal regions. These are thought to be a critical part of drug reinforcement and ultimately the development of addiction. Recently, metabolic regulatory peptides, including the satiety signal glucagon-like peptide-1 (GLP-1), have been shown to modulate cocaine reward-driven behavior and sustained dopamine levels after cocaine administration. Here, we use fast-scan cyclic voltammetry (FSCV) to explore GLP-1 receptor (GLP-1R) modulation of dynamic dopamine release in the nucleus accumbens (NAc) during cocaine administration. We analyzed dopamine release events in both the NAc shell and core, as these two subregions are differentially affected by cocaine and uniquely contribute to motivated behavior. We found that central delivery of the GLP-1R agonist Exendin-4 suppressed the induction of phasic dopamine release events by intravenous cocaine. This effect was selective for dopamine signaling in the NAc core. Suppression of phasic signaling in the core by Exendin-4 could not be attributed to interference with cocaine binding to one of its major substrates, the dopamine transporter, as cocaine-induced increases in reuptake were unaffected. The results suggest that GLP-1R activation, instead, exerts its suppressive effects by altering dopamine release - possibly by suppressing the excitability of dopamine neurons. Given the role of NAc core dopamine in the generation of conditioned responses based on associative learning, suppression of cocaine-induced dopamine signaling in this subregion by GLP-1R agonism may decrease the reinforcing properties of cocaine. Thus, GLP-1Rs remain viable targets for the treatment and prevention of cocaine seeking, taking and relapse.

Neurobehavioral effects of lithium in the rat: Investigation of the effect/concentration relationships and the contribution of the poisoning pattern

Severity of lithium poisoning depends on the ingested dose, previous treatment duration and renal function. No animal study has investigated neurobehavioral differences in relation to the lithium poisoning pattern observed in humans, while differences in lithium pharmacokinetics have been reported in lithium-pretreated rats mimicking chronic poisonings with enhanced brain accumulation in rats with renal failure. Our objectives were: 1)-to investigate lithium-related effects in overdose on locomotor activity, anxiety-like behavior, spatial recognition memory and anhedonia in the rat; 2)-to model the relationships between lithium-induced effects on locomotion and plasma, erythrocyte, cerebrospinal fluid and brain concentrations previously obtained according to the poisoning pattern. Open-field, elevated plus-maze, Y-maze and sucrose consumption tests were used. In acutely lithium-poisoned rats, we observed horizontal (p<0.001) and vertical hypolocomotion (p<0.0001), increased anxiety-like behavior (p<0.05) and impaired memory (p<0.01) but no altered hedonic status. Horizontal (p<0.01) and vertical (p<0.001) hypolocomotion peaked more markedly 24h after lithium injection and was more prolonged in acute-on-chronically vs. acutely lithium-poisoned rats. Hypolocomotion in chronically lithium-poisoned rats with impaired renal function did not differ from acutely poisoned rats 24h after the last injection. Interestingly, hypolocomotion/concentration relationships best fitted a sigmoidal E_max model in acute poisoning and a linear regression model linked to brain lithium in acute-on-chronic poisoning. In conclusion, lithium overdose alters rat behavior and consistently induces hypolocomotion which is more marked and prolonged in repeatedly lithium-treated rats. Our data suggest that differences between poisoning patterns regarding lithium-induced hypolocomotion are better explained by the duration of lithium exposure than by its brain accumulation.

Abundant collateralization of temporal lobe projections to the accumbens, bed nucleus of stria terminalis, central amygdala and lateral septum

Behavioral flexibility is subserved in part by outputs from the cerebral cortex to telencephalic subcortical structures. In our earlier evaluation of the organization of the cortical-subcortical output system (Reynolds and Zahm, J Neurosci 25:11757-11767, 2005), retrograde double-labeling was evaluated in the prefrontal cortex following tracer injections into pairs of the following subcortical telencephalic structures: caudate-putamen, core and shell of the accumbens (Acb), bed nucleus of stria terminalis (BST) and central nucleus of the amygdala (CeA). The present study was done to assess patterns of retrograde labeling in the temporal lobe after similar paired tracer injections into most of the same telencephalic structures plus the lateral septum (LS). In contrast to the modest double-labeling observed in the prefrontal cortex in the previous study, up to 60-80 % of neurons in the basal and accessory basal amygdaloid nuclei and amygdalopiriform transition area exhibited double-labeling in the present study. The most abundant double-labeling was generated by paired injections into structures affiliated with the extended amygdala, including the CeA, BST and Acb shell. Injections pairing the Acb core with the BST or CeA produced significantly fewer double-labeled neurons. The ventral subiculum exhibited modest amounts of double-labeling associated with paired injections into the Acb, BST, CeA and LS. The results raise the issue of how an extraordinarily collateralized output from the temporal lobe may contribute to behavioral flexibility.

Acquisition and expression of fat-conditioned flavor preferences are differentially affected by NMDA receptor antagonism in BALB/c and SWR mice

Conditioned flavor preferences are elicited by fat (Intralipid) in inbred mouse strains with BALB/c and SWR mice displaying among the most robust preferences. Dopamine D₁ and opioid receptor antagonism differentially reduces the acquisition (learning) and expression (maintenance) of fat-conditioned flavor preferences in these two strains. Because noncompetitive NMDA receptor antagonism with MK-801 differentially altered sugar-conditioned flavor preferences in these strains, and because NMDA receptors are involved in fat intake, the present study examined whether MK-801 differentially altered expression and acquisition of fat (Intralipid)-conditioned flavor preferences in BALB/c and SWR mice. In expression studies, food-restricted male mice alternately consumed a flavored (CS+, e.g., cherry, 5 sessions) 5% Intralipid solution and a differently-flavored (CS-, e.g., grape, 5 sessions) 0.5% Intralipid solution. Two-bottle CS choice tests occurred following vehicle or MK-801 (100, 200µg/kg). MK-801 blocked expression of Intralipid-CFP at both doses in BALB/c mice, but only at the 100µg/kg dose in SWR mice. In acquisition studies, groups of BALB/c (0, 100µg/kg) and SWR (0, 100µg/kg) male mice were treated prior to the ten acquisition training sessions followed by six 2-bottle CS choice tests without injections. MK-801 eliminated acquisition of Intralipid-conditioned flavor preferences in BALB/c mice, and actually changed the preference to an avoidance response in SWR mice. Thus, NMDA receptor signaling appears essential especially for the learning of fat-conditioned flavor preferences in both mouse strains.

Relief learning requires a coincident activation of dopamine D1 and NMDA receptors within the nucleus accumbens

Relief learning is the association of a stimulus with the offset of an aversive event. Later, the now conditioned relief stimulus induces appetitive-like behavioral changes. We previously demonstrated that the NMDA receptors within the nucleus accumbens (NAC) are involved in relief learning. The NAC is also important for reward learning and it has been shown that reward learning is mediated by an interaction of accumbal dopamine and NMDA glutamate receptors. Since conditioned relief has reward-like properties, we hypothesized that (a) acquisition of relief learning requires the activation of dopamine D1 receptors in the NAC, and (b) if D1 receptors are involved in this process as expected, a concurrent dopamine D1 and NMDA receptor activation may mediate this learning. The present study tested these hypotheses. Therefore, rats received intra-NAC injections of the dopamine D1 receptor antagonist SCH23390 and the NMDA antagonist AP5, either separately or together, at different time points of a relief conditioning procedure. First, we showed that SCH23390 dose-dependently blocked acquisition and the expression of conditioned relief. Next, we demonstrated that co-injections of SCH23390 and AP5 into the NAC, at doses that were ineffective when applied separately, blocked acquisition but not consolidation or expression of relief learning. Notably, neither of the injections affected the locomotor response of the animals to the aversive stimuli suggesting that their perception is not changed. This data indicates that a co-activation of dopamine D1 and NMDA receptors in the NAC is required for acquisition of relief learning.

Role of DARPP-32 and ARPP-21 in the Emergence of Temporal Constraints on Striatal Calcium and Dopamine Integration

In reward learning, the integration of NMDA-dependent calcium and dopamine by striatal projection neurons leads to potentiation of corticostriatal synapses through CaMKII/PP1 signaling. In order to elicit the CaMKII/PP1-dependent response, the calcium and dopamine inputs should arrive in temporal proximity and must follow a specific (dopamine after calcium) order. However, little is known about the cellular mechanism which enforces these temporal constraints on the signal integration. In this computational study, we propose that these temporal requirements emerge as a result of the coordinated signaling via two striatal phosphoproteins, DARPP-32 and ARPP-21. Specifically, DARPP-32-mediated signaling could implement an input-interval dependent gating function, via transient PP1 inhibition, thus enforcing the requirement for temporal proximity. Furthermore, ARPP-21 signaling could impose the additional input-order requirement of calcium and dopamine, due to its Ca²⁺/calmodulin sequestering property when dopamine arrives first. This highlights the possible role of phosphoproteins in the temporal aspects of striatal signal transduction.

A response towards an environmental stimulus could be reinforced if it elicits a reward. On the subcellular level, the environmental stimulus and the reward signal lead to a transient increase in striatal calcium- and dopamine-signaling, respectively. The integration of calcium and dopamine signals, which is important for reward-learning, could elicit a downstream response only if they are close in time and arrive in correct order (first calcium and then dopamine). This study proposes that the requirement for the input signals to be temporally close and in correct order could emerge due to the coordinated signaling via two striatal phosphoproteins, DARPP-32 and ARPP-21. The DARPP-32 signaling implements an input-interval dependent gating function and ARPP-21 implements an input-order dependent threshold-like function. Thus, a molecular mechanism has been presented here which could explain the emergence of important temporal aspects of subcellular signal integration in reward-learning.

Safety out of control: dopamine and defence

We enjoy a sophisticated understanding of how animals learn to predict appetitive outcomes and direct their behaviour accordingly. This encompasses well-defined learning algorithms and details of how these might be implemented in the brain. Dopamine has played an important part in this unfolding story, appearing to embody a learning signal for predicting rewards and stamping in useful actions, while also being a modulator of behavioural vigour. By contrast, although choosing correct actions and executing them vigorously in the face of adversity is at least as important, our understanding of learning and behaviour in aversive settings is less well developed. We examine aversive processing through the medium of the role of dopamine and targets such as D2 receptors in the striatum. We consider critical factors such as the degree of control that an animal believes it exerts over key aspects of its environment, the distinction between 'better' and 'good' actual or predicted future states, and the potential requirement for a particular form of opponent to dopamine to ensure proper calibration of state values.

Manganese-Disrupted Interaction of Dopamine D1 and NMDAR in the Striatum to Injury Learning and Memory Ability of Mice

Manganese (Mn) is widely regarded as a neurotoxic heavy metal that causes learning and memory deficits. Recently, it has been proved that the striatum is related to memory and learning ability. However, no previous study focused on the effect of Mn-induced learning and memory deficits on the striatum. This study aims to investigate the probable interaction of dopamine D1 receptor (DR1) and N-methyl-D-aspartate receptor (NMDAR), two cognition-related receptors in the striatum during Mn exposure. Mice are randomly divided into four groups, including control group, 12.5 mg/kg MnCl₂ group, 25 mg/kg MnCl₂ group, and 50 mg/kg MnCl₂ group. The mice receive intraperitoneal injections of 0, 12.5, 25, and 50 mg/kg MnCl₂ once daily for 2 weeks. Then, learning and memory ability, pathological changes, expression, and interaction of DR1 and NMDAR are determined. It has been found that Mn disrupted spatial learning and memory ability of mice by Morris water maze test and the passive avoidance test. Pathological and ultrastructure were injured. Mn decreased the immunohistochemical activities, protein levels, and messenger RNA (mRNA) expression of DR1, NR1, and NR2A. Mn exposure inhibited interaction between DR1 and NMDAR in striatum by double immunofluorescent staining and co-immunoprecipitation. In conclusion, our study illustrated that Mn caused learning and memory dysfunction via injury of striatum and inhibition of interaction between DR1 and NMDAR in striatum.