Changes in nucleus accumbens and neostriatal c-Fos and DARPP-32 immunoreactivity during different stages of food-reinforced instrumental training

Dorsal striatum c-Fos activity in perseverative ephrin-A2A5-/- mice and the cellular effect of low-intensity rTMS

Introduction

Overreliance on habit is linked with disorders, such as drug addiction and obsessive-compulsive disorder, and there is increasing interest in the use of repetitive transcranial magnetic stimulation (rTMS) to alter neuronal activity in the relevant pathways and for therapeutic outcomes. In this study, we researched the brains of ephrin-A2A5^-/- mice, which previously showed perseverative behavior in progressive-ratio tasks, associated with low cellular activity in the nucleus accumbens. We investigated whether rTMS treatment had altered the activity of the dorsal striatum in a way that suggested altered hierarchical recruitment of brain regions from the ventral striatum to the dorsal striatum, which is linked to abnormal habit formation.

Methods

Brain sections from a limited number of mice that underwent training and performance on a progressive ratio task with and without low-intensity rTMS (LI-rTMS) were taken from a previous study. We took advantage of the previous characterization of perseverative behavior to investigate the contribution of different neuronal subtypes and striatal regions within this limited sample. Striatal regions were stained for c-Fos as a correlate of neuronal activation for DARPP32 to identify medium spiny neurons (MSNs) and for GAD67 to identify GABA-ergic interneurons.

Results and discussion

Contrary to our hypothesis, we found that neuronal activity in ephrin-A2A5^-/- mice still reflected the typical organization of goal-directed behavior. There was a significant difference in the proportion of neuronal activity across the striatum between experimental groups and control but no significant effects identifying a specific regional change. However, there was a significant group by treatment interaction which suggests that MSN activity is altered in the dorsomedial striatum and a trend suggesting that rTMS increases ephrin-A2A5^-/- MSN activity in the DMS. Although preliminary and inconclusive, the analysis of this archival data suggests that investigating circuit-based changes in striatal regions may provide insight into chronic rTMS mechanisms that could be relevant to treating disorders associated with perseverative behavior.

Fos-expressing neuronal ensembles in rat infralimbic cortex encode initial and maintained oxycodone seeking in rats

Neuronal ensembles within the infralimbic cortex (IL) and their projections to the nucleus accumbens (NAc) mediate opiate seeking in well-trained rats. However, it is unclear how early this circuitry is recruited during oxycodone self-administration. Here, we used retrograde labelling (CTb) and immunohistochemistry to identify NAc-projecting neurons in the IL that were activated during initial oxycodone seeking. Next, we sought to determine the role of IL neuronal ensembles in initial oxycodone self-administration. We used the Daun02 procedure in male and female Fos-LacZ rats to chemogenetically inactivate IL Fos-expressing neurons at different time points in oxycodone self-administration training: immediately after meeting criteria for acquisition of behaviour and following nine daily sessions with increasing schedules of reinforcement (FR1, FR2 and FR3) in which rats demonstrated stable oxycodone intake under increasing effort to self-administer. We found that Daun02 infusions attenuated oxycodone seeking at both the initial learning and well-trained time points. These results suggest that IL neuronal ensembles are formed during initial learning of oxycodone self-administration and required for the maintenance and expression of oxycodone seeking.

Concurrent LI-rTMS induces changes in c-Fos expression but not behavior during a progressive ratio task with adult ephrin-A2A5-/- mice

Changes within the dopaminergic system induced by repetitive transcranial magnetic stimulation (rTMS) may contribute to its therapeutic effects; however, dopamine-related behavioral effects of rTMS have not been widely investigated. We recently showed that ephrin-A2A5^-/- mice completed significantly fewer trials in a visual task than wildtype mice, and that concurrent low-intensity (LI-) rTMS during the task could partially rescue the abnormal behavior [Poh et al. 2018, eNeuro, vol. 5]. Here, we investigated whether the behavioral differences in ephrin-A2A5^-/- mice are due to abnormal motivation, primarily a dopamine-modulated behavior, and whether LI-rTMS would increase motivation. Ephrin-A2A5^-/- and wildtype mice underwent 14 daily sessions of progressive ratio (PR) tasks and received either sham or LI-rTMS during the first 10 min. Ephrin-A2A5^-/- mice responded more than wildtype comparisons, and LI-rTMS did not influence task performance for either strain. Therefore concurrent stimulation does not influence motivation in a PR task. However, ephrin-A2A5^-/- mice did have abnormal performance in the PR tasks after a change in the PR schedule which suggests perseverative behavior. We stained for c-Fos in the prelimbic area (PrL), ventral tegmental area and nucleus accumbens (NAc) core and shell to examine neuronal activity from the final PR session. Sham ephrin-A2A5^-/- mice had lower c-Fos expression in the PrL and NAc vs. wildtype mice. Ephrin-A2A5^-/- mice that received LI-rTMS showed c-Fos expression closer to wildtype levels in the NAc. Combined with high PR performance, ephrin-A2A5^-/- mice show an abnormal shift to habitual responding and LI-rTMS may attenuate this shift.

Molecular Plasticity of the Nucleus Accumbens Revisited-Astrocytic Waves Shall Rise

Part of the ventral striatal division, the nucleus accumbens (NAc) drives the circuit activity of an entire macrosystem about reward like a "flagship," signaling and leading diverse conducts. Accordingly, NAc neurons feature complex inhibitory phenotypes that assemble to process circuit inputs and generate outputs by exploiting specific arrays of opposite and/or parallel neurotransmitters, neuromodulatory peptides. The resulting complex combinations enable versatile yet specific forms of accumbal circuit plasticity, including maladaptive behaviors. Although reward signaling and behavior are elaborately linked to neuronal circuit activities, it is plausible to propose whether these neuronal ensembles and synaptic islands can be directly controlled by astrocytes, a powerful modulator of neuronal activity. Pioneering studies showed that astrocytes in the NAc sense citrate cycle metabolites and/or ATP and may induce recurrent activation. We argue that the astrocytic calcium, GABA, and Glu signaling and altered sodium and chloride dynamics fundamentally shape metaplasticity by providing active regulatory roles in the synapse- and network-level flexibility of the NAc.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

DARPP-32 in the orchestration of responses to positive natural stimuli

Dopamine- and cAMP-regulated phosphoprotein (M_r 32 kDa, DARPP-32) is an integrator of multiple neuronal signals and plays a crucial role particularly in mediating the dopaminergic component of the systems involved in the evaluation of stimuli and the ensuing elaboration of complex behavioral responses (e.g., responses to reinforcers and stressors). Dopamine neurons can fire tonically or phasically in distinct timescales and in specific brain regions to code different behaviorally relevant information. Dopamine signaling is mediated mainly through the regulation of adenylyl cyclase activity, stimulated by D1-like or inhibited by D2-like receptors, respectively, that modulates cAMP-dependent protein kinase (PKA) function. The activity of DARPP-32 is finely regulated by its phosphorylation at multiple sites. Phosphorylation at the threonine (Thr) 34 residue by PKA converts DARPP-32 into an inhibitor of protein phosphatase 1, while the phosphorylation at the Thr75 residue turns it into an inhibitor of PKA. Thus, DARPP-32 is critically implicated in regulating striatal output in response to the convergent pathways that influence signaling of the cAMP/PKA pathway. This review summarizes some of the landmark and recent studies of DARPP-32-mediated signaling in the attempt to clarify the role played by DARPP-32 in the response to rewarding natural stimuli. Particularly, the review deals with data derived from rodents studies and discusses the involvement of the cAMP/PKA/DARPP-32 pathway in: 1) appetitive food-sustained motivated behaviors, 2) motivated behaviors sustained by social reward, 3) sexual behavior, and 4) responses to environmental enrichment.

Corticoinsular circuits encode subjective value expectation and violation for effortful goal-directed behavior

The ability to form value estimates is crucial for optimal decision making, especially when not all features of a choice option are known. To date, however, the neural mechanisms for expectation processes under conditions of incomplete information are unknown. Using computational fMRI, we show that ventromedial prefrontal cortex encodes the expected value of a trial. We also observe a distinct network composed of dorsal anterior cingulate, anterior insula, and dorsomedial caudate that encodes an expectation violation or prediction error signal, based on previous trial history. These findings highlight how the brain computes and monitors value-based predictions during effortful goal-directed behavior when choice-relevant information is not fully available.

We are presented with choices each day about how to invest our effort to achieve our goals. Critically, these decisions must frequently be made under conditions of incomplete information, where either the effort required or possible reward to be gained is uncertain. Such choices therefore require the development of potential value estimates to guide effortful goal-directed behavior. To date, however, the neural mechanisms for this expectation process are unknown. Here, we used computational fMRI during an effort-based decision-making task where trial-wise information about effort costs and reward magnitudes was presented separately over time, thereby allowing us to model distinct effort/reward computations as choice-relevant information unfolded. We found that ventromedial prefrontal cortex (vmPFC) encoded expected subjective value. Further, activity in dorsal anterior cingulate (dACC) and anterior insula (aI) reflected both effort discounting as well as a subjective value prediction error signal derived from trial history. While prior studies have identified these regions as being involved in effort-based decision making, these data demonstrate their specific role in the formation and maintenance of subjective value estimates as relevant information becomes available.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

Effort-related motivational effects of the pro-inflammatory cytokine interleukin-6: pharmacological and neurochemical characterization

RATIONALE

Motivational dysfunctions such as anergia, fatigue, and reduced effort expenditure are common in patients with depression and other disorders. Pro-inflammatory cytokines are implicated in depression, and cytokine administration induces motivational deficits in humans.

OBJECTIVES

These studies focused on the effects of the cytokine interleukin-6 (IL-6) on effort-related decision-making.

METHODS

Rats were assessed using the concurrent fixed ratio 5-lever pressing/chow feeding choice procedure, which measures the tendency of rats to work for a preferred food (high carbohydrate pellets) in the presence of a concurrently available but less preferred substitute (lab chow).

RESULTS

IL-6 (2.0-8.0 μg/kg IP) shifted choice behavior, significantly decreasing lever pressing and increasing chow intake. Further experiments showed that the adenosine A2A antagonist MSX-3 and the stimulant methylphenidate attenuated the effort-related impairments produced by IL-6, increasing lever pressing and decreasing chow intake in IL-6 treated rats. The same doses of IL-6 did not alter food intake or preference in parallel free-feeding choice studies, demonstrating that these low doses were not altering preference for the high carbohydrate pellets or generally suppressing appetite. Also, IL-6 did not affect body temperature. Microdialysis studies showed that 8.0 μg/kg IL-6 significantly decreased extracellular dopamine in nucleus accumbens core.

CONCLUSIONS

In summary, IL-6 reduces the tendency to work for food, even at low doses that do not produce fever or loss of appetite. Dopaminergic mechanisms may be involved in these effort-related effects. This research has implications for the involvement of cytokines in motivational dysfunctions such as anergia and fatigue.

Regionally distinct phasic dopamine release patterns in the striatum during reversal learning

Striatal dopamine (DA) plays a central role in reward-related learning and behavioral adaptation to changing environments. Recent studies suggest that rather than being broadcast as a uniform signal throughout the entire region, DA release dynamics diverge between different striatal regions. In a previous study, we showed that phasic DA release patterns in the ventromedial striatum (VMS) rapidly adapt during reversal learning. However, it is unknown how DA dynamics in the dorsolateral striatum (DLS) are modulated during such adaptive behavior. Here, we used fast-scan cyclic voltammetry to measure phasic DA release in the DLS during spatial reversal learning. In the DLS, we observed minor DA release after the onset of a visual cue signaling reward availability, followed by more pronounced DA release during more proximal reward cues (e.g., lever extension) and execution of the operant response (i.e., lever press), both in rewarded and non-rewarded trials. These release dynamics (minor DA after onset of the predictive visual cue, prominent DA during the operant response) did not change significantly during or following a reversal of response-reward contingencies. Notably, the DA increase to the lever press did not reflect a general signal related to the initiation of any motivated motor response, as we did not observe DA release when rats initiated nose pokes into the food receptacle during inter-trial intervals. This suggests that DA release in the DLS occurs selectively during the initiation and execution of a learned operant response. Together with our previous results obtained in the VMS, these findings reveal distinct phasic DA release patterns during adaptation of established behavior in DLS and VMS. The VMS DA signal, which is highly sensitive to reversal of response-reward contingences, may provide a teaching signal to guide reward-related learning and facilitate behavioral adaptation, whereas DLS DA may reflect a 'response execution signal' largely independent of outcome, that may be involved in initiation and energizing of operant behavior.

PPARγ activation attenuates opioid consumption and modulates mesolimbic dopamine transmission

PPARγ is one of the three isoforms identified for the peroxisome proliferator-activated receptors (PPARs) and is the receptor for the thiazolidinedione class of anti-diabetic medications including pioglitazone. PPARγ has been long studied for its role in adipogenesis and glucose metabolism, but the discovery of the localization in ventral tegmental area (VTA) neurons opens new vistas for a potential role in the regulation of reward processing and motivated behavior in drug addiction. Here, we demonstrate that activation of PPARγ by pioglitazone reduces the motivation for heroin and attenuates its rewarding properties. These effects are associated with a marked reduction of heroin-induced increase in phosphorylation of DARPP-32 protein in the nucleus accumbens (NAc) and with a marked and selective reduction of acute heroin-induced elevation of extracellular dopamine (DA) levels in the NAc shell, as measured by in vivo microdialysis. Through ex vivo electrophysiology in acute midbrain slices, we also show that stimulation of PPARγ attenuates opioid-induced excitation of VTA DA neurons via reduction of presynaptic GABA release from the rostromedial tegmental nucleus (RMTg). Consistent with this finding, site-specific microinjection of pioglitazone into the RMTg but not into the VTA reduced heroin taking. Our data illustrate that activation of PPARγ may represent a new pharmacotherapeutic option for the treatment of opioid addiction.

Bupropion increases selection of high effort activity in rats tested on a progressive ratio/chow feeding choice procedure: implications for treatment of effort-related motivational symptoms

BACKGROUND

Depression and related disorders are characterized by deficits in behavioral activation, exertion of effort, and other psychomotor/motivational dysfunctions. Depressed patients show alterations in effort-related decision making and a bias towards selection of low effort activities. It has been suggested that animal tests of effort-related decision making could be useful as models of motivational dysfunctions seen in psychopathology.

METHODS

Because clinical studies have suggested that inhibition of catecholamine uptake may be a useful strategy for treatment of effort-related motivational symptoms, the present research assessed the ability of bupropion to increase work output in rats responding on a test of effort-related decision-making (ie, a progressive ratio/chow feeding choice task). With this task, rats can choose between working for a preferred food (high-carbohydrate pellets) by lever pressing on a progressive ratio schedule vs obtaining a less preferred laboratory chow that is freely available in the chamber.

RESULTS

Bupropion (10.0-40.0 mg/kg intraperitoneal) significantly increased all measures of progressive ratio lever pressing, but decreased chow intake. These effects were greatest in animals with low baseline levels of work output on the progressive ratio schedule. Because accumbens dopamine is implicated in effort-related processes, the effects of bupropion on markers of accumbens dopamine transmission were examined. Bupropion elevated extracellular dopamine levels in accumbens core as measured by microdialysis and increased phosphorylated dopamine and cyclic-AMP related phosphoprotein 32 kDaltons (pDARPP-32) immunoreactivity in a manner consistent with D1 and D2 receptor stimulation.

CONCLUSION

The ability of bupropion to increase exertion of effort in instrumental behavior may have implications for the pathophysiology and treatment of effort-related motivational symptoms in humans.

Mesolimbic Dopamine and the Regulation of Motivated Behavior

It has been known for some time that nucleus accumbens dopamine (DA) is involved in aspects of motivation , but theoretical approaches to understanding the functions of DA have continued to evolve based upon emerging data and novel concepts. Although it has become traditional to label DA neurons as "reward" neurons, the actual findings are more complicated than that, because they indicate that DA neurons can respond to a variety of motivationally significant stimuli. Moreover, it is important to distinguish between aspects of motivation that are differentially affected by dopaminergic manipulations. Studies that involve nucleus accumbens DA antagonism or depletion indicate that accumbens DA does not mediate primary food motivation or appetite. Nevertheless, DA is involved in appetitive and aversive motivational processes including behavioral activation , exertion of effort, sustained task engagement, and Pavlovian-to-instrumental transfer. Interference with accumbens DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task and also shifts effort-related choice behavior, biasing animals toward low-effort alternatives. Dysfunctions of mesolimbic DA may contribute to motivational symptoms seen in various psychopathologies, including depression , schizophrenia, parkinsonism, and other disorders.

The dopamine D2 antagonist eticlopride accelerates extinction and delays reacquisition of food self-administration in rats

Dopamine receptors are implicated in the reinforcing effects of food and drug reinforcement. The purpose of this study was to evaluate whether blocking D2 dopamine receptors during extinction (secondary reinforcement) would affect reacquisition of responding for food pellets (primary reinforcement). Food-restricted rats self-administered (fixed-ratio 1) food pellets in 1-h daily sessions for 7 days. For the next 7 days rats responded in extinction conditions. Before each extinction session rats were injected with saline or the dopamine D2 antagonist eticlopride (0.03 mg/kg, subcutaneously). After the extinction phase, rats were allowed to reacquire food pellet self-administration in seven daily sessions, and received saline or eticlopride before each session. Four treatment groups were represented: saline extinction, saline reacquisition; eticlopride extinction, saline reacquisition; saline extinction, eticlopride reacquisition; and eticlopride extinction, eticlopride reacquisition. Locomotor activity did not differ between eticlopride-treated and saline-treated rats throughout the study. Extinction was accelerated in eticlopride-treated rats. Eticlopride also delayed reacquisition of food self-administration compared with saline-treated rats. Rats administered eticlopride during extinction showed delayed reacquisition and a decreased response rate for food during the reacquisition phase. Indirectly reducing the value of a reinforcer in this way may provide a novel approach for reducing addiction-related food or drug self-administration behaviors.

Effort-related motivational effects of the pro-inflammatory cytokine interleukin 1-beta: studies with the concurrent fixed ratio 5/ chow feeding choice task

RATIONALE

Effort-related motivational symptoms such as anergia and fatigue are common in patients with depression and other disorders. Research implicates pro-inflammatory cytokines in depression, and administration of cytokines can induce effort-related motivational symptoms in humans.

OBJECTIVES

The present experiments focused on the effects of the pro-inflammatory cytokine interleukin 1-beta (IL-1β) on effort-related choice behavior.

METHODS

Rats were tested on a concurrent fixed ratio 5 lever pressing/chow feeding choice procedure, which assesses the tendency of rats to work for a preferred food (high carbohydrate pellets) in the presence of a concurrently available but less preferred substitute (laboratory chow).

RESULTS

IL-1β (1.0-4.0 μg/kg IP) shifted choice behavior, significantly decreasing lever pressing and increasing intake of the freely available chow. The second experiment assessed the ability of the adenosine A2A antagonist (E)-phosphoric acid mono-[3-[8-[2-(3-methoxyphenyl)vinyl]-7-methyl-2,6-dioxo-1-prop-2-ynyl-1,2,6,7-tetrahydropurin-3-yl] propyl] ester disodium salt (MSX-3) to reverse the behavioral effects of IL-1β. MSX-3 attenuated the effort-related impairments produced by IL-1β, increasing lever pressing and also decreasing chow intake. In the same dose range that shifted effort-related choice behavior, IL-1β did not alter food intake or preference in parallel free-feeding choice studies, indicating that these low doses were not generally suppressing appetite or altering preference for the high carbohydrate pellets. In addition, IL-1β did not affect core body temperature.

CONCLUSIONS

These results indicate that IL-1β can reduce the tendency to work for food, even at low doses that do not produce a general sickness, malaise, or loss of appetite. This research has implications for the involvement of cytokines in motivational symptoms such as anergia and fatigue.

Role of the plasticity-associated transcription factor zif268 in the early phase of instrumental learning

Gene transcription is essential for learning, but the precise role of transcription factors that control expression of many other genes in specific learning paradigms is yet poorly understood. Zif268 (Krox24/Egr-1) is a transcription factor and an immediate-early gene associated with memory consolidation and reconsolidation, and induced in the striatum after addictive drugs exposure. In contrast, very little is known about its physiological role at early stages of operant learning. We investigated the role of Zif268 in operant conditioning for food. Zif268 expression was increased in all regions of the dorsal striatum and nucleus accumbens in mice subjected to the first session of operant conditioning. In contrast, Zif268 increase in the dorsomedial caudate-putamen and nucleus accumbens core was not detected in yoked mice passively receiving the food reward. This indicates that Zif268 induction in these structures is linked to experiencing or learning contingency, but not to reward delivery. When the task was learned (5 sessions), Zif268 induction disappeared in the nucleus accumbens and decreased in the medial caudate-putamen, whereas it remained high in the lateral caudate-putamen, previously implicated in habit formation. In transgenic mice expressing green fluorescent protein (GFP) in the striatonigral neurons, Zif268 induction occured after the first training session in both GFP-positive and negative neurons indicating an enhanced Zif268 expression in both striatonigral and striatopallidal neurons. Mutant mice lacking Zif268 expression obtained less rewards, but displayed a normal discrimination between reinforced and non-reinforced targets, and an unaltered approach to food delivery box. In addition, their motivation to obtain food rewards, evaluated in a progressive ratio schedule, was blunted. In conclusion, Zif268 participates in the processes underlying performance and motivation to execute food-conditioned instrumental task.

Effort-related motivational effects of the VMAT-2 inhibitor tetrabenazine: implications for animal models of the motivational symptoms of depression

Motivated behaviors are often characterized by a high degree of behavioral activation, and work output and organisms frequently make effort-related decisions based upon cost/benefit analyses. Moreover, people with major depression and other disorders often show effort-related motivational symptoms such as anergia, psychomotor retardation, and fatigue. It has been suggested that tasks measuring effort-related choice behavior could be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT) inhibitor tetrabenazine. Tetrabenazine produces depressive symptoms in humans and, because of its selective inhibition of VMAT-2, it preferentially depletes dopamine (DA). Rats were assessed using a concurrent fixed-ratio 5/chow feeding choice task that is known to be sensitive to dopaminergic manipulations. Tetrabenazine shifted response choice in rats, producing a dose-related decrease in lever pressing and a concomitant increase in chow intake. However, it did not alter food intake or preference in parallel free-feeding choice studies. The effects of tetrabenazine on effort-related choice were reversed by the adenosine A2A antagonist MSX-3 and the antidepressant bupropion. A behaviorally active dose of tetrabenazine decreased extracellular DA in nucleus accumbens and increased expression of DARPP-32 in accumbens medium spiny neurons in a pattern indicative of reduced transmission at both D1 and D2 DA receptors. These experiments demonstrate that tetrabenazine, which is used in animal models to produce depression-like effects, can alter effort-related choice behavior. These studies have implications for the development of animal models of the motivational symptoms of depression and related disorders.

Effect of rhynchophylline on the expression of p-CREB and sc-Fos in triatum and hippocampal CA1 area of methamphetamine-induced conditioned place preference rats

To explore the effect of rhynchophylline (Rhy) on the expression of p-CREB and c-Fos in the striatum and hippocampal CA1 area of methamphetamine-induced conditioned place preference (CPP) rat, methamphetamine (2 mg/kg) was injected to rats and the conditioned place preference was observed in these rats treated with or without Rhy. An immunohistochemistry assay was used to determine the expression of p-CREB and c-Fos in the striatum and hippocampal CA1 area. Methamphetamine induced significant behavior alteration in CPP, while after pretreatment with rhynchophylline or ketamine, the time of staying in methamphetamine-paired compartment of rats was significantly reduced. Methamphetamine also increased the number of p-CREB positive cells in the striatum and hippocampal CA1 zone, as well as p-Fos positive cells. However, the compound Rhy could attenuate the effect. These findings show that Rhy can suppress the acquisition of CPP in rats induced by methamphetamine and the action may be related with the reduced expression of p-CREB and p-Fos in the striatum and hippocampus.

Methylphenidate restores novel object recognition in DARPP-32 knockout mice

Previously, we have shown that Dopamine- and cAMP-regulated phosphoprotein of 32kDa (DARPP-32) knockout mice required significantly more trials to reach criterion than wild-type mice in an operant reversal-learning task. The present study was conducted to examine adult male and female DARPP-32 knockout mice and wild-type controls in a novel object recognition test. Wild-type and knockout mice exhibited comparable behavior during the initial exploration trials. As expected, wild-type mice exhibited preferential exploration of the novel object during the substitution test, demonstrating recognition memory. In contrast, knockout mice did not show preferential exploration of the novel object, instead exhibiting an increase in exploration of all objects during the test trial. Given that the removal of DARPP-32 is an intracellular manipulation, it seemed possible to pharmacologically restore some cellular activity and behavior by stimulating dopamine receptors. Therefore, a second experiment was conducted examining the effect of methylphenidate. The results show that methylphenidate increased horizontal activity in both wild-type and knockout mice, though this increase was blunted in knockout mice. Pretreatment with methylphenidate significantly impaired novel object recognition in wild-type mice. In contrast, pretreatment with methylphenidate restored the behavior of DARPP-32 knockout mice to that observed in wild-type mice given saline. These results provide additional evidence for a functional role of DARPP-32 in the mediation of processes underlying learning and memory. These results also indicate that the behavioral deficits in DARPP-32 knockout mice may be restored by the administration of methylphenidate.

Genetic variation in dopamine-related gene expression influences motor skill learning in mice

Several neurodevelopmental disorders with a strong genetic basis, including attention-deficit/hyperactivity disorder, autism spectrum disorders and developmental coordination disorder, involve deficits in fine motor skills. This phenotype may depend on heritable variation in components of the dopamine (DA) system, which is known to play a critical role in motor skill learning. In this study, we took advantage of two inbred strains of mice (BALB/c and C57BL/6) that differ markedly in the number of midbrain DA neurons in order to investigate the influence of such naturally occurring genetic variation on the acquisition and performance of fine motor skills. Gene expression analysis of midbrain, frontal cortex and striatum showed significant differences in the expression of presynaptic and postsynaptic dopaminergic (DAergic) markers (e.g. tyrosine hydroxylase, DA transporter, DA D4 receptor, DA D5 receptor and DARPP-32) between these two strains. BALB/c mice had lower learning rate and performance scores in a complex skilled reaching task when compared with C57BL/6 mice. A negative correlation was found between the motor learning rate and level of DARPP-32 mRNA expression in the frontal cortex contralateral to the trained forelimb. The rate of motor learning was also negatively correlated with the levels of DARPP-32 and DA D1 receptor mRNAs in the striatum. Our results suggest that genetically driven variation in frontostriatal DAergic neurotransmission is a major contributor to individual differences in motor skill learning. Moreover, these findings implicate the D1R/cAMP/DARPP-32 signaling pathway in those neurodevelopmental disorders that are associated with fine motor skill deficits.

c-Fos immunoreactivity in prefrontal, basal ganglia and limbic areas of the rat brain after central and peripheral administration of ethanol and its metabolite acetaldehyde

Considerable evidence indicates that the metabolite of ethanol (EtOH), acetaldehyde, is biologically active. Acetaldehyde can be formed from EtOH peripherally mainly by alcohol dehydrogenase (ADH), and also centrally by catalase. EtOH and acetaldehyde show differences in their behavioral effects depending upon the route of administration. In terms of their effects on motor activity and motivated behaviors, when administered peripherally acetaldehyde tends to be more potent than EtOH but shows very similar potency administered centrally. Since dopamine (DA) rich areas have an important role in regulating both motor activity and motivation, the present studies were undertaken to compare the effects of central (intraventricular, ICV) and peripheral (intraperitoneal, IP) administration of EtOH and acetaldehyde on a cellular marker of brain activity, c-Fos immunoreactivity, in DA innervated areas. Male Sprague-Dawley rats received an IP injection of vehicle, EtOH (0.5 or 2.5 g/kg) or acetaldehyde (0.1 or 0.5 g/kg) or an ICV injection of vehicle, EtOH or acetaldehyde (2.8 or 14.0 μmoles). IP administration of EtOH minimally induced c-Fos in some regions of the prefrontal cortex and basal ganglia, mainly at the low dose (0.5 g/kg), while IP acetaldehyde induced c-Fos in virtually all the structures studied at both doses. Acetaldehyde administered centrally increased c-Fos in all areas studied, a pattern that was very similar to EtOH. Thus, IP administered acetaldehyde was more efficacious than EtOH at inducing c-Fos expression. However, the general pattern of c-Fos induction promoted by ICV EtOH and acetaldehyde was similar. These results are consistent with the pattern observed in behavioral studies in which both substances produced the same magnitude of effect when injected centrally, and produced differences in potency after peripheral administration.

Dopamine and food addiction: lexicon badly needed

Over the last few years, the concept of food addiction has become a common feature in the scientific literature, as well as the popular press. Nevertheless, the use of the term addiction to describe pathological aspects of food intake in humans remains controversial, and even among those who affirm the validity of the concept, there is considerable disagreement about its utility for explaining the increasing prevalence of obesity throughout much of the world. An examination of the literature on food addiction indicates that mesolimbic and nigrostriatal dopamine systems often are cited as mechanisms that contribute to the establishment of food addiction. However, in reviewing this literature, it is important to have a detailed consideration of the complex nature of dopaminergic involvement in motivational processes. For example, although it is often stated that mesolimbic dopamine mediates reward, there is no standard or consistent technical meaning of this term. Moreover, there is a persistent tendency to link dopamine transmission with pleasure or hedonia, as opposed to other aspects of motivation or learning. The present article provides a critical discussion of some aspects of the food addiction literature, viewed through the lens of recent findings and current theoretical views of dopaminergic involvement in food motivation. Furthermore, compulsive food intake and binge eating will be considered from an evolutionary perspective, in terms of the motivational subsystems that are involved in adaptive patterns of food consumption and seeking behaviors and a consideration of how these could be altered in pathological conditions.

The mysterious motivational functions of mesolimbic dopamine

Nucleus accumbens dopamine is known to play a role in motivational processes, and dysfunctions of mesolimbic dopamine may contribute to motivational symptoms of depression and other disorders, as well as features of substance abuse. Although it has become traditional to label dopamine neurons as "reward" neurons, this is an overgeneralization, and it is important to distinguish between aspects of motivation that are differentially affected by dopaminergic manipulations. For example, accumbens dopamine does not mediate primary food motivation or appetite, but is involved in appetitive and aversive motivational processes including behavioral activation, exertion of effort, approach behavior, sustained task engagement, Pavlovian processes, and instrumental learning. In this review, we discuss the complex roles of dopamine in behavioral functions related to motivation.

Dopaminergic modulation of effort-related choice behavior as assessed by a progressive ratio chow feeding choice task: pharmacological studies and the role of individual differences

Mesolimbic dopamine (DA) is involved in behavioral activation and effort-related processes. Rats with impaired DA transmission reallocate their instrumental behavior away from food-reinforced tasks with high response requirements, and instead select less effortful food-seeking behaviors. In the present study, the effects of several drug treatments were assessed using a progressive ratio (PROG)/chow feeding concurrent choice task. With this task, rats can lever press on a PROG schedule reinforced by a preferred high-carbohydrate food pellet, or alternatively approach and consume the less-preferred but concurrently available laboratory chow. Rats pass through each ratio level 15 times, after which the ratio requirement is incremented by one additional response. The DA D₂ antagonist haloperidol (0.025–0.1 mg/kg) reduced number of lever presses and highest ratio achieved but did not reduce chow intake. In contrast, the adenosine A_2A antagonist MSX-3 increased lever presses and highest ratio achieved, but decreased chow consumption. The cannabinoid CB1 inverse agonist and putative appetite suppressant AM251 decreased lever presses, highest ratio achieved, and chow intake; this effect was similar to that produced by pre-feeding. Furthermore, DA-related signal transduction activity (pDARPP-32(Thr34) expression) was greater in nucleus accumbens core of high responders (rats with high lever pressing output) compared to low responders. Thus, the effects of DA antagonism differed greatly from those produced by pre-feeding or reduced CB1 transmission, and it appears unlikely that haloperidol reduces PROG responding because of a general reduction in primary food motivation or the unconditioned reinforcing properties of food. Furthermore, accumbens core signal transduction activity is related to individual differences in work output.

The novel adenosine A(2A) antagonist prodrug MSX-4 is effective in animal models related to motivational and motor functions

Adenosine A(2A) and dopamine D2 receptors interact to regulate diverse aspects of ventral and dorsal striatal functions related to motivational and motor processes, and it has been suggested that adenosine A(2A) antagonists could be useful for the treatment of depression, parkinsonism and other disorders. The present experiments were performed to characterize the effects of MSX-4, which is an amino acid ester prodrug of the potent and selective adenosine A(2A) receptor antagonist MSX-2, by assessing its ability to reverse pharmacologically induced motivational and motor impairments. In the first group of studies, MSX-4 reversed the effects of the D2 antagonist eticlopride on a concurrent lever pressing/chow feeding task that is used as a measure of effort-related choice behavior. MSX-4 was less potent after intraperitoneal administration than the comparison compound, MSX-3, though both were equally efficacious. With this task, MSX-4 was orally active in the same dose range as MSX-3. MSX-4 also reversed the locomotor suppression induced by eticlopride in the open field, but did not induce anxiogenic effects as measured by the relative amount of interior activity. Behaviorally active doses of MSX-4 also attenuated the increase in c-Fos and pDARPP-32(Thr34) expression in nucleus accumbens core that was induced by injections of eticlopride. In addition, MSX-4 suppressed the oral tremor induced by the anticholinesterase galantamine, which is consistent with an antiparkinsonian profile. These actions of MSX-4 indicate that this compound could have potential utility as a treatment for parkinsonism, as well as some of the motivational symptoms of depression and other disorders.