A role for phasic dopamine release within the nucleus accumbens in encoding aversion: a review of the neurochemical literature

Sex-Dependent Differences in the Neural Correlates of Cocaine and Emotional Cue-Reactivity in Regular Cocaine Users and Non-Drug-Using Controls: Understanding the Role of Duration and Severity of Use

INTRODUCTION

The development of cocaine use disorder in females is suggested to be more strongly related to neural mechanisms underlying stress-reactivity, whereas in males it is suggested to be more strongly related to neural mechanisms underlying drug cue-reactivity. Existing evidence, however, is based on neuroimaging studies that either lack a control group and/or have very small sample sizes that do not allow to investigate sex differences.

METHODS

The main objective of the current study was to investigate sex differences in the neural correlates of cocaine and negative emotional cue-reactivity within high-risk intranasal cocaine users (CUs: 31 males and 26 females) and non-cocaine-using controls (non-CUs: 28 males and 26 females). A region of interest (ROI) analysis was applied to test for the main and interaction effects of group, sex, and stimulus type (cocaine cues vs. neutral cocaine cues and negative emotional cues vs. neutral emotional cues) on activity in the dorsal striatum, ventral striatum (VS), amygdala, and dorsal anterior cingulate cortex (dACC).

RESULTS

There were no significant sex or group differences in cocaine cue-reactivity in any of the ROIs. Results did reveal significant emotional cue-reactivity in the amygdala and VS, but these effects were not moderated by group or sex. Exploratory analyses demonstrated that emotional cue-induced activation of the dACC and VS was negatively associated with years of regular cocaine use in female CUs, while this relationship was absent in male CUs.

CONCLUSIONS

While speculative, the sex-specific associations between years of regular use and emotional cue-reactivity in the dACC and VS suggest that, with longer years of use, female CUs become less sensitive to aversive stimuli, including the negative consequences of cocaine use, which could account for the observed "telescoping effect" in female CUs.

Mesoaccumbal glutamate neurons drive reward via glutamate release but aversion via dopamine co-release

Ventral tegmental area (VTA) projections to the nucleus accumbens (NAc) drive reward-related motivation. Although dopamine neurons are predominant, a substantial glutamatergic projection is also present, and a subset of these co-release both dopamine and glutamate. Optogenetic stimulation of VTA glutamate neurons not only supports self-stimulation but can also induce avoidance behavior, even in the same assay. Here, we parsed the selective contribution of glutamate or dopamine co-release from VTA glutamate neurons to reinforcement and avoidance. We expressed channelrhodopsin-2 (ChR2) in mouse VTA glutamate neurons in combination with CRISPR-Cas9 to disrupt either the gene encoding vesicular glutamate transporter 2 (VGLUT2) or tyrosine hydroxylase (Th). Selective disruption of VGLUT2 abolished optogenetic self-stimulation but left real-time place avoidance intact, whereas CRISPR-Cas9 deletion of Th preserved self-stimulation but abolished place avoidance. Our results demonstrate that glutamate release from VTA glutamate neurons is positively reinforcing but that dopamine release from VTA glutamate neurons can induce avoidance behavior.

Interleukin-10 enhances activity of ventral tegmental area dopamine neurons resulting in increased dopamine release

Dopamine transmission from the ventral tegmental area (VTA) to the nucleus accumbens (NAc) regulates important aspects of motivation and is influenced by the neuroimmune system. The neuroimmune system is a complex network of leukocytes, microglia and astrocytes that detect and remove foreign threats like bacteria or viruses and communicate with each other to regulate non-immune (e.g neuronal) cell activity through cytokine signaling. Inflammation is a key regulator of motivational states, though the effects of specific cytokines on VTA circuitry and motivation are largely unknown. Therefore, electrophysiology, neurochemical, immunohistochemical and behavioral studies were performed to determine the effects of the anti-inflammatory cytokine interleukin-10 (IL-10) on mesolimbic activity, dopamine transmission and conditioned behavior. IL-10 enhanced VTA dopamine firing and NAc dopamine levels via decreased VTA GABA currents in dopamine neurons. The IL-10 receptor was localized on VTA dopamine and non-dopamine cells. The IL-10 effects on dopamine neurons required post-synaptic phosphoinositide 3-kinase activity, and IL-10 appeared to have little-to-no efficacy on presynaptic GABA terminals. Intracranial IL-10 enhanced NAc dopamine levels in vivo and produced conditioned place aversion. Together, these studies identify the IL-10R on VTA dopamine neurons as a potential regulator of motivational states.

A structural comparison of salt forms of dopamine with the structures of other phenylethylamines

The structures of four salt forms of dopamine are reported. These are dopamine [2-(3,4-dihydroxyphenyl)ethan-1-aminium] benzoate, C8H12NO2+·C7H5O2-, I, dopamine 4-nitrobenzoate, C8H12NO2+·C7H4NO4-, II, dopamine ethanedisulfonate, 2C8H12NO2+·C2H4O6S22-, III, and dopamine 4-hydroxybenzenesulfonate monohydrate, C8H12NO2+·C6H5O4S-·H2O, IV. In all four structures, the dopamine cation adopts an extended conformation. Intermolecular interaction motifs that are common in the salt forms of tyramine can be found in related dopamine structures, but hydrogen bonding in the dopamine structures appear to be more variable and less predictable than for tyramine. Packing analysis discovered three dopamine-containing groups of structures that can be described as isostructural with regards to the cation positions. Two of these groups contain both dopamine and tyramine species, and one of these is also highly variable in other ways too, containing anhydrous and hydrated forms, different anion types and ionized and neutral phenylethylamine species. As such, the group illustrates that packing behaviour can be robust and similar even where intermolecular interactions such as hydrogen bonds are very different.

Dopamine release at the time of a predicted aversive outcome causally controls the trajectory and expression of conditioned behavior

Dopamine release in the nucleus accumbens (NAc) is causally linked to adaptive aversive learning, and its dysregulation is a core phenotype in anxiety and stress disorders. Here, we record NAc core dopamine during a task where mice learn to discriminate between cues signaling two types of outcomes: (1) footshock presentation and (2) footshock omission. We show that dopamine release is evoked by footshock omission. This dopamine response is largest when the omission is unexpected and decreases over learning, and artificially increasing this signal disrupts discrimination learning. Conversely, optogenetic inhibition of dopamine responses to the footshock itself impairs learning. Finally, theory-driven computational modeling suggests that these effects can be explained by dopamine signaling the perceived saliency of predicted aversive events. Together, we elucidate the role of NAc dopamine in aversive learning and offer potential avenues for understanding the neural mechanisms involved in anxiety and stress disorders.

Modulation of aversive value coding in the vertebrate and invertebrate brain

Avoiding potentially dangerous situations is key for the survival of any organism. Throughout life, animals learn to avoid environments, stimuli or actions that can lead to bodily harm. While the neural bases for appetitive learning, evaluation and value-based decision-making have received much attention, recent studies have revealed more complex computations for aversive signals during learning and decision-making than previously thought. Furthermore, previous experience, internal state and systems level appetitive-aversive interactions seem crucial for learning specific aversive value signals and making appropriate choices. The emergence of novel methodologies (computation analysis coupled with large-scale neuronal recordings, neuronal manipulations at unprecedented resolution offered by genetics, viral strategies and connectomics) has helped to provide novel circuit-based models for aversive (and appetitive) valuation. In this review, we focus on recent vertebrate and invertebrate studies yielding strong evidence that aversive value information can be computed by a multitude of interacting brain regions, and that past experience can modulate future aversive learning and therefore influence value-based decisions.

The Role of Physical Exercise in Opioid Substitution Therapy: Mechanisms of Sequential Effects

It is generally accepted that chronic opioid use is associated with structural and functional changes in the human brain that lead to an enhancement of impulsive behavior for immediate satisfaction. Interestingly, in recent years, physical exercise interventions have been used as an adjunctive treatment for patients with opioid use disorders (OUDs). Indeed, exercise has positive effects on both the biological and psychosocial basis of addiction, modifying neural circuits such as the reward, inhibition, and stress systems, and thus causing behavioral changes. This review focuses on the possible mechanisms that contribute to the beneficial effects of exercise on the treatment of OUDs, with emphasis placed on the description of a sequential consolidation of these mechanisms. Exercise is thought to act initially as a factor of internal activation and self-regulation and eventually as a factor of commitment. This approach suggests a sequential (temporal) consolidation of the functions of exercise in favor of gradual disengagement from addiction. Particularly, the sequence in which the exercise-induced mechanisms are consolidated follows the pattern of internal activation-self-regulation-commitment, eventually resulting in stimulation of the endocannabinoid and endogenous opioid systems. Additionally, this is accompanied by modification of molecular and behavioral aspects of opioid addiction. Overall, the neurobiological actions of exercise in combination with certain psychological mechanisms appear to promote its beneficial effects. Given the positive effects of exercise on both physical and mental health, exercise prescription is recommended as a complement to conventional therapy for patients on opioid maintenance treatment.

Neurotransmitters Regulation and Food Intake: The Role of Dietary Sources in Neurotransmission

Neurotransmitters (NTs) are biologically active chemicals, which mediate the electrochemical transmission between neurons. NTs control numerous organic functions particularly crucial for life, including movement, emotional responses, and the physical ability to feel pleasure and pain. These molecules are synthesized from simple, very common precursors. Many types of NTs have both excitatory and inhibitory effects. Neurotransmitters' imbalance can cause many diseases and disorders, such as Parkinson's disease, depression, insomnia, increased anxiety, memory loss, etc. Natural food sources containing NTs and/or their precursors would be a potential option to help maintain the balance of NTs to prevent brain and psychiatric disorders. The level of NTs could be influenced, therefore, by targeting dietary habits and nutritional regimens. The progressive implementation of nutritional approaches in clinical practice has made it necessary to infer more about some of the nutritional NTs in neuropsychiatry. However, the importance of the intake of nutritional NTs requires further understanding, since there are no prior significant studies about their bioavailability, clinical significance, and effects on nerve cells. Interventional strategies supported by evidence should be encouraged.

Habit Formation and the Effect of Repeated Stress Exposures on Cognitive Flexibility Learning in Horses

Horse training exposes horses to an array of cognitive and ethological challenges. Horses are routinely required to perform behaviours that are not aligned to aspects of their ethology, which may delay learning. While horses readily form habits during training, not all of these responses are considered desirable, resulting in the horse being subject to retraining. This is a form of cognitive flexibility and is critical to the extinction of habits and the learning of new responses. It is underpinned by complex neural processes which can be impaired by chronic or repeated stress. Domestic horses may be repeatedly exposed to multiples stressors. The potential contribution of stress impairments of cognitive flexibility to apparent training failures is not well understood, however research from neuroscience can be used to understand horses’ responses to training. We trained horses to acquire habit-like responses in one of two industry-style aversive instrumental learning scenarios (moving away from the stimulus-instinctual or moving towards the stimulus-non-instinctual) and evaluated the effect of repeated stress exposures on their cognitive flexibility in a reversal task. We measured heart rate as a proxy for noradrenaline release, salivary cortisol and serum Brain Derived Neurotrophic Factor (BDNF) to infer possible neural correlates of the learning outcomes. The instinctual task which aligned with innate equine escape responses to aversive stimuli was acquired significantly faster than the non-instinctual task during both learning phases, however contrary to expectations, the repeated stress exposure did not impair the reversal learning. We report a preliminary finding that serum BDNF and salivary cortisol concentrations in horses are positively correlated. The ethological salience of training tasks and cognitive flexibility learning can significantly affect learning in horses and trainers should adapt their practices where such tasks challenge innate equine behaviour.

Freezing revisited: coordinated autonomic and central optimization of threat coping

Animals have sophisticated mechanisms for coping with danger. Freezing is a unique state that, upon threat detection, allows evidence to be gathered, response possibilities to be previsioned and preparations to be made for worst-case fight or flight. We propose that - rather than reflecting a passive fear state - the particular somatic and cognitive characteristics of freezing help to conceal overt responses, while optimizing sensory processing and action preparation. Critical for these functions are the neurotransmitters noradrenaline and acetylcholine, which modulate neural information processing and also control the sympathetic and parasympathetic branches of the autonomic nervous system. However, the interactions between autonomic systems and the brain during freezing, and the way in which they jointly coordinate responses, remain incompletely explored. We review the joint actions of these systems and offer a novel computational framework to describe their temporally harmonized integration. This reconceptualization of freezing has implications for its role in decision-making under threat and for psychopathology.

Neural alterations in opioid-exposed infants revealed by edge-centric brain functional networks

Prenatal opioid exposure has been linked to adverse effects spanning multiple neurodevelopmental domains, including cognition, motor development, attention, and vision. However, the neural basis of these abnormalities is largely unknown. A total of 49 infants, including 21 opioid-exposed and 28 controls, were enrolled and underwent MRI (43 ± 6 days old) after birth, including resting state functional MRI. Edge-centric functional networks based on dynamic functional connections were constructed, and machine-learning methods were employed to identify neural features distinguishing opioid-exposed infants from unexposed controls. An accuracy of 73.6% (sensitivity 76.25% and specificity 69.33%) was achieved using 10 times 10-fold cross-validation, which substantially outperformed those obtained using conventional static functional connections (accuracy 56.9%). More importantly, we identified that prenatal opioid exposure preferentially affects inter- rather than intra-network dynamic functional connections, particularly with the visual, subcortical, and default mode networks. Consistent results at the brain regional and connection levels were also observed, where the brain regions and connections associated with visual and higher order cognitive functions played pivotal roles in distinguishing opioid-exposed infants from controls. Our findings support the clinical phenotype of infants exposed to opioids in utero and may potentially explain the higher rates of visual and emotional problems observed in this population. Finally, our findings suggested that edge-centric networks could better capture the neural differences between opioid-exposed infants and controls by abstracting the intrinsic co-fluctuation along edges, which may provide a promising tool for future studies focusing on investigating the effects of prenatal opioid exposure on neurodevelopment.

Frequency of the Dopamine Receptor D3 (rs6280) vs. Opioid Receptor µ1 (rs1799971) Polymorphic Risk Alleles in Patients with Opioid Use Disorder: A Preponderance of Dopaminergic Mechanisms?

While opioids are a powerful class of drugs that inhibit transmission of pain signals, their use is tarnished by the current epidemic of opioid use disorder (OUD) and overdose deaths. Notwithstanding published reports, there remain gaps in our knowledge of opioid receptor mechanisms and their role in opioid seeking behavior. Thus, novel insights into molecular, neurogenetic and neuropharmacological bases of OUD are needed. We propose that an addictive endophenotype may not be entirely specific to the drug of choice but rather may be generalizable to altered brain reward circuits impacting net mesocorticolimbic dopamine release. We suggest that genetic or epigenetic alterations across dopaminergic reward systems lead to uncontrollable self-administration of opioids and other drugs. For instance, diminished availability via knockout of dopamine D3 receptor (DRD3) increases vulnerability to opioids. Building upon this concept via the use of a sophisticated polymorphic risk analysis in a human cohort of chronic opioid users, we found evidence for a higher frequency of polymorphic DRD3 risk allele (rs6280) than opioid receptor µ1 (rs1799971). In conclusion, while opioidergic mechanisms are involved in OUD, dopamine-related receptors may have primary influence on opioid-seeking behavior in African Americans. These findings suggest OUD-targeted novel and improved neuropharmacological therapies may require focus on DRD3-mediated regulation of dopaminergic homeostasis.

Dopaminergic neurons project to the nucleus accumbens regulates anxiety-like behaviors through dopamine D1 signaling

Dopamine (DA) transmission is important in the regulation of mood and anxiety behaviors. However, how specific dopaminergic signaling pathways respond to anxiogenic stimuli as well as regulate behaviors remains unknown. To understand how DA regulates the animal behaviors under anxiety we performed retrograde labeling and c-Fos staining of midbrain DA neurons. Our c-Fos labeling results showed that DA neurons projected to nucleus accumbens (NAc) are activated in animals treated with the elevated plus-maze (EPM). Real-time measurement of DA release using fast scanning cyclic voltammetry (FSCV) in NAc of freely behaving mice showed that increased DA release and more DA transients in the close arms than the open arms in the EPM. Meanwhile, we also observed a reduction of DA level from the close arms to the open arms. Local infusion of DA D₁ receptor antagonist, SCH23390 in the core of NAc, leads to an anxiolytic-like effect in the open-field and EPM. These anxiolytic effects were not observed in animals received D₂ receptor antagonist sulpiride infusion in the core of NAc. Taken together, our results reveal a novel function of the mesolimbic DA pathway through the D₁ receptor in the regulation of anxiety-like behaviors.

Functional connectivity during feedback learning in smokers

BACKGROUND

Although it has been traditionally assumed that dysregulation of psychological processes in smokers results from activity within specific brain regions, an emerging view regards such dysregulation as attributable to aberrant communication between distinct brain regions. These processes can be measured during appropriate task paradigms such as the learning from errors task. This study aims to elucidate interactions between brain regions underlying the process of learning from errors, punishment and sensitivity to reward in dependent smokers.

METHODS

Functional MRI data from 23 age-matched dependent smokers (8 females, mean age = 25.48, SD = 4.46) and 23 controls (13 females, mean age = 24.83, SD = 5.99) were analysed during a feedback-based associative learning task. Functional connectivity between the dorsal anterior cingulate cortex, nucleus accumbens and reward/sensorimotor areas was investigated during a feedback learning task.

RESULTS

Behaviourally, smokers exhibited lower error correction rates and were less sensitive to punishment magnitude. Smokers showed increased functional connectivity between dorsal anterior cingulate cortex/nucleus accumbens seed regions and numerous reward-related target regions including the putamen, anterior cingulate and orbitofrontal cortex.

CONCLUSIONS

Reduced learning from errors and widespread aberrant functional connectivity contribute to the emerging functional characterisation of dependent smokers and may bear significant implications when considering the efficacy of smoking interventions.

Motivational Salience Guides Attention to Valuable and Threatening Stimuli: Evidence from Behavior and Functional Magnetic Resonance Imaging

Rewarding and aversive outcomes have opposing effects on behavior, facilitating approach and avoidance, although we need to accurately anticipate each type of outcome to behave effectively. Attention is biased toward stimuli that have been learned to predict either type of outcome, and it remains an open question whether such orienting is driven by separate systems for value- and threat-based orienting or whether there exists a common underlying mechanism of attentional control driven by motivational salience. Here, we provide a direct comparison of the neural correlates of value- and threat-based attentional capture after associative learning. Across multiple measures of behavior and brain activation, our findings overwhelmingly support a motivational salience account of the control of attention. We conclude that there exists a core mechanism of experience-dependent attentional control driven by motivational salience and that prior characterizations of attention as being value driven or supporting threat monitoring need to be revisited.

Distinct Role of Dopamine in the PFC and NAc During Exposure to Cocaine-Associated Cues

BACKGROUND

Dopamine neurotransmission plays a critical role in reward in drug abuse and drug addiction. However, the role of dopamine in the recognition of drug-associated environmental stimuli, retrieval of drug-associated memory, and drug-seeking behaviors is not fully understood.

METHODS

Roles of dopamine neurotransmission in the prefrontal cortex (PFC) and nucleus accumbens (NAc) in the cocaine-conditioned place preference (CPP) paradigm were evaluated using in vivo microdialysis.

RESULTS

In mice that had acquired cocaine CPP, dopamine levels in the PFC, but not in the NAc, increased in response to cocaine-associated cues when mice were placed in the cocaine chamber of an apparatus with 2 separated chambers. The induction of the dopamine response and the development of cocaine CPP were mediated through activation of glutamate NMDA (N-methyl-D-aspartate)/AMPA (α-amino-3-hydroxy-5-methyl-4-isoxazolepropionic acid) receptor signaling in the PFC during conditioning. Activation of dopamine D1 or D2 receptor signaling in the PFC was required for cocaine-induced locomotion, but not for the induction of the dopamine response or the development of cocaine CPP. Interestingly, dopamine levels in the NAc increased in response to cocaine-associated cues when mice were placed at the center of an apparatus with 2 connected chambers, which requires motivated exploration associated with cocaine reward.

CONCLUSIONS

Dopamine neurotransmission in the PFC is activated by the exposure to the cocaine-associated cues, whereas dopamine neurotransmission in the NAc is activated in a process of motivated exploration of cues associated with cocaine reward. Furthermore, the glutamate signaling cascade in the PFC is suggested to be a potential therapeutic target to prevent the progression of drug addiction.

Characterization of cognitive function in survivors of diffuse gliomas using resting-state functional MRI (rs-fMRI)

As treatments for diffuse gliomas have advanced, survival for patients with gliomas has also increased. However, there remains limited knowledge on the relationships between brain connectivity and the lasting changes to cognitive function that glioma survivors often experience long after completing treatment. This resting-state functional magnetic resonance imaging (rs-fMRI) study explored functional connectivity (FC) alterations associated with cognitive function in survivors of gliomas. In this pilot study, 22 patients (mean age 43.8 ± 11.9) with diffuse gliomas who completed treatment within the past 10 years were evaluated using rs-fMRI and neuropsychological measures. Novel rs-fMRI analysis methods were used to account for missing brain in the resection cavity. FC relationships were assessed between cognitively impaired and non-impaired glioma patients, along with self-reported cognitive impairment, non-work daily functioning, and time with surgery. In the cognitively non-impaired patients, FC was stronger in the medial prefrontal cortex, rostral prefrontal cortex, and intraparietal sulcus compared to the impaired survivors. When examining non-work daily functioning, a positive correlation with FC was observed between the accumbens and the intracalcarine cortices, while a negative correlation with FC was observed between the parietal operculum cortex and the cerebellum. Additionally, worse self-reported cognitive impairment and worse non-work daily functioning were associated with increased FC between regions involved in cognition and sensorimotor processing. These preliminary findings suggest that neural correlates for cognitive and daily functioning in glioma patients can be revealed using rs-fMRI. Resting-state network alterations may serve as a biomarker for patients’ cognition and functioning.

Subcortical structures and visual divergent thinking: a resting-state functional MRI analysis

An increasing number of studies have found that a few, specific subcortical regions are involved in creative visual divergent thinking. In addition, creative thinking is heavily reliant on the fronto-striatal dopaminergic pathways. This study aimed to explore whether spontaneous fluctuations in the subcortex, which contribute to our creative abilities, showed significant differences between individuals with different levels of creativity based on resting-state functional magnetic resonance imaging data. We calculated subcortical regions' seed-wise and dynamic functional connectivity (dFC), and then examined the differences between the high and low visual creativity groups. Furthermore, the topological properties of the subcortical network were measured, and their relationship with creative visual divergent thinking was calculated using brain-behavior correlation analyses. The results showed that functional connectivity (FC) between the putamen, pallidum, and thalamus indicated group differences within the subcortex. Whole-brain FC results showed group differences across subcortical (i.e., the thalamus and pallidum) and cerebral regions (i.e., the insula, middle frontal gyrus, and middle temporal gyrus). In addition, subcortical FC demonstrated a positive correlation with visual divergent thinking scores across the pallidum, putamen, and thalamus. Our findings provide novel insights into the relationship between visual divergent thinking and the activities of the subcortex. It is likely that not only fronto-striatal dopaminergic pathways, but also "motor" pathways, are involved in creative visual divergent thinking processing.

Dissociable roles of the nucleus accumbens core and shell subregions in the expression and extinction of conditioned fear

The nucleus accumbens (NAc), consisting of core (NAcC) and shell (NAcS) sub-regions, has primarily been studied as a locus mediating the effects of drug reward and addiction. However, there is ample evidence that this region is also involved in regulating aversive responses, but the exact role of the NAc and its subregions in regulating associative fear processing remains unclear. Here, we investigated the specific contribution of the NAcC and NAcS in regulating both fear expression and fear extinction in C57BL/6J mice. Using Arc expression as an indicator of neuronal activity, we first show that the NAcC is specifically active only in response to an associative fear cue during an expression test. In contrast, the NAcS is specifically active during fear extinction. We next inactivated each subregion using lidocaine and demonstrated that the NAcC is necessary for fear expression, but not for extinction learning or consolidation of extinction. In contrast, we demonstrate that the NAcS is necessary for the consolidation of extinction, but not fear expression or extinction learning. Further, inactivation of mGluR1 or ERK signaling specifically in the NAcS disrupted the consolidation of extinction but had no effect on fear expression or extinction learning itself. Our data provide the first evidence for the importance of the ERK/MAPK pathway as the underlying neural mechanism facilitating extinction consolidation within the NAcS. These findings suggest that the NAc subregions play dissociable roles in regulating fear recall and the consolidation of fear extinction, and potentially implicate them as critical regions within the canonical fear circuit.

Obesity and dietary fat influence dopamine neurotransmission: exploring the convergence of metabolic state, physiological stress, and inflammation on dopaminergic control of food intake

The aim of this review is to explore how metabolic changes induced by diets high in saturated fat (HFD) affect nucleus accumbens (NAc) dopamine neurotransmission and food intake, and to explore how stress and inflammation influence this process. Recent evidence linked diet-induced obesity and HFD with reduced dopamine release and reuptake. Altered dopamine neurotransmission could disrupt satiety circuits between NAc dopamine terminals and projections to the hypothalamus. The NAc directs learning and motivated behaviours based on homeostatic needs and psychological states. Therefore, impaired dopaminergic responses to palatable food could contribute to weight gain by disrupting responses to food cues or stress, which impacts type and quantity of food consumed. Specifically, saturated fat promotes neuronal resistance to anorectic hormones and activation of immune cells that release proinflammatory cytokines. Insulin has been shown to regulate dopamine neurotransmission by enhancing satiety, but less is known about effects of diet-induced stress. Therefore, changes to dopamine signalling due to HFD warrant further examination to characterise crosstalk of cytokines with endocrine and neurotransmitter signals. A HFD promotes a proinflammatory environment that may disrupt neuronal endocrine function and dopamine signalling that could be exacerbated by the hypothalamic-pituitary-adrenal and κ-opioid receptor stress systems. Together, these adaptive changes may dysregulate eating by changing NAc dopamine during hedonic versus homeostatic food intake. This could drive palatable food cravings during energy restriction and hinder weight loss. Understanding links between HFD and dopamine neurotransmission will inform treatment strategies for diet-induced obesity and identify molecular candidates for targeted therapeutics.

Cannabinoid Modulation of Dopamine Release During Motivation, Periodic Reinforcement, Exploratory Behavior, Habit Formation, and Attention

Motivational and attentional processes energize action sequences to facilitate evolutionary competition and promote behavioral fitness. Decades of neuropharmacology, electrophysiology and electrochemistry research indicate that the mesocorticolimbic DA pathway modulates both motivation and attention. More recently, it was realized that mesocorticolimbic DA function is tightly regulated by the brain's endocannabinoid system and greatly influenced by exogenous cannabinoids-which have been harnessed by humanity for medicinal, ritualistic, and recreational uses for 12,000 years. Exogenous cannabinoids, like the primary psychoactive component of cannabis, delta-9-tetrahydrocannabinol, produce their effects by acting at binding sites for naturally occurring endocannabinoids. The brain's endocannabinoid system consists of two G-protein coupled receptors, endogenous lipid ligands for these receptor targets, and several synthetic and metabolic enzymes involved in their production and degradation. Emerging evidence indicates that the endocannabinoid 2-arachidonoylglycerol is necessary to observe concurrent increases in DA release and motivated behavior. And the historical pharmacology literature indicates a role for cannabinoid signaling in both motivational and attentional processes. While both types of behaviors have been scrutinized under manipulation by either DA or cannabinoid agents, there is considerably less insight into prospective interactions between these two important signaling systems. This review attempts to summate the relevance of cannabinoid modulation of DA release during operant tasks designed to investigate either motivational or attentional control of behavior. We first describe how cannabinoids influence DA release and goal-directed action under a variety of reinforcement contingencies. Then we consider the role that endocannabinoids might play in switching an animal's motivation from a goal-directed action to the search for an alternative outcome, in addition to the formation of long-term habits. Finally, dissociable features of attentional behavior using both the 5-choice serial reaction time task and the attentional set-shifting task are discussed along with their distinct influences by DA and cannabinoids. We end with discussing potential targets for further research regarding DA-cannabinoid interactions within key substrates involved in motivation and attention.

Emotional State and Feedback-Related Negativity Induced by Positive, Negative, and Combined Reinforcement

Reinforcement learning relies on the reward prediction error (RPE) signals conveyed by the midbrain dopamine system. Previous studies showed that dopamine plays an important role in both positive and negative reinforcement. However, whether various reinforcement processes will induce distinct learning signals is still unclear. In a probabilistic learning task, we examined RPE signals in different reinforcement types using an electrophysiology index, namely, the feedback-related negativity (FRN). Ninety-four participants were randomly assigned into four groups: base (no money incentive), positive reinforcement (presentation of money rewards), negative reinforcement (removal of money losses), and combined reinforcement (money rewards and removal of money losses) groups. In addition, in order to evaluate the engagement of emotional activity in the different reinforcement processes, Positive and Negative Affect Schedule-Expanded Form (PANAS-X) scales were applied before and after the experiment to detect the emotional changes. The results showed that there was no difference between groups in the dopamine-related learning bias. However, compared to the other three groups, negative reinforcement elicited smaller FRN (the difference-wave measure) during the learning, stronger positive affect and joviality, and less fatigue after the learning, in which the difference between the negative and positive reinforcement groups was smaller. The results indicated that pure avoidance motivation may induce distinct emotional fluctuations, which influence the feedback processing.

Explaining socioeconomic disparities in health behaviours: A review of biopsychological pathways involving stress and inflammation

The purpose of this article was to explore how individuals' position in a socioeconomic hierarchy is related to health behaviours that are related to socioeconomic disparities in health. We identified research which shows that: (a) low socioeconomic status (SES) is associated with living in harsh environments, (b) harsh environments are related to increased levels of stress and inflammation, (c) stress and inflammation impact neural systems involved in self-control by sensitising the impulsive system and desensitising the reflective system, (d) the effects are inflated valuations of small immediate rewards and deflated valuations of larger delayed rewards, (e) these effects are observed as increased delay discounting, and (f) delay discounting is positively associated with practicing more unhealthy behaviours. The results are discussed within an adaptive evolutionary framework which lays out how the stress response system, and its interaction with the immune system and brain systems for decision-making and behaviours, provides the biopsychological mechanisms and regulatory shifts that make widespread conditional adaptability possible. Consequences for policy work, interventions, and future research are discussed.

Impairment of Synaptic Plasticity by Cannabis, Δ9-THC, and Synthetic Cannabinoids

The ability of neurons to dynamically and flexibly encode synaptic inputs via short- and long-term plasticity is critical to an organism's ability to learn and adapt to the environment. Whereas synaptic plasticity may be encoded by pre- or postsynaptic mechanisms, current evidence suggests that optimization of learning requires both forms of plasticity. Endogenous cannabinoids (eCBs) play critical roles in modulating synaptic transmission via activation of cannabinoid CB1 receptors (CB1Rs) in many central nervous system (CNS) regions, and the eCB system has been implicated, either directly or indirectly, in several forms of synaptic plasticity. Because of this, perturbations within the eCB signaling system can lead to impairments in a variety of learned behaviors. One agent of altered eCB signaling is exposure to "exogenous cannabinoids" such as the primary psychoactive constituent of cannabis, Δ⁹-THC, or illicit synthetic cannabinoids that in many cases have higher potency and efficacy than Δ⁹-THC. Thus, by targeting the eCB system, these agonists can produce widespread impairment of synaptic plasticity by disrupting ongoing eCB function. Here, we review studies in which Δ⁹-THC and synthetic cannabinoids impair synaptic plasticity in a variety of neuronal circuits and examine evidence that this contributes to their well-documented ability to disrupt cognition and behavior.

Pharmacokinetic, behavioral, and brain activity effects of Δ9-tetrahydrocannabinol in adolescent male and female rats

Δ⁹-tetrahydrocannabinol (THC) is the intoxicating constituent of cannabis and is responsible for the drug's reinforcing effects. Retrospective human studies suggest that cannabis use during adolescence is linked to long-term negative psychological outcomes, but in such studies it is difficult to distinguish the effects of THC from those of coexisting factors. Therefore, translationally relevant animal models are required to properly investigate THC effects in adolescents. However, though the relevance of these studies depends upon human-relevant dosing, surprisingly little is known about THC pharmacology and its effects on behavior and brain activity in adolescent rodents-especially in females. Here, we conducted a systematic investigation of THC pharmacokinetics, metabolism and distribution in blood and brain, and of THC effects upon behavior and neural activity in adolescent Long Evans rats of both sexes. We administered THC during an early-middle adolescent window (postnatal days 27-45) in which the brain may be particularly sensitive to developmental perturbation by THC. We determined the pharmacokinetic profile of THC and its main first-pass metabolites (11-hydroxy-THC and 11-nor-9-carboxy-THC) in blood and brain following acute injection (0.5 or 5 mg/kg, intraperitoneal). We also evaluated THC effects on behavioral assays of anxiety, locomotion, and place conditioning, as well as c-Fos expression in 14 brain regions. Confirming previous work, we find marked sex differences in THC metabolism, including a female-specific elevation in the bioactive metabolite 11-hydroxy-THC. Furthermore, we find dose-dependent and sex-dependent effects on behavior, neural activity, and functional connectivity across multiple nodes of brain stress and reward networks. Our findings are relevant for interpreting results of rat adolescent THC exposure studies, and may lend new insights into how THC impacts the brain in a sex-dependent manner.

Endocannabinoid modulation of dopamine release during reward seeking, interval timing, and avoidance

Endocannabinoids (eCBs) are neuromodulators that influence a wide range of neural systems and behaviors. In the current review, we describe our recent research showing how eCBs, particularly 2-arachidonoylglycerol (2-AG), concurrently shape mesolimbic dopamine (DA) release and associated behavior. We will restrict our discussion by emphasizing three distinct behaviors: reward seeking, interval timing, and active avoidance. During reward seeking we find that 2-AG is necessary to observe cue-evoked DA release events that are thought to represent the value of a rewarding outcome. We then describe data showing that 2-AG modulates unique patterns of DA release and behavior observed under conditions of periodic reinforcement. These data are discussed within the context of interval timing and adjunctive behavior. eCB modulation of DA release is also implicated in defensive behavior, including the avoidance of harm. As in reward seeking, our data suggest that the concentration of DA that is evoked by a warning signal can represent the value of an avoidance outcome. And, disrupting eCB signaling concomitantly reduces the concentration of the avoidance value signal and active avoidance. Disruptions in reward seeking, interval timing, and defensive behavior are commonly observed in a variety of movement disorders (e.g., Parkinson's and Huntington's disease) and disorders of motivation (e.g., addiction). We believe our data on eCB-DA interactions have implications for the development of novel pharmacotherapies to treat these disorders. Thus, we conclude by discussing how eCB pharmacology might be harnessed to treat disorders of movement and motivation.

A Brain on Cannabinoids: The Role of Dopamine Release in Reward Seeking and Addiction

Cannabis sativa, like all known drugs of abuse, leads to increased dopamine activation within the mesolimbic pathway. Consequent dopamine release within terminal regions of the striatum is a powerful mediator of reward and reinforcement and patterned dopamine release is critical for associative learning processes that are fundamentally involved in addiction. The endocannabinoid system modulates dopamine release at multiple sites, and the receptors, endogenous ligands, and synthetic and metabolic enzymes of the endocannabinoid system may provide key targets for pharmacotherapies to treat disorders of motivation including addiction. Disrupting endocannabinoid signaling decreases drug-induced increases in dopamine release as well those dopamine events evoked by conditioned stimuli during reward seeking. Advances in recording techniques for dopamine are allowing unprecedented examinations of these two interacting systems and elucidating the mechanisms of endocannabinoid modulation of dopamine release in reward and addiction.

Transcriptomics Analysis Reveals Shared Pathways in Peripheral Blood Mononuclear Cells and Brain Tissues of Patients With Schizophrenia

Background: Schizophrenia is a serious mental disorder with complicated biological mechanisms. Few studies explore the transcriptional features that are shared in brain tissue and peripheral blood. In the present study, we aimed to explore the biological pathways with similar expression patterns in both peripheral blood mononuclear cells (PBMCs) and brain tissues. Methods: The present study used transcriptomics technology to detect mRNA expression of PBMCs of 10 drug-naïve patients with schizophrenia and 20 healthy controls. Transcriptome data sets of brain tissue of patients with schizophrenia downloaded from public databases were also analyzed in our study. The biological pathways with similar expression patterns in the PBMCs and brain tissues were uncovered by differential expression analysis, weighted gene co-expression network analysis (WGCNA), and pathway analysis. Finally, the expression levels of differential expressed genes (DEGs) were validated by real-time fluorescence quantitative polymerase chain reaction (qPCR) in another 12 drug-naïve patients with schizophrenia and 12 healthy controls. Results: We identified 542 DEGs, 51 DEGs, 732 DEGs, and 104 DEGs in PBMCs, dorsolateral prefrontal cortex, anterior cingulate gyrus, and nucleus accumbent, respectively. Five DEG clusters were recognized as having similar gene expression patterns in PBMCs and brain tissues by WGCNA. The pathway analysis illustrates that these DEG clusters are mainly enriched in several biological pathways that are related to phospholipid metabolism, ribosome signal transduction, and mitochondrial oxidative phosphorylation. The differential significance of PLAAT3, PLAAT4, PLD2, RPS29, RPL30, COX7C, COX7A2, NDUFAF2, and ATP5ME were confirmed by qPCR. Conclusions: This study finds that the pathways associated with phospholipid metabolism, ribosome signal transduction, and energy metabolism have similar expression patterns in PBMCs and brain tissues of patients with schizophrenia. Our results supply a novel insight for revealing the pathogenesis of schizophrenia and might offer a new approach to explore potential biological markers of peripheral blood in schizophrenia.

Acute exercise enhances fear extinction through a mechanism involving central mTOR signaling

Impaired fear extinction, combined with the likelihood of fear relapse after exposure therapy, contributes to the persistence of many trauma-related disorders such as anxiety and post-traumatic stress disorder. Identifying mechanisms to aid fear extinction and reduce relapse could provide novel strategies for augmentation of exposure therapy. Exercise can enhance learning and memory and augment fear extinction of traumatic memories in humans and rodents. One factor that could contribute to enhanced fear extinction following exercise is the mammalian target of rapamycin (mTOR). mTOR is a translation regulator involved in synaptic plasticity and is sensitive to many exercise signals such as monoamines, growth factors, and cellular metabolism. Further, mTOR signaling is increased after chronic exercise in brain regions involved in learning and emotional behavior. Therefore, mTOR is a compelling potential facilitator of the memory-enhancing and overall beneficial effects of exercise on mental health.The goal of the current study is to test the hypothesis that mTOR signaling is necessary for the enhancement of fear extinction produced by acute, voluntary exercise. We observed that intracerebral-ventricular administration of the mTOR inhibitor rapamycin reduced immunoreactivity of phosphorylated S6, a downstream target of mTOR, in brain regions involved in fear extinction and eliminated the enhancement of fear extinction memory produced by acute exercise, without reducing voluntary exercise behavior or altering fear extinction in sedentary rats. These results suggest that mTOR signaling contributes to exercise-augmentation of fear extinction.

The role of cannabinoid 1 receptor in the nucleus accumbens on tramadol induced conditioning and reinstatement

AIMS

Previous investigations demonstrated that tramadol, as a painkiller, similar to morphine induces tolerance and dependence. Furthermore, the cannabinoid receptor 1 (CB1R) located in the nucleus accumbens (NAc) plays a critical role in morphine-induced conditioning. Therefore, the main objective of this study was to evaluate the role of NAc CB1R in tramadol induced conditioning and reinstatement.

MAIN METHODS

In the present experiment, the effect of NAc CB1 receptors on tramadol induced conditioning was tested by microinjecting of arachidonylcyclopropylamide (ACPA, CB1R agonist) and AM 251 (CB1R inverse agonist) in the NAc during tramadol-induced conditioning in the adult male Wistar rats. In addition, the role of NAc CB1R in the reinstatement was also evaluated by injecting ACPA and AM 251 after a 10-days extinction period.

KEY FINDINGS

The obtained data revealed that the administration of tramadol (1,2, and 4 mg/kg, ip) dose-dependently produced conditioned place preference (CPP). Moreover, intra-NAc administration of ACPA (0.25, 0.5, and 1 μg/rat) dose-dependently induced conditioning, while the administration of AM-251 (30, 60, and 120 ng/rat) induced a significant aversion. In addition, the administration of a non-effective dose of AM251 during tramadol conditioning inhibited conditioning induced by tramadol. On the other hand, the administration of ACPA after extinction induced a significant reinstatement. Notably, the locomotor activity did not change among groups.

SIGNIFICANCE

Previous studies have shown that tramadol-induced CPP occurs through μ-opioid receptors. The data obtained in the current study indicated that CB1R located in the NAc is involved in mediating conditioning induced by tramadol. Besides, CB1R also plays a vital role in the reinstatement of tramadol-conditioned animals. It might be due to the effect of opioids on enhancing the level of CB1R.

Alcohol Sensitivity as an Endophenotype of Alcohol Use Disorder: Exploring Its Translational Utility between Rodents and Humans

Alcohol use disorder (AUD) is a complex, chronic, relapsing disorder with multiple interacting genetic and environmental influences. Numerous studies have verified the influence of genetics on AUD, yet the underlying biological pathways remain unknown. One strategy to interrogate complex diseases is the use of endophenotypes, which deconstruct current diagnostic categories into component traits that may be more amenable to genetic research. In this review, we explore how an endophenotype such as sensitivity to alcohol can be used in conjunction with rodent models to provide mechanistic insights into AUD. We evaluate three alcohol sensitivity endophenotypes (stimulation, intoxication, and aversion) for their translatability across human and rodent research by examining the underlying neurobiology and its relationship to consumption and AUD. We show examples in which results gleaned from rodents are successfully integrated with information from human studies to gain insight in the genetic underpinnings of AUD and AUD-related endophenotypes. Finally, we identify areas for future translational research that could greatly expand our knowledge of the biological and molecular aspects of the transition to AUD with the broad hope of finding better ways to treat this devastating disorder.

Dopaminergic Signaling in the Nucleus Accumbens Modulates Stress-Coping Strategies during Inescapable Stress

Maladaptation to stress is a critical risk factor in stress-related disorders, such as major depression and post-traumatic stress disorder (PTSD). Dopamine signaling in the nucleus accumbens (NAc) has been shown to modulate behavior by reinforcing learning and evading aversive stimuli, which are important for the survival of animals under environmental challenges such as stress. However, the mechanisms through which dopaminergic transmission responds to stressful events and subsequently regulates its downstream neuronal activity during stress remain unknown. To investigate how dopamine signaling modulates stress-coping behavior, we measured the subsecond fluctuation of extracellular dopamine concentration and pH using fast scanning cyclic voltammetry (FSCV) in the NAc, a postsynaptic target of midbrain dopaminergic neurons, in male mice engaged in a tail suspension test (TST). The results revealed a transient decrease in dopamine concentration and an increase in pH levels when the animals changed behaviors, from being immobile to struggling. Interestingly, optogenetic inhibition of dopamine release in NAc, potentiated the struggling behavior in animals under the TST. We then addressed the causal relationship of such a dopaminergic transmission with behavioral alterations by knocking out both the dopamine receptors, i.e., D1 and D2, in the NAc using viral vector-mediated genome editing. Behavioral analyses revealed that male D1 knock-out mice showed significantly more struggling bouts and longer struggling durations during the TST, while male D2 knock-out mice did not. Our results therefore indicate that D1 dopaminergic signaling in the NAc plays a pivotal role in the modulation of stress-coping behaviors in animals under tail suspension stress.SIGNIFICANCE STATEMENT The tail suspension test (TST) has been widely used as a despair-based behavioral assessment to screen the antidepressant so long. Despite its prevalence in the animal studies, the neural substrate underlying the changes of behavior during the test remains unclear. This study provides an evidence for a role of dopaminergic transmission in the modulation of stress-coping behavior during the TST, a despair test widely used to screen the antidepressants in rodents. Taking into consideration the fact that the dopamine metabolism is upregulated by almost all antidepressants, a part of which acts directly on the dopaminergic transmission, current results would uncover the molecular mechanism through which the dopaminergic signaling mediates antidepressant effect with facilitation of the recovery from the despair-like behavior in the TST.

Glycogen synthase kinase-3 signaling in cellular and behavioral responses to psychostimulant drugs

Glycogen synthase kinase-3 (GSK-3) is a serine/threonine kinase implicated in numerous physiological processes and cellular functions through its ability to regulate the function of many proteins, including transcription factors and structural proteins. GSK-3β has been demonstrated to function as a regulator of multiple behavioral processes induced by drugs of abuse, particularly psychostimulant drugs. In this review, we provide an overview of the regulation of GSK-3β activity produced by psychostimulants, and the role of GSK-3β signaling in psychostimulant-induced behaviors including drug reward, associative learning and memory which play a role in the maintenance of drug-seeking. Evidence supports the conclusion that GSK-3β is an important component of the actions of psychostimulant drugs and that GSK-3β is a valid target for developing novel therapeutics. Additional studies are required to examine the role of GSK-3β in distinct cell types within the mesolimbic and memory circuits to further elucidate the mechanisms related to the acquisition, consolidation, and recall of drug-related memories, and potentially countering neuroadaptations that reinforce drug-seeking behaviors that maintain drug dependence.

Involvement of the Nucleus Accumbens in Chocolate-induced Cataplexy

Happiness is key for both mental and physical well-being. To further understand the brain mechanisms involved, we utilized the cataplexy that occurs in narcoleptic animal models as a quantitative behavioral measure because it is triggered by actions associated with happiness, such as laughter in humans and palatable foods in mice. Here we report that the rostral part of the nucleus accumbens (NAc) shell is strongly activated during the beginning of chocolate-induced cataplexy in orexin neuron-ablated mice. We made a local lesion in the NAc using ibotenic acid and observed the animals' behavior. The number of cataplexy bouts was negatively correlated to the lesion size. We also examined the hedonic response to palatable food by measuring the number of tongue protrusions in response to presentation of honey, which was also found to be negatively correlated to the lesion size. Next, we used clozapine N-oxide to either activate or inactivate the NAc through viral DREADD expression. As expected, the number of cataplexy bouts increased with activation and decreased with inactivation, and saline control injections showed no changes. Hedonic response in the DREADD experiment varied and showed both increases and decreases across mice. These results demonstrated that the rostral part of the NAc plays a crucial role in triggering cataplexy and hedonic orofacial movements. Since the NAc is also implicated in motivated behavior, we propose that the NAc is one of the key brain structures involved in happiness and is a driving force for positive emotion-related behaviors.

Developing a screen-printed graphite-polyurethane composite electrode modified with gold nanoparticles for the voltammetric determination of dopamine

A screen-printed electrode (SPGPUE) was prepared with graphite-polyurethane composite ink containing gold nanoparticles (AuNPs), resulting in a screen-printed graphite-polyurethane composite electrode modified with gold nanoparticles (SPGPUE-AuNPs). Gold nanoparticles were prepared by the citrate method and extracted from the water medium since polyurethane is not compatible with humidity. After extraction to chloroform, they were characterized via transmission electron microscopy (TEM). The presence of gold on the SPGPUE-AuNP surface was confirmed via SEM and EDX analyses, while thermogravimetry revealed the presence of approximately 3.0% (m/m) gold in the composite. An electrochemical pretreatment in 0.10 mol L-1 phosphate buffer (pH 7.0) with successive cycling between -1.0 V and 1.0 V (vs. pseudo-Ag/AgCl) under a scan rate of 200 mV s-1 and 150 cycles was required in order to provide a suitable electrochemical response for the voltammetric determination of dopamine. After the optimization of the parameters of differential pulse voltammetry (DPV), an analytical curve was obtained within a linear dynamic range of 0.40-60.0 μmol L-1 and detection limit (LOD) of 1.55 ×10-8 mol L-1 for dopamine at the SPGPUE-AuNP. A non-modified SPGPUE was used for comparison and a linear range was obtained between 2.0 and 10 μmol L-1 with an LOD of 2.94 × 10-7 mol L-1. During the dopamine determination in cerebrospinal synthetic fluid (CSF), recoveries between 89.3 and 103% were achieved. There were no significant interferences from ascorbic acid and uric acid, but some from epinephrine due to the structural similarity.

Intranasal dopamine attenuates fear responses induced by electric shock to the foot and by electrical stimulation of the dorsal periaqueductal gray matter

PURPOSE

Intranasally applied dopamine (IN-DA), which likely reaches the brain via nasal-brain pathways and bypasses the blood-brain barrier, has been found to increase extracellular DA and bind to the DA2 transporter in the striatum. Recent studies suggest that DA plays a significant role in the processing of signaled and unconditioned aversive stimulation, including evidence that may attenuate responses to painful input. The purpose of this study was to examine the effects of IN-DA on fear-related behaviors induced by electric shock to the foot or by electrical stimulation of the dorsal periaqueductal gray matter (dPAG).

METHODS

DA hydrochloride suspended in a viscous castor oil gel (1 or 2 mg/kg) was applied (IN-DA) in a volume of 5 μL into the nostrils of adult Wistar male rats in order to evaluate its effects on (a) freezing induced by electric shock to the foot and (b) thresholds of freezing and escape and duration of post-stimulation freezing induced by electrical stimulation of the dPAG.

RESULTS

IN-DA attenuated freezing induced by electric shock to the foot in the three test trials, indicating that it reduced long-term fear responses. IN-DA also increased the threshold of dPAG stimulation-induced escape responses and reduced post-stimulation freezing.

CONCLUSIONS

IN-DA, which has previously been shown to facilitate learning and to have antidepressive-like effects, attenuated unconditioned fear responses elicited by peripheral and intramesencephalic (dPAG) stimulation and reduced long-term conditioned fear responses.

The effects of psychosocial stress on dopaminergic function and the acute stress response

Chronic psychosocial adversity induces vulnerability to mental illnesses. Animal studies demonstrate that this may be mediated by dopaminergic dysfunction. We therefore investigated whether long-term exposure to psychosocial adversity was associated with dopamine dysfunction and its relationship to psychological and physiological responses to acute stress. Using 3,4-dihydroxy-6-[¹⁸F]-fluoro-l-phenylalanine ([¹⁸F]-DOPA) positron emission tomography (PET), we compared dopamine synthesis capacity in n = 17 human participants with high cumulative exposure to psychosocial adversity with n = 17 age- and sex-matched participants with low cumulative exposure. The PET scan took place 2 hr after the induction of acute psychosocial stress using the Montréal Imaging Stress Task to induce acute psychosocial stress. We found that dopamine synthesis correlated with subjective threat and physiological response to acute psychosocial stress in the low exposure group. Long-term exposure to psychosocial adversity was associated with dampened striatal dopaminergic function (p=0.03, d = 0.80) and that psychosocial adversity blunted physiological yet potentiated subjective responses to acute psychosocial stress. Future studies should investigate the roles of these changes in vulnerability to mental illnesses.

The Neuroscience of Drug Reward and Addiction

Drug consumption is driven by a drug's pharmacological effects, which are experienced as rewarding, and is influenced by genetic, developmental, and psychosocial factors that mediate drug accessibility, norms, and social support systems or lack thereof. The reinforcing effects of drugs mostly depend on dopamine signaling in the nucleus accumbens, and chronic drug exposure triggers glutamatergic-mediated neuroadaptations in dopamine striato-thalamo-cortical (predominantly in prefrontal cortical regions including orbitofrontal cortex and anterior cingulate cortex) and limbic pathways (amygdala and hippocampus) that, in vulnerable individuals, can result in addiction. In parallel, changes in the extended amygdala result in negative emotional states that perpetuate drug taking as an attempt to temporarily alleviate them. Counterintuitively, in the addicted person, the actual drug consumption is associated with an attenuated dopamine increase in brain reward regions, which might contribute to drug-taking behavior to compensate for the difference between the magnitude of the expected reward triggered by the conditioning to drug cues and the actual experience of it. Combined, these effects result in an enhanced motivation to "seek the drug" (energized by dopamine increases triggered by drug cues) and an impaired prefrontal top-down self-regulation that favors compulsive drug-taking against the backdrop of negative emotionality and an enhanced interoceptive awareness of "drug hunger." Treatment interventions intended to reverse these neuroadaptations show promise as therapeutic approaches for addiction.

Dopamine replacement remediates risk aversion in Parkinson's disease in a value-independent manner

INTRODUCTION

Clinical evidence suggests that Parkinson's Disease (PD) patients are risk averse. Dopaminergic therapy has been reported to increase risk tolerance, but the underlying mechanisms are unclear. Some studies have suggested an amplification of subjective reward value, consistent with the role of dopamine in reward value coding. Others have reported value-independent risk enhancement. We evaluated the value-dependence of the effects of PD and its therapy on risk using tasks designed to sensitively measure risk over a wide range of expected values.

METHOD

36 patients with idiopathic PD receiving levodopa monotherapy and 36 healthy matched controls performed two behavioural economic tasks aimed at quantifying 1) risk tolerance/aversion in the gain frame and 2) valuation of potential gains relative to losses. PD patients performed the tasks on and off their usual dose of levodopa in randomized order; controls performed the same tasks twice.

RESULTS

Relative to the controls, unmedicated PD patients showed significant value-independent risk aversion in the gain frame, which was normalized by levodopa. PD patients did not differ from controls in their valuation of gains relative to losses. However, across both tasks and regardless of medication, choices of the patients were more determined by expected values of the prospects than those of controls.

CONCLUSION

Dopamine deficiency in PD was associated with risk aversion, and levodopa promoted riskier choice in a value-independent manner. PD patients also showed an increased sensitivity to expected value, which was independent of levodopa and does not appear to result directly from dopamine deficiency.

Differential Roles of Accumbal GSK3β in Cocaine versus Morphine-Induced Place Preference, U50,488H-Induced Place Aversion, and Object Memory

Previous research has demonstrated that activity of glycogen synthase kinase-3 (GSK3) is necessary for the rewarding effects of cocaine. In the present study, a conditional GSK3β gene knockdown model was used to determine if GSK3β activity specifically in the nucleus accumbens is important for cocaine conditioned reward. The roles of accumbal GSK3β in morphine conditioned reward, trans-(±)-3,4-dichloro-N-methyl-N-[2-(1-pyrrolidinyl)cyclohexyl]benzeneacetamide methanesulfonate salt (U50,488H)-induced conditioned place aversion, and cognitive function were also studied. Adult male and female GSK3β-floxed or wild-type mice were injected with adeno-associated virus/Cre into the nucleus accumbens to reduce expression of GSK3β and underwent behavioral testing 4 weeks later. The development of cocaine-induced conditioned place preference was significantly attenuated in mice with reduced levels of GSK3β in the nucleus accumbens, whereas the development of morphine-induced place preference remained intact. Conditional knockdown of GSK3β in the accumbens prevented the development of conditioned aversion produced by U50,488H, a κ-opioid receptor agonist. Cognitive memory tests revealed deficits in object location memory, but not novel object recognition in mice with accumbal GSK3β knockdown. These data demonstrate that GSK3β in the nucleus accumbens is required for cocaine conditioned place preference and U50,488H conditioned place aversion, as well as spatial memory in object location task, indicating differential roles of GSK3β in the psychostimulant and opiate reward process, as well as in memory for spatial locations and object identity. SIGNIFICANCE STATEMENT: Knockdown of GSK3β in the nucleus accumbens attenuated the development of cocaine-induced place preference, as well as conditioned place aversion to U50,488H, a κ-opioid receptor agonist. In contrast, the development of morphine place preference was not altered by GSK3β knockdown. GSK3β knockdown in nucleus accumbens impaired performance in the object location task, but not the novel object recognition task. These results elucidate different physiological roles of accumbal GSKβ in conditioned reward, aversion, and memory.

Cell-type and projection-specific dopaminergic encoding of aversive stimuli in addiction

Drug addiction is a major public health concern across the world for which there are limited treatment options. In order to develop new therapies to correct the behavioral deficits that result from repeated drug use, we need to understand the neural circuit dysfunction that underlies the pathophysiology of the disorder. Because the initial reinforcing effects of drugs are dependent on increases in dopamine in reward-related brain regions such as the mesolimbic dopamine pathway, a large focus of addiction research has centered on the dysregulation of this system and its control of positive reinforcement and motivation. However, in addition to the processing of positive, rewarding stimuli, there are clear deficits in the encoding and valuation of information about potential negative outcomes and how they control decision making and motivation. Further, aversive stimuli can motivate or suppress behavior depending on the context in which they are encountered. We propose a model where rewarding and aversive information guides the execution of specific motivated actions through mesocortical and mesolimbic dopamine acting on D1- and D2- receptor containing neuronal populations. Volitional drug exposure alters the processing of rewarding and aversive stimuli through remodeling of these dopaminergic circuits, causing maladaptive drug seeking, self-administration in the face of negative consequences, and drug craving. Together, this review discusses the dysfunction of the circuits controlling different types of aversive learning as well as how these guide specific discrete behaviors, and provides a conceptual framework for how they should be considered in preclinical addiction models.

Dopamine signals related to appetitive and aversive events in paradigms that manipulate reward and avoidability

Using environmental cues to acquire good and avoid harmful things is critical for survival. Rewarding and aversive outcomes both drive behavior through reinforcement learning and sometimes occur together in the environment, but it remains unclear how these signals are encoded within the brain and if signals for positive and negative reinforcement are encoded similarly. Recent studies demonstrate that the dopaminergic system and interconnected brain regions process both positive and negative reinforcement necessary for approach and avoidance behaviors, respectively. Here, we review these data with a special focus on behavioral paradigms that manipulate both expected reward and the avoidability of aversive events to reveal neural correlates related to value, prediction error encoding, motivation, and salience.

8-Oxoguanine accumulation in aged female brain impairs neurogenesis in the dentate gyrus and major island of Calleja, causing sexually dimorphic phenotypes

In mammals, including humans, MTH1 with 8-oxo-dGTPase and OGG1 with 8-oxoguanine DNA glycosylase minimize 8-oxoguanine accumulation in genomic DNA. We investigated age-related alterations in behavior, 8-oxoguanine levels, and neurogenesis in the brains of Mth1/Ogg1-double knockout (TO-DKO), Ogg1-knockout, and human MTH1-transgenic (hMTH1-Tg) mice. Spontaneous locomotor activity was significantly decreased in wild-type mice with age, and females consistently exhibited higher locomotor activity than males. This decrease was significantly suppressed in female but not male TO-DKO mice and markedly enhanced in female hMTH1-Tg mice. Long-term memory retrieval was impaired in middle-aged female TO-DKO mice. 8-Oxoguanine accumulation significantly increased in nuclear DNA, particularly in the dentate gyrus (DG), subventricular zone (SVZ) and major island of Calleja (ICjM) in middle-aged female TO-DKO mice. In middle-aged female TO-DKO mice, neurogenesis was severely impaired in SVZ and DG, accompanied by ICjM and DG atrophy. Conversely, expression of hMTH1 efficiently suppressed 8-oxoguanine accumulation in both SVZ and DG with hypertrophy of ICjM. These findings indicate that newborn neurons from SVZ maintain ICjM in the adult brain, and increased accumulation of 8-oxoguanine in nuclear DNA of neural progenitors in females is caused by 8-oxo-dGTP incorporation during proliferation, causing depletion of neural progenitors, altered behavior, and cognitive function changes with age.

Real-Time Accumbal Dopamine Response to Negative Stimuli: Effects of Ethanol

Activity in the mesolimbic dopamine (DA) pathway is known to have a role in reward processing and related behaviors. The mesolimbic DA response to reward has been well-examined, while the response to aversive or negative stimuli has been studied to a lesser extent and produced inconclusive results. However, a brief increase in the DA concentration in terminals during nociceptive activation has become an established but not well-characterized phenomenon. Consequently, the interpretation of the significance of this neurochemical response is still elusive. The present study was designed to further explore these increases in subsecond DA dynamics triggered by negative stimuli using voltammetry in anesthetized rats. Our experiments revealed that repeated exposure to a tail pinch resulted in more efficacious DA release in rat nucleus accumbens. This fact may suggest a protective nature of immediate DA efflux. Furthermore, a sensitized DA response to a neutral stimulus, such as a touch, was discovered following several noxious pinches, while a touch applied before these pinches did not trigger DA release. Finally, it was found that the pinch-evoked DA efflux was significantly decreased by ethanol acutely administrated at an analgesic dose. Taken together, these results support the hypothesis that subsecond DA release in the nucleus accumbens may serve as an endogenous antinociceptive signal.

Intracerebral injection of R-(-)-Apomorphine into the nucleus accumbens decreased carbachol-induced 22-kHz ultrasonic vocalizations in rats

Rats can produce ultrasonic vocalizations (USVs) in a variety of different contexts that signal their emotional state to conspecifics. Under distress, rats can emit 22-kHz USVs, while during positive pro-social interactions rats can emit frequency-modulated (FM) 50-kHz USVs. It has been previously reported that rats with increasing emission of FM 50-kHz USVs in anticipation of rewarding electrical stimulation or positive pro-social interaction decrease the number of emitted 22-kHz USVs. The purpose of the present investigation was to determine, in a pharmacological-behavioural experiment, if the positive emotional arousal of the rat indexed by the number of emitted FM 50-kHz USVs can decrease the magnitude of a subsequent negative emotional state indexed by the emission of 22-kHz USVs. To induce a positive emotional state, an intracerebral injection of a known D₁/D₂ agonist R-(-)-apomorphine (3.0 μg/0.3 μl) into the medial nucleus accumbens shell was used, while a negative emotional state was induced by intracerebral injection of carbachol (1.0 μg/0.3 μl), a known broad-spectrum muscarinic agonist, into the anterior hypothalamic-medial preoptic area. Our results demonstrated that initiation of a positive emotional state was able to significantly decrease the magnitude of subsequently expressed negative emotional state measured by the number of emitted 22-kHz USVs. The results suggest the neurobiological substrates that initiate positive emotional state indirectly antagonize the brain regions that initiate negative emotional states.