Disentangling pleasure from incentive salience and learning signals in brain reward circuitry

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the mechanisms by which VP cell types shape VTA activity and drive behavior. Here, we found that both VP GABA and glutamate neurons were activated during approach to reward or by delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine and glutamate neurons. Remarkably, stimulation-evoked activation was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP glutamate neurons activated VTA GABA, as well as dopamine and glutamate neurons, despite driving aversion. However, VP glutamate neurons evoked dopamine in aversion-associated ventromedial nucleus accumbens (NAc), but reduced dopamine release in reward-associated dorsomedial NAc. These findings show how heterogeneous VP projections to VTA can be engaged to shape approach and avoidance behaviors.

Ventral pallidal GABAergic neurons drive consumption in male, but not female rats

Food intake is controlled by multiple converging signals: hormonal signals that provide information about energy homeostasis, but also hedonic and motivational aspects of food and food cues that can drive non-homeostatic or "hedonic "feeding. The ventral pallidum (VP) is a brain region implicated in the hedonic and motivational impact of food and foods cues, as well as consumption of rewards. Disinhibition of VP neurons has been shown to generate intense hyperphagia, or overconsumption. While VP gamma-Aminobutyric acidergic (GABA) neurons have been implicated in cue-elicited reward seeking and motivation, the role of these neurons in the hyperphagia resulting from VP activation remains unclear. Here, we used Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) to activate or inhibit VP GABA neurons in sated male and female rats during chow and sucrose consumption. We found that activation of VP GABA neurons increases consumption of chow and sucrose in male rats, but not female rats. We also found that, while inhibition of VP GABA neurons tended to decrease sucrose consumption, this effect was not statistically significant. Together, these findings suggest that activation of VP GABA neurons can stimulate consumption of routine or highly palatable rewards selectively in male rats.

Response of nitrergic system in the brain of rat conditioned to intracranial self-stimulation

The role of nitrergic system in modulating the action of psychostimulants on reward processing is well established. However, the relevant anatomical underpinnings and scope of the involved interactions with mesolimbic dopaminergic system have not been clarified. Using immunohistochemistry, we track the changes in neuronal nitric oxide synthase (nNOS) containing cell groups in the animals conditioned to intracranial self-stimulation (ICSS) via an electrode implanted in the lateral hypothalamus-medial forebrain bundle (LH-MFB) area. An increase in the nNOS immunoreactivity was noticed in the cells and fibers in the ventral tegmental area (VTA) and nucleus accumbens shell (AcbSh), the primary loci of the reward system. In addition, nNOS was up-regulated in the nucleus accumbens core (AcbC), vertical limb of diagonal band (VDB), locus coeruleus (LC), lateral hypothalamus (LH), superficial gray layer (SuG) of the superior colliculus, and periaqueductal gray (PAG). The brain tissue fragments drawn from these areas showed a change in nNOS mRNA expression, but in opposite direction. Intracerebroventricular (icv) administration of nNOS inhibitor, 7-nitroindazole (7-NI) showed decreased lever press activity in a dose-dependent manner in ICSS task. While an increase in the dopamine (DA) and 3, 4-dihydroxyphenylacetic acid (DOPAC) efflux was noted in the microdialysates collected from the AcbSh of ICSS rats, pre-administration of 7-NI (icv route) attenuated the response. The study identifies nitrergic centers that probably mediate sensory, cognitive, and motor components of the goal-directed behavior.

Contexts facilitate dynamic value encoding in the mesolimbic dopamine system

Adaptive behavior in a dynamic environment often requires rapid revaluation of stimuli that deviates from well-learned associations. The divergence between stable value-encoding and appropriate behavioral output remains a critical test to theories of dopamine's function in learning, motivation, and motor control. Yet how dopamine neurons are involved in the revaluation of cues when the world changes to alter our behavior remains unclear. Here we make use of pharmacology, in vivo electrophysiology, fiber photometry, and optogenetics to resolve the contributions of the mesolimbic dopamine system to the dynamic reorganization of reward-seeking. Male and female rats were trained to discriminate when a conditioned stimulus would be followed by sucrose reward by exploiting the prior, non-overlapping presentation of a separate discrete cue - an occasion setter. Only when the occasion setter's presentation preceded the conditioned stimulus did the conditioned stimulus predict sucrose delivery. As a result, in this task we were able to dissociate the average value of the conditioned stimulus from its immediate expected value on a trial-to-trial basis. Both the activity of ventral tegmental area dopamine neurons and dopamine signaling in the nucleus accumbens were essential for rats to successfully update behavioral responding in response to the occasion setter. Moreover, dopamine release in the nucleus accumbens following the conditioned stimulus only occurred when the occasion setter indicated it would predict reward. Downstream of dopamine release, we found that single neurons in the nucleus accumbens dynamically tracked the value of the conditioned stimulus. Together these results reveal a novel mechanism within the mesolimbic dopamine system for the rapid revaluation of motivation.

Dopaminergic error signals retune to social feedback during courtship

Hunger, thirst, loneliness and ambition determine the reward value of food, water, social interaction and performance outcome1. Dopamine neurons respond to rewards meeting these diverse needs2-8, but it remains unclear how behaviour and dopamine signals change as priorities change with new opportunities in the environment. One possibility is that dopamine signals for distinct drives are routed to distinct dopamine pathways9,10. Another possibility is that dopamine signals in a given pathway are dynamically tuned to rewards set by the current priority. Here we used electrophysiology and fibre photometry to test how dopamine signals associated with quenching thirst, singing a good song and courting a mate change as male zebra finches (Taeniopygia guttata) were provided with opportunities to retrieve water, evaluate song performance or court a female. When alone, water reward signals were observed in two mesostriatal pathways but singing-related performance error signals were routed to Area X, a striatal nucleus specialized for singing. When courting a female, water seeking was reduced and dopamine responses to both water and song performance outcomes diminished. Instead, dopamine signals in Area X were driven by female calls timed with the courtship song. Thus the dopamine system handled coexisting drives by routing vocal performance and social feedback signals to a striatal area for communication and by flexibly re-tuning to rewards set by the prioritized drive.

Altered reward processing in patients with lifelong premature ejaculation

Given that sexual behavior is usually pleasurable and highly rewarding, it is surprising that there is as yet no known research to empirically assess how premature ejaculation (PE) patients respond to the rewarding aspect of sexual behavior. This study was designed to address this issue by evaluating how these men respond to the anticipation and hedonic experience of sexual rewards in comparison to non-sexual rewards. Thirty lifelong PE patients and thirty healthy controls (HCs) performed the incentive delay task manipulating both erotic and monetary rewards. Compared to HCs, lifelong PE patients exhibited significantly faster RTs to erotic cues than to monetary cues during reward anticipation. Meanwhile, hedonic experience ratings after obtaining the actual reward showed that erotic rewards were rated as more pleasant than monetary rewards only by lifelong PE patients, which was driven by a decreased sensitivity to experienced monetary rewards in lifelong PE patients compared to HCs. These findings indicate the existence of dysfunctional reward processing in lifelong PE patients, which is characterized by increased incentive motivation elicited by sexual cues and reduced hedonic impact of nonsexual rewards. This study may offer an insightful clue regarding how PE is related to the abnormal regulation of the rewarding aspect of sexual behavior.

Separating desire from prediction of outcome value

Individuals typically want what they expect to like, often based on memories of previous positive experiences. However, in some situations desire can decouple completely from memories and from learned predictions of outcome value. The potential for desire to separate from prediction arises from independent operating rules that control motivational incentive salience. Incentive salience, or 'wanting', is a type of mesolimbic desire that evolved for adaptive goals, but can also generate maladaptive addictions. Two proof-of-principle examples are presented here to show how motivational 'wanting' can soar above memory-based predictions of outcome value: (i) 'wanting what is remembered to be disgusting', and (ii) 'wanting what is predicted to hurt'. Consequently, even outcomes remembered and predicted to be negatively aversive can become positively 'wanted'. Similarly, in human addictions, people may experience powerful cue-triggered cravings for outcomes that are not predicted to be enjoyable.

Reward expectation enhances action-related activity of nigral dopaminergic and two striatal output pathways

Neurons comprising nigrostriatal system play important roles in action selection. However, it remains unclear how this system integrates recent outcome information with current action (movement) and outcome (reward or no reward) information to achieve appropriate subsequent action. We examined how neuronal activity of substantia nigra pars compacta (SNc) and dorsal striatum reflects the level of reward expectation from recent outcomes in rats performing a reward-based choice task. Movement-related activity of direct and indirect pathway striatal projection neurons (dSPNs and iSPNs, respectively) were enhanced by reward expectation, similarly to the SNc dopaminergic neurons, in both medial and lateral nigrostriatal projections. Given the classical basal ganglia model wherein dopamine stimulates dSPNs and suppresses iSPNs through distinct dopamine receptors, dopamine might not be the primary driver of iSPN activity increasing following higher reward expectation. In contrast, outcome-related activity was affected by reward expectation in line with the classical model and reinforcement learning theory, suggesting purposive effects of reward expectation.

Stress to inflammation and anhedonia: Mechanistic insights from preclinical and clinical models

Anhedonia, as evidenced by impaired pleasurable response to reward, reduced reward motivation, and/or deficits in reward-related learning, is a common feature of depression. Such deficits in reward processing are also an important clinical target as a risk factor for depression onset. Unfortunately, reward-related deficits remain difficult to treat. To address this gap and inform the development of effective prevention and treatment strategies, it is critical to understand the mechanisms that drive impairments in reward function. Stress-induced inflammation is a plausible mechanism of reward deficits. The purpose of this paper is to review evidence for two components of this psychobiological pathway: 1) the effects of stress on reward function; and 2) the effects of inflammation on reward function. Within these two areas, we draw upon preclinical and clinical models, distinguish between acute and chronic effects of stress and inflammation, and address specific domains of reward dysregulation. By addressing these contextual factors, the review reveals a nuanced literature which might be targeted for additional scientific inquiry to inform the development of precise interventions.

The neurophysiological Behavioral Perspective Model of consumer choice and its contribution to the intentional behaviorist research programme

Cognitive explanations raise epistemological problems not faced by accounts confined to observable variables. Many explanatory components of cognitive models are unobservable: beliefs, attitudes, and intentions, for instance, must be made empirically available to the researcher in the form of measures of observable behavior from which the latent variables are inferred. The explanatory variables are abstract and theoretical and rely, if they are to enter investigations and explanations, on reasoned agreement on how they can be captured by proxy variables derived from what people say and how they behave. Psychometrics must be founded upon a firm, intersubjective agreement among researchers and users of research on the relationship of behavioral measures to the intentional constructs to which they point and the latent variables they seek to operationalize. Only if these considerations are adequately addressed can we arrive at consistent interpretations of the data. This problem provides the substance of the intentional behaviorist research programme which seeks to provide a rationale for the cognitive explanation. Within this programme, two versions of the Behavioral Perspective Model (BPM), an extensional portrayal of socioeconomic behavior and a corresponding intentional approach, address the task of identifying where intentional explanation becomes necessary and the form it should take. This study explores a third version, based on neurophysiological substrates of consumer choice as a contributor to this task. The nature of "value" is closely related to the rationale for a neurophysiological model of consumer choice. The variables involved are operationally specified and measured with high intersubjective agreement. The intentional model (BPM-I), depicting consumer action in terms of mental processes such as perception, deliberation, and choice, extends the purview of the BPM to new situations and areas of explanation.

Cortical theta oscillations and 50-kHz ultrasonic vocalizations in response to tactile reward indicate positive emotion in rats

Rats emit 50-kHz ultrasonic vocalizations (USVs), which reflect positive affective states. Rhythmic stroking increases 50-kHz USVs via the mesolimbic dopaminergic system. However, little is known about the effect of tactile reward on rat brain activity. This study aimed to investigate the brain activity associated with positive emotions induced by tactile stimulation using a frontoparietal electroencephalogram (EEG) as well as through the analysis of 50-kHz USVs and behavioral activity in awake rats. During rhythmic stroking, the power of the middle theta band and harmonics calls significantly increased compared with baseline. After rhythmic stroking, fast theta oscillations significantly increased but slow theta significantly decreased, with abundant frequency-modulated (FM) calls. Light touch stimulation increased the fast theta power but decreased FM calls. However, there was no significant difference in behavior after stimulation with rhythmic stroking or light touch. These results suggest that the characteristic brain theta oscillations and 50-kHz USV profiles induced by tactile reward can detect positive affective states in rats.

Ventral Pallidal GABAergic Neuron Calcium Activity Encodes Cue-Driven Reward Seeking and Persists in the Absence of Reward Delivery

Reward-seeking behavior is often initiated by environmental cues that signal reward availability. This is a necessary behavioral response; however, cue reactivity and reward-seeking behavior can become maladaptive. To better understand how cue-elicited reward seeking becomes maladaptive, it is important to understand the neural circuits involved in assigning appetitive value to rewarding cues and actions. Ventral pallidum (VP) neurons are known to contribute to cue-elicited reward-seeking behavior and have heterogeneous responses in a discriminative stimulus (DS) task. The VP neuronal subtypes and output pathways that encode distinct aspects of the DS task remain unknown. Here, we used an intersectional viral approach with fiber photometry to record bulk calcium activity in VP GABAergic (VP GABA) neurons in male and female rats as they learned and performed the DS task. We found that VP GABA neurons are excited by reward-predictive cues but not neutral cues and that this response develops over time. We also found that this cue-evoked response predicts reward-seeking behavior and that inhibiting this VP GABA activity during cue presentation decreases reward-seeking behavior. Additionally, we found increased VP GABA calcium activity at the time of expected reward delivery, which occurred even on trials when reward was omitted. Together, these findings suggest that VP GABA neurons encode reward expectation, and calcium activity in these neurons encodes the vigor of cue-elicited reward seeking.SIGNIFICANCE STATEMENT VP circuitry is a major driver of cue-evoked behaviors. Previous work has found that VP neurons have heterogenous responses and contributions to reward-seeking behavior. This functional heterogeneity is because of differences of neurochemical subtypes and projections of VP neurons. Understanding the heterogenous responses among and within VP neuronal cell types is a necessary step in further understanding how cue-evoked behavior becomes maladaptive. Our work explores the canonical GABAergic VP neuron and how the calcium activity of these cells encodes components of cue-evoked reward seeking, including the vigor and persistence of reward seeking.

Ventral pallidum GABA and glutamate neurons drive approach and avoidance through distinct modulation of VTA cell types

The ventral pallidum (VP) contains GABA and glutamate (Glut) neurons projecting to ventral tegmental area (VTA) whose stimulation drives approach and avoidance, respectively. Yet little is known about the cell-type-specific mechanisms by which VP projections to VTA drive behavior. Here, we found that both VP GABA and Glut neurons were activated during approach to reward or delivery of an aversive stimulus. Stimulation of VP GABA neurons inhibited VTA GABA, but activated dopamine (DA) and glutamate neurons. Remarkably, this cell-type-specific recruitment was behavior-contingent such that VTA recruitment was inhibited when evoked by the subject's own action. Conversely, VP Glut neurons activated VTA GABA, as well as DA and Glut neurons, despite driving aversion. However, VP Glut neurons evoked DA in reward-associated ventromedial nucleus accumbens (NAc), but reduced DA in aversion-associated dorsomedial NAc. These findings show how heterogeneous VP cell types can engage VTA cell types to shape approach and avoidance behaviors.

Understanding health behavior change by motivation and reward mechanisms: a review of the literature

The global rise of lifestyle-related chronic diseases has engendered growing interest among various stakeholders including policymakers, scientists, healthcare professionals, and patients, regarding the effective management of health behavior change and the development of interventions that facilitate lifestyle modification. Consequently, a plethora of health behavior change theories has been developed with the intention of elucidating the mechanisms underlying health behavior change and identifying key domains that enhance the likelihood of successful outcomes. Until now, only few studies have taken into account neurobiological correlates underlying health behavior change processes. Recent progress in the neuroscience of motivation and reward systems has provided further insights into the relevance of such domains. The aim of this contribution is to review the latest explanations of health behavior change initiation and maintenance based on novel insights into motivation and reward mechanisms. Based on a systematic literature search in PubMed, PsycInfo, and Google Scholar, four articles were reviewed. As a result, a description of motivation and reward systems (approach/wanting = pleasure; aversion/avoiding = relief; assertion/non-wanting = quiescence) and their role in health behavior change processes is presented. Three central findings are discussed: (1) motivation and reward processes allow to distinguish between goal-oriented and stimulus-driven behavior, (2) approach motivation is the key driver of the individual process of behavior change until a new behavior is maintained and assertion motivation takes over, (3) behavior change techniques can be clustered based on motivation and reward processes according to their functional mechanisms into facilitating (= providing external resources), boosting (= strengthening internal reflective resources) and nudging (= activating internal affective resources). The strengths and limitations of these advances for intervention planning are highlighted and an agenda for testing the models as well as future research is proposed.

Prefrontal cortex neurons in adult rats exposed to early life stress fail to appropriately signal the consequences of motivated actions

Early life stress (ELS) can set the stage for susceptibility to cognitive and emotional dysfunction in adulthood by disrupting typical neural development. The prefrontal cortex (PFC) continues to mature during early life, making this region particularly vulnerable to disruption for animals who experience ELS. Despite this, the effects of ELS experience on in vivo PFC function in awake and behaving adult animals are currently poorly understood. To assess this, we employed an instrumental conflict task to assess how hungry adult rats, either ELS (wet bedding) or unstressed Controls, were able to flexibly alter their motivation for food reward seeking (lever presses) in situations that were either threatening or safe. During this task, in vivo electrophysiological recordings (both single unit and local field potentials [LFPs]) were made in the rats' ventral-medial PFC (vmPFC). We found that ELS rats were less motivated to lever press for rewards than Controls in the threat situations during repeated extinction sessions. In recordings taken during this suppression task, Control vmPFC neurons displayed reliable differences between motivated actions, such as between rewarded and unrewarded presses, but ELS neurons failed to differentiate these action-outcome differences. We also found differences in task-related LFP activity between groups; in particular, prior ELS experience appears to induce abnormal changes in low-frequency oscillations during shock-associated threat stimuli prior to presses, as well as diminished higher-frequency oscillations following rewarded presses. Collectively, we demonstrate that ELS experience produces persistent impairment in motivational regulation that is associated with significant changes in in vivo PFC signals. Specifically, ELS-experienced adults fail to appropriately update motivated action strategies under threat conditions, and likewise fail to appropriately monitor and update action/outcome relationships in motivated behavior. These ELS-related changes may therefore lay the foundation for heightened susceptibility to mental-health disorders in adults such as substance abuse and post-traumatic stress disorder.

Ventral pallidal regulation of motivated behaviors and reinforcement

The interconnected nuclei of the ventral basal ganglia have long been identified as key regulators of motivated behavior, and dysfunction of this circuit is strongly implicated in mood and substance use disorders. The ventral pallidum (VP) is a central node of the ventral basal ganglia, and recent studies have revealed complex VP cellular heterogeneity and cell- and circuit-specific regulation of reward, aversion, motivation, and drug-seeking behaviors. Although the VP is canonically considered a relay and output structure for this circuit, emerging data indicate that the VP is a central hub in an extensive network for reward processing and the regulation of motivation that extends beyond classically defined basal ganglia borders. VP neurons respond temporally faster and show more advanced reward coding and prediction error processing than neurons in the upstream nucleus accumbens, and regulate the activity of the ventral mesencephalon dopamine system. This review will summarize recent findings in the literature and provide an update on the complex cellular heterogeneity and cell- and circuit-specific regulation of motivated behaviors and reinforcement by the VP with a specific focus on mood and substance use disorders. In addition, we will discuss mechanisms by which stress and drug exposure alter the functioning of the VP and produce susceptibility to neuropsychiatric disorders. Lastly, we will outline unanswered questions and identify future directions for studies necessary to further clarify the central role of VP neurons in the regulation of motivated behaviors. Significance: Research in the last decade has revealed a complex cell- and circuit-specific role for the VP in reward processing and the regulation of motivated behaviors. Novel insights obtained using cell- and circuit-specific interrogation strategies have led to a major shift in our understanding of this region. Here, we provide a comprehensive review of the VP in which we integrate novel findings with the existing literature and highlight the emerging role of the VP as a linchpin of the neural systems that regulate motivation, reward, and aversion. In addition, we discuss the dysfunction of the VP in animal models of neuropsychiatric disorders.

Evidence for dopaminergic involvement in endogenous modulation of pain relief

Relief of ongoing pain is a potent motivator of behavior, directing actions to escape from or reduce potentially harmful stimuli. Whereas endogenous modulation of pain events is well characterized, relatively little is known about the modulation of pain relief and its corresponding neurochemical basis. Here, we studied pain modulation during a probabilistic relief-seeking task (a 'wheel of fortune' gambling task), in which people actively or passively received reduction of a tonic thermal pain stimulus. We found that relief perception was enhanced by active decisions and unpredictability, and greater in high novelty-seeking trait individuals, consistent with a model in which relief is tuned by its informational content. We then probed the roles of dopaminergic and opioidergic signaling, both of which are implicated in relief processing, by embedding the task in a double-blinded cross-over design with administration of the dopamine precursor levodopa and the opioid receptor antagonist naltrexone. We found that levodopa enhanced each of these information-specific aspects of relief modulation but no significant effects of the opioidergic manipulation. These results show that dopaminergic signaling has a key role in modulating the perception of pain relief to optimize motivation and behavior.

The role of opioid transmission in music-induced pleasure

Studies conducted in rodents indicate a crucial role of the opioid circuit in mediating objective hedonic reactions to primary rewards. However, it remains unclear whether opioid transmission is also essential to experience pleasure with more abstract rewards, such as music. We addressed this question using a double-blind within-subject pharmacological design in which opioid levels were up- and downregulated by administering an opioid agonist (oxycodone) and antagonist (naltrexone), respectively, before healthy participants (n = 21) listened to music. Participants also performed a monetary incentive delay (MID) task to control for the effectiveness of the treatment and the specificity of the effects. Our results revealed that the pharmacological intervention did not modulate subjective reports of pleasure, nor the occurrence of chills. On the contrary, psychophysiological (objective) measures of emotional arousal, such as skin conductance responses (SCRs), were bidirectionally modulated in both the music and MID tasks. This modulation specifically occurred during reward consumption, with greater pleasure-related SCR following oxycodone than naltrexone. These findings indicate that opioid transmission does not modulate subjective evaluations but rather affects objective reward-related psychophysiological responses. These findings raise new caveats about the role of the opioidergic system in the modulation of pleasure for more abstract or cognitive forms of rewarding experiences, such as music.

Impact of Calorie-Restricted Cafeteria Diet and Treadmill Exercise on Sweet Taste in Diet-Induced Obese Female and Male Rats

The goal of the present study was to evaluate the sweet taste function in obese rats fed with a 30% calorie-restricted cafeteria diet (CAFR) and/or subjected to moderate treadmill exercise (12-17 m/min, 35 min, 5 days per week) for 9 weeks. A two-bottle preference test, a taste reactivity test, and a brief-access licking test were carried out when animals were aged 21 weeks; biometric and metabolic parameters were also measured along the interventions. Two separate experiments for females and males were performed. Behaviorally, CAF diet decreased sucrose intake and preference, as well as perceived palatability, in both sexes and decreased hedonic responses in males. Compared to the CAF diet, CAFR exerted a corrective effect on sweet taste variables in females by increasing sucrose intake in the preference test and licking responses, while exercise decreased sucrose intake in both sexes and licking responses in females. As expected, CAF diet increased body weight and Lee index and worsened the metabolic profile in both sexes, whereas CAFR diet ameliorated these effects mainly in females. Exercise had no noticeable effects on these parameters. We conclude that CAF diet might diminish appetitive behavior toward sucrose in both sexes, and that this effect could be partially reverted by CAFR diet in females only, while exercise might exert protective effects against overconsumption of sucrose in both sexes.

Pain, from perception to action: A computational perspective

Pain is driven by sensation and emotion, and in turn, it motivates decisions and actions. To fully appreciate the multidimensional nature of pain, we formulate the study of pain within a closed-loop framework of sensory-motor prediction. In this closed-loop cycle, prediction plays an important role, as the interaction between prediction and actual sensory experience shapes pain perception and subsequently, action. In this Perspective, we describe the roles of two prominent computational theories-Bayesian inference and reinforcement learning-in modeling adaptive pain behaviors. We show that prediction serves as a common theme between these two theories, and that each of these theories can explain unique aspects of the pain perception-action cycle. We discuss how these computational theories and models can improve our mechanistic understandings of pain-centered processes such as anticipation, attention, placebo hypoalgesia, and pain chronification.

[Neurobiological and neurochemical mechanisms of placebo analgesia]

BACKGROUND

The efficacy of pain therapies can be substantially modulated by treatment expectations, which is reflected by the substantial placebo effects observed in pain (so called placebo analgesia).

QUESTION

What is currently known about the neurobiological and neurochemical mechanisms underlying placebo analgesia?

MATERIALS AND METHODS

A focused presentation of key publications in the field embedded in a structured overview of the mechanistic concepts and current theories according to recent evidence.

RESULTS

Experimental studies with functional neuroimaging showed that the effect of placebo analgesia is reflected by changes in brain activity related to pain processing and cognitive control. The important neurotransmitters involved include opioids and dopamine.

CONCLUSION

Placebo analgesia is associated with complex neurobiological and -physiological mechanisms. An advanced comprehension of these processes should be applied to optimize existing and future therapeutic approaches in pain therapy.

The ABC Model of Happiness-Neurobiological Aspects of Motivation and Positive Mood, and Their Dynamic Changes through Practice, the Course of Life

Simple Summary

This article proposes a new model for exploring happiness primarily from a neurobiological perspective. Such understanding includes the dynamics of positive mood states and how they change throughout life. Happiness is not a cognitive construct: it is an immediate emotional experience—a feeling that relies on neurophysiological activation in the brain’s reward system. With this in mind, three types of happiness are proposed: (A) wanting, approaching, and pleasure, (B) avoiding, departing, and relief, (C) non-wanting, staying, and satisfaction. Behind this is a sophisticated (neuro)biological dynamic, ranging from the search for autonomy and ecstasy, which is particularly characteristic of young people, to the way we cope with stress, as we find it pronounced in the middle-aged, to deep contentment, peace, and inner joy, as it is mainly attributed to older people. Paradoxically, it is in fact the elderly who appear to be the happiest and most content—this phenomenon is also known as the “satisfaction paradox”. Apparently, these dynamic changes in happiness can be amplified with practice. Happiness is biological in this context, but can still be “learned”. Contemplative practices can serve as an example here to demonstrate this trainability, and they may themselves influence the course of happiness.

Abstract

Background: Happiness is a feeling, an immediate experience, not a cognitive construct. It is based on activity in the brain’s neurobiological reward and motivation systems, which have been retained in evolution. This conceptual review provides an overview of the basic neurobiological principles behind happiness phenomena and proposes a framework for further classification. Results: Three neurobiologically distinct types of happiness exist: (A) wanting, (B) avoiding, and (C) non-wanting. Behind these types lies a dynamic gradation, ranging from the more youthful anticipation, pleasure and ecstasy (A), to stress processing, escape and relief (B) as we find them accentuated in the middle-aged, to deep satisfaction, quiescence and inner joy (C), which is particularly attributed to older people. As a result, the development of happiness and satisfaction over the course of life typically takes the form of a U-curve. Discussion: The outlined triad and dynamic of happiness leads to the paradoxical finding that the elderly seem to be the happiest—a phenomenon that is termed “satisfaction paradox”. This assumed change in happiness and contentment over the life span, which includes an increasing “emancipation” from the idea of good health as a mandatory prerequisite for happiness and contentment, can itself be changed—it is trainable. Conclusions: Programs for mindfulness, contemplation, or stress reduction, including positive psychology and mind–body/behavioral medicine training, seem to be capable of influencing the course happiness over time: Happiness can be shaped through practice.

Neurobiology of Depression: Chronic Stress Alters the Glutamatergic System in the Brain-Focusing on AMPA Receptor

Major depressive disorder (MDD) is a common neuropsychiatric disorder affecting the mood and mental well-being. Its pathophysiology remains elusive due to the complexity and heterogeneity of this disorder that affects millions of individuals worldwide. Chronic stress is frequently cited as the one of the risk factors for MDD. To date, the conventional monoaminergic theory (serotonin, norepinephrine, and/or dopamine dysregulation) has received the most attention in the treatment of MDD, and all available classes of antidepressants target these monoaminergic systems. However, the contributions of other neurotransmitter systems in MDD have been widely reported. Emerging preclinical and clinical findings reveal that maladaptive glutamatergic neurotransmission might underlie the pathophysiology of MDD, thus revealing its critical role in the neurobiology of MDD and as the therapeutic target. Aiming beyond the monoaminergic hypothesis, studies of the neurobiological mechanisms underlying the stress-induced impairment of AMPA (a-amino-3-hydroxy-5-methyl-4-isoxazole propionic acid)-glutamatergic neurotransmission in the brain could provide novel insights for the development of a new generation of antidepressants without the detrimental side effects. Here, the authors reviewed the recent literature focusing on the role of AMPA-glutamatergic neurotransmission in stress-induced maladaptive responses in emotional and mood-associated brain regions, including the hippocampus, amygdala, prefrontal cortex, nucleus accumbens and periaqueductal gray.

Dysfunction of Glutamatergic Synaptic Transmission in Depression: Focus on AMPA Receptor Trafficking

Pharmacological and anatomical evidence suggests that abnormal glutamatergic neurotransmission may be associated with the pathophysiology of depression. Compounds that act as NMDA receptor antagonists may be a potential treatment for depression, notably the rapid-acting agent ketamine. The rapid-acting and sustained antidepressant effects of ketamine rely on the activation of AMPA receptors (AMPARs). As the key elements of fast excitatory neurotransmission in the brain, AMPARs are crucially involved in synaptic plasticity and memory. Recent efforts have been directed toward investigating the bidirectional dysregulation of AMPAR-mediated synaptic transmission in depression. Here, we summarize the published evidence relevant to the dysfunction of AMPAR in stress conditions and review the recent progress toward the understanding of the involvement of AMPAR trafficking in the pathophysiology of depression, focusing on the roles of AMPAR auxiliary subunits, key AMPAR-interacting proteins, and posttranslational regulation of AMPARs. We also discuss new prospects for the development of improved therapeutics for depression.

Reward Deficiency Syndrome (RDS) Surprisingly Is Evolutionary and Found Everywhere: Is It "Blowin' in the Wind"?

Reward Deficiency Syndrome (RDS) encompasses many mental health disorders, including a wide range of addictions and compulsive and impulsive behaviors. Described as an octopus of behavioral dysfunction, RDS refers to abnormal behavior caused by a breakdown of the cascade of reward in neurotransmission due to genetic and epigenetic influences. The resultant reward neurotransmission deficiencies interfere with the pleasure derived from satisfying powerful human physiological drives. Epigenetic repair may be possible with precision gene-guided therapy using formulations of KB220, a nutraceutical that has demonstrated pro-dopamine regulatory function in animal and human neuroimaging and clinical trials. Recently, large GWAS studies have revealed a significant dopaminergic gene risk polymorphic allele overlap between depressed and schizophrenic cohorts. A large volume of literature has also identified ADHD, PTSD, and spectrum disorders as having the known neurogenetic and psychological underpinnings of RDS. The hypothesis is that the true phenotype is RDS, and behavioral disorders are endophenotypes. Is it logical to wonder if RDS exists everywhere? Although complex, “the answer is blowin’ in the wind,” and rather than intangible, RDS may be foundational in species evolution and survival, with an array of many neurotransmitters and polymorphic loci influencing behavioral functionality.

Temporal dynamics of affect in the brain: Evidence from human imaging and animal models

Emotions are time-varying internal states that promote survival in the face of dynamic environments and shifting homeostatic needs. Research in non-human organisms has recently afforded specific insights into the neural mechanisms that support the emergence, persistence, and decay of affective states. Concurrently, a separate affective neuroscience literature has begun to dissect the neural bases of affective dynamics in humans. However, the circuit-level mechanisms identified in animals lack a clear mapping to the human neuroscience literature. As a result, critical questions pertaining to the neural bases of affective dynamics in humans remain unanswered. To address these shortcomings, the present review integrates findings from humans and non-human organisms to highlight the neural mechanisms that govern the temporal features of emotional states. Using the theory of affective chronometry as an organizing framework, we describe the specific neural mechanisms and modulatory factors that arbitrate the rise-time, intensity, and duration of emotional states.

The effects of lisdexamfetamine dimesylate on eating behaviour and homeostatic, reward and cognitive processes in women with binge-eating symptoms: an experimental medicine study

Lisdexamfetamine dimesylate (LDX) is the only drug currently approved by the FDA for the treatment of Binge-Eating Disorder (BED), but little is known about the behavioural mechanisms that underpin the efficacy of LDX in treating BED. We examined the behavioural and neural effects of an acute dose of LDX (50 mg) in 22 women with binge-eating symptomatology using a randomised, crossover, double-blind, placebo-controlled experimental medicine design. LDX reduced self-reported appetite ratings and intake of both a pasta meal and a palatable cookie snack. LDX also decreased the eating rate of pasta but not of cookies and reduced self-reported liking ratings for pasta at the end of the meal. When viewing food pictures during an fMRI scan, LDX reduced activity bilaterally in the thalamus. LDX enhanced sustained attention and reduced impulsive responding in a continuous performance task but had no effect on emotional bias or working memory. These results suggest the observed effects of LDX on food intake (and by implication the efficacy of LDX in treating BED) may be related to the actions of the drug to enhance satiety, reduce food-related reward responding when full and/or increase cognitive control. Novel pharmacotherapies for BED might be most effective if they have a broad spectrum of effects on appetite, reward and cognition.

The Relationship Between 5-Hydroxytryptamine and Its Metabolite Changes With Post-stroke Depression

Post-stroke depression (PSD) is the most common and serious sequelae of stroke. Approximately 33% of stroke survivors were affected by PSD. However, many issues (e.g., incidence, diagnostic marker, and risk factor) related to PSD remained unclear. The "monoamine hypothesis" is a significant hypothesis for depression, which suggests that three monoamines play a key role in depression. Therefore, most current antidepressants are developed to modulate the monoamines on PSD treatment, and these antidepressants have good effects on patients with PSD. However, the potential mechanisms of three monoamines in PSD are still unclear. Previously, we proposed "three primary emotions," which suggested a new model of basic emotions based on the three monoamines. It may provide a new way for PSD treatment. In addition, recent studies have found that monoamine-related emotional intervention also showed potential effects in the treatment and prevention of PSD. This study discusses these issues and attempts to provide a prospect for future research on PSD.

Neural correlates and determinants of approach-avoidance conflict in the prelimbic prefrontal cortex

The recollection of environmental cues associated with threat or reward allows animals to select the most appropriate behavioral responses. Neurons in the prelimbic (PL) cortex respond to both threat- and reward-associated cues. However, it remains unknown whether PL regulates threat-avoidance vs. reward-approaching responses when an animals’ decision depends on previously associated memories. Using a conflict model in which male Long–Evans rats retrieve memories of shock- and food-paired cues, we observed two distinct phenotypes during conflict: (1) rats that continued to press a lever for food (Pressers) and (2) rats that exhibited a complete suppression in food seeking (Non-pressers). Single-unit recordings revealed that increased risk-taking behavior in Pressers is associated with persistent food-cue responses in PL, and reduced spontaneous activity in PL glutamatergic (PL^GLUT) neurons during conflict. Activating PL^GLUT neurons in Pressers attenuated food-seeking responses in a neutral context, whereas inhibiting PL^GLUT neurons in Non-pressers reduced defensive responses and increased food approaching during conflict. Our results establish a causal role for PL^GLUT neurons in mediating individual variability in memory-based risky decision-making by regulating threat-avoidance vs. reward-approach behaviors.

Affective Episodic Memory System for Virtual Creatures: The First Step of Emotion-Oriented Memory

Episodic memory and emotions are considered essential functions in human cognition. Both allow us to acquire new knowledge from the environment, ranging from the objects around us to how we feel towards them. These qualities make them crucial functions for systems trying to create human-like behaviour. In the field of cognitive architectures (CAs), there are multiple studies covering memory and emotions. However, most of them treat these subjects in an isolated manner, considering emotions only as a reward signal unrelated to a retrieved experience. To address this lack of direct interaction, we propose a computational model that covers the common processes that are related to memory and emotions. Specifically, this proposal focuses on affective evaluations of episodic memories. Neurosciences and psychology are the bases of this model. That is, the model's components and the processes that they carry out on the information they receive are designed based on evidence from these cognitive sciences. The proposed model is a part of Cuáyóllótl, a cognitive architecture for cybernetic entities such as virtual creatures and robots. Case studies validate our proposal. They show the relevance of the integration of emotions and memory in a virtual creature. The virtual creature endowed with our emotional episodic model improves its learning and modifies its behaviour according to planning and decision-making processes.

Mitragynine (Kratom)-Induced Cognitive Impairments in Mice Resemble Δ9-THC and Morphine Effects: Reversal by Cannabinoid CB1 Receptor Antagonism

Kratom is a widely abused plant-based drug preparation with a global interest in recent years, well beyond its native grounds in Southeast Asia. Mitragynine, its major psychoactive constituent is known to exhibit opioid-like behavioral effects with resultant neuroplasticity in the brain reward system. Its chronic administration is associated with cognitive impairments in animal studies. However, the underlying molecular mechanism for such a deficit remains elusive. In this study, the involvement of cannabinoid type-1 (CB₁) receptors in cognitive deficits after chronic mitragynine exposures was investigated for 28 days (with incremental dose sensitization from 1 to 25 mg/kg) in adult male Swiss albino mice using the IntelliCage^® system. Chronic high-dose mitragynine exposure (5–25 mg/kg, intraperitoneal [i.p.]), but not low-dose exposure (1–4 mg/kg, i.p.), induced hyperlocomotion, potentiated the preference for sucrose reward, increased resistance to punishment, and impaired place learning and its reversal. Comparable deficits were also observed after chronic treatments with Δ-9-tetrahydrocannabinol (THC, 2 mg/kg, i.p.) or morphine (5 mg/kg, subcutaneous). Mitragynine-, morphine-, and THC-induced learning and memory deficits were reversed by co-treatment with the CB₁ receptor antagonist, NIDA-41020 (10 mg/kg, i.p.). A significant upregulation of CB₁ receptor expression was found in the hippocampal CA1 region and ventral tegmental area after chronic high-dose mitragynine and morphine, whereas a downregulation was observed after chronic THC. In conclusion, the present study suggests a plausible role of the CB₁ receptor in mediating the dose-dependent cognitive deficits after chronic high-dose mitragynine exposure. This also highlights the potential of CB₁ receptor antagonism in ameliorating the cognitive deficits associated with long-term kratom/mitragynine consumption in humans.

Temporal fluctuations in chemotaxis gain implement a simulated-tempering strategy for efficient navigation in complex environments

Bacterial chemotaxis is a major testing ground for systems biology, including the role of fluctuations and individual variation. Individual bacteria vary in their tumbling frequency and adaptation time. Recently, large cell-cell variation was also discovered in chemotaxis gain, which determines the sensitivity of the tumbling rate to attractant gradients. Variation in gain is puzzling, because low gain impairs chemotactic velocity. Here, we provide a functional explanation for gain variation by establishing a formal analogy between chemotaxis and algorithms for sampling probability distributions. We show that temporal fluctuations in gain implement simulated tempering, which allows sampling of attractant distributions with many local peaks. Periods of high gain allow bacteria to detect and climb gradients quickly, and periods of low gain allow them to move to new peaks. Gain fluctuations thus allow bacteria to thrive in complex environments, and more generally they may play an important functional role for organism navigation.

Oxycodone in the Opioid Epidemic: High 'Liking', 'Wanting', and Abuse Liability

It is estimated that nearly a third of people who abuse drugs started with prescription opioid medicines. Approximately, 11.5 million Americans used prescription drugs recreationally in 2016, and in 2018, 46,802 Americans died as the result of an opioid overdose, including prescription opioids, heroin, and illicitly manufactured fentanyl (National Institutes on Drug Abuse (2020) Opioid Overdose Crisis. https://www.drugabuse.gov/drugs-abuse/opioids/opioid-overdose-crisis . Accessed 06 June 2020). Yet physicians will continue to prescribe oral opioids for moderate-to-severe pain in the absence of alternative therapeutics, underscoring the importance in understanding how drug choice can influence detrimental outcomes. One of the opioid prescription medications that led to this crisis is oxycodone, where misuse of this drug has been rampant. Being one of the most highly prescribed opioid medications for treating moderate-to-severe pain as reflected in the skyrocketed increase in retail sales of 866% between 1997 and 2007, oxycodone was initially suggested to be less addictive than morphine. The false-claimed non-addictive formulation of oxycodone, OxyContin, further contributed to the opioid crisis. Abuse was often carried out by crushing the pills for immediate burst release, typically by nasal insufflation, or by liquefying the pills for intravenous injection. Here, we review oxycodone pharmacology and abuse liability as well as present the hypothesis that oxycodone may exhibit a unique pharmacology that contributes to its high likability and abuse susceptibility. We will discuss various mechanisms that likely contribute to the high abuse rate of oxycodone including clinical drug likability, pharmacokinetics, pharmacodynamics, differences in its actions within mesolimbic reward circuity compared to other opioids, and the possibility of differential molecular and cellular receptor interactions that contribute to its selective effects. We will also discuss marketing strategies and drug difference that likely contributes to the oxycodone opioid use disorders and addiction.

Understanding the Role of Incentive Salience in Sexual Decision-Making

In the search for understanding female sexual decision-making, progress has been made in uncovering a variety of perceptual biases and most of these concern the animal's sensory biology and cognitive processes. We are now poised to dig deeper into the female's decision-making and ask if incentive salience, which plays a role in all types of appetitive behaviors, also influences a female's "taste for the beautiful." The incentive salience hypothesis suggests that dopamine assigns value or salience to objects or actions. After value is assigned to all potential actions, an action selection system then chooses among potential options to select the most valuable action. In this view, dopamine stimulates reward-seeking behavior by assigning incentive salience to specific behavioral actions, which in turn, increases pursuit and focus on objects or stimuli that represent the valuable action. Here, we apply this framework to understand why females are compelled to respond maximally to some male courtship signals over others and how this process may reveal a female's hidden mate preferences. We examine studies of dopamine and the mesolimbic reward system because these may play a role in expanding the female's perceptual landscape for novelty in male courtship signals and establishing novel hidden preferences. We review three avenues of research that may identify signatures of incentive salience in females during sexual decision-making. This review includes studies of dopamine agonist or antagonist administration in females during mate choice or partner preference tests, measures of neural activity in dopaminergic neural circuits during mate choice or partner preference tests, and social regulation of dopamine in females when entering reproductive contexts and/or exposure to mate signals. By applying the incentive salience hypothesis to female reproductive decision-making, it redefines how we see the female's role in sexual encounters. Females cannot be considered passive during reproductive encounters; rather they are seeking sexual encounters, particularly with males that tap into their perceptual biases and initiate a reward-seeking response. Incentive salience applied to reproductive behavior requires considering females as viewing sexual stimuli as rewarding and initiating action to seek out this reward, all of which indicates females are driving sexual encounters.

Mapping excessive "disgust" in the brain: Ventral pallidum inactivation recruits distributed circuitry to make sweetness "disgusting"

The ventral pallidum (VP) is an important structure in processing reward. The VP may be the only brain structure where localized lesions in rats replace normal facial "liking" expressions to sweetness with excessive "disgust" reactions, such as gapes and chin rubs, that are normally reserved for unpalatable tastes. The posterior half of the VP (pVP) contains a hedonic hot spot where opioid or related neurochemical stimulations can amplify positive "liking" reactions to sweet taste. This is the same site where lesions or pharmacological inactivations replace positive hedonic reactions to sucrose with intense negative "disgust." In the present study, we aimed to identify brain networks recruited by pVP inactivation to generate excessive "disgust," using neuronal Fos expression as a marker of neurobiological activation. Microinjections in pVP of inhibitory GABA_A/B agonists (muscimol and baclofen) caused rats to exhibit excessive "disgust" reactions to sucrose. Excessive "disgust" was accompanied by recruitment of neural Fos activation in several subcortical structures, including the posterior medial shell of nucleus accumbens (which also contains another GABAergic "disgust"-inducing "hedonic cold spot"), the bed nucleus of stria terminalis, lateral habenula, hypothalamus, and midbrain ventral tegmentum. Fos suppression was found in cortical limbic regions, including previously identified hedonic hot spots in the anteromedial orbitofrontal cortex and posterior insula. Finally, in addition to inducing excessive "disgust," pVP inactivation abolished motivational "wanting" to eat palatable food, reduced positive social interactions, and reordered sensorimotor relations. Our findings identify potential "disgust" generators in the brain that are released into excitation by pVP inhibition and may serve as targets for future research.

Biological Functions of Rat Ultrasonic Vocalizations, Arousal Mechanisms, and Call Initiation

This review summarizes all reported and suspected functions of ultrasonic vocalizations in infant and adult rats. The review leads to the conclusion that all types of ultrasonic vocalizations subserving all functions are vocal expressions of emotional arousal initiated by the activity of the reticular core of the brainstem. The emotional arousal is dichotomic in nature and is initiated by two opposite-in-function ascending reticular systems that are separate from the cognitive reticular activating system. The mesolimbic cholinergic system initiates the aversive state of anxiety with concomitant emission of 22 kHz calls, while the mesolimbic dopaminergic system initiates the appetitive state of hedonia with concomitant emission of 50 kHz vocalizations. These two mutually exclusive arousal systems prepare the animal for two different behavioral outcomes. The transition from broadband infant isolation calls to the well-structured adult types of vocalizations is explained, and the social importance of adult rat vocal communication is emphasized. The association of 22 kHz and 50 kHz vocalizations with aversive and appetitive states, respectively, was utilized in numerous quantitatively measured preclinical models of physiological, psychological, neurological, neuropsychiatric, and neurodevelopmental investigations. The present review should help in understanding and the interpretation of these models in biomedical research.

Perception of repeated pain relief with controllable and uncontrollable pain

BACKGROUND

The ultimate goal of pain research is to provide effective routes for pain relief. Nevertheless, the perception pain relief as a change in pain intensity and un-/pleasantness has only been rarely investigated. It has been demonstrated that pain relief has rewarding and reinforcing properties, but it remains unknown whether the perception of pain relief changes when pain reductions occur repeatedly. Further, it remains an open question whether the perception of pain relief depends on the controllability of the preceding pain.

METHODS

In this study, healthy volunteers (N = 38) received five cycles of painful heat stimulation and reduction of this stimulation to a non-painful warm stimulation once in a condition with control of the stimulation and once without control. Participants rated perceived intensity and un-/pleasantness on visual analogue scales during the heat stimulation and immediately after its reduction.

RESULTS

Results showed that perceived pain relief, estimated by the difference in ratings during ongoing heat stimulation and after its reduction, increased with repetitions. However, this increase levelled off after two to four repetitions. Further, perceived pain relief was larger in the condition without control compared to the condition with control.

CONCLUSION

The perception of pain relief can be modulated similar to the perception of pain by stimulus characteristics and psychological factors. Mechanistic knowledge about such modulating factors is important, because they can determine, e.g., the amount of requested pain killers in clinical settings and the efficacy of pain relief as a reinforcing stimulus.

SIGNIFICANCE

When in pain, pain relief can become an all-dominate goal. The perception of such pain relief can vary depending on external and internal characteristics and thus modulate, e.g., requests for pain killers in clinical settings. Here, we show that perceived intensity and pleasantness of pain relief changes with repetitions and whether the preceding pain is perceived as uncontrollable. Such mechanistic knowledge needs to be considered to maximize the effects of pain relief as a rewarding and reinforcing stimulus.

A hindbrain dopaminergic neural circuit prevents weight gain by reinforcing food satiation

The neural circuitry mechanism that underlies dopaminergic (DA) control of innate feeding behavior is largely uncharacterized. Here, we identified a subpopulation of DA neurons situated in the caudal ventral tegmental area (cVTA) directly innervating DRD1-expressing neurons within the lateral parabrachial nucleus (LPBN). This neural circuit potently suppresses food intake via enhanced satiation response. Notably, this cohort of DAcVTA neurons is activated immediately before the cessation of each feeding bout. Acute inhibition of these DA neurons before bout termination substantially suppresses satiety and prolongs the consummatory feeding. Activation of postsynaptic DRD1LPBN neurons inhibits feeding, whereas genetic deletion of Drd1 within the LPBN causes robust increase in food intake and subsequent weight gain. Furthermore, the DRD1LPBN signaling manifests the central mechanism in methylphenidate-induced hypophagia. In conclusion, our study illuminates a hindbrain DAergic circuit that controls feeding through dynamic regulation in satiety response and meal structure.

Event-related brain response to visual cues in individuals with Internet gaming disorder: relevance to attentional bias and decision-making

This study investigated attentional bias toward game-related cues in Internet gaming disorder (IGD) using electrophysiological markers of late positive potential (LPP) and identifying the sources of LPP. In addition, the association between LPP and decision-making ability was investigated. The IGD (n = 40) and healthy control (HC; n = 39) participants viewed a series of game-related and neutral pictures, while their event-related potentials (ERPs) were recorded. LPPs were calculated as the mean amplitudes between 400 and 700 ms at the centro-parietal (CP3, CP1, Cpz, CP2, and CP4) and parietal (P3, P1, Pz, P2, and P4) electrode sites. The source activations of LPP were estimated using standardized low-resolution brain electromagnetic tomography (sLORETA). In addition, decision-making ability was evaluated by the Cambridge Gambling Task. Higher LPP amplitudes were found for game-related cues in the IGD group than in the HC group. sLORETA showed that the IGD group was more active in the superior and middle temporal gyri, which are involved in social perception, than in the HC group, whereas it was less active in the frontal area. Individuals with IGD have deficits in decision-making ability. In addition, in the HC group, the lower the LPP when looking at the game-related stimuli, the better the quality of decision-making, but not in the IGD group. Enhanced LPP amplitudes are associated with emotional arousal to gaming cues and decision-making deficits in IGD. In addition, source activities suggest that patients with IGD perceive game-related cues as social stimuli. LPP can be used as a neurophysiological marker of IGD.

Lateral septum as a nexus for mood, motivation, and movement

The lateral septum (LS) has been implicated in a wide variety of functions, including emotional, motivational, and spatial behavior, and the LS may regulate interactions between the hippocampus and other regions that mediate goal directed behavior. In this review, we suggest that the lateral septum incorporates movement into the evaluation of environmental context with respect to motivation, anxiety, and reward to output an 'integrated movement value signal'. Specifically, hippocampally-derived contextual information may be combined with reinforcement or motivational information in the LS to inform task-relevant decisions. We will discuss how movement is represented in the LS and the literature on the LS's involvement in mood and motivation. We will then connect these results to LS movement-related literature and hypotheses about the role of the lateral septum. We suggest that the LS may communicate a movement-scaled reward signal via changes in place-, movement-, and reward-related firing, and that the LS should be considered a fundamental node of affect and locomotor pathways in the brain.

Neuronal Nitric Oxide Synthase in Nucleus Accumbens Specifically Mediates Susceptibility to Social Defeat Stress through Cyclin-Dependent Kinase 5

Stress-induced depression is common worldwide. NAc, a "reward" center, is recently reported to be critical to confer the susceptibility to chronic social defeat stress (CSDS) and the depression-related outcome. However, the underlying molecular mechanisms have not been well characterized. In this study, we induced depression-like behaviors with CSDS and chronic mild stress in male mice to mimic social and environmental factors, respectively, and observed animal behaviors with social interaction test, tail suspension test, and sucrose preference test. To determine the role of neuronal nitric oxide synthase (nNOS) and its product nitric oxide (NO), we used brain region-specifically nNOS overexpression and stereotaxic injection of NO inhibitor or donor. Moreover, the downstream molecular cyclin-dependent kinase 5 (CDK5) was explored by conditional KO and gene mutation. We demonstrate that nNOS-implicated mechanisms in NAc shell (NAcSh), including increased cell number, increased protein expression levels, and increased specific enzyme activity, contribute the susceptibility to social defeat and the following depression-like behaviors. NAcSh nNOS does not directly respond to chronic mild stress but facilitates the depression-like behaviors. The increased NAcSh nNOS expression after CSDS leads to the social avoidance and depression-like behaviors in defeated mice, which is dependent on the nNOS enzyme activity and NO production. Moreover, we identify the downstream signal in NAcSh. S-nitrosylation of CDK5 by NO contributes to enhanced CDK5 activity, leading to depression-related behaviors in susceptible mice. Therefore, NAcSh nNOS mediates susceptibility to social defeat stress and the depression-like behaviors through CDK5.SIGNIFICANCE STATEMENT Stress-induced depression is common worldwide, and chronic exposure to social and psychological stressors is important cause of human depression. Our study conducted with chronic social defeat stress mice models demonstrates that nNOS in NAcSh is crucial to regulate the susceptibility to social defeat stress and the following depression-like behaviors, indicating NAcSh nNOS as the responding molecule to social factors of depression. Moreover, we discover the downstream mechanism of NAcSh nNOS in mediating the susceptibility is NO and S-nitrosylation of CDK5. Thus, NAcSh nNOS mediates susceptibility to social defeat stress through CDK5 is a potential mechanism for depression, which may interpret how the brain transduces social stress exposure into depression.

The effect of risperidone on reward-related brain activity is robust to drug-induced vascular changes

Dopamine (DA) mediated brain activity is intimately linked to reward‐driven cerebral responses, while aberrant reward processing has been implicated in several psychiatric disorders. fMRI has been a valuable tool in understanding the mechanism by which DA modulators alter reward‐driven responses and how they may exert their therapeutic effect. However, the potential effects of a pharmacological compound on aspects of neurovascular coupling may cloud the interpretability of the BOLD contrast. Here, we assess the effects of risperidone on reward driven BOLD signals produced by reward anticipation and outcome, while attempting to control for potential drug effects on regional cerebral blood flow (CBF) and cerebrovascular reactivity (CVR). Healthy male volunteers (n = 21) each received a single oral dose of either 0.5 mg, 2 mg of risperidone or placebo in a double‐blind, placebo‐controlled, randomised, three‐period cross‐over study design. Participants underwent fMRI scanning while performing the widely used Monetary Incentive Delay (MID) task to assess drug impact on reward function. Measures of CBF (Arterial Spin Labelling) and breath‐hold challenge induced BOLD signal changes (as a proxy for CVR) were also acquired and included as covariates. Risperidone produced divergent, dose‐dependent effects on separate phases of reward processing, even after controlling for potential nonneuronal influences on the BOLD signal. These data suggest the D2 antagonist risperidone has a wide‐ranging influence on DA‐mediated reward function independent of nonneuronal factors. We also illustrate that assessment of potential vascular confounds on the BOLD signal may be advantageous when investigating CNS drug action and advocate for the inclusion of these additional measures into future study designs.

Rational inattention and tonic dopamine

Slow-timescale (tonic) changes in dopamine (DA) contribute to a wide variety of processes in reinforcement learning, interval timing, and other domains. Furthermore, changes in tonic DA exert distinct effects depending on when they occur (e.g., during learning vs. performance) and what task the subject is performing (e.g., operant vs. classical conditioning). Two influential theories of tonic DA-the average reward theory and the Bayesian theory in which DA controls precision-have each been successful at explaining a subset of empirical findings. But how the same DA signal performs two seemingly distinct functions without creating crosstalk is not well understood. Here we reconcile the two theories under the unifying framework of 'rational inattention,' which (1) conceptually links average reward and precision, (2) outlines how DA manipulations affect this relationship, and in so doing, (3) captures new empirical phenomena. In brief, rational inattention asserts that agents can increase their precision in a task (and thus improve their performance) by paying a cognitive cost. Crucially, whether this cost is worth paying depends on average reward availability, reported by DA. The monotonic relationship between average reward and precision means that the DA signal contains the information necessary to retrieve the precision. When this information is needed after the task is performed, as presumed by Bayesian inference, acute manipulations of DA will bias behavior in predictable ways. We show how this framework reconciles a remarkably large collection of experimental findings. In reinforcement learning, the rational inattention framework predicts that learning from positive and negative feedback should be enhanced in high and low DA states, respectively, and that DA should tip the exploration-exploitation balance toward exploitation. In interval timing, this framework predicts that DA should increase the speed of the internal clock and decrease the extent of interference by other temporal stimuli during temporal reproduction (the central tendency effect). Finally, rational inattention makes the new predictions that these effects should be critically dependent on the controllability of rewards, that post-reward delays in intertemporal choice tasks should be underestimated, and that average reward manipulations should affect the speed of the clock-thus capturing empirical findings that are unexplained by either theory alone. Our results suggest that a common computational repertoire may underlie the seemingly heterogeneous roles of DA.

The neuroscience of positive emotions and affect: Implications for cultivating happiness and wellbeing

This review paper provides an integrative account regarding neurophysiological correlates of positive emotions and affect that cumulatively contribute to the scaffolding for happiness and wellbeing in humans and other animals. This paper reviews the associations among neurotransmitters, hormones, brain networks, and cognitive functions in the context of positive emotions and affect. Consideration of lifespan developmental perspectives are incorporated, and we also examine the impact of healthy social relationships and environmental contexts on the modulation of positive emotions and affect. The neurophysiological processes that implement positive emotions are dynamic and modifiable, and meditative practices as well as flow states that change patterns of brain function and ultimately support wellbeing are also discussed. This review is part of "The Human Affectome Project" (http://neuroqualia.org/background.php), and in order to advance a primary aim of the Human Affectome Project, we also reviewed relevant linguistic dimensions and terminology that characterizes positive emotions and wellbeing. These linguistic dimensions are discussed within the context of the neuroscience literature with the overarching goal of generating novel recommendations for advancing neuroscience research on positive emotions and wellbeing.

Motivation and reward mechanisms in health behavior change processes

With increasing prevalence of lifestyle-related chronic diseases worldwide, understanding health behavior change and the development of successful interventions to support lifestyle modification is gaining increasing interest among politicians, scientists, therapists and patients alike. A number of health behavior change theories have been developed aiming at explaining health behavior change and understanding the domains that make change more likely. Until now, only few studies have taken into account automatic, implicit or non-cognitive aspects of behavior, including emotion and positive affect. Recent progress in the neuroscience of motivation and reward systems can provide further insights into the relevance of such domains. In this integrative review, we present a description of the possible motivation and reward systems (approach/wanting = pleasure; aversion/avoiding = relief; assertion/non-wanting = quiescence) involved in behavior change. Therefore, based on established theories encompassing both initiation and maintenance of behavior change, we create a flexible seven-stage behavior change process with three engagement phases (non-engagement, motivational engagement, executive engagement) and relate the motivation and reward systems to each of these stages. We propose that either appetitive (preferably) or aversive motivational salience is activated during motivational engagement, that learning leads to continued behavior and that assertive salience prevails when the new behavior has become habitual. We discuss under which circumstances these mechanisms and reward-motivation pathways are likely to occur and address potential shortcomings of our proposed theoretical framework. We highlight implications for future interventions aiming at lifestyle modification.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Momentary subjective well-being depends on learning and not reward

Subjective well-being or happiness is often associated with wealth. Recent studies suggest that momentary happiness is associated with reward prediction error, the difference between experienced and predicted reward, a key component of adaptive behaviour. We tested subjects in a reinforcement learning task in which reward size and probability were uncorrelated, allowing us to dissociate between the contributions of reward and learning to happiness. Using computational modelling, we found convergent evidence across stable and volatile learning tasks that happiness, like behaviour, is sensitive to learning-relevant variables (i.e. probability prediction error). Unlike behaviour, happiness is not sensitive to learning-irrelevant variables (i.e. reward prediction error). Increasing volatility reduces how many past trials influence behaviour but not happiness. Finally, depressive symptoms reduce happiness more in volatile than stable environments. Our results suggest that how we learn about our world may be more important for how we feel than the rewards we actually receive.

Many people believe they would be happier if only they had more money. And events such as winning the lottery or receiving a large pay rise do make people happy, at least temporarily. But recent studies suggest that the main factor driving happiness on such occasions is not the size of the reward received. Instead, it is how well that reward matches up with expectations. Receiving a 10% pay rise when you were expecting 1% will make you feel happier than receiving 10% when you had been expecting 20%.

This difference between an expected and an actual reward is referred to as a reward prediction error. Reward prediction errors have a key role in learning. They motivate people to repeat behaviours that led to unexpectedly large rewards. But they also enable people to update their beliefs about the world, which is rewarding in itself. Could it be that reward prediction errors are associated with happiness mainly because they help us understand the world a little better than before?

To test this idea, Blain and Rutledge designed a task in which the likelihood of receiving a reward was unrelated to the size of the reward. This study design makes it possible to separate out the contributions of learning versus reward to moment-by-moment happiness.

In the task, volunteers had to decide which of two cars would win a race. In the ‘stable’ condition, one of the cars always had an 80% chance of winning. In the ‘volatile’ condition, one car had an 80% chance of winning for the first 20 trials. The other car then had an 80% chance of winning for the next 20 trials. The volunteers were not told these probabilities in advance, but had to work them out by playing the game. However, on every trial, the volunteers were shown the reward they would receive if they chose either of the cars and that car went on to win. The size of the rewards varied at random and was unrelated to the likelihood of a car winning.

Every few trials, the volunteers were asked to indicate their current level of happiness on a scale. The results showed that volunteers were happier after winning than after losing. On average they were also happier in the stable condition than in the volatile condition. This was especially true for volunteers with pre-existing symptoms of depression. Moreover, happiness after wins did not depend on how large the reward they got was, but instead simply on how surprised they were to win.

These results suggest that how we learn about the world around us can be more important for how we feel than rewards we receive directly. Measuring happiness in various types of environment could help us understand factors affecting mental health. The current results suggest, for example, that uncertain environments may be especially unpleasant for people with depression. Further research is needed to understand why this might be the case. In the real world, rewards are often uncertain and infrequent, but learning may nevertheless have the potential to boost happiness.