Separating desire from prediction of outcome value

Individuals typically want what they expect to like, often based on memories of previous positive experiences. However, in some situations desire can decouple completely from memories and from learned predictions of outcome value. The potential for desire to separate from prediction arises from independent operating rules that control motivational incentive salience. Incentive salience, or 'wanting', is a type of mesolimbic desire that evolved for adaptive goals, but can also generate maladaptive addictions. Two proof-of-principle examples are presented here to show how motivational 'wanting' can soar above memory-based predictions of outcome value: (i) 'wanting what is remembered to be disgusting', and (ii) 'wanting what is predicted to hurt'. Consequently, even outcomes remembered and predicted to be negatively aversive can become positively 'wanted'. Similarly, in human addictions, people may experience powerful cue-triggered cravings for outcomes that are not predicted to be enjoyable.

Corticotropin releasing factor (CRF) systems: Promoting cocaine pursuit without distress via incentive motivation

Corticotropin releasing factor (CRF) systems in limbic structures are posited to mediate stress-induced relapse in addiction, traditionally by generating distress states that spur drug consumption as attempts at hedonic self-medication. Yet evidence suggests that activating CRF-expressing neurons in the central amygdala (CeA) or nucleus accumbens (NAc) can magnify incentive motivation in absence of distress, at least for sucrose rewards. However, traditional CRF hypotheses in addiction neuroscience are primarily directed toward drug rewards. The question remains open whether CRF systems can similarly act via incentive motivation mechanisms to promote pursuit of drug rewards, such as cocaine. Here we tested whether optogenetic excitation of CRF-containing neurons in either NAc medial shell, lateral CeA, or dorsolateral BNST of transgenic Crh-Cre+ rats would spur preference and pursuit of a particular laser-paired cocaine reward over an alternative cocaine reward, and whether excitation served as a positively-valenced incentive itself, through laser self-stimulation tests. We report that excitation of CRF-containing neurons in either NAc or CeA recruited mesocorticolimbic circuitry to amplify incentive motivation to pursue the laser-paired cocaine: focusing preference on the laser-paired cocaine reward in a two-choice task, and spurred pursuit as doubled breakpoint in a progressive ratio task. Crucially indicating positive-valence, excitation of CRF neurons in NAc and CeA also was actively sought after by most rats in self-stimulation tasks. Conversely, CRF neuronal activation in BNST was never self-stimulated, but failed to enhance cocaine consumption. Collectively, we find that NAc and CeA CRF-containing neurons can amplify pursuit and consumption of cocaine by positively-valenced incentive mechanisms, without any aversive distress.

The rise of affectivism

Research over the past decades has demonstrated the explanatory power of emotions, feelings, motivations, moods, and other affective processes when trying to understand and predict how we think and behave. In this consensus article, we ask: has the increasingly recognized impact of affective phenomena ushered in a new era, the era of affectivism?

Activating Corticotropin-Releasing Factor Systems in the Nucleus Accumbens, Amygdala, and Bed Nucleus of Stria Terminalis: Incentive Motivation or Aversive Motivation?

BACKGROUND

Corticotropin-releasing factor (CRF) neural systems are important stress mechanisms in the central amygdala (CeA), bed nucleus of stria terminalis (BNST), nucleus accumbens (NAc), and related structures. CRF-containing neural systems are traditionally posited to generate aversive distress states that motivate overconsumption of rewards and relapse in addiction. However, CRF-containing systems may alternatively promote incentive motivation to increase reward pursuit and consumption without requiring aversive states.

METHODS

We optogenetically stimulated CRF-expressing neurons in the CeA, BNST, or NAc using Crh-Cre+ rats (n = 37 female, n = 34 male) to investigate roles in incentive motivation versus aversive motivation. We paired CRF-expressing neuronal stimulations with earning sucrose rewards in two-choice and progressive ratio tasks and investigated recruitment of distributed limbic circuitry. We further assessed valence with CRF-containing neuron laser self-stimulation tasks.

RESULTS

Channelrhodopsin excitation of CRF-containing neurons in the CeA and NAc amplified and focused incentive motivation and recruited activation of mesocorticolimbic reward circuitry. CRF systems in both the CeA and NAc supported laser self-stimulation, amplified incentive motivation for sucrose in a breakpoint test, and focused "wanting" on laser-paired sucrose over a sucrose alternative in a two-choice test. Conversely, stimulation of CRF-containing neurons in the BNST produced negative valence or aversive effects and recruited distress-related circuitry, as stimulation was avoided and suppressed motivation for sucrose.

CONCLUSIONS

CRF-containing systems in the NAc and CeA can promote reward consumption by increasing incentive motivation without involving aversion. In contrast, stimulation of CRF-containing systems in the BNST is aversive but suppresses sucrose reward pursuit and consumption rather than increase, as predicted by traditional hedonic self-medication hypotheses.

Incentive motivation: 'wanting' roles of central amygdala circuitry

The central nucleus of amygdala (CeA) mediates positively-valenced reward motivation as well as negatively-valenced fear. Optogenetic or neurochemical stimulation of CeA circuitry can generate intense incentive motivation to pursue and consume a paired natural food, sex, or addictive drug reward, and even create maladaptive 'wanting what hurts' such as attraction to a shock rod. Evidence indicates CeA stimulations selectively amplify incentive motivation ('wanting') but not hedonic impact ('liking') of the same reward. Further, valence flips can occur for CeA contributions to motivational salience. That is, CeA stimulation can promote either incentive motivation or fearful motivation, even in the same individual, depending on situation. These findings may carry implications for understanding CeA roles in neuropsychiatric disorders involving aberrant motivational salience, ranging from addiction to paranoia and anxiety disorders.

Positive Affect: Nature and brain bases of liking and wanting

The positive affect of rewards is an important contributor to well-being. Reward involves components of pleasure 'liking', motivation 'wanting', and learning. 'Liking' refers to the hedonic impact of positive events, with underlying mechanisms that include hedonic hotspots in limbic brain structures that amplify 'liking' reactions. 'Wanting' refers to incentive salience, a motivational process that makes reward cues attractive and able to trigger craving for their reward, mediated by larger dopamine-related mesocorticolimbic networks. Under normal conditions, 'liking' and 'wanting' cohere. However, 'liking' and 'wanting' can be dissociated by alterations in neural signaling, either induced in animal neuroscience laboratories or arising spontaneously in addictions and other affective disorders, which can be detrimental to positive well-being.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

The central amygdala recruits mesocorticolimbic circuitry for pursuit of reward or pain

How do brain mechanisms create maladaptive attractions? Here intense maladaptive attractions are created in laboratory rats by pairing optogenetic channelrhodopsin (ChR2) stimulation of central nucleus of amygdala (CeA) in rats with encountering either sucrose, cocaine, or a painful shock-delivering object. We find that pairings make the respective rats pursue either sucrose exclusively, or cocaine exclusively, or repeatedly self-inflict shocks. CeA-induced maladaptive attractions, even to the painful shock-rod, recruit mesocorticolimbic incentive-related circuitry. Shock-associated cues also gain positive incentive value and are pursued. Yet the motivational effects of paired CeA stimulation can be reversed to negative valence in a Pavlovian fear learning situation, where CeA ChR2 pairing increases defensive reactions. Finally, CeA ChR2 valence can be switched to neutral by pairing with innocuous stimuli. These results reveal valence plasticity and multiple modes for motivation via mesocorticolimbic circuitry under the control of CeA activation.

Desire or Dread from Nucleus Accumbens Inhibitions: Reversed by Same-Site Optogenetic Excitations

Microinjections of a glutamate AMPA antagonist (DNQX) in medial shell of nucleus accumbens (NAc) can cause either intense appetitive motivation (i.e., 'desire') or intense defensive motivation (i.e., 'dread'), depending on site along a flexible rostrocaudal gradient and on environmental ambience. DNQX, by blocking excitatory AMPA glutamate inputs, is hypothesized to produce relative inhibitions of NAc neurons. However, given potential alternative explanations, it is not known whether neuronal inhibition is in fact necessary for NAc DNQX microinjections to generate motivations. Here we provide a direct test of whether local neuronal inhibition in NAc is necessary for DNQX microinjections to produce either desire or dread. We used optogenetic channelrhodopsin (ChR2) excitations at the same local sites in NAc as DNQX microinjections to oppose relative neuronal inhibitions induced by DNQX in female and male rats. We found that same-site ChR2 excitation effectively reversed the ability of NAc DNQX microinjections to generate appetitive motivation, and similarly reversed ability of DNQX microinjections to generate defensive motivation. Same-site NAc optogenetic excitations also attenuated recruitment of Fos expression in other limbic structures throughout the brain, which was otherwise elevated by NAc DNQX microinjections that generated motivation. However, to successfully reverse motivation generation, an optic fiber tip for ChR2 illumination needed to be located within <1 mm of the corresponding DNQX microinjector tip; that is, both truly at the same NAc site. Thus, we confirm that localized NAc neuronal inhibition is required for AMPA-blocking microinjections in medial shell to induce either positively-valenced 'desire' or negatively-valenced 'dread'.SIGNIFICANCE STATEMENT A major hypothesis posits neuronal inhibitions in nucleus accumbens generate intense motivation. Microinjections in nucleus accumbens of glutamate antagonist, DNQX, which might suppress local neuronal firing, generate either appetitive or defensive motivation, depending on site and environmental factors. Is neuronal inhibition in nucleus accumbens required for such pharmacologically-induced motivations? Here we demonstrate that neuronal inhibition is necessary to generate appetitive or defensive motivations, using local optogenetic excitations to oppose putative DNQX-induced inhibitions. We show that excitation at the same site prevents DNQX microinjections from recruiting downstream limbic structures into neurobiological activation, and simultaneously prevents generation of either appetitive or defensive motivated behaviors. These results may be relevant to roles of nucleus accumbens mechanisms in pathological motivations, including addiction and paranoia.

Optogenetic mapping of feeding and self-stimulation within the lateral hypothalamus of the rat

The lateral hypothalamus (LH) includes several anatomical subregions involved in eating and reward motivation. This study explored localization of function across different LH subregions in controlling food intake stimulated by optogenetic channelrhodopsin excitation, and in supporting laser self-stimulation. We particularly compared the tuberal LH subregion, the posterior LH subregion, and the lateral preoptic area. Local diameters of tissue optogenetically stimulated within the LH were assessed by measuring laser-induced Fos plumes and Jun plumes via immunofluorescence surrounding optic fiber tips. Those plume diameters were used to map localization of function for behavioral effects elicited by LH optogenetic stimulation. Optogenetic stimulation of the tuberal subsection of the LH produced the most robust eating behavior and food intake initially, but produced only mild laser self-stimulation in the same rats. However, after repeated exposures to optogenetic stimulation, tuberal LH behavioral profiles shifted toward more self-stimulation and less food intake. By contrast, stimulation of the lateral preoptic area produced relatively little food intake or self-stimulation, either initially or after extended stimulation experience. Stimulation in the posterior LH subregion supported moderate self-stimulation, but not food intake, and at higher laser intensity shifted valence to evoke escape behaviors. We conclude that the tuberal LH subregion may best mediate stimulation-bound increases in food intake stimulated by optogenetic excitation. However, incentive motivational effects of tuberal LH stimulation may shift toward self-stimulation behavior after repeated stimulation. By contrast, the lateral preoptic area and posterior LH do not as readily elicit either eating behavior or laser self-stimulation, and may be more prone to higher-intensity aversive effects.

A Neurobehavioral Approach to Addiction: Implications for the Opioid Epidemic and the Psychology of Addiction

Two major questions about addictive behaviors need to be explained by any worthwhile neurobiological theory. First, why do people seek drugs in the first place? Second, why do some people who use drugs seem to eventually become unable to resist drug temptation and so become "addicted"? We will review the theories of addiction that address negative-reinforcement views of drug use (i.e., taking opioids to alleviate distress or withdrawal), positive-reinforcement views (i.e., taking drugs for euphoria), habit views (i.e., growth of automatic drug-use routines), incentive-sensitization views (i.e., growth of excessive "wanting" to take drugs as a result of dopamine-related sensitization), and cognitive-dysfunction views (i.e., impaired prefrontal top-down control), including those involving competing neurobehavioral decision systems (CNDS), and the role of the insula in modulating addictive drug craving. In the special case of opioids, particular attention is paid to whether their analgesic effects overlap with their reinforcing effects and whether the perceived low risk of taking legal medicinal opioids, which are often prescribed by a health professional, could play a role in the decision to use. Specifically, we will address the issue of predisposition or vulnerability to becoming addicted to drugs (i.e., the question of why some people who experiment with drugs develop an addiction, while others do not). Finally, we review attempts to develop novel therapeutic strategies and policy ideas that could help prevent opioid and other substance abuse.

Optogenetic self-stimulation in the nucleus accumbens: D1 reward versus D2 ambivalence

The nucleus accumbens (NAc) contains multiple subpopulations of medium spiny neurons (MSNs). One subpopulation expresses D1-type dopamine receptors, another expresses D2-type receptors, and a third expresses both. The relative roles in NAc of D1 neurons versus D2 neurons in appetitive motivation were assessed here. Specifically, we asked whether D1-Cre mice would instrumentally seek optogenetic self-stimulation specifically targeted at D1 MSNs in NAc, and similarly if D2-Cre mice would self-stimulate D2 neurons in NAc. Mice were implanted with Cre-targeted channelrhodopsin (ChR2) virus and optic fibers in NAc. Subsequently, mice could earn brief NAc laser illuminations by actively touching a metal spout in one task, or by going to a particular location in a separate task. Results indicated that D1 neuronal excitation in NAc supported intense self-stimulation in both tasks. D1-Cre mice earned hundreds to thousands of spout-touches per half-hour session, and also sought out locations that delivered NAc laser to excite D1 MSNs. By comparison, D2 ChR2 mice showed lower but still positive levels of self-stimulation in the spout-touch task, earning dozens to hundreds of NAc laser illuminations. However, in the location task, D2 mice failed to show positive self-stimulation. If anything, a few D2 individuals gradually avoided the laser location. Brain-wide measures indicated that D1 and D2 stimulations in NAc recruited heavily overlapping patterns of Fos activation in distant limbic structures. These results confirm that excitation of D1 MSNs in NAc supports strong incentive motivation to self-stimulate. They also suggest that excitation of D2 neurons in NAc supports self-stimulation under some conditions, but fails under others and possibly may even shift to negative avoidance.

Evolving Concepts of Emotion and Motivation

This review takes a historical perspective on concepts in the psychology of motivation and emotion, and surveys recent developments, debates and applications. Old debates over emotion have recently risen again. For example, are emotions necessarily subjective feelings? Do animals have emotions? I review evidence that emotions exist as core psychological processes, which have objectively detectable features, and which can occur either with subjective feelings or without them. Evidence is offered also that studies of emotion in animals can give new insights into human emotions. Beyond emotion, motivation concepts have changed over decades too, and debates still continue. Motivation was once thought in terms of aversive drives, and reward was thought of in terms of drive reduction. Motivation-as-drive concepts were largely replaced by motivation-as-incentive concepts, yet aversive drive concepts still occasionally surface in reward neuroscience today. Among incentive concepts, incentive salience is a core motivation process, mediated by brain mesocorticolimbic systems (dopamine-related systems) and sometimes called 'wanting' (in quotation marks), to distinguish it from cognitive forms of desire (wanting without quotation marks). Incentive salience as 'wanting' is separable also from pleasure 'liking' for the same reward, which has important implications for several human clinical disorders. Ordinarily, incentive salience adds motivational urgency to cognitive desires, but 'wanting' and cognitive desires can dissociate in some conditions. Excessive incentive salience can cause addictions, in which excessive 'wanting' can diverge from cognitive desires. Conversely, lack of incentive salience may cause motivational forms of anhedonia in depression or schizophrenia, whereas a negatively-valenced form of 'fearful salience' may contribute to paranoia. Finally, negative 'fear' and 'disgust' have both partial overlap but also important neural differences.

Current perspectives on incentive salience and applications to clinical disorders

Affective neuroscience research has revealed that reward contains separable components of 'liking', 'wanting', and learning. Here we focus on current 'liking' and 'wanting' findings and applications to clinical disorders. 'Liking' is the hedonic impact derived from a pleasant experience, and is amplified by opioid and related signals in discrete sites located in limbic-related brain areas. 'Wanting' refers to incentive salience, a motivation process for reward, and is mediated by larger systems involving mesocorticolimbic dopamine. Deficits in incentive salience may contribute to avolitional features of depression and related disorders, whereas deficits in hedonic impact may produce true anhedonia. Excesses in incentive salience, on the other hand, can lead to addiction, especially when narrowly focused on a particular target. Finally, a fearful form of motivational salience may even contribute to some paranoia symptoms of schizophrenia and related disorders.

Endocannabinoid-Enhanced "Liking" in Nucleus Accumbens Shell Hedonic Hotspot Requires Endogenous Opioid Signals

Introduction: Stimulating either endogenous cannabinoids or opioids within a restricted dorsomedial “hedonic hotspot” in nucleus accumbens (NAc) shell enhances hedonic impact, or “liking” reactions to sweet tastes. In this study, we probed within this hotspot the relationship between endocannabinoid and opioid signals in hedonic enhancement.

Materials and Methods: Specifically, we asked whether enhancement of sucrose “liking” by intra-NAc microinjections of the endocannabinoid anandamide requires concurrent endogenous opioid signaling.

Results: Co-administration of the opioid antagonist naloxone in the same NAc microinjections with anandamide prevented the endocannabinoid from enhancing orofacial “liking” reactions to sucrose. Since intra-NAc hotspot naloxone injection alone failed to affect hedonics, reversal of anandamide-induced “liking” by opioid blockade reveals an interdependence of opioid and cannabinoid signaling in enhancing taste hedonic impact.

Conclusions: These results elaborate our understanding of the mechanisms of hedonic processing of food rewards, and may also carry implications more generally for how opioid and cannabinoid drugs interact to generate natural pleasures, or drug-induced euphoria.

Addiction research and theory: a commentary on the Surgeon General's Report on alcohol, drugs, and health

The Office of the Surgeon General recently produced its first Report on the consequences of alcohol and drug abuse on health, making several very laudable policy recommendations. The Report also emphasizes the importance of adequate funding for biomedical research, which is good news for both researchers and patients. However, the Report is marred by a biased viewpoint on the psychology and neurobiology of drug addiction. We highlight here four controversial issues that were depicted as facts in the Report, thereby potentially misleading non-expert readers about the current state-of-the-art understanding of the psychology and neurobiology of drug addiction. It will be important to recognize a fuller range of scientific viewpoints in addiction neuroscience to avoid amplifying this bias in the coming years.

Opioid and orexin hedonic hotspots in rat orbitofrontal cortex and insula

Hedonic hotspots are brain sites where particular neurochemical stimulations causally amplify the hedonic impact of sensory rewards, such as "liking" for sweetness. Here, we report the mapping of two hedonic hotspots in cortex, where mu opioid or orexin stimulations enhance the hedonic impact of sucrose taste. One hedonic hotspot was found in anterior orbitofrontal cortex (OFC), and another was found in posterior insula. A suppressive hedonic coldspot was also found in the form of an intervening strip stretching from the posterior OFC through the anterior and middle insula, bracketed by the two cortical hotspots. Opioid/orexin stimulations in either cortical hotspot activated Fos throughout a distributed "hedonic circuit" involving cortical and subcortical structures. Conversely, cortical coldspot stimulation activated circuitry for "hedonic suppression." Finally, food intake was increased by stimulations at several prefrontal cortical sites, indicating that the anatomical substrates in cortex for enhancing the motivation to eat are discriminable from those for hedonic impact.

Optogenetic Central Amygdala Stimulation Intensifies and Narrows Motivation for Cocaine

Addiction is often characterized by intense motivation for a drug, which may be narrowly focused at the expense of other rewards. Here, we examined the role of amygdala-related circuitry in the amplification and narrowing of motivation focus for intravenous cocaine. We paired optogenetic channelrhodopsin (ChR2) stimulation in either central nucleus of amygdala (CeA) or basolateral amygdala (BLA) of female rats with one particular nose-poke porthole option for earning cocaine infusions (0.3 mg/kg, i.v.). A second alternative porthole earned identical cocaine but without ChR2 stimulation. Consequently, CeA rats quickly came to pursue their CeA ChR2-paired cocaine option intensely and exclusively, elevating cocaine intake while ignoring their alternative cocaine alone option. By comparison, BLA ChR2 pairing failed to enhance cocaine motivation. CeA rats also emitted consummatory bites toward their laser-paired porthole, suggesting that higher incentive salience made that cue more attractive. A separate progressive ratio test of incentive motivation confirmed that CeA ChR2 amplified rats' motivation, raising their breakpoint effort price for cocaine by 10-fold. However, CeA ChR2 laser on its own lacked any reinforcement value: laser by itself was never self-stimulated, not even by the same rats in which it amplified motivation for cocaine. Conversely, CeA inhibition by muscimol/baclofen microinjections prevented acquisition of cocaine self-administration and laser preference, whereas CeA inhibition by optogenetic halorhodopsin suppressed cocaine intake, indicating that CeA circuitry is needed for ordinary cocaine motivation. We conclude that CeA ChR2 excitation paired with a cocaine option specifically focuses and amplifies motivation to produce intense pursuit and consumption focused on that single target.SIGNIFICANCE STATEMENT In addiction, intense incentive motivation often becomes narrowly focused on a particular drug of abuse. Here we show that pairing central nucleus of amygdala (CeA) optogenetic stimulation with one option for earning intravenous cocaine makes that option almost the exclusive focus of intense pursuit and consumption. CeA stimulation also elevated the effort cost rats were willing to pay for cocaine and made associated cues become intensely attractive. However, we also show that CeA laser had no reinforcing properties at all when given alone for the same rats. Therefore, CeA laser pairing makes its associated cocaine option and cues become powerfully attractive in a nearly addictive fashion.

The Affective Core of Emotion: Linking Pleasure, Subjective Well-Being, and Optimal Metastability in the Brain

Arguably, emotion is always valenced-either pleasant or unpleasant-and dependent on the pleasure system. This system serves adaptive evolutionary functions; relying on separable wanting, liking, and learning neural mechanisms mediated by mesocorticolimbic networks driving pleasure cycles with appetitive, consummatory, and satiation phases. Liking is generated in a small set of discrete hedonic hotspots and coldspots, while wanting is linked to dopamine and to larger distributed brain networks. Breakdown of the pleasure system can lead to anhedonia and other features of affective disorders. Eudaimonia and well-being are difficult to study empirically, yet whole-brain computational models could offer novel insights (e.g., routes to eudaimonia such as caregiving of infants or music) potentially linking eudaimonia to optimal metastability in the pleasure system.

Hypothalamic Cooling Elicits Eating: Differential Effects on Motivation and Pleasure

The perceived attractiveness of stimuli to humans has been modulated by changes in cephalic blood temperature. Can similar effects be produced in animals by manipulation of hypothalamic temperature? This study examined the attractiveness and pleasure of food to rats during hypothalamic cooling or hypothalamic heating, by measuring feeding and hedonic and aversive facial reactions to taste. Hypothalamic cooling administered through a permanently implanted thermode elicited feeding. Hypothalamic heating did not. Hedonic and aversive reactions to taste were unaltered by hypothalamic cooling or heating, even for rats that ate during cooling. Hypothalamic cooling may thus potentiate the attractive quality of food without modulating basic taste pleasure.

Liking, wanting, and the incentive-sensitization theory of addiction

Rewards are both "liked" and "wanted," and those 2 words seem almost interchangeable. However, the brain circuitry that mediates the psychological process of "wanting" a particular reward is dissociable from circuitry that mediates the degree to which it is "liked." Incentive salience or "wanting," a form of motivation, is generated by large and robust neural systems that include mesolimbic dopamine. By comparison, "liking," or the actual pleasurable impact of reward consumption, is mediated by smaller and fragile neural systems, and is not dependent on dopamine. The incentive-sensitization theory posits the essence of drug addiction to be excessive amplification specifically of psychological "wanting," especially triggered by cues, without necessarily an amplification of "liking." This is because of long-lasting changes in dopamine-related motivation systems of susceptible individuals, called "neural sensitization." A quarter-century after its proposal, evidence has continued to grow in support the incentive-sensitization theory. Further, its scope is now expanding to include diverse behavioral addictions and other psychopathologies. (PsycINFO Database Record

Orexin in Rostral Hotspot of Nucleus Accumbens Enhances Sucrose 'Liking' and Intake but Scopolamine in Caudal Shell Shifts 'Liking' Toward 'Disgust' and 'Fear'

The nucleus accumbens (NAc) contains a hedonic hotspot in the rostral half of medial shell, where opioid agonist microinjections are known to enhance positive hedonic orofacial reactions to the taste of sucrose ('liking' reactions). Within NAc shell, orexin/hypocretin also has been reported to stimulate food intake and is implicated in reward, whereas blockade of muscarinic acetylcholine receptors by scopolamine suppresses intake and may have anti-reward effects. Here, we show that NAc microinjection of orexin-A in medial shell amplifies the hedonic impact of sucrose taste, but only within the same anatomically rostral site, identical to the opioid hotspot. By comparison, at all sites throughout medial shell, orexin microinjections stimulated 'wanting' to eat, as reflected by increases in intake of palatable sweet chocolates. At NAc shell sites outside the hotspot, orexin selectively enhanced 'wanting' to eat without enhancing sweetness 'liking' reactions. In contrast, microinjections of the antagonist scopolamine at all sites in NAc shell suppressed sucrose 'liking' reactions as well as suppressing intake of palatable food. Conversely, scopolamine increased aversive 'disgust' reactions elicited by bitter quinine at all NAc shell sites. Finally, scopolamine microinjections localized to the caudal half of medial shell additionally generated a fear-related anti-predator reaction of defensive treading and burying directed toward the corners of the transparent chamber. Together, these results confirm a rostral hotspot in NAc medial shell as a unique site for orexin induction of hedonic 'liking' enhancement, similar to opioid enhancement. They also reveal distinct roles for orexin and acetylcholine signals in NAc shell for hedonic reactions and motivated behaviors.

Unconscious Emotion

Conscious feelings have traditionally been viewed as a central and necessary ingredient of emotion. Here we argue that emotion also can be genuinely unconscious. We describe evidence that positive and negative reactions can be elicited subliminally and remain inaccessible to introspection. Despite the absence of subjective feelings in such cases, subliminally induced affective reactions still influence people's preference judgments and even the amount of beverage they consume. This evidence is consistent with evolutionary considerations suggesting that systems underlying basic affective reactions originated prior to systems for conscious awareness. The idea of unconscious emotion is also supported by evidence from affective neuroscience indicating that subcortical brain systems underlie basic “liking” reactions. More research is needed to clarify the relations and differences between conscious and unconscious emotion, and their underlying mechanisms. However, even under the current state of knowledge, it appears that processes underlying conscious feelings can become decoupled from processes underlying emotional reactions, resulting in genuinely unconscious emotion.

Neuronal Coding of Serial Order: Syntax of Grooming in the Neostriatum

How does the brain create rule-governed sequences of behavior? An answer to this question may come from a surprising source: the neostriatum (caudate nucleus and putamen). Traditionally, the neostriatum has been considered part of the brain's motor system, but its contribution to the preparation or execution of movement is recognized generally to concern high-level motor functions. Recent work implicates the neostriatum in disorders of sequential action and thought, as in the repetition of thoughts or habits in human obsessive-compulsive disorder and movements or speech in Tourette's syndrome. Yet there is no direct evidence to support the idea that the neostriatum controls sequences of behavior. Using ethological and neurophysiological techniques to study neural activity in the rat neostriatum during syntactic grooming sequences, we found that neuronal activity in the anterolateral neostriatum depended on the execution of syntactic sequences of grooming actions. The individual grooming movements themselves did not activate the neostriatum; activation was determined by the syntactic sequence in which grooming movements were performed. These data provide the first direct evidence that the neostriatum coordinates the control of rule-governed behavioral sequences.

Dorsolateral neostriatum contribution to incentive salience: opioid or dopamine stimulation makes one reward cue more motivationally attractive than another

Pavlovian cues for rewards can become attractive incentives: approached and 'wanted' as the rewards themselves. The motivational attractiveness of a previously learned cue is not fixed, but can be dynamically amplified during re-encounter by simultaneous activation of brain limbic circuitry. Here it was reported that opioid or dopamine microinjections in the dorsolateral quadrant of the neostriatum (DLS) of rats selectively amplify attraction toward a previously learned Pavlovian cue in an individualized fashion, at the expense of a competing cue. In an autoshaping (sign-tracking vs. goal-tracking) paradigm, microinjection of the mu opioid receptor agonist (DAMGO) or dopamine indirect agonist (amphetamine) in the DLS of sign-tracker individuals selectively enhanced their sign-tracking attraction toward the reward-predictive lever cue. By contrast, DAMGO or amphetamine in the DLS of goal-trackers selectively enhanced prepotent attraction toward the reward-proximal cue of sucrose dish. Amphetamine also enhanced goal-tracking in some sign-tracker individuals (if they ever defected to the dish even once). That DLS enhancement of cue attraction was due to stronger motivation, not stronger habits, was suggested by: (i) sign-trackers flexibly followed their cue to a new location when the lever was suddenly moved after DLS DAMGO microinjection; and (ii) DAMGO in the DLS also made sign-trackers work harder on a new instrumental nose-poke response required to earn presentations of their Pavlovian lever cue (instrumental conditioned reinforcement). Altogether, the current results suggest that DLS circuitry can enhance the incentive salience of a Pavlovian reward cue, selectively making that cue a stronger motivational magnet.

Neurobiology of rodent self-grooming and its value for translational neuroscience

Self-grooming is a complex innate behaviour with an evolutionarily conserved sequencing pattern and is one of the most frequently performed behavioural activities in rodents. In this Review, we discuss the neurobiology of rodent self-grooming, and we highlight studies of rodent models of neuropsychiatric disorders--including models of autism spectrum disorder and obsessive compulsive disorder--that have assessed self-grooming phenotypes. We suggest that rodent self-grooming may be a useful measure of repetitive behaviour in such models, and therefore of value to translational psychiatry. Assessment of rodent self-grooming may also be useful for understanding the neural circuits that are involved in complex sequential patterns of action.

Ventral pallidal coding of a learned taste aversion

The hedonic value of a sweet food reward, or how much a taste is 'liked', has been suggested to be encoded by neuronal firing in the posterior ventral pallidum (VP). Hedonic impact can be altered by psychological manipulations, such as taste aversion conditioning, which can make an initially pleasant sweet taste become perceived as disgusting. Pairing nausea-inducing LiCl injection as a Pavlovian unconditioned stimulus (UCS) with a novel taste that is normally palatable as the predictive conditioned stimulus (CS+) suffices to induce a learned taste aversion that changes orofacial 'liking' responses to that sweet taste (e.g., lateral tongue protrusions) to 'disgust' reactions (e.g., gapes) in rats. We used two different sweet tastes of similar initial palatability (a sucrose solution and a polycose/saccharin solution, CS ± assignment was counterbalanced across groups) to produce a discriminative conditioned aversion. Only one of those tastes (arbitrarily assigned and designated as CS+) was associatively paired with LiCl injections as UCS to form a conditioned aversion. The other taste (CS-) was paired with mere vehicle injections to remain relatively palatable as a control sweet taste. We recorded the neural activity in VP in response to each taste, before and after aversion training. We found that the safe and positively hedonic taste always elicited excitatory increases in firing rate of VP neurons. By contrast, aversion learning reversed the VP response to the 'disgusting' CS+ taste from initial excitation into a conditioned decrease in neuronal firing rate after training. Such neuronal coding of hedonic impact by VP circuitry may contribute both to normal pleasure and disgust, and disruptions of VP coding could result in affective disorders, addictions and eating disorders.

Individual Differences in Cue-Induced Motivation and Striatal Systems in Rats Susceptible to Diet-Induced Obesity

Pavlovian cues associated with junk-foods (caloric, highly sweet, and/or fatty foods), like the smell of brownies, can elicit craving to eat and increase the amount of food consumed. People who are more susceptible to these motivational effects of food cues may have a higher risk for becoming obese. Further, overconsumption of junk-foods leading to the development of obesity may itself heighten attraction to food cues. Here, we used a model of individual susceptibility to junk-foods diet-induced obesity to determine whether there are pre-existing and/or diet-induced increases in attraction to and motivation for sucrose-paired cues (ie, incentive salience or 'wanting'). We also assessed diet- vs obesity-associated alterations in mesolimbic function and receptor expression. We found that rats susceptible to diet-induced obesity displayed heightened conditioned approach prior to the development of obesity. In addition, after junk-food diet exposure, those rats that developed obesity also showed increased willingness to gain access to a sucrose cue. Heightened 'wanting' was not due to individual differences in the hedonic impact ('liking') of sucrose. Neurobiologically, Mu opioid receptor mRNA expression was lower in striatal 'hot-spots' that generate eating or hedonic impact only in those rats that became obese. In contrast, prolonged exposure to junk-food resulted in cross-sensitization to amphetamine-induced locomotion and downregulation of striatal D2R mRNA regardless of the development of obesity. Together these data shed light on individual differences in behavioral and neurobiological consequences of exposure to junk-food diets and the potential contribution of incentive sensitization in susceptible individuals to greater food cue-triggered motivation.

Amphetamine-induced sensitization and reward uncertainty similarly enhance incentive salience for conditioned cues

Amphetamine and stress can sensitize mesolimbic dopamine-related systems. In Pavlovian autoshaping, repeated exposure to uncertainty of reward prediction can enhance motivated sign-tracking or attraction to a discrete reward-predicting cue (lever-conditioned stimulus; CS+), as well as produce cross-sensitization to amphetamine. However, it remains unknown how amphetamine sensitization or repeated restraint stress interact with uncertainty in controlling CS+ incentive salience attribution reflected in sign-tracking. Here rats were tested in 3 successive phases. First, different groups underwent either induction of amphetamine sensitization or repeated restraint stress, or else were not sensitized or stressed as control groups (either saline injections only, or no stress or injection at all). All next received Pavlovian autoshaping training under either certainty conditions (100% CS-UCS association) or uncertainty conditions (50% CS-UCS association and uncertain reward magnitude). During training, rats were assessed for sign-tracking to the CS+ lever versus goal-tracking to the sucrose dish. Finally, all groups were tested for psychomotor sensitization of locomotion revealed by an amphetamine challenge. Our results confirm that reward uncertainty enhanced sign-tracking attraction toward the predictive CS+ lever, at the expense of goal-tracking. We also reported that amphetamine sensitization promoted sign-tracking even in rats trained under CS-UCS certainty conditions, raising them to sign-tracking levels equivalent to the uncertainty group. Combining amphetamine sensitization and uncertainty conditions did not add together to elevate sign-tracking further above the relatively high levels induced by either manipulation alone. In contrast, repeated restraint stress enhanced subsequent amphetamine-elicited locomotion, but did not enhance CS+ attraction.

Lateral hypothalamus, nucleus accumbens, and ventral pallidum roles in eating and hunger: interactions between homeostatic and reward circuitry

The study of the neural bases of eating behavior, hunger, and reward has consistently implicated the lateral hypothalamus (LH) and its interactions with mesocorticolimbic circuitry, such as mesolimbic dopamine projections to nucleus accumbens (NAc) and ventral pallidum (VP), in controlling motivation to eat. The NAc and VP play special roles in mediating the hedonic impact (“liking”) and motivational incentive salience (“wanting”) of food rewards, and their interactions with LH help permit regulatory hunger/satiety modulation of food motivation and reward. Here, we review some progress that has been made regarding this circuitry and its functions: the identification of localized anatomical hedonic hotspots within NAc and VP for enhancing hedonic impact; interactions of NAc/VP hedonic hotspots with specific LH signals such as orexin; an anterior-posterior gradient of sites in NAc shell for producing intense appetitive eating vs. intense fearful reactions; and anatomically distributed appetitive functions of dopamine and mu opioid signals in NAc shell and related structures. Such findings help improve our understanding of NAc, VP, and LH interactions in mediating affective and motivation functions, including “liking” and “wanting” for food rewards.

Pleasure systems in the brain

Pleasure is mediated by well-developed mesocorticolimbic circuitry and serves adaptive functions. In affective disorders, anhedonia (lack of pleasure) or dysphoria (negative affect) can result from breakdowns of that hedonic system. Human neuroimaging studies indicate that surprisingly similar circuitry is activated by quite diverse pleasures, suggesting a common neural currency shared by all. Wanting for reward is generated by a large and distributed brain system. Liking, or pleasure itself, is generated by a smaller set of hedonic hot spots within limbic circuitry. Those hot spots also can be embedded in broader anatomical patterns of valence organization, such as in a keyboard pattern of nucleus accumbens generators for desire versus dread. In contrast, some of the best known textbook candidates for pleasure generators, including classic pleasure electrodes and the mesolimbic dopamine system, may not generate pleasure after all. These emerging insights into brain pleasure mechanisms may eventually facilitate better treatments for affective disorders.

The hunger games

Although AgRP and POMC neurons in the hypothalamus have long been associated with regulation of food intake, in this issue of Cell, Chen et al. use direct imaging in vivo to demonstrate rapid changes in their activity upon food presentation. The rapidity of their altered responses challenges classic notions of their functions and raises new hypotheses.

Optogenetic excitation of central amygdala amplifies and narrows incentive motivation to pursue one reward above another

Choosing one reward above another is important for achieving adaptive life goals. Yet hijacked into excessive intensity in disorders such as addiction, single-minded pursuit becomes maladaptive. Here, we report that optogenetic channelrhodopsin stimulation of neurons in central nucleus of amygdala (CeA), paired with earning a particular sucrose reward in rats, amplified and narrowed incentive motivation to that single reward target. Therefore, CeA rats chose and intensely pursued only the laser-paired sucrose reward while ignoring an equally good sucrose alternative. In contrast, reward-paired stimulation of basolateral amygdala did not hijack choice. In a separate measure of incentive motivation, CeA stimulation also increased the progressive ratio breakpoint or level of effort exerted to obtain sucrose reward. However, CeA stimulation by itself failed to support behavioral self-stimulation in the absence of any paired external food reward, suggesting that CeA photo-excitation specifically transformed the value of its external reward (rather than adding an internal reinforcement state). Nor did CeA stimulation by itself induce any aversive state that motivated escape. Finally, CeA stimulation also failed to enhance 'liking' reactions elicited by sucrose taste and did not simply increase the general motivation to eat. This pattern suggests that CeA photo-excitation specifically enhances and narrows incentive motivation to pursue an associated external reward at the expense of another comparable reward.

Excessive disgust caused by brain lesions or temporary inactivations: mapping hotspots of the nucleus accumbens and ventral pallidum

Disgust is a prototypical type of negative affect. In animal models of excessive disgust, only a few brain sites are known in which localized dysfunction (lesions or neural inactivations) can induce intense 'disgust reactions' (e.g. gapes) to a normally pleasant sensation such as sweetness. Here, we aimed to map forebrain candidates more precisely, to identify where either local neuronal damage (excitotoxin lesions) or local pharmacological inactivation (muscimol/baclofen microinjections) caused rats to show excessive sensory disgust reactions to sucrose. Our study compared subregions of the nucleus accumbens shell, ventral pallidum, lateral hypothalamus, and adjacent extended amygdala. The results indicated that the posterior half of the ventral pallidum was the only forebrain site where intense sensory disgust gapes in response to sucrose were induced by both lesions and temporary inactivations (this site was previously identified as a hedonic hotspot for enhancements of sweetness 'liking'). By comparison, for the nucleus accumbens, temporary GABA inactivations in the caudal half of the medial shell also generated sensory disgust, but lesions never did at any site. Furthermore, even inactivations failed to induce disgust in the rostral half of the accumbens shell (which also contains a hedonic hotspot). In other structures, neither lesions nor inactivations induced disgust as long as the posterior ventral pallidum remained spared. We conclude that the posterior ventral pallidum is an especially crucial hotspot for producing excessive sensory disgust by local pharmacological/lesion dysfunction. By comparison, the nucleus accumbens appears to segregate sites for pharmacological disgust induction and hedonic enhancement into separate posterior and rostral halves of the medial shell.

Advances in the neurobiological bases for food 'liking' versus 'wanting'

The neural basis of food sensory pleasure has become an increasingly studied topic in neuroscience and psychology. Progress has been aided by the discovery of localized brain subregions called hedonic hotspots in the early 2000s, which are able to causally amplify positive affective reactions to palatable tastes ('liking') in response to particular neurochemical or neurobiological stimulations. Those hedonic mechanisms are at least partly distinct from larger mesocorticolimbic circuitry that generates the incentive motivation to eat ('wanting'). In this review, we aim to describe findings on these brain hedonic hotspots, especially in the nucleus accumbens and ventral pallidum, and discuss their role in generating food pleasure and appetite.

Opioid hedonic hotspot in nucleus accumbens shell: mu, delta, and kappa maps for enhancement of sweetness "liking" and "wanting"

A specialized cubic-millimeter hotspot in the rostrodorsal quadrant of medial shell in nucleus accumbens (NAc) of rats may mediate opioid enhancement of gustatory hedonic impact or "liking". Here, we selectively stimulated the three major subtypes of opioid receptors via agonist microinjections [mu (DAMGO), delta (DPDPE), or kappa (U50488H)] and constructed anatomical maps for functional localizations of consequent changes in hedonic "liking" (assessed by affective orofacial reactions to sucrose taste) versus "wanting" (assessed by changes in food intake). Results indicated that the NAc rostrodorsal quadrant contains a shared opioid hedonic hotspot that similarly mediates enhancements of sucrose "liking" for mu, delta, and kappa stimulations. Within the rostrodorsal hotspot boundaries each type of stimulation generated at least a doubling or higher enhancement of hedonic reactions, with comparable intensities for all three types of opioid stimulation. By contrast, a negative hedonic coldspot was mapped in the caudal half of medial shell, where all three types of opioid stimulation suppressed "liking" reactions to approximately one-half normal levels. Different anatomical patterns were produced for stimulation of food "wanting", reflected in food intake. Altogether, these results indicate that the rostrodorsal hotspot in medial shell is unique for generating opioid-induced hedonic enhancement, and add delta and kappa signals to mu as hedonic generators within the hotspot. Also, the identification of a separable NAc caudal coldspot for hedonic suppression, and separate NAc opioid mechanisms for controlling food "liking" versus "wanting" further highlights NAc anatomical heterogeneity and localizations of function within subregions of medial shell.

Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues

Uncertainty is a component of many gambling games and may play a role in incentive motivation and cue attraction. Uncertainty can increase the attractiveness for predictors of reward in the Pavlovian procedure of autoshaping, visible as enhanced sign-tracking (or approach and nibbles) by rats of a metal lever whose sudden appearance acts as a conditioned stimulus (CS+) to predict sucrose pellets as an unconditioned stimulus (UCS). Here we examined how reward uncertainty might enhance incentive salience as sign-tracking both in intensity and by broadening the range of attractive CS+s. We also examined whether initially induced uncertainty enhancements of CS+ attraction can endure beyond uncertainty itself, and persist even when Pavlovian prediction becomes 100% certain. Our results show that uncertainty can broaden incentive salience attribution to make CS cues attractive that would otherwise not be (either because they are too distal from reward or too risky to normally attract sign-tracking). In addition, uncertainty enhancement of CS+ incentive salience, once induced by initial exposure, persisted even when Pavlovian CS-UCS correlations later rose toward 100% certainty in prediction. Persistence suggests an enduring incentive motivation enhancement potentially relevant to gambling, which in some ways resembles incentive-sensitization. Higher motivation to uncertain CS+s leads to more potent attraction to these cues when they predict the delivery of uncertain rewards. In humans, those cues might possibly include the sights and sounds associated with gambling, which contribute a major component of the play immersion experienced by problematic gamblers.

Mapping brain circuits of reward and motivation: in the footsteps of Ann Kelley

Ann Kelley was a scientific pioneer in reward neuroscience. Her many notable discoveries included demonstrations of accumbens/striatal circuitry roles in eating behavior and in food reward, explorations of limbic interactions with hypothalamic regulatory circuits, and additional interactions of motivation circuits with learning functions. Ann Kelley's accomplishments inspired other researchers to follow in her footsteps, including our own laboratory group. Here we describe results from several lines of our research that sprang in part from earlier findings by Kelley and colleagues. We describe hedonic hotspots for generating intense pleasure 'liking', separate identities of 'wanting' versus 'liking' systems, a novel role for dorsal neostriatum in generating motivation to eat, a limbic keyboard mechanism in nucleus accumbens for generating intense desire versus intense dread, and dynamic limbic transformations of learned memories into motivation. We describe how origins for each of these themes can be traced to fundamental contributions by Ann Kelley.

Nucleus accumbens GABAergic inhibition generates intense eating and fear that resists environmental retuning and needs no local dopamine

Intense fearful behavior and/or intense appetitive eating behavior can be generated by localized amino acid inhibitions along a rostrocaudal anatomical gradient within medial shell of nucleus accumbens of the rat. This can be produced by microinjections in medial shell of either the γ-aminobutyric acid (GABA)A agonist muscimol (mimicking intrinsic GABAergic inputs) or the AMPA (α-amino-3-hydroxy-5-methylisoxazole-4-propionic acid) antagonist DNQX (6,7-dinitroquinoxaline-2,3-dione), disrupting corticolimbic glutamate inputs). At rostral sites in medial shell, each drug robustly stimulates appetitive eating and food intake, whereas at more caudal sites the same drugs instead produce increasingly fearful behaviors such as escape, distress vocalizations and defensive treading (an antipredator behavior rodents emit to snakes and scorpions). Previously we showed that intense motivated behaviors generated by glutamate blockade require local endogenous dopamine and can be modulated in valence by environmental ambience. Here we investigated whether GABAergic generation of intense appetitive and fearful motivations similarly depends on local dopamine signals, and whether the valence of motivations generated by GABAergic inhibition can also be retuned by changes in environmental ambience. We report that the answer to both questions is 'no'. Eating and fear generated by GABAergic inhibition of accumbens shell does not need endogenous dopamine. Also, the appetitive/fearful valence generated by GABAergic muscimol microinjections resists environmental retuning and is determined almost purely by rostrocaudal anatomical placement. These results suggest that nucleus accumbens GABAergic release of fear and eating are relatively independent of modulatory dopamine signals, and more anatomically pre-determined in valence balance than release of the same intense behaviors by glutamate disruptions.

Dopamine or opioid stimulation of nucleus accumbens similarly amplify cue-triggered 'wanting' for reward: entire core and medial shell mapped as substrates for PIT enhancement

Pavlovian cues [conditioned stimulus (CS+)] often trigger intense motivation to pursue and consume related reward [unconditioned stimulus (UCS)]. But cues do not always trigger the same intensity of motivation. Encountering a reward cue can be more tempting on some occasions than on others. What makes the same cue trigger more intense motivation to pursue reward on a particular encounter? The answer may be the level of incentive salience ('wanting') that is dynamically generated by mesocorticolimbic brain systems, influenced especially by dopamine and opioid neurotransmission in the nucleus accumbens (NAc) at that moment. We tested the ability of dopamine stimulation (by amphetamine microinjection) vs. mu opioid stimulation [by d-Ala, nMe-Phe, Glyol-enkephalin (DAMGO) microinjection] of either the core or shell of the NAc to amplify cue-triggered levels of motivation to pursue sucrose reward, measured with a Pavlovian-Instrumental Transfer (PIT) procedure, a relatively pure assay of incentive salience. Cue-triggered 'wanting' in PIT was enhanced by amphetamine or DAMGO microinjections equally, and also equally at nearly all sites throughout the entire core and medial shell (except for a small far-rostral strip of shell). NAc dopamine/opioid stimulations specifically enhanced CS+ ability to trigger phasic peaks of 'wanting' to obtain UCS, without altering baseline efforts when CS+ was absent. We conclude that dopamine/opioid stimulation throughout nearly the entire NAc can causally amplify the reactivity of mesocorticolimbic circuits, and so magnify incentive salience or phasic UCS 'wanting' peaks triggered by a CS+. Mesolimbic amplification of incentive salience may explain why a particular cue encounter can become irresistibly tempting, even when previous encounters were successfully resisted before.

Prefrontal cortex modulates desire and dread generated by nucleus accumbens glutamate disruption

BACKGROUND

Corticolimbic circuits, including direct projections from prefrontal cortex to nucleus accumbens (NAc), permit top-down control of intense motivations generated by subcortical circuits. In rats, localized disruptions of glutamate signaling within medial shell of NAc generate desire or dread, anatomically organized along a rostrocaudal gradient analogous to a limbic keyboard. At rostral locations in shell, these disruptions generate appetitive eating, but at caudal locations the disruptions generate progressively fearful behaviors (distress vocalizations, escape attempts, and antipredator reactions). Here, we asked whether medial prefrontal cortex can modulate intense motivations generated by subcortical NAc disruptions.

METHODS

We used simultaneous microinjections in medial prefrontal cortex regions and in NAc shell to examine whether the desire or dread generated by NAc shell disruptions is modulated by activation/inhibition of three specific regions of prefrontal cortex: medial orbitofrontal cortex, infralimbic cortex (homologous to area 25 or subgenual anterior cingulate in the human), or prelimbic cortex (midventral anterior cingulate).

RESULTS

We found that activation of medial orbitofrontal cortex biased intense bivalent motivation in an appetitive direction by amplifying generation of eating behavior by middle to caudal NAc disruptions, without altering fear. In contrast, activation of infralimbic prefrontal cortex powerfully and generally suppressed both appetitive eating and fearful behaviors generated by NAc shell disruptions.

CONCLUSIONS

These results suggest that corticolimbic projections from discrete prefrontal regions can either bias motivational valence or generally suppress subcortically generated intense motivations of desire or fear.

From prediction error to incentive salience: mesolimbic computation of reward motivation

Reward contains separable psychological components of learning, incentive motivation and pleasure. Most computational models have focused only on the learning component of reward, but the motivational component is equally important in reward circuitry, and even more directly controls behavior. Modeling the motivational component requires recognition of additional control factors besides learning. Here I discuss how mesocorticolimbic mechanisms generate the motivation component of incentive salience. Incentive salience takes Pavlovian learning and memory as one input and as an equally important input takes neurobiological state factors (e.g. drug states, appetite states, satiety states) that can vary independently of learning. Neurobiological state changes can produce unlearned fluctuations or even reversals in the ability of a previously learned reward cue to trigger motivation. Such fluctuations in cue-triggered motivation can dramatically depart from all previously learned values about the associated reward outcome. Thus, one consequence of the difference between incentive salience and learning can be to decouple cue-triggered motivation of the moment from previously learned values of how good the associated reward has been in the past. Another consequence can be to produce irrationally strong motivation urges that are not justified by any memories of previous reward values (and without distorting associative predictions of future reward value). Such irrationally strong motivation may be especially problematic in addiction. To understand these phenomena, future models of mesocorticolimbic reward function should address the neurobiological state factors that participate to control generation of incentive salience.

Instant transformation of learned repulsion into motivational "wanting"

BACKGROUND

Learned cues for pleasant reward often elicit desire, which, in addicts, may become compulsive. According to the dominant view in addiction neuroscience and reinforcement modeling, such desires are the simple products of learning, coming from a past association with reward outcome.

RESULTS

We demonstrate that cravings are more than merely the products of accumulated pleasure memories-even a repulsive learned cue for unpleasantness can become suddenly desired via the activation of mesocorticolimbic circuitry. Rats learned repulsion toward a Pavlovian cue (a briefly-inserted metal lever) that always predicted an unpleasant Dead Sea saltiness sensation. Yet, upon first reencounter in a novel sodium-depletion state to promote mesocorticolimbic reactivity (reflected by elevated Fos activation in ventral tegmentum, nucleus accumbens, ventral pallidum, and the orbitofrontal prefrontal cortex), the learned cue was instantly transformed into an attractive and powerful motivational magnet. Rats jumped and gnawed on the suddenly attractive Pavlovian lever cue, despite never having tasted intense saltiness as anything other than disgusting.

CONCLUSIONS

Instant desire transformation of a learned cue contradicts views that Pavlovian desires are essentially based on previously learned values (e.g., prediction error or temporal difference models). Instead desire is recomputed at reencounter by integrating Pavlovian information with the current brain/physiological state. This powerful brain transformation reverses strong learned revulsion into avid attraction. When applied to addiction, related mesocorticolimbic transformations (e.g., drugs or neural sensitization) of cues for already-pleasant drug experiences could create even more intense cravings. This cue/state transformation helps define what it means to say that addiction hijacks brain limbic circuits of natural reward.

Enkephalin surges in dorsal neostriatum as a signal to eat

Compulsive overconsumption of reward characterizes disorders ranging from binge eating to drug addiction. Here, we provide evidence that enkephalin surges in an anteromedial quadrant of dorsal neostriatum contribute to generating intense consumption of palatable food. In ventral striatum, mu opioid circuitry contributes an important component of motivation to consume reward. In dorsal neostriatum, mu opioid receptors are concentrated within striosomes that receive inputs from limbic regions of prefrontal cortex. We employed advanced opioid microdialysis techniques that allow detection of extracellular enkephalin levels. Endogenous >150% enkephalin surges in anterior dorsomedial neostriatum were triggered as rats began to consume palatable chocolates. In contrast, dynorphin levels remained unchanged. Furthermore, a causal role for mu opioid stimulation in overconsumption was demonstrated by observations that microinjection in the same anterior dorsomedial quadrant of a mu receptor agonist ([D-Ala2, N-MePhe4, Gly-ol]-enkephalin; DAMGO) generated intense >250% increases in intake of palatable sweet food (without altering hedonic impact of sweet tastes). Mapping by "Fos plume" methods confirmed the hyperphagic effect to be anatomically localized to the anteromedial quadrant of the dorsal neostriatum, whereas other quadrants were relatively ineffective. These findings reveal that opioid signals in anteromedial dorsal neostriatum are able to code and cause motivation to consume sensory reward.