Dorsolateral neostriatum contribution to incentive salience: opioid or dopamine stimulation makes one reward cue more motivationally attractive than another

20 Years of Aberrant Salience in Psychosis: What Have We Learned?

Twenty years ago Shitij Kapur's "Psychosis as a state of aberrant salience" captured the attention of clinicians and cognitive and behavioral neuroscientists. It has become the de facto way of talking about delusion formation in labs and clinics. Here, evidence for this theory is critically evaluated in consideration of evolving data since its publication. A particular focus is placed on its specific predictions regarding the neural and behavioral loci of dopamine dysfunction in psychosis and finds them lacking. This examination is informed by recent advances in the understanding of the function of the dopamine system and its impacts on behavior following the explosion of new tools and probes for precise measurement and manipulation of dopaminergic circuits. Contemporary theories that have developed since Kapur-which suggest a role for dopamine in belief formation, belief updating under uncertainty, and abductive inference to the best explanation for some set of circumstances-are argued to form a more cogent theory that fits better with the work in patients with delusions and hallucinations, how they behave, and what is known about the function of their dopamine system. The original salience hypothesis has been influential as it attempted to unite neurochemical dysfunction with clinical phenomenology through computational cognitive neuroscience, which has led to the development of novel predictions that the authors highlight as future directions for the field.

The Incentive-Sensitization Theory of Addiction 30 Years On

The incentive-sensitization theory (IST) of addiction was first published in 1993, proposing that (a) brain mesolimbic dopamine systems mediate incentive motivation ("wanting") for addictive drugs and other rewards, but not their hedonic impact (liking) when consumed; and (b) some individuals are vulnerable to drug-induced long-lasting sensitization of mesolimbic systems, which selectively amplifies their "wanting" for drugs without increasing their liking of the same drugs. Here we describe the origins of IST and evaluate its status 30 years on. We compare IST to other theories of addiction, including opponent-process theories, habit theories of addiction, and prefrontal cortical dysfunction theories of impaired impulse control. We also address critiques of IST that have been raised over the years, such as whether craving is important in addiction and whether addiction can ever be characterized as compulsive. Finally, we discuss several contemporary phenomena, including the potential role of incentive sensitization in behavioral addictions, the emergence of addiction-like dopamine dysregulation syndrome in medicated Parkinson's patients, the role of attentional capture and approach tendencies, and the role of uncertainty in incentive motivation.

Mesocorticolimbic system reactivity to alcohol use-related visual cues as a function of alcohol sensitivity phenotype: A pilot fMRI study

Low sensitivity (LS) to alcohol is a risk factor for alcohol use disorder (AUD). Compared to peers with high sensitivity (HS), LS individuals drink more, report more problems, and exhibit potentiated alcohol cue reactivity (ACR). Heightened ACR suggests LS confers AUD risk via incentive sensitization, which is thought to take place in the mesocorticolimbic system. This study examined neural ACR in LS and HS individuals. Young adults (N = 32, M age=20.3) were recruited based on the Alcohol Sensitivity Questionnaire (HS: n = 16; LS: n = 16; 9 females/group). Participants completed an event-related fMRI ACR task. Group LS had higher ACR in left ventrolateral prefrontal cortex than group HS. In group LS, ACR in left caudomedial orbitofrontal cortex or left putamen was low at low alcohol use levels and high at heavier or more problematic alcohol use levels, whereas the opposite was true in group HS. Alcohol use level also was associated with the level of ACR in left substantia nigra among males in group LS. Taken together, results suggest elevated mesocorticolimbic ACR among LS individuals, especially those using alcohol at hazardous levels. Future studies with larger samples are warranted to determine the neurobiological loci underlying LS-based amplified ACR and AUD risk.

The Role of Estrogen Signaling and Exercise in Drug Abuse: A Review

BACKGROUND

Discovering how sex differences impact the efficacy of exercise regimens used for treating drug addiction is becoming increasingly important. Estrogen is a hormone believed to explain a large portion of sex differences observed during drug addiction, and why certain exercise regimens are not equally effective between sexes in treatment. Addiction is currently a global hindrance to millions, many of whom are suffering under the influence of their brain's intrinsic reward system coupled with external environmental factors. Substance abuse disorders in the U.S. alone cost billions of dollars annually.

REVIEW SUMMARY

Studies involving the manipulation of estrogen levels in female rodents, primarily via ovariectomy, highlight its impact regarding drug addiction. More specifically, female rodents with higher estrogen levels during the estrus phase increase cocaine consumption, whereas those in the non-estrus phase (low estrogen levels) decrease cocaine consumption. If estrogen is reintroduced, self-administration increases once again. Exercise has been proven to decrease relapse tendency, but its effect on estrogen levels is not fully understood.

CONCLUSIONS

Such findings and results discussed in this review suggest that estrogen influences the susceptibility of females to relapse. Therefore, to improve drug-abuse-related treatment, exercise regimens for females should be generated based on key sex differences with respect to males.

Separating desire from prediction of outcome value

Individuals typically want what they expect to like, often based on memories of previous positive experiences. However, in some situations desire can decouple completely from memories and from learned predictions of outcome value. The potential for desire to separate from prediction arises from independent operating rules that control motivational incentive salience. Incentive salience, or 'wanting', is a type of mesolimbic desire that evolved for adaptive goals, but can also generate maladaptive addictions. Two proof-of-principle examples are presented here to show how motivational 'wanting' can soar above memory-based predictions of outcome value: (i) 'wanting what is remembered to be disgusting', and (ii) 'wanting what is predicted to hurt'. Consequently, even outcomes remembered and predicted to be negatively aversive can become positively 'wanted'. Similarly, in human addictions, people may experience powerful cue-triggered cravings for outcomes that are not predicted to be enjoyable.

Dopamine-mediated striatal activity and function is enhanced in GlyRα2 knockout animals

The glycine receptor alpha 2 (GlyRα2) is a ligand-gated ion channel which upon activation induces a chloride conductance. Here, we investigated the role of GlyRα2 in dopamine-stimulated striatal cell activity and behavior. We show that depletion of GlyRα2 enhances dopamine-induced increases in the activity of putative dopamine D1 receptor-expressing striatal projection neurons, but does not alter midbrain dopamine neuron activity. We next show that the locomotor response to d-amphetamine is enhanced in GlyRα2 knockout animals, and that this increase correlates with c-fos expression in the dorsal striatum. 3-D modeling revealed an increase in the neuronal ensemble size in the striatum in response to D-amphetamine in GlyRα2 KO mice. Finally, we show enhanced appetitive conditioning in GlyRα2 KO animals that is likely due to increased motivation, but not changes in associative learning or hedonic response. Taken together, we show that GlyRα2 is an important regulator of dopamine-stimulated striatal activity and function.

Rho kinase inhibitors ameliorate cognitive impairment in a male mouse model of methamphetamine-induced schizophrenia

Schizophrenia (SCZ) is a severe psychiatric disorder characterized by positive symptoms, negative symptoms, and cognitive deficits. Current antipsychotic treatment in SCZ improves positive symptoms but has major side effects and little impact on negative symptoms and cognitive impairment. The pathoetiology of SCZ remains unclear, but is known to involve small GTPase signaling. Rho kinase, an effector of small GTPase Rho, is highly expressed in the brain and plays a major role in neurite elongation and neuronal architecture. This study used a touchscreen-based visual discrimination (VD) task to investigate the effects of Rho kinase inhibitors on cognitive impairment in a methamphetamine (METH)-treated male mouse model of SCZ. Systemic injection of the Rho kinase inhibitor fasudil dose-dependently ameliorated METH-induced VD impairment. Fasudil also significantly suppressed the increase in the number of c-Fos-positive cells in the infralimbic medial prefrontal cortex (infralimbic mPFC) and dorsomedial striatum (DMS) following METH treatment. Bilateral microinjections of Y-27632, another Rho kinase inhibitor, into the infralimbic mPFC or DMS significantly ameliorated METH-induced VD impairment. Two proteins downstream of Rho kinase, myosin phosphatase-targeting subunit 1 (MYPT1; Thr696) and myosin light chain kinase 2 (MLC2; Thr18/Ser19), exhibited increased phosphorylation in the infralimbic mPFC and DMS, respectively, after METH treatment, and fasudil inhibited these increases. Oral administration of haloperidol and fasudil ameliorated METH-induced VD impairment, while clozapine had little effect. Oral administration of haloperidol and clozapine suppressed METH-induced hyperactivity, but fasudil had no effect. These results suggest that METH activates Rho kinase in the infralimbic mPFC and DMS, which leads to cognitive impairment in male mice. Rho kinase inhibitors ameliorate METH-induced cognitive impairment, perhaps via the cortico-striatal circuit.

Highly processed foods can be considered addictive substances based on established scientific criteria

BACKGROUND

There is growing evidence that an addictive-eating phenotype may exist. There is significant debate regarding whether highly processed foods (HPFs; foods with refined carbohydrates and/or added fats) are addictive. The lack of scientifically grounded criteria to evaluate the addictive nature of HPFs has hindered the resolution of this debate.

ANALYSIS

The most recent scientific debate regarding a substance's addictive potential centered around tobacco. In 1988, the Surgeon General issued a report identifying tobacco products as addictive based on three primary scientific criteria: their ability to (1) cause highly controlled or compulsive use, (2) cause psychoactive (i.e. mood-altering) effects via their effect on the brain and (3) reinforce behavior. Scientific advances have now identified the ability of tobacco products to (4) trigger strong urges or craving as another important indicator of addictive potential. Here, we propose that these four criteria provide scientifically valid benchmarks that can be used to evaluate the addictiveness of HPFs. Then, we review the evidence regarding whether HPFs meet each criterion. Finally, we consider the implications of labeling HPFs as addictive.

CONCLUSION

Highly processed foods (HPFs) can meet the criteria to be labeled as addictive substances using the standards set for tobacco products. The addictive potential of HPFs may be a key factor contributing to the high public health costs associated with a food environment dominated by cheap, accessible and heavily marketed HPFs.

Reinstatement of Pavlovian responses to alcohol cues by stress

RATIONALE

Stress may contribute to relapse to alcohol use in part by enhancing reactivity to cues previously paired with alcohol. Yet, standard models of stress-induced reinstatement generally use contingent presentations of alcohol-paired cues to reinforce instrumental behaviors, making it difficult to isolate the ability of cues to invigorate alcohol-seeking.

OBJECTIVE

Here we sought to test the impact of stress on behavioral responses to alcohol-paired cues, using a model of stress-induced reinstatement of Pavlovian conditioned approach, inspired by Nadia Chaudhri's work on context-induced reinstatement.

METHODS

Long Evans rats were trained to associate one auditory cue with delivery of alcohol or sucrose and an alternative auditory cue with no reward. Following extinction training, rats were exposed to a stressor prior to being re-exposed to the cues under extinction conditions. We assessed the effects of yohimbine, intermittent footshock and olfactory cues paired with social defeat on responses to alcohol-paired cues and the effects of yohimbine on responses to sucrose-paired cues.

RESULTS

The pharmacological stressor, yohimbine, enhanced alcohol seeking in a Pavlovian setting, but not in a cue-selective manner. Intermittent footshock and social defeat cues did not enhance alcohol seeking in this paradigm.

CONCLUSIONS

While yohimbine elicited reinstatement of reward-seeking in a Pavlovian setting, these effects may be unrelated to activation of stress systems or to interactions with specific cues.

Continuous cholinergic-dopaminergic updating in the nucleus accumbens underlies approaches to reward-predicting cues

The ability to learn Pavlovian associations from environmental cues predicting positive outcomes is critical for survival, motivating adaptive behaviours. This cued-motivated behaviour depends on the nucleus accumbens (NAc). NAc output activity mediated by spiny projecting neurons (SPNs) is regulated by dopamine, but also by cholinergic interneurons (CINs), which can release acetylcholine and glutamate via the activity of the vesicular acetylcholine transporter (VAChT) or the vesicular glutamate transporter (VGLUT3), respectively. Here we investigated behavioural and neurochemical changes in mice performing a touchscreen Pavlovian approach task by recording dopamine, acetylcholine, and calcium dynamics from D1- and D2-SPNs using fibre photometry in control, VAChT or VGLUT3 mutant mice to understand how these signals cooperate in the service of approach behaviours toward reward-predicting cues. We reveal that NAc acetylcholine-dopaminergic signalling is continuously updated to regulate striatal output underlying the acquisition of Pavlovian approach learning toward reward-predicting cues.

Male DAT Val559 Mice Exhibit Compulsive Behavior under Devalued Reward Conditions Accompanied by Cellular and Pharmacological Changes

Identified across multiple psychiatric disorders, the dopamine (DA) transporter (DAT) Ala559Val substitution triggers non-vesicular, anomalous DA efflux (ADE), perturbing DA neurotransmission and behavior. We have shown that DAT Val559 mice display a waiting impulsivity and changes in cognitive performance associated with enhanced reward motivation. Here, utilizing a within-subject, lever-pressing paradigm designed to bias the formation of goal-directed or habitual behavior, we demonstrate that DAT Val559 mice modulate their nose poke behavior appropriately to match context, but demonstrate a perseverative checking behavior. Although DAT Val559 mice display no issues with the cognitive flexibility required to acquire and re-learn a visual pairwise discrimination task, devaluation of reward evoked habitual reward seeking in DAT Val559 mutants in operant tasks regardless of reinforcement schedule. The direct DA agonist apomorphine also elicits locomotor stereotypies in DAT Val559, but not WT mice. Our observation that dendritic spine density is increased in the dorsal medial striatum (DMS) of DAT Val559 mice speaks to an imbalance in striatal circuitry that might underlie the propensity of DAT Val559 mutants to exhibit compulsive behaviors when reward is devalued. Thus, DAT Val559 mice represent a model for dissection of how altered DA signaling perturbs circuits that normally balance habitual and goal-directed behaviors.

The incentive amplifying effects of nicotine: Roles in alcohol seeking and consumption

Nicotine has a unique profile among drugs of abuse. To the noninitiated user, nicotine has powerful aversive effects and its relatively weak euphorigenic effects undergo rapid tolerance. Despite this, nicotine is commonly abused despite negative heath consequences, and nicotine users have enormous difficulty quitting. Further, nicotine is one of the most commonly co-abused substances, in that it is often taken in combination with other drugs. One explanation of this polydrug use is that nicotine has multiple appetitive and consummatory conditioning effects. For example, nicotine is a reinforcement enhancer in that it can potently increase the incentive value of other stimuli, including those surrounding drugs of abuse such as alcohol. In addition, nicotine also has a unique profile of neurobiological effects that alter regulation of alcohol intake and interoception. This review discusses the psychological and biological mechanisms surrounding nicotine's appetitive conditioning and consummatory effects, particularly its interactions with alcohol.

μ-opioid receptor availability is associated with sex drive in human males

The endogenous mu-opioid receptor (MOR) system modulates a multitude of social and reward-related functions, and exogenous opiates also influence sex drive in humans and animals. Sex drive shows substantial variation across humans, and it is possible that individual differences in MOR availability underlie interindividual of variation in human sex drive. We measured healthy male subjects’ (n = 52) brain’s MOR availability with positron emission tomography (PET) using an agonist radioligand, [¹¹C]carfentanil, that has high affinity for MORs. Sex drive was measured using self-reports of engaging in sexual behaviour (sex with partner and masturbating). Bayesian hierarchical regression analysis revealed that sex drive was positively associated with MOR availability in cortical and subcortical areas, notably in caudate nucleus, hippocampus, and cingulate cortices. These results were replicated in full-volume GLM analysis. These widespread effects are in line with high spatial autocorrelation in MOR expression in human brain. Complementary voxel-based morphometry analysis (n = 108) of anatomical MR images provided limited evidence for positive association between sex drive and cortical density in the midcingulate cortex. We conclude that endogenous MOR tone is associated with individual differences in sex drive in human males.

Cocaine cue-induced mesocorticolimbic activation in cocaine users: Effects of personality traits, lifetime drug use, and acute stimulant ingestion

Stimulant drug-paired cues can acquire the ability to activate mesocorticolimbic pathways and lead to new bouts of drug use. Studies in laboratory animals suggest that these effects are augmented by progressively greater drug use histories, impulsive personality traits, and acute drug ingestion. As a preliminary test of these hypotheses in humans, we exposed cocaine users (n = 14) and healthy volunteers (n = 10) to cocaine-related videos during two functional magnetic resonance imaging (fMRI) sessions, once following acute administration of placebo and once following d-amphetamine (0.3 mg/kg, p.o.). Across sessions, cocaine users showed larger cocaine cue-induced responses than healthy controls in the associative striatum and midbrain. Among the cocaine users, larger drug cue-induced responses during the placebo session were correlated with higher Barratt Impulsiveness Scale (BIS-11) nonplanning scores (associative striatum) and greater lifetime use of stimulant drugs (limbic, associative, and sensorimotor striatum). The administration of d-amphetamine did not augment the cue-induced activations, but, in cocaine users, drug cue-induced striatal activations were more widespread following prolonged cocaine cue exposure. Together, these effects of past and present drug use might aggravate the risk for stimulant drug use problems.

Quantifying the instrumental and noninstrumental underpinnings of Pavlovian responding with the Price equation

The Price equation is a mathematical expression of selectionist and non-selectionist pressures on biological, cultural, and behavioral change. We use it here to specify instrumental and noninstrumental behaviors as they arise within the context of the Pavlovian autoshaping procedure, for rats trained under reward certainty and reward uncertainty. The point of departure for this endeavor is that some portion of autoshaped behavior referred to as goal-tracking appears instrumental-a function of resource attainment (the individual approaches the location where the unconditioned stimulus is to be delivered). By contrast, some other portion of autoshaped behavior referred to as sign-tracking is noninstrumental-irrelevant to making contact with the to-be-delivered unconditioned stimulus. A Price equation model is proposed that unifies our understanding of Pavlovian autoshaping behavior by isolating operant and respondent influences on goal-tracking (instrumental) and sign-tracking (noninstrumental) behavior.

Nicotine Enhances Goal-Tracking in Ethanol and Food Pavlovian Conditioned Approach Paradigms

Rationale

Nicotine promotes alcohol intake through pharmacological and behavioral interactions. As an example of the latter, nicotine can facilitate approach toward food- and alcohol-associated stimuli ("sign-tracking") in lever-Pavlovian conditioned approach (PavCA) paradigms. However, we recently reported that nicotine can also enhance approach toward locations of reward delivery ("goal-tracking") triggered by ethanol-predictive stimuli when the location of ethanol delivery is non-static (i.e., a retractable sipper bottle).

Objective

To determine whether the non-static nature of the reward location could have biased the development of goal-tracking in our previous study (Loney et al., 2019); we assessed the effect of nicotine in a lever-PavCA paradigm wherein the location of ethanol delivery was static (i.e., a stationary liquid receptacle). Then, to determine whether nicotine's enhancement of goal-tracking is unique to ethanol-predictive stimuli, we assessed the effect of systemic nicotine on approach triggered by food-predictive stimuli in a lever-PavCA paradigm.

Methods

Long-Evans rats were used in two PavCA experiments wherein a lever predicted the receipt of ethanol (15% vol/vol; experiment 1) or food (experiment 2) into a stationary receptacle. Prior to testing, rats were administered nicotine (0.4 mg/kg subcutaneously) or saline systemically.

Results

In both experiments, nicotine increased measures of goal-tracking, but not sign-tracking.

Conclusion

Nicotine can facilitate approach to reward locations without facilitating approach to reward-predictive stimuli. As such, conceptualization of the mechanisms by which nicotine affects behavior must be expanded to explain an enhancement of goal-tracking by nicotine.

Incentive motivation: 'wanting' roles of central amygdala circuitry

The central nucleus of amygdala (CeA) mediates positively-valenced reward motivation as well as negatively-valenced fear. Optogenetic or neurochemical stimulation of CeA circuitry can generate intense incentive motivation to pursue and consume a paired natural food, sex, or addictive drug reward, and even create maladaptive 'wanting what hurts' such as attraction to a shock rod. Evidence indicates CeA stimulations selectively amplify incentive motivation ('wanting') but not hedonic impact ('liking') of the same reward. Further, valence flips can occur for CeA contributions to motivational salience. That is, CeA stimulation can promote either incentive motivation or fearful motivation, even in the same individual, depending on situation. These findings may carry implications for understanding CeA roles in neuropsychiatric disorders involving aberrant motivational salience, ranging from addiction to paranoia and anxiety disorders.

Dopaminergic Control of the Feeding Circuit

There is increasing evidence demonstrating that reward-related motivational food intake is closely connected with the brain's homeostatic system of energy balance and that this interaction might be important in the integrative control of feeding behavior. Dopamine regulates motivational behavior, including feeding behaviors, and the dopamine reward system is recognized as the most prominent system that controls appetite and motivational and emotional drives for food. It appears that the dopamine system exerts a critical role in the control of feeding behavior not only by the reward-related circuit, but also by contributing to the homeostatic circuit of food intake, suggesting that dopamine plays an integrative role across the converging circuitry of control of food intake by linking energy state-associated signals to reward-related behaviors. This review will cover and discuss up-to-date findings on the dopaminergic control of food intake by both the reward-related circuit and the homeostatic hypothalamic system.

A proposed role for glucocorticoids in mediating dopamine-dependent cue-reward learning

Learning to respond appropriately to one's surrounding environment is fundamental to survival. Importantly, however, individuals vary in how they respond to cues in the environment and this variation may be a key determinant of psychopathology. The ability of seemingly neutral cues to promote maladaptive behavior is a hallmark of several psychiatric disorders including, substance use disorder, post-traumatic stress disorder, eating disorders and obsessive-compulsive disorder. Thus, it is important to uncover the neural mechanisms by which such cues are able to attain inordinate control and promote psychopathological behavior. Here, we suggest that glucocorticoids play a critical role in this process. Glucocorticoids are primarily recognized as the main hormone secreted in response to stress but are known to exert their effects across the body and the brain, and to affect learning and memory, cognition and reward-related behaviors, among other things. Here we speculate that glucocorticoids act to facilitate a dopamine-dependent form of cue-reward learning that appears to be relevant to a number of psychiatric conditions. Specifically, we propose to utilize the sign-tracker/goal-tracker animal model as a means to capture individual variation in stimulus-reward learning and to isolate the role of glucocorticoid-dopamine interactions in mediating these individual differences. It is hoped that this framework will lead to the discovery of novel mechanisms that contribute to complex neuropsychiatric disorders and their comorbidity.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Thirst recruits phasic dopamine signaling through subfornical organ neurons

Thirst is a highly potent drive that motivates organisms to seek out and consume balance-restoring stimuli. The detection of dehydration is well understood and involves signals of peripheral origin and the sampling of internal milieu by first order homeostatic neurons within the lamina terminalis-particularly glutamatergic neurons of the subfornical organ expressing CaMKIIa (SFOCaMKIIa). However, it remains unknown whether mesolimbic dopamine pathways that are critical for motivation and reinforcement integrate information from these "early" dehydration signals. We used in vivo fiber photometry in the ventral tegmental area and measured phasic dopamine responses to a water-predictive cue. Thirst, but not hunger, potentiated the phasic dopamine response to the water cue. In euvolemic rats, the dipsogenic hormone angiotensin II, but not the orexigenic hormone ghrelin, potentiated the dopamine response similarly to that observed in water-deprived rats. Chemogenetic manipulations of SFOCaMKIIa revealed bidirectional control of phasic dopamine signaling during cued water reward. Taking advantage of within-subject designs, we found predictive relationships between changes in cue-evoked dopamine response and changes in behavioral responses-supporting a role for dopamine in motivation induced by homeostatic need. Collectively, we reveal a putative mechanism for the invigoration of goal-directed behavior: internal milieu communicates to first order, need state-selective circuits to potentiate the mesolimbic dopamine system's response to cues predictive of restorative stimuli.

Vulnerability to ethanol sensitization predicts higher intake and motivation to self-administer ethanol: Proof of the incentive salience sensitization theory?

Ethanol-induced behavioral sensitization (EIBS) is thought to play a key role in addiction. However, whether EIBS is linked to an increase in the motivation to self-administerethanol in an operant paradigm has never been demonstrated, and thus, the motivational sensitization theory (increase in drug wanting) has not been yet confirmed. We investigated using the operant ethanol self-administrationparadigm if the motivation to self-administerethanol (breakpoint) is increased in female mice prone to develop EIBS. Outbred female Swiss mice were treated once a day with 2.5-g ethanol per kilogram during 10 days and challenged with the same dose of ethanol 7 days later. EIBS-pronegroup was characterized by a significant increase in locomotion between the challenge day and day 1. When the difference was not significant, mice were considered as the "EIBS-resistant"group. Mice were then trained to nose poke for a 20% ethanol solution reinforcer under a FR1 and then a FR-2schedule of reinforcement. Motivation was assessed more directly with a progressive ratio schedule. Our results show that there is a positive correlation between EIBS and both the level of intake and motivation. Interestingly, acquisition of ethanol self-administrationwas faster in sensitized mice that also display a quick and long-lastingincrease in ethanol intake together with a lack of effect of alcohol challenge on c-Fosexpression restricted to the dorsolateral striatum. These results further support that EIBS vulnerability is crucial in the development of addictive behaviors and suggest a potential link with habit learning processes.

Effects of the cannabinoid receptor agonist CP-55,940 on incentive salience attribution

RATIONALE

Pavlovian conditioned approach paradigms are used to characterize the nature of motivational behaviors in response to stimuli as either directed toward the cue (i.e., sign-tracking) or the site of reward delivery (i.e., goal-tracking). Recent evidence has shown that activity of the endocannabinoid system increases dopaminergic activity in the mesocorticolimbic system, and other studies have shown that sign-tracking behaviors are dependent on dopamine.

OBJECTIVES

Therefore, we hypothesized that administration of a cannabinoid agonist would increase sign-tracking and decrease goal-tracking behaviors.

METHODS

Forty-seven adult male Sprague-Dawley rats were given a low, medium, or high dose of the cannabinoid agonist CP-55,940 (N = 12 per group) or saline (N = 11) before Pavlovian conditioned approach training. A separate group of rats (N = 32) were sacrificed after PCA training for measurement of cannabinoid receptor type 1 (CB1) and fatty acid amide hydrolase (FAAH) using in situ hybridization.

RESULTS

Contrary to our initial hypothesis, CP-55,940 dose-dependently decreased sign-tracking and increased goal-tracking behavior. CB1 expression was higher in sign-trackers compared with that in goal-trackers in the prelimbic cortex, but there were no significant differences in CB1 or FAAH expression in the infralimbic cortex, dorsal or ventral CA1, dorsal or ventral CA3, dorsal or ventral dentate gyrus, or amygdala.

CONCLUSIONS

These results demonstrate that cannabinoid signaling can specifically influence behavioral biases toward sign- or goal-tracking. Pre-existing differences in CB1 expression patterns, particularly in the prelimbic cortex, could contribute to individual differences in the tendency to attribute incentive salience to reward cues.

Manipulation of Self-Expansion Alters Responses to Attractive Alternative Partners

Past behavioral research has examined relationship infidelity as a potential outcome of focusing on attractive alternative partners when already in a relationship. The extent to which individuals find such alternatives attractive has been shown to be associated with various factors in the relationship, including self-expansion. However, no previous research has tested the role of self-expansion experimentally. This paper presents two experiments that directly manipulate self-expansion to determine the effect of self-expansion on responses to attractive alternative partners. Participants primed to experience a higher need for self-expansion had better memory for attractive alternatives with self-expanding traits dissimilar to their partner's versus attractive alternatives with self-expanding traits similar to their partner's. Additionally, participants primed with self-expansion (via a video of their partner discussing ways in which life with one another is exciting, novel, and challenging), had less fMRI BOLD response to attractive alternatives of the opposite sex in regions associated with perception of attractive faces (anterior cingulate and medial prefrontal cortex) relative to when they were primed with love (via a video of their partner discussing times they felt strong feelings of love for one another), or neutral content (via a video of their partner discussing some times in which they engage in mundane, routine activities together). The magnitude of this effect in the ACC correlated with relationship closeness as measured by the inclusion of the other in the self scale.

Affective valence in the brain: modules or modes?

How do brain systems evaluate the affective valence of a stimulus - that is, its quality of being good or bad? One possibility is that a neural subsystem, or 'module' (such as a subregion of the brain, a projection pathway, a neuronal population or an individual neuron), is permanently dedicated to mediate only one affective function, or at least only one specific valence - an idea that is termed here the 'affective modules' hypothesis. An alternative possibility is that a given neural module can exist in multiple neurobiological states that give it different affective functions - an idea termed here the 'affective modes' hypothesis. This suggests that the affective function or valence mediated by a neural module need not remain permanently stable but rather can change dynamically across different situations. An evaluation of evidence for the 'affective modules' versus 'affective modes' hypotheses may be useful for advancing understanding of the affective organization of limbic circuitry.

Ovarian Hormones Mediate Changes in Adaptive Choice and Motivation in Female Rats

In female rodents, sexual receptivity is coordinated with cyclic changes in the release of gonadal hormones. Increases in estradiol (E) and progesterone (P) during proestrus and estrus not only induce ovulation but also modulate behaviors that increase the likelihood that the female will find a mate and reproduce. This includes changes in receptive behaviors, such as lordosis, as well as changes in appetitive or proceptive behaviors, including motivation. Interestingly, the direction of these changes in motivation is dependent on the type of reward that is being pursued. While induction of sexual receptivity by E and P increases motivation for access to a male, motivation for a palatable food reward is decreased. These concurrent changes may facilitate adaptive choice across the estrous cycle; females bias their choice for sex when fertilization is most likely to occur, but for food when copulation is unlikely to result in impregnation. In order to test this hypothesis, we developed a novel paradigm to measure the motivated choice between a palatable food reward and access to a male conspecific. Ovariectomized, hormone primed females were trained to operantly respond for both food and sex on a fixed interval (FI) schedule. After training, unprimed and primed females were tested in a chamber that allows them to choose between food and sex while still requiring responding on the FI schedule for reach reward. From this we can not only determine the impact of hormone priming on female choice for food or sex, but also how this is reflected by changes in motivation for each specific reward, as measured by the average number of responses made during each fixed interval. Induction of sexual receptivity by hormone priming biases choice toward sex over food and this change is accompanied by an increase in motivation for sex but a decrease in motivation for food. This work provides evidence in support of a novel framework for understanding how the release of ovarian hormones over the course of the estrous cycle modulates adaptive behavioral choice in females by directly assessing motivation via operant responding when multiple rewards are available.

Affective biases and their interaction with other reward-related deficits in rodent models of psychiatric disorders

Major depressive disorder (MDD) is one of the leading global causes of disability. Symptoms of MDD can vary person to person, and current treatments often fail to alleviate the poor quality of life that patients experience. One of the two core diagnostic criteria for MDD is the loss of interest in previously pleasurable activities, which suggests a link between the disease aetiology and reward processing. Cognitive impairments are also common in patients with MDD, and more recently, emotional processing deficits known as affective biases have been recognised as a key feature of the disorder. Studies in animals have found similar affective biases related to reward. In this review we consider these affective biases in the context of other reward-related deficits and examine how affective biases associated with learning and memory may interact with the wider behavioural symptoms seen in MDD. We discuss recent developments in how analogues of affective biases and other aspects of reward processing can be assessed in rodents, as well as how these behaviours are influenced in models of MDD. We subsequently discuss evidence for the neurobiological mechanisms contributing to one or more reward-related deficits in preclinical models of MDD, identified using these behavioural assays. We consider how the relationships between these selective behavioural assays and the neurobiological mechanisms for affective bias and reward processing could be used to identify potential treatment strategies.

Could the link between drug addiction in adulthood and substance use in adolescence result from a blurring of the boundaries between incentive and hedonic processes?

There is a broad consensus that the development of drug addiction in adulthood is closely linked to the onset of drug use in adolescence. However, the relationship between drug exposure during adolescence and subsequent vulnerability to addiction is yet to be fully understood. This review will first use evidence from adult studies on reward and addiction to give an up-to-date reference point of normal reward-circuitry and the maladaptive changes that later occur in addiction. This will then be compared with current evidence from adolescent studies on reward-circuitry. Similarities between the reward processes governing characteristic behavioral traits in adolescence and the reward profile in adult addiction could help to explain why the risk of later developing addiction is increased when substance use is initiated in adolescence. We argue that the age of onset is a major risk factor in the development of substance use disorder due to a blurring of the boundaries between incentive and hedonic processes, which occurs during adolescence. A deeper understanding of the processes that mediate this blurring could open new avenues for the prevention and treatment of adult drug addiction.

Eating Rewards the Gears of the Clock

Eating behavior is regulated by metabolic and hedonic brain networks, which interact with each other to balance the physiological regulation of hunger and satiety. The daily balance of this regulation is controlled by the central circadian clock. Importantly, metabolic and reward properties of food impact the functioning of circadian clocks, altering the oscillatory activity of the molecular clockwork and circadian rhythms. However, when feeding (metabolic or reward) is timed, the whole circadian system is entrained. Furthermore, besides synchronizing the clock, the timing of both metabolic and reward eating might be crucial for health, to improve circadian physiology, as well as to treat metabolic (e.g., diabetes, obesity) and neurological diseases (e.g., mental, neurodegenerative).

Targeting opioid dysregulation in depression for the development of novel therapeutics

Since the serendipitous discovery of the first class of modern antidepressants in the 1950's, all pharmacotherapies approved by the Food and Drug Administration for major depressive disorder (MDD) have shared a common mechanism of action, increased monoaminergic neurotransmission. Despite the widespread availability of antidepressants, as many as 50% of depressed patients are resistant to these conventional therapies. The significant length of time required to produce meaningful symptom relief with these medications, 4-6 weeks, indicates that other mechanisms are likely involved in the pathophysiology of depression which may yield more viable targets for drug development. For decades, no viable candidate target with a different mechanism of action to that of conventional therapies proved successful in clinical studies. Now several exciting avenues for drug development are under intense investigation. One of these emerging targets is modulation of endogenous opioid tone. This review will evaluate preclinical and clinical evidence pertaining to opioid dysregulation in depression, focusing on the role of the endogenous ligands endorphin, enkephalin, dynorphin, and nociceptin/orphanin FQ (N/OFQ) and their respective receptors, mu (MOR), delta (DOR), kappa (KOR), and the N/OFQ receptor (NOP) in mediating behaviors relevant to depression and anxiety. Finally, putative opioid based antidepressants that are under investigation in clinical trials, ALKS5461, JNJ-67953964 (formerly LY2456302 and CERC-501) and BTRX-246040 (formerly LY-2940094) will be discussed. This review will illustrate the potential therapeutic value of targeting opioid dysregulation in developing novel therapies for MDD.

Current perspectives on incentive salience and applications to clinical disorders

Affective neuroscience research has revealed that reward contains separable components of 'liking', 'wanting', and learning. Here we focus on current 'liking' and 'wanting' findings and applications to clinical disorders. 'Liking' is the hedonic impact derived from a pleasant experience, and is amplified by opioid and related signals in discrete sites located in limbic-related brain areas. 'Wanting' refers to incentive salience, a motivation process for reward, and is mediated by larger systems involving mesocorticolimbic dopamine. Deficits in incentive salience may contribute to avolitional features of depression and related disorders, whereas deficits in hedonic impact may produce true anhedonia. Excesses in incentive salience, on the other hand, can lead to addiction, especially when narrowly focused on a particular target. Finally, a fearful form of motivational salience may even contribute to some paranoia symptoms of schizophrenia and related disorders.

Alcohol exposure disrupts mu opioid receptor-mediated long-term depression at insular cortex inputs to dorsolateral striatum

Drugs of abuse, including alcohol, ablate the expression of specific forms of long-term synaptic depression (LTD) at glutamatergic synapses in dorsal striatum (DS), a brain region involved in goal-directed and habitual behaviors. This loss of LTD is associated with altered DS-dependent behavior. Given the role of the µ-opioid receptor (MOR) in behavioral responding for alcohol, we explored the impact of alcohol on various forms of MOR-mediated synaptic depression that we find are differentially expressed at specific DS synapses. Corticostriatal MOR-mediated LTD (mOP-LTD) in the dorsolateral striatum occurs exclusively at inputs from anterior insular cortex and is selectively disrupted by in vivo alcohol exposure. Alcohol has no effect on corticostriatal mOP-LTD in dorsomedial striatum, thalamostriatal MOR-mediated short-term depression, or mOP-LTD of cholinergic interneuron-driven glutamate release. Disrupted mOP-LTD at anterior insular cortex-dorsolateral striatum synapses may therefore be a key mechanism of alcohol-induced neuroadaptations involved in the development of alcohol use disorders.

Sex-dependent impact of early-life stress and adult immobilization in the attribution of incentive salience in rats

Early life stress (ELS) induces long-term effects in later functioning and interacts with further exposure to other stressors in adulthood to shape our responsiveness to reward-related cues. The attribution of incentive salience to food-related cues may be modulated by previous and current exposures to stressors in a sex-dependent manner. We hypothesized from human data that exposure to a traumatic (severe) adult stressor will decrease the attribution of incentive salience to reward-associated cues, especially in females, because these effects are modulated by previous ELS. To study these factors in Long-Evans rats, we used as an ELS model of restriction of nesting material and concurrently evaluated maternal care. In adulthood, the offspring of both sexes were exposed to acute immobilization (IMO), and several days after, a Pavlovian conditioning procedure was used to assess the incentive salience of food-related cues. Some rats developed more attraction to the cue predictive of reward (sign-tracking) and others were attracted to the location of the reward itself, the food-magazine (goal-tracking). Several dopaminergic markers were evaluated by in situ hybridization. The results showed that ELS increased maternal care and decreased body weight gain (only in females). Regarding incentive salience, in absolute control animals, females presented slightly greater sign-tracking behavior than males. Non-ELS male rats exposed to IMO showed a bias towards goal-tracking, whereas in females, IMO produced a bias towards sign-tracking. Animals of both sexes not exposed to IMO displayed an intermediate phenotype. ELS in IMO-treated females was able to reduce sign-tracking and decrease tyrosine hydroxylase expression in the ventral tegmental area and dopamine D1 receptor expression in the accumbens shell. Although the predicted greater decrease in females in sign-tracking after IMO exposure was not corroborated by the data, the results highlight the idea that sex is an important factor in the study of the long-term impact of early and adult stressors.

Disconnection of basolateral amygdala and insular cortex disrupts conditioned approach in Pavlovian lever autoshaping

Previously established individual differences in appetitive approach and devaluation sensitivity observed in goal- and sign-trackers may be attributed to differences in the acquisition, modification, or use of associative information in basolateral amygdala (BLA) pathways. Here, we sought to determine the extent to which communication of associative information between BLA and anterior portions of insular cortex (IC) supports ongoing Pavlovian conditioned approach behaviors in sign- and goal-tracking rats, in the absence of manipulations to outcome value. We hypothesized that the BLA mediates goal-, but not sign- tracking approach through interactions with the IC, a brain region involved in supporting flexible behavior. We first trained rats in Pavlovian lever autoshaping to determine their sign- or goal-tracking tendency. During alternating test sessions, we gave unilateral intracranial injections of vehicle or a cocktail of gamma-aminobutyric acid (GABA) receptor agonists, baclofen and muscimol, unilaterally into the BLA and contralaterally or ipsilaterally into the IC prior to reinforced lever autoshaping sessions. Consistent with our hypothesis we found that contralateral inactivation of BLA and IC increased the latency to approach the food cup and decreased the number of food cup contacts in goal-trackers. While contralateral inactivation of BLA and IC did not affect the total number of lever contacts in sign-trackers, this manipulation increased the latency to approach the lever. Ipsilateral inactivation of BLA and IC did not impact approach behaviors in Pavlovian lever autoshaping. These findings, contrary to our hypothesis, suggest that communication between BLA and IC maintains a representation of initially learned appetitive associations that commonly support the initiation of Pavlovian conditioned approach behavior regardless of whether it is directed at the cue or the location of reward delivery.

Parallels and Overlap: The Integration of Homeostatic Signals by Mesolimbic Dopamine Neurons

Motivated behaviors are often initiated in response to perturbations of homeostasis. Indeed, animals and humans have fundamental drives to procure (appetitive behaviors) and eventually ingest (consummatory behaviors) substances based on deficits in body fluid (e.g., thirst) and energy balance (e.g., hunger). Consumption, in turn, reinforces motivated behavior and is therefore considered rewarding. Over the years, the constructs of homeostatic (within the purview of the hypothalamus) and reward (within the purview of mesolimbic circuitry) have been used to describe need-based vs. need-free consumption. However, many experiments have demonstrated that mesolimbic circuits and "higher-order" brain regions are also profoundly influenced by changes to physiological state, which in turn generate behaviors that are poised to maintain homeostasis. Mesolimbic pathways, particularly dopamine neurons of the ventral tegmental area (VTA) and their projections to nucleus accumbens (NAc), can be robustly modulated by a variety of energy balance signals, including post-ingestive feedback relaying nutrient content and hormonal signals reflecting hunger and satiety. Moreover, physiological states can also impact VTA-NAc responses to non-nutritive rewards, such as drugs of abuse. Coupled with recent evidence showing hypothalamic structures are modulated in anticipation of replenished need, classic boundaries between circuits that convey perturbations in homeostasis and those that drive motivated behavior are being questioned. In the current review, we examine data that have revealed the importance of mesolimbic dopamine neurons and their downstream pathways as a dynamic neurobiological mechanism that provides an interface between physiological state, perturbations to homeostasis, and reward-seeking behaviors.

Are Cocaine-Seeking "Habits" Necessary for the Development of Addiction-Like Behavior in Rats?

Drug self-administration models of addiction typically require animals to make the same response (e.g., a lever-press or nose-poke) over and over to procure and take drugs. By their design, such procedures often produce behavior controlled by stimulus-response (S-R) habits. This has supported the notion of addiction as a "drug habit," and has led to considerable advances in our understanding of the neurobiological basis of such behavior. However, to procure such drugs as cocaine, addicts often require considerable ingenuity and flexibility in seeking behavior, which, by definition, precludes the development of habits. To better model drug-seeking behavior in addicts, we first developed a novel cocaine self-administration procedure [puzzle self-administration procedure (PSAP)] that required rats to solve a new puzzle every day to gain access to cocaine, which they then self-administered on an intermittent access (IntA) schedule. Such daily problem-solving precluded the development of S-R seeking habits. We then asked whether prolonged PSAP/IntA experience would nevertheless produce "symptoms of addiction." It did, including escalation of intake, sensitized motivation for drug, continued drug use in the face of adverse consequences, and very robust cue-induced reinstatement of drug seeking, especially in a subset of "addiction-prone" rats. Furthermore, drug-seeking behavior continued to require dopamine neurotransmission in the core of the nucleus accumbens (but not the dorsolateral striatum). We conclude that the development of S-R seeking habits is not necessary for the development of cocaine addiction-like behavior in rats.SIGNIFICANCE STATEMENT Substance-use disorders are often characterized as "habitual" behaviors aimed at obtaining and administering drugs. Although the actions involved in consuming drugs may involve a rigid repertoire of habitual behaviors, evidence suggests that addicts must be very creative and flexible when trying to procure drugs, and thus drug seeking cannot be governed by habit alone. We modeled flexible drug-seeking behavior in rats by requiring animals to solve daily puzzles to gain access to cocaine. We find that habitual drug-seeking isn't necessary for the development of addiction-like behavior, and that our procedure doesn't result in transfer of dopaminergic control from the ventral to dorsal striatum. This approach may prove useful in studying changes in neuropsychological function that promote the transition to addiction.

Sex differences, gender and addiction

This review discusses alcohol and other forms of drug addiction as both a sociocultural and biological phenomenon. Sex differences and gender are not solely determined by biology, nor are they entirely sociocultural. The interactions among biological, environmental, sociocultural, and developmental influences result in phenotypes that may be more masculine or more feminine. These gender-related sex differences in the brain can influence the responses to drugs of abuse, progressive changes in the brain after exposure to drugs of abuse and whether addiction results from drug-taking experiences. In addition, the basic laboratory evidence for sex differences is discussed within the context of four types of sex/gender differences. © 2016 Wiley Periodicals, Inc.

Revisiting the role of the insula and smoking cue-reactivity in relapse: A replication and extension of neuroimaging findings

INTRODUCTION

The ability to direct smoking cessation treatment based on neuroscientific findings holds incredible promise. However, there is a strong need for consistency across studies to confirm neurobiological targets. While our prior work implicated enhanced insula reactivity to smoking cues in tobacco smoking relapse vulnerability, this finding has not been confirmed.

METHOD

Using functional magnetic resonance imaging (fMRI), we evaluated the pre-cessation brain reactivity to smoking vs. neutral cues in nicotine dependent smokers who were and were not able to maintain subsequent abstinence.

RESULTS

Of the 23 (7 women) individuals assessed, 13 relapsed and there were no demographic differences between those who did and did not relapse. However, smokers who relapsed showed enhanced reactivity to smoking cues in the right insula and dorsal striatum, showing significant overlap between our current and prior work despite methodological differences, including the fact that our previous work only included women.

CONCLUSION

The current work supports our prior results and builds on the concept that the insula and dorsal striatum work in concert to maintain nicotine dependence. Specifically, dorsal striatal-mediated habitual responding may be triggered both by the external drug-associated cues, and the insula-mediated internal states that provide additional context motivating drug use. This replicated finding also mirrors preclinical work that finds the same individualized distinction, as only some rodents attribute incentive salience to drug cues and are more likely to reinstate drug seeking after extinction. To effectively treat addiction, these individual characteristics and their underlying neurobiological foundations must be considered.

Long-lasting contribution of dopamine in the nucleus accumbens core, but not dorsal lateral striatum, to sign-tracking

The attribution of incentive salience to reward-paired cues is dependent on dopamine release in the nucleus accumbens core (NAcC). These dopamine signals conform to traditional reward-prediction error signals and have been shown to diminish with time. Here we examined whether the diminishing dopamine signal in the NAcC has functional implications for the expression of sign-tracking, a Pavlovian conditioned response indicative of the attribution of incentive salience to reward-paired cues. Food-restricted male Sprague Dawley rats were trained in a Pavlovian paradigm in which an insertable lever predicted delivery of food reward in a nearby food cup. After 7 or 14 training sessions, rats received infusions of saline, the dopamine antagonist flupenthixol, or the GABA agonists baclofen and muscimol into the NAcC or the dorsal lateral striatum (DLS). Dopamine antagonism within the NAcC attenuated sign-tracking, whereas reversible inactivation did not affect sign-tracking but increased non-specific food cup checking behaviors. Neither drug in the DLS affected sign-tracking behavior. Critically, extended training did not alter these effects. Although extended experience with an incentive stimulus may reduce cue-evoked dopamine in the NAcC, this does not remove the dependence on dopamine in this region to promote Pavlovian cue approach nor result in the recruitment of dorsal lateral striatal systems for this behavior. These data support the notion that dopamine within the mesoaccumbal system, but not the nigrostriatal system, contributes critically to incentive motivational processes independent of the length of training.

Neurobiological Basis of Individual Variation in Stimulus-Reward Learning

Cues in the environment can guide behavior in adaptive ways, leading one towards valuable resources such as food, water, or a potential mate. However, cues in the environment may also serve as powerful motivators that lead to maladaptive patterns of behavior, such as addiction. Importantly, and central to this article, there is considerable individual variation in the extent to which reward cues gain motivational control over behavior. Here we describe an animal model that captures this individual variation, allowing us to better understand the psychological and neurobiological processes that contribute to cue-evoked behaviors. When a discrete cue is paired with a food reward in a Pavlovian manner it acquires greater control over motivated behavior in some rats ("sign-trackers, STs) than in others ("goal-trackers", GTs). We review studies that have exploited this animal model to parse the neurobiological mechanisms involved in learning associations between stimuli vs. those involved in attributing incentive salience to those same stimuli. The latter seems to be dependent on dopamine and subcortical circuits, whereas the former may engage more cortical "top-down" mechanisms.