Sign-tracking to non-drug reward is related to severity of alcohol-use problems in a sample of individuals seeking treatment

BACKGROUND

A prominent neuroscientific theory of drug addiction is the incentive sensitization model. Individual differences in the tendency to ascribe motivational salience to cues that predict reward, and involuntary "sign-tracking" (orientation towards) such cues have been identified as potentially important in understanding vulnerability to addiction and relapse. However, to date this behaviour has not been assessed in a treatment-seeking clinical population, who typically represent those most susceptible to alcohol-related harms and episodes of relapse. This highlights a significant gap in the literature pertaining to incentive sensitization and drug dependence.

METHODS

Individuals accessing inpatient drug and alcohol services with alcohol as primary drug of concern were recruited to participate in a Cognitive Bias Modification (CBM) intervention. At the baseline assessment, participants completed various self-report measures (including the Alcohol Use Disorders Identification Test; AUDIT) in addition to a visual search task measuring sign-tracking to cues signalling monetary reward. At 3-month follow up, abstinence from alcohol was the primary outcome measure. All analyses and hypotheses were pre-registered.

RESULTS

At baseline (57 participants), AUDIT scores correlated with sign-tracking to signals of monetary reward. In a subsequent regression analysis sign-tracking, gender and self-reported alcohol craving predicted abstinence at 3-month follow up (41 participants).

CONCLUSIONS

Our work demonstrates that involuntary sign-tracking to cues signalling non-drug reward is associated with problematic alcohol use and return to use at 3-month follow up, in a treatment-seeking sample. Whether this automatic prioritisation of cues signalling reward is a consequence or vulnerability for problematic alcohol use remains to be investigated.

Acute MK-801 increases measures of both sign-tracking and goal-tracking in male Sprague-Dawley rats

Sign-tracking is a Pavlovian conditioned approach behavior thought to be important in understanding cue-driven relapse to drug use, and strategies for reducing sign-tracking may have some benefit in preventing relapse. A previous study successfully employed the NMDA receptor antagonist MK-801 in preventing the development of sign-tracking (but not goal-tracking) in a conditioned approach task. In this study, we focused on whether MK-801 would have similar effects on previously established sign-tracking behavior. MK-801 was administered after training in a standard sign-/goal-tracking task using a retractable lever as a conditioned stimulus and a sucrose pellet as unconditioned stimulus. It was found that MK-801 increased measures of both sign- and goal-tracking in subjects who had previously learned the task. The NMDA receptor appears to play a complex role in governing behavior related to sign-tracking.

Risk-promoting effects of reward-paired cues in human sign- and goal-trackers

Animal research suggests trait-like individual variation in the degree of incentive salience attribution to reward-predictive cues, defined phenotypically as sign-tracking (high) and goal-tracking (low incentive salience attribution). While these phenotypes have been linked to addiction features in rodents, their translational validity is less clear. Here, we examined whether sign- and goal-tracking in healthy human volunteers modulates the effects of reward-paired cues on decision making. Sign-tracking was measured in a Pavlovian conditioning paradigm as the amount of eye gaze fixation on the reward-predictive cue versus the location of impending reward delivery. In Study 1 (Cherkasova et al., 2018), participants were randomly assigned to perform a binary choice task in which rewards were either accompanied (cued, n = 63) or unaccompanied (uncued, n = 68) by money images and casino jingles. In Study 2, participants (n = 58) performed cued and uncued versions of the task in a within-subjects design. Across both studies, cues promoted riskier choice. Sign-tracking was not associated with risky choice in either study. Goal-tracking rather than sign-tracking was significantly associated with greater risk-promoting effects of cues in Study 1 but not in Study 2, although the direction of findings was consistent across both studies. These findings are at odds with the notion of sign-trackers being preferentially susceptible to the influence of reward cues on behavior and point to the role of mechanisms besides incentive salience in mediating such influences.

Sign-tracking and goal-tracking in humans: Utilising eye-tracking in clinical and non-clinical populations

BACKGROUND

In Pavlovian conditioning, learned behaviour varies according to the perceived value of environmental cues. For goal-trackers (GT), the cue merely predicts a reward, whilst for sign-trackers (ST), the cue holds incentive value. The sign-tracking/goal-tracking model is well-validated in animals, but translational work is lacking. Despite the model's relevance to several conditions, including attention deficit hyperactivity disorder (ADHD), we are unaware of any studies that have examined the model in clinical populations.

METHODS

The current study used an eye-tracking Pavlovian conditioning paradigm to identify ST and GT in non-clinical (N = 54) and ADHD (N = 57) participants. Eye movements were recorded whilst performing the task. Dwell time was measured for two areas of interest: sign (i.e., cue) and goal (i.e., reward), and an eye-gaze index (EGI) was computed based on the dwell time sign-to-goal ratio. Higher EGI values indicate sign-tracking behaviour. ST and GT were determined using median and tertiary split approaches in both samples.

RESULTS

Despite greater propensity for sign-tracking in those with ADHD, there was no significant difference between groups. The oculomotor conditioned response was reward-specific (CS+) and present, at least partly, from the start of the task indicating dispositional and learned components. There were no differences in externalising behaviours between ST and GT for either sample.

CONCLUSIONS

Sign-tracking is associated with CS+ trials only. There may be both dispositional and learned components to sign-tracking, potentially more common in those with ADHD. This holds translational potential for understanding individual differences in reward-learning.

The role of sex on sign-tracking acquisition and outcome devaluation sensitivity in Long Evans rats

Cues that predict rewards can trigger reward-seeking behaviors but also can, in some cases, become targets of motivation themselves. One behavioral phenomenon that captures this idea is sign-tracking in which animals, including humans, interact with reward-predictive cues even though it is not necessary to do so. Sign-tracking in rats has been studied in the domain of motivation and in how motivated behaviors can or cannot become excessive and habit-like over time. Many prior studies look at sign-tracking examine this behavior in male subjects, but there are few papers that look at this behavior in female subjects. Moreover, it is unknown where there might be sex-related variation in how flexible sign-tracking is when faced with changing reward values. Therefore, we asked if there were sex differences in the acquisition of sign-tracking behavior and if there were any sex differences in how sensitive animals were in their sign-tracking following reward devaluation. In contrast to previous reports, we found that males and females show no differences in how they acquire sign-tracking and in ultimate sign-tracking levels following training. Additionally, we found no difference in how quickly males and females learned to devalue the food reward, and we found no differences in sign-tracking levels by sex following outcome devaluation. We believe that this is primarily due to our experiment being performed in the Long Evans strain but also believe that there are many other factors contributing to differences between our study and previous work.

Effects of inter-trial interval on sign-tracking and conditioned reinforcer efficacy in female rats

Previous nonhuman studies have reported that sign-tracking to a conditioned stimulus (CS) is increased when the intertrial interval (ITI) duration is increased. Separate studies indicate that individual differences in sign-tracking (vs. goal-tracking) at a fixed ITI (and CS duration) is predictive of the conditioned reinforcer efficacy of the CS. The present study evaluates, for the first time, if increasing the ITI increases rats' sign-tracking and the conditioned reinforcing efficacy of the CS. Forty-five female rats were randomly assigned to one of three groups that completed appetitive Pavlovian training with ITIs of 14, 24, or 96 s. Subsequently, they completed tests of conditioned reinforcement. Replicating previous findings, longer ITIs increased sign-tracking to a lever-CS and, extending the literature, conditioned reinforcer efficacy of that CS was highest at the longest ITI used during Pavlovian training. Implications for behavioral interventions using conditioned reinforcement are discussed.

Nicotinic and muscarinic acetylcholine receptor antagonism dose-dependently decreases sign- but not goal-tracking behavior in male rats

RATIONALE

Acetylcholinergic antagonists have shown some promise in reducing addiction-related behaviors in both preclinical and clinical studies. However, the psychological mechanisms by which these drugs are able to affect addictive behavior remain unclear. A particular key process for the development of addiction is the attribution of incentive salience to reward-related cues, which can be specifically measured in animals using a Pavlovian conditioned approach procedure. When confronted with a lever that predicts food delivery, some rats engage with the lever directly (i.e., they sign track), indicating attribution of incentive-motivational properties to the lever itself. In contrast, others treat the lever as a predictive cue and approach the location of impending food delivery (i.e., they goal track), without treating the lever itself as a reward.

OBJECTIVES

We tested whether systemic antagonism of the either nicotinic or muscarinic acetylcholine receptors would selectively affect sign- or goal-tracking behavior, indicating a selective effect on incentive salience attribution.

METHODS

A total of 98 male Sprague Dawley rats were either given the muscarinic antagonist scopolamine (100, 50, or 10 µg/kg i.p.) or the nicotinic antagonist mecamylamine (0.3, 1.0, or 3 mg/kg i.p.) before being trained on a Pavlovian conditioned approach procedure.

RESULTS

Scopolamine dose-dependently decreased sign tracking behavior and increased goal-tracking behavior. Mecamylamine reduced sign-tracking but did not affect goal-tracking behavior.

CONCLUSIONS

Antagonism of either muscarinic or nicotinic acetylcholine receptors can reduce incentive sign-tracking behavior in male rats. This effect appears to be specifically due to a reduction in incentive salience attribution since goal-tracking either increased or was not affected by these manipulations.

Effects of bupropion on sign- and goal-tracking in male Sprague Dawley rats

Relapse into addiction is often triggered by cues that have a Pavlovian association with drugs and drug-taking. Sign-tracking involves approach of and interaction with Pavlovian conditioned signals for appetitive events (as opposed to goal-tracking, which involves approach of the site of the appetitive events themselves) and may be important in understanding cue-driven relapse. Bupropion is an atypical antidepressant and smoking cessation aid with effects on dopamine and norepinephrine that may have some utility in reducing sign-tracking. Male Sprague-Dawley rats were trained in a task where sign- and goal-tracking were possible and then administered doses of bupropion during a test phase. Bupropion decreased measures of sign-tracking and increased goal-tracking. This suggests that bupropion might be a useful adjunct medication for many kinds of behavioral disorders in which cue-driven behavior is problematic.

A mechanical task for measuring sign- and goal-tracking in humans: A proof-of-concept study

Cue-based associative learning (i.e., Pavlovian conditioning) is a foundational component of behavior in almost all forms of animal life and may provide insight into individual differences in addiction liability. Cues can take on incentive-motivational properties (i.e., incentive salience) through Pavlovian learning. Extensive testing with non-human animals (primarily rats) has demonstrated significant variation among individuals in the behaviors this type of learning evokes. So-named "sign-trackers" and "goal-trackers" have been examined in many studies of non-human animals, but this work in humans is still a nascent area of research. In the present proof-of-concept study, we used a Pavlovian conditioned approach task to investigate human sign- and goal-tracking in emerging adults. Conditioned behaviors that developed over the course of the task were directed toward the reward-cue and toward the reward location. Participants' eye-gaze and behavior during the task were submitted to a latent profile analysis, which revealed three groups defined as sign-trackers (n = 10), goal-trackers (n = 4), and intermediate responders (n = 36). Impulsivity was a significant predictor of the sign-tracking group relative to the goal-tracking group. The present study provides preliminary evidence that a simple procedure can produce learned Pavlovian conditioned approach behavior in humans. Though further investigation is required, findings provide a promising step toward the long-term goal of translating important insights gleaned from basic research into treatment strategies that can be applied to clinical populations.

Appetitive 50 kHz calls in a pavlovian conditioned approach task in Cacna1c haploinsufficient rats

We have previously shown that rats emit high-frequency 50 kHz ultrasonic vocalizations (USV) during sign- and goal-tracking in a common Pavlovian conditioned approach task. Such 50 kHz calls are probably related to positive affect and are associated with meso-limbic dopamine function. In humans, the CACNA1C gene, encoding for the α_1C subunit of the L-type voltage-gated calcium channel Ca_V1.2, is implicated in several mental disorders, including mood disorders associated with altered dopamine signaling. In the present study, we investigated sign- and goal-tracking behavior and the emission of 50 kHz USV in Cacna1c haploinsufficent rats in a task where food pellet delivery is signaled by an appearance of an otherwise inoperable lever. Over the course of this Pavlovian training, these rats not only increased their approach to the reward site, but also their rates of pressing the inoperable lever. During subsequent extinction tests, where reward delivery was omitted, extinction patterns differed between reward site (i.e. magazine entries) and lever, since magazine entries quickly declined whereas behavior towards the lever transiently increased. Based on established criteria to define sign- or goal-tracking individuals, no CACNA1C rat met a sign-tracking criterion, since around 42% of rats tested where goal-trackers and the other 58% fell into an intermediate range. Regarding USV, we found that the CACNA1C rats emitted 50 kHz calls with a clear subject-dependent pattern; also, most of them were of a flat subtype and occurred mainly during initial habituation phases without cues or rewards. Compared, to previously published wildtype controls, Cacna1c haploinsufficent rats displayed reduced numbers of appetitive 50 kHz calls. Moreover, similar to wildtype littermate controls, 50 kHz call emission in Cacna1c haploinsufficent rats was intra-individually stable over training days and was negatively associated with goal-tracking. Together, these findings provide evidence in support of 50 kHz calls as trait marker. The finding that Cacna1c haploinsufficent rats show reductions of 50 kHz calls accompanied with more goal-tracking, is consistent with the assumption of altered dopamine signaling in these rats, a finding which supports their applicability in models of mental disorders.

Effects of dopamine receptor antagonism and amphetamine-induced psychomotor sensitization on sign- and goal-tracking after extended training

The dopamine system is important for incentive salience attribution, where motivational value is assigned to conditioned cues that predict appetitive reinforcers. However, the role of dopamine in this process may change with extended training. We tested the effects of dopamine D1-like and D2-like receptor antagonism on the expression of sign-tracking and goal-tracking conditioned responses following extended Pavlovian conditioned approach (PCA) training. We also tested if amphetamine-induced psychomotor sensitization accelerates the enhanced acquisition of sign-tracking that is observed with extended training. In experiment 1, 24 male Long-Evans rats received 20 PCA sessions in which one lever (CS+, 10 s) predicted 0.2 ml sucrose (10 %, w/v) delivery and the other lever (CS-) did not. SCH-23390 (D1-like antagonist) or eticlopride (D2-like antagonist) were administered before non-reinforced behavioural tests at doses of 0, 0.01, and 0.1 mg/kg (s.c.). In experiment 2, rats received vehicle or 2 mg/kg amphetamine (i.p.) for 7 days (n = 12/group). Ten days later, they received 16 PCA training sessions. Both doses of SCH-23390 reduced sign- and goal-tracking, but also reduced locomotor behaviour. A low dose of eticlopride (0.01 mg/kg) selectively reduced goal-tracking, without affecting sign-tracking or locomotor behaviour. Amphetamine produced psychomotor sensitization, and this did not affect the acquisition of sign- or goal-tracking. Following extended PCA training, dopamine D2-like receptor activity is required for the expression of goal-tracking but not sign-tracking. Psychomotor sensitization to amphetamine did not impact incentive salience attribution; however, more selective manipulations of the dopamine system may be needed.

Reward-related attentional capture predicts non-abstinence during a one-month abstinence challenge

BACKGROUND

While it is generally recognised that cognitive attributes can predict behaviour change outcomes in the field of addiction this question is typically studied in treatment seeking samples (to predict treatment outcomes and relapse). However the concept of behaviour change applies to the entire spectrum of addiction-like behaviours and initiatives such as temporary abstinence challenges offer insight into an understudied but equally relevant point of the spectrum. Thus the current study examined whether reward-related attentional capture predicted non-abstinence during IkPas (the Dutch national dry January campaign translated: NoThanks!).

METHOD

Participants included 1130 adults who had complete baseline data and performed above chance level on the cognitive task. Of these 683 participants completed the post-IkPas assessment and were included in the primary analysis. A binary logistic regression examined whether reward-related attentional capture predicted drinking during IkPas controlling for alcohol use at baseline (among other potential confounders).

RESULTS

Participants who showed greater reward-related attentional capture before IkPas were more likely to not remain abstinent from drinking during IkPas (p = .014). Findings were replicated using multiple imputation to replace missing data (p = .013).

CONCLUSION

These findings provide important insights into the cognitive mechanisms that support successful behaviour change such as the ability to ignore task-irrelevant reward cues and may inform the development of tools that individuals could use to maximise their likelihood of achieving successful behaviour change.

The lateral hypothalamus and orexinergic transmission in the paraventricular thalamus promote the attribution of incentive salience to reward-associated cues

RATIONALE

Prior research suggests that the neural pathway from the lateral hypothalamic area (LHA) to the paraventricular nucleus of the thalamus (PVT) mediates the attribution of incentive salience to Pavlovian reward cues. However, a causal role for the LHA and the neurotransmitters involved have not been demonstrated in this regard.

OBJECTIVES

To examine (1) the role of LHA in the acquisition of Pavlovian conditioned approach (PavCA) behaviors, and (2) the role of PVT orexin 1 receptors (OX1r) and orexin 2 receptors (OX2r) in the expression of PavCA behaviors and conditioned reinforcement.

METHODS

Rats received excitotoxic lesions of the LHA prior to Pavlovian training. A separate cohort of rats characterized as sign-trackers (STs) or goal-trackers (GTs) received the OX1r antagonist SB-334867, or the OX2r antagonist TCS-OX2-29, into the PVT, to assess their effects on the expression of PavCA behavior and on the conditioned reinforcing properties of a Pavlovian reward cue.

RESULTS

LHA lesions attenuated the development of sign-tracking behavior. Administration of either the OX1r or OX2r antagonist into the PVT reduced sign-tracking behavior in STs. Further, OX2r antagonism reduced the conditioned reinforcing properties of a Pavlovian reward cue in STs.

CONCLUSIONS

The LHA is necessary for the development of sign-tracking behavior; and blockade of orexin signaling in the PVT attenuates the expression of sign-tracking behavior and the conditioned reinforcing properties of a Pavlovian reward cue. Together, these data suggest that LHA orexin inputs to the PVT are a key component of the circuitry that encodes the incentive motivational value of reward cues.

Ultrasonic vocalizations and individual differences in rats performing a Pavlovian conditioned approach task

Rats emit distinct types of ultrasonic vocalizations (USV), including high-frequency 50-kHz USV, which occur in appetitive situations. Such 50-kHz USV are thought to reflect positive affective states, for example in case of reward anticipation, and are linked to dopamine signaling. The present study was conducted to investigate whether rats emit 50-kHz USV during a Pavlovian conditioned approach task and whether trait-like differences in 50-kHz USV emission are associated with sign- versus goal-tracking. We hypothesize that individuals engaging more with a cue predicting a food reward will also elicit more 50-kHz USV. In order to test this, we investigated 34 female rats and gauged USV while they underwent a Pavlovian conditioned approach training and extinction paradigm. For one, we found a high subject-dependent variability in the emission of 50-kHz calls. These were not largely affected by state differences, since these 50-kHz USV were observed throughout the task. During task progress and in most subjects, there was a rather complete shift toward goal-tracking, but subjects engaging more with the cue predicting a reward also emitted higher numbers of appetitive 50-kHz calls. This supports the hypothesis that sign-tracking is positively associated with the emission of 50-kHz USV. The high subject-dependent variability in the emission of 50-kHz calls warrants special attention in future appetitive studies.

Effects of the cannabinoid receptor agonist CP-55,940 on incentive salience attribution

RATIONALE

Pavlovian conditioned approach paradigms are used to characterize the nature of motivational behaviors in response to stimuli as either directed toward the cue (i.e., sign-tracking) or the site of reward delivery (i.e., goal-tracking). Recent evidence has shown that activity of the endocannabinoid system increases dopaminergic activity in the mesocorticolimbic system, and other studies have shown that sign-tracking behaviors are dependent on dopamine.

OBJECTIVES

Therefore, we hypothesized that administration of a cannabinoid agonist would increase sign-tracking and decrease goal-tracking behaviors.

METHODS

Forty-seven adult male Sprague-Dawley rats were given a low, medium, or high dose of the cannabinoid agonist CP-55,940 (N = 12 per group) or saline (N = 11) before Pavlovian conditioned approach training. A separate group of rats (N = 32) were sacrificed after PCA training for measurement of cannabinoid receptor type 1 (CB1) and fatty acid amide hydrolase (FAAH) using in situ hybridization.

RESULTS

Contrary to our initial hypothesis, CP-55,940 dose-dependently decreased sign-tracking and increased goal-tracking behavior. CB1 expression was higher in sign-trackers compared with that in goal-trackers in the prelimbic cortex, but there were no significant differences in CB1 or FAAH expression in the infralimbic cortex, dorsal or ventral CA1, dorsal or ventral CA3, dorsal or ventral dentate gyrus, or amygdala.

CONCLUSIONS

These results demonstrate that cannabinoid signaling can specifically influence behavioral biases toward sign- or goal-tracking. Pre-existing differences in CB1 expression patterns, particularly in the prelimbic cortex, could contribute to individual differences in the tendency to attribute incentive salience to reward cues.

Dose-dependent effects of alcohol injections on omission-contingency learning have an inverted-U pattern

Previous examinations of the long-term effects of alcohol exposure on omission-contingency learning have produced mixed results across different age or sex groups, with evidence for faster learning or no effect. However, none of these experiments made comparisons using the same exposure-dose across the age/sex groups. Here, we exposed rats to 6 weeks of alcohol injections (3 days/week, 1.75 or 3.5 g/kg/24-h, i.p. broken up into 2 injections/day) in adolescent/early adult males or females (PND27-66) or adult males (PND62-101). We then tested the rats in autoshaping and omission-contingency tasks. In contrast to our hypotheses, the low 1.75-g/kg/24-h dose led to slower omission learning and the higher 3.5-g/kg/24-h dose had no effect. There were no age- or sex-differences in omission learning. Additionally, during autoshaping training, rats exposed in adolescence/early adulthood had a faster shift to sign-tracking in their sign-tracking/goal-tracking ratios than rats exposed in adulthood, with no consistent effect of alcohol exposure or sex-differences. Our results suggest complex effects of alcohol on the neural substrates of omission-contingency learning at different doses, which will require future investigation.

From sign-tracking to attentional bias: Implications for gambling and substance use disorders

Sign-tracking behavior in Pavlovian autoshaping is known to be a relevant index of the incentive salience attributed to reward-related cues. Evidence has accumulated to suggest that animals that exhibit a sign-tracker phenotype are especially vulnerable to addiction and relapse due to their proneness to attribute incentive salience to drug cues, and their relatively weak cognitive and attentional control over their behavior. Interestingly, sign-tracking is also influenced by reward uncertainty in a way that may promote gambling disorder. Research indicates that reward uncertainty sensitizes sign-tracking responses and favors the development of a sign-tracker phenotype, compatible with the conditioned attractiveness of lights and sounds in casinos for problem gamblers. The study of attentional biases in humans (an effect akin to sign-tracking in animals) leads to similar observations, notably that the propensity to develop attraction for conditioned stimuli (CSs) is predictive of addictive behavior. Here we review the literature on drug addiction and gambling disorder, highlighting the similarities between studies of sign-tracking and attentional biases.

Mapping sign-tracking and goal-tracking onto human behaviors

As evidenced through classic Pavlovian learning mechanisms, environmental cues can become incentivized and influence behavior. These stimulus-outcome associations are relevant in everyday life but may be particularly important for the development of impulse control disorders including addiction. Rodent studies have elucidated specific learning profiles termed 'sign-tracking' and 'goal-tracking' which map onto individual differences in impulsivity and other behaviors associated with impulse control disorders' etiology, course, and relapse. Whereas goal-trackers are biased toward the outcome, sign-trackers fixate on features that are associated with but not necessary for achieving an outcome; a pattern of behavior that often leads to escalation of reward-seeking that can be maladaptive. The vast majority of the sign- and goal-tracking research has been conducted using rodent models and very few have bridged this concept into the domain of human behavior. In this review, we discuss the attributes of sign- and goal-tracking profiles, how these are manifested neurobiologically, and how these distinct learning styles could be an important tool for clinical interventions in human addiction.

Dissociable dopaminergic and pavlovian influences in goal-trackers and sign-trackers on a model of compulsive checking in OCD

RATIONALE

Checking is a functional behaviour that provides information to guide behaviour. However, in obsessive-compulsive disorder (OCD), checking may escalate to dysfunctional levels. The processes underpinning the transition from functional to dysfunctional checking are unclear but may be associated with individual differences that support the development of maladaptive behaviour. We examined one such predisposition, sign-tracking to a pavlovian conditioned stimulus, which we previously found associated with dysfunctional checking. How sign-tracking interacts with another treatment with emerging translational validity for OCD-like checking, chronic administration of the dopamine D₂ receptor agonist quinpirole, is unknown.

OBJECTIVES

We tested how functional and dysfunctional checking in the rat observing response task (ORT) was affected by chronic quinpirole administration in non-autoshaped controls and autoshaped animals classified as sign-trackers or goal-trackers.

METHODS

Sign-trackers or goal-trackers were trained on the ORT before the effects of chronic quinpirole administration on checking were assessed. Subsequently, the effects on checking of different behavioural challenges, including reward omission and the use of unpredictable reinforcement schedules, were tested.

RESULTS

Prior autoshaping increased checking. Sign-trackers and goal-trackers responded differently to quinpirole sensitization, reward omission and reinforcement uncertainty. Sign-trackers showed greater elevations in dysfunctional checking, particularly during uncertainty. By contrast, goal-trackers predominantly increased functional checking responses, possibly in response to reduced discrimination accuracy in the absence of cues signalling which lever was currently active.

CONCLUSIONS

The results are discussed in terms of how pavlovian associations influence behaviour that becomes compulsive in OCD and how this may be dependent on striatal dopamine D₂ receptors.

Neural circuits linking sleep and addiction: Animal models to understand why select individuals are more vulnerable to substance use disorders after sleep deprivation

Individuals differ widely in their drug-craving behaviors. One reason for these differences involves sleep. Sleep disturbances lead to an increased risk of substance use disorders and relapse in only some individuals. While animal studies have examined the impact of sleep on reward circuitry, few have addressed the role of individual differences in the effects of altered sleep. There does, however, exist a rodent model of individual differences in reward-seeking behavior: the sign/goal-tracker model of Pavlovian conditioned approach. In this model, only some rats show the key behavioral traits associated with addiction, including impulsivity and poor attentional control, making this an ideal model system to examine individually distinct sleep-reward interactions. Here, we describe how the limbic neural circuits responsible for individual differences in incentive motivation overlap with those involved in sleep-wake regulation, and how this model can elucidate the common underlying mechanisms. Consideration of individual differences in preclinical models would improve our understanding of how sleep interacts with motivational systems, and why sleep deprivation contributes to addiction in only select individuals.

Circuit directionality for motivation: Lateral accumbens-pallidum, but not pallidum-accumbens, connections regulate motivational attraction to reward cues

Sign-tracking behavior, in which animals interact with a cue that predicts reward, provides an example of how incentive salience can be attributed to cues and elicit motivation. The nucleus accumbens (NAc) and ventral pallidum (VP) are two regions involved in cue-driven motivation. The VP, and NAc subregions including the medial shell and core, are critical for sign-tracking. Further, connections between the medial shell and VP are known to participate in sign-tracking and other motivated behaviors. The NAc lateral shell (NAcLSh) is a distinct and understudied subdivision of the NAc, and its contribution to the process by which reward cues acquire value remains unclear. The NAcLSh has been implicated in reward-directed behavior, and has reciprocal connections with the VP, suggesting that NAcLSh and VP interactions could be important mechanisms for incentive salience. Here, we use DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) and an intersectional viral delivery strategy to produce a biased inhibition of NAcLSh neurons projecting to the VP, and vice versa. We find that disruption of connections from NAcLSh to VP reduces sign-tracking behavior while not affecting consumption of food rewards. In contrast, VP to NAcLSh disruption affected neither sign-tracking nor reward consumption, but did produce a greater shift in animals' behavior more towards the reward source when it was available. These findings indicate that the NAcLSh → VP pathway plays an important role in guiding animals towards reward cues, while VP → NAcLSh back-projections may not and may instead bias motivated behavior towards rewards.

Voluntary alcohol access during adolescence/early adulthood, but not during adulthood, causes faster omission contingency learning

In omission contingency training, rodents learn to suppress their natural tendency to approach or touch a reward-predictive cue (termed "autoshaping" or "sign-tracking" responses) if the approach/touching responses lead to the omission of the reward. Previous research has shown that high levels of alcohol exposure (through alcohol vapor exposure) or adolescent alcohol consumption (with some versions of the omission contingency task) can lead to faster omission contingency learning. However, the alcohol exposure procedures and/or omission contingency task parameters differed between these different demonstrations. It was unclear whether the same voluntary alcohol consumption procedures during adolescence/early adulthood and/or adulthood would lead to faster omission contingency learning in one or both age groups. Here, rats received 6 weeks of chronic intermittent access to 20% alcohol or water from PND 26-66 (adolescence/early adulthood in Exp. 1) or PND 68-108 (adulthood in Exp. 2) and began behavioral training (autoshaping training followed by omission contingency training) several days later. We found no evidence that alcohol access at either age altered the number of trials with a sign-tracking response on the levers during autoshaping training. However, alcohol access during adolescence/early adulthood, but not during adulthood, led to faster learning to withhold responding on the lever under omission contingencies during the subsequent phase. We also found no evidence that the level of alcohol consumption was correlated with sign-tracking behavior in the autoshaping phase or with the suppression of lever-pressing during the omission contingency phase. Our results suggest that adolescent/early adult rats have increased vulnerability, compared with adults, to some long-term behavioral effects of voluntary alcohol consumption.

Differential involvement of dopamine receptor subtypes in the acquisition of Pavlovian sign-tracking and goal-tracking responses

RATIONALE

Previous work has identified that different forms of Pavlovian conditioned approach, sign-tracking and goal-tracking, are governed by distinct neurochemical mechanisms when compared in animals predisposed to learning one form vs. the other.

OBJECTIVES

The present study aimed to investigate whether these are also neurochemically distinct processes in a population of animals capable of developing either response when this is manipulated via the use of distinct conditioned stimuli (CS).

METHODS

Rats were trained on one of two Pavlovian conditioning procedures in which the CS was either a lever, which elicits sign-tracking, or an auditory click, which elicits goal-tracking. The differential involvement of dopamine D1- and D2-receptors (D1R; D2R) in the acquisition of approach types was investigated via systemic administration of antagonists selective to one or both receptor subtypes during Pavlovian training.

RESULTS

Results indicate that dopaminergic signalling is important for the acquisition of both sign-tracking and goal-tracking responses. However, whilst development of sign-tracking to a lever depends on activity at both D1R and D2R, development of goal-tracking in response to a click was shown to depend only on activity at D1R.

CONCLUSIONS

We suggest that the importance of D1R activity in both sign- and goal-tracking acquisition reflects a general role in learning Pavlovian associations, which aligns with data implicating dopamine in prediction error processes. In contrast, the selective involvement of D2R activity in sign-tracking acquisition may reflect its importance in motivational processes such as incentive salience attribution.

Extinction to amphetamine-associated context in female rats is dependent upon conditioned orienting

RATIONALE

Females are considered more susceptible to the reinforcing effects of drugs and subsequently at increased risk for drug abuse and relapse after treatment. Estrogen is known to facilitate drug effects in females. However, other factors which contribute to the incidence of drug abuse are important to identify in order to recognize early risk factors and develop effective prevention and treatment schemes. Cue-directed behavior (aka sign tracking) has been implicated as a behavioral phenotype which identifies populations susceptible to drug abuse, partly due to its association with impulsivity and heightened dopamine function.

OBJECTIVES AND METHODS

In this study, we investigate the viability of conditioned orienting (a form of cue-directed behavior) as a potential phenotype which predicts drug proclivity in female rats. In addition, we examine any influence endogenous female hormones across the estrous cycle may have on conditioned orienting and drug proclivity.

RESULTS AND CONCLUSIONS

Utilizing an amphetamine-conditioned place preference task, results suggest that the orienting phenotype is an effective predictor of drug proclivity in females. Rats exhibiting enhanced orienting behavior show more robust preference for an amphetamine-associated context and are more resistant to extinction of this preference than nonorienting counterparts. Furthermore, both conditioned orienting behavior and conditioned place preference are minimally influenced by the estrous cycle.

goal-tracking behaviour

In the context of Pavlovian conditioning, two types of behaviour may emerge within the population (Flagel et al. Nature, 469(7328): 53-57, 2011). Animals may choose to engage either with the conditioned stimulus (CS), a behaviour known as sign-tracking (ST) which is sensitive to dopamine inhibition for its acquisition, or with the food cup in which the reward or unconditioned stimulus (US) will eventually be delivered, a behaviour known as goal-tracking (GT) which is dependent on dopamine for its expression only. Previous work by Lesaint et al. (PLoS Comput Biol, 10(2), 2014) offered a computational explanation for these phenomena and led to the prediction that varying the duration of the inter-trial interval (ITI) would change the relative ST-GT proportion in the population as well as phasic dopamine responses. A recent study verified this prediction, but also found a rich variance of ST and GT behaviours within the trial which goes beyond the original computational model. In this paper, we provide a computational perspective on these novel results.

Cannabinoid receptor-1 signaling contributions to sign-tracking and conditioned reinforcement in rats

RATIONALE

Endocannabinoids (eCBs) are critical gatekeepers of dopaminergic signaling, and disrupting cannabinoid receptor-1 (CB1) signaling alters DA dynamics to attenuate cue-motivated behaviors. Prior studies suggest that dopamine (DA) release plays a critical role in driving sign-tracking.

OBJECTIVES

Here, we determine whether systemic injections of rimonabant, a CB1 receptor inverse agonist, during Pavlovian lever autoshaping impair the expression of sign-tracking. We next examine whether rimonabant blocks the reinforcing properties of the Pavlovian lever cue in a conditioned reinforcement test.

METHODS

In Exp. 1, we trained rats in Pavlovian lever autoshaping prior to systemic rimonabant injections (0, 1, 3 mg/kg) during early and late Pavlovian lever autoshaping sessions. In Exp. 2, we trained rats in Pavlovian lever autoshaping prior to systemic rimonabant injections (0, 1 mg/kg) during a conditioned reinforcement test.

RESULTS

Rimonabant dose-dependently decreased lever contact and probability, and increased sign-tracker's latency to approach the lever cue early in Pavlovian training. With extended training, many previously goal-tracking and intermediate rats shifted to lever approach, which remained dose-dependently sensitive to rimonabant. Rimonabant attenuated cue-evoked food cup approach early, but not late, in conditioning, and did not affect pellet retrieval or consumption. The inserted lever cue served as a robust conditioned reinforcer after Pavlovian lever autoshaping, and 1 mg/kg rimonabant blocked conditioned reinforcement.

CONCLUSIONS

Together, our results suggest that CB1 signaling mediates two critical properties of incentive stimuli; their ability to attract (Exp. 1) and their ability to reinforce (Exp. 2) behavior.

Effects of nicotine self-administration on incentive salience in male Sprague Dawley rats

RATIONALE

Prolonged use of nicotine appears to enhance incentive salience, a motivational-cognitive process that transforms an otherwise neutral stimulus into a "wanted" stimulus. It has been suggested that nicotinic enhancement of incentive salience contributes to the potential of relapse in individuals with tobacco addiction. However, there are two main limitations of prior research that caution this claim: (a) the use of passive experimentally delivered nicotine and (b) the use of sign-tracking as an index of incentive salience, without acknowledging the competing nature of goal- and sign-tracking responses.

OBJECTIVES

To determine whether nicotinic enhancement of incentive salience attributed to non-nicotinic stimuli occurs when rats self-administer nicotine, and whether it is facilitated by a prior history of nicotine self-administration.

METHODS

Twenty-three male rats were trained daily, for 24 days, on a nicotine self-administration (SA) paradigm in the morning, and on a four-conditioned-stimuli Pavlovian conditioned approach (4-CS PCA) task in the afternoon. Self-administration was followed by extinction and cue reinstatement. A subcutaneous nicotine challenge was performed during the last 7 days of the study.

RESULTS

Nicotine self-administration selectively enhanced sign-tracking in the 4-CS PCA. Upon extinction, sign-tracking quickly declined to control levels. Experimenter-administered nicotine enhanced sign-tracking similarly regardless of nicotine history.

CONCLUSIONS

The results suggest that nicotinic enhancement of incentive salience is transient, and a previous history of nicotine use does not cause further sensitization. Taken together, these results suggest that nicotine enhances incentive salience, particularly-and perhaps exclusively-while onboard.

Behavioral predictors of alcohol drinking in a neurodevelopmental rat model of schizophrenia and co-occurring alcohol use disorder

Alcohol use disorder commonly occurs in patients with schizophrenia and contributes greatly to its morbidity. Unfortunately, the neural and behavioral underpinnings of alcohol drinking in these patients are not well understood. In order to begin to understand the cognitive and reward-related changes that may contribute to alcohol drinking, this study was designed to address: 1) latent inhibition; 2) conditioning; and 3) extinction of autoshaping in a neurodevelopmental rat model with relevance to co-occurring schizophrenia and alcohol use disorders, the neonatal ventral hippocampal lesioned (NVHL) rat. NVHL lesions (or sham surgeries) were performed on post-natal day 7 (PND7) and animals were given brief exposure to alcohol during adolescent (PND 28-42). Latent inhibition of autoshaping, conditioning and extinction were assessed between PND 72-90. On PND90 animals were given alcohol again and allowed to establish stable drinking. Latent inhibition of autoshaping was found to be prolonged in the NVHL rats; the NVHL rats pre-exposed to the lever stimulus were slower to acquire autoshaping than sham pre-exposed rats. NVHL rats that were not pre-exposed to the lever stimulus did not differ during conditioning, but were slower to extinguish conditioned responding compared to sham controls. Finally, the NVHL rats from both groups drank significantly more alcohol than sham rats, and the extent of latent inhibition predicted future alcohol intake in the pre-exposed animals. These findings suggest that the latent inhibition of autoshaping procedure can be used to model cognitive- and reward-related dysfunctions in schizophrenia, and these dysfunctions may contribute to the development of co-occurring alcohol use.

Paradoxical accentuation of motivation following accumbens-pallidum disconnection

The nucleus accumbens (NAc) and ventral pallidum (VP) are reciprocally connected, and activity within this circuit is thought to promote reward learning. Inconsistent with this notion, we find that disconnecting NAc medial shell and VP greatly enhances the attribution of value to a cue that is paired with reward. This result suggests that medial NAc shell and VP are both needed for attributing value to cues yet can also oppose one-another's functional contribution.

Nicotine-enhanced Pavlovian conditioned approach is resistant to omission of expected outcome

Conditioned stimuli contribute to the resilience of nicotine addiction in that nicotine-associated cues can influence smokers and promote relapse. These stimuli are thought to acquire incentive motivational properties through a Pavlovian mechanism, and this phenomenon can be measured in animals by observing conditioned approach to the conditioned stimulus (sign-tracking) or to the location of unconditioned stimulus delivery (goal-tracking). Goal-tracking is thought to be more flexible than sign-tracking in response to changes in expected outcome. Nicotine exposure can increase the expression of conditioned responses, and we hypothesized that animals exposed to nicotine would also exhibit less flexible conditioned responses after a change in the expected unconditioned stimulus. Adult male rats were exposed to nicotine (0.4mg/kg, s.c.) or saline before Pavlovian conditioned approach training sessions. After training, animals underwent test sessions that reduced (water substitution) or withheld (omission) the unconditioned stimulus (US, 20% sucrose). As expected, nicotine enhanced sign- and goal-tracking. Water substitution moderately and nonspecifically reduced both sign- and goal-tracking in all rats. In contrast, US omission only reduced goal-tracking, with robust effects in saline-exposed rats and smaller effects in nicotine-exposed rats. These data support the hypothesis that both sign-tracking and nicotine exposure confer behavioral inflexibility under US omission.

Disconnection of basolateral amygdala and insular cortex disrupts conditioned approach in Pavlovian lever autoshaping

Previously established individual differences in appetitive approach and devaluation sensitivity observed in goal- and sign-trackers may be attributed to differences in the acquisition, modification, or use of associative information in basolateral amygdala (BLA) pathways. Here, we sought to determine the extent to which communication of associative information between BLA and anterior portions of insular cortex (IC) supports ongoing Pavlovian conditioned approach behaviors in sign- and goal-tracking rats, in the absence of manipulations to outcome value. We hypothesized that the BLA mediates goal-, but not sign- tracking approach through interactions with the IC, a brain region involved in supporting flexible behavior. We first trained rats in Pavlovian lever autoshaping to determine their sign- or goal-tracking tendency. During alternating test sessions, we gave unilateral intracranial injections of vehicle or a cocktail of gamma-aminobutyric acid (GABA) receptor agonists, baclofen and muscimol, unilaterally into the BLA and contralaterally or ipsilaterally into the IC prior to reinforced lever autoshaping sessions. Consistent with our hypothesis we found that contralateral inactivation of BLA and IC increased the latency to approach the food cup and decreased the number of food cup contacts in goal-trackers. While contralateral inactivation of BLA and IC did not affect the total number of lever contacts in sign-trackers, this manipulation increased the latency to approach the lever. Ipsilateral inactivation of BLA and IC did not impact approach behaviors in Pavlovian lever autoshaping. These findings, contrary to our hypothesis, suggest that communication between BLA and IC maintains a representation of initially learned appetitive associations that commonly support the initiation of Pavlovian conditioned approach behavior regardless of whether it is directed at the cue or the location of reward delivery.

NMDA receptor blockade specifically impedes the acquisition of incentive salience attribution

Glutamatergic signaling plays an important role in learning and memory. Using Pavlovian conditioned approach procedures, the mechanisms that drive stimulus-reward learning and memory have been investigated. However, there are instances where reward-predictive stimuli can function beyond being solely predictive and can be attributed with "motivational value" or incentive salience. Using a Pavlovian conditioned approach procedure consisting of two different but equally predictive stimuli (lever vs. tone) we investigated the role NMDA receptor function has in the attribution of incentive salience. The results revealed that the administration of MK-801, an NMDA receptor antagonist, during acquisition of Pavlovian conditioned approach promoted goal-tracking to a lever stimulus, while control animals learned to sign-track. Moreover, within the same animals, the use of a tone stimulus elicited goal-tracking responses that were unaffected by MK-801 pretreatments. Furthermore, a lever CS that elicited sign-tracking served as a more robust conditioned reinforcer than a tone CS that elicited goal-tracking or a lever CS that elicited goal-tracking via MK-801 pretreatments. Collectively, these results demonstrate that NMDA receptor antagonism can alter the stimulus-reward relationship learned and prevent the attribution of incentive salience, rather than impede general learning.

Selective attention moderates the relationship between attentional capture by signals of nondrug reward and illicit drug use

BACKGROUND

The current study examined whether cognitive control moderates the association between (non-drug) reward-modulated attentional capture and use of alcohol and other drugs (AOD).

METHODS

Participants were 66 university students who completed an assessment including questions about AOD use, a visual search task to measure value-modulated attentional capture, and a goal-directed selective attention task as a measure of cognitive control.

RESULTS

The association between the effect of value-modulated attentional capture and illicit drug use was moderated by level of cognitive control. Among participants with lower levels of cognitive control, value-modulated attentional capture was associated with illicit drug use. This was not the case among participants with higher levels of cognitive control, who instead showed a significant association between illicit drug use and self-reported impulsivity, as well as alcohol use.

CONCLUSIONS

These results provide support for models that view addictive behaviours as resulting from interaction and competition between automatic and more reflective processes. That is, the mechanisms that ultimately drive addictive behaviour may differ between people low or high in cognitive control. This has important implications for understanding the development and maintenance of substance use disorders and potentially their treatment and prevention.

The ability for cocaine and cocaine-associated cues to compete for attention

In humans, reward cues, including drug cues in individuals experiencing addiction, are especially effective in biasing attention towards them, so much so they can disrupt ongoing task performance. It is not known, however, whether this happens in rats. To address this question, we developed a behavioral paradigm to assess the capacity of an auditory drug (cocaine) cue to evoke cocaine-seeking behavior, thus distracting thirsty rats from performing a well-learned sustained attention task (SAT) to obtain a water reward. First, it was determined that an auditory cocaine cue (tone-CS) reinstated drug-seeking equally in sign-trackers (STs) and goal-trackers (GTs), which otherwise vary in the propensity to attribute incentive salience to a localizable drug cue. Next, we tested the ability of an auditory cocaine cue to disrupt performance on the SAT in STs and GTs. Rats were trained to self-administer cocaine intravenously using an Intermittent Access self-administration procedure known to produce a progressive increase in motivation for cocaine, escalation of intake, and strong discriminative stimulus control over drug-seeking behavior. When presented alone, the auditory discriminative stimulus elicited cocaine-seeking behavior while rats were performing the SAT, but it was not sufficiently disruptive to impair SAT performance. In contrast, if cocaine was available in the presence of the cue, or when administered non-contingently, SAT performance was severely disrupted. We suggest that performance on a relatively automatic, stimulus-driven task, such as the basic version of the SAT used here, may be difficult to disrupt with a drug cue alone. A task that requires more top-down cognitive control may be needed.

Learning not to respond: Role of the hippocampus in withholding responses during omission training

Autoshaping is a Pavlovian learning paradigm in which rats experience pairings of a CS and a US independently of their behavior. When the CS is a lever inserted into the test cage and the US is food delivered to an adjacent magazine, many rats acquire a lever-pressing response called 'sign-tracking' even though that response has no effect on the occurrence of either the CS or the US. Since these lever presses are always followed by the US, it has been suggested that sign-tracking could be due to unintended reinforcement of the response. To eliminate the possibility of such instrumental learning the omission schedule, in which a response to the CS cancels the US, was introduced. Previous research has shown that training rats on autoshaping and switching them to an omission schedule generally reduces but does not eliminate sign-tracking, suggesting that it may be due to both Pavlovian and instrumental learning. In the present study naive rats trained on an omission schedule sign-tracked less than a control group exposed to random, unpaired CS and US presentations, suggesting that they learned to withhold the lever press response because of the negative contingency between that response and the US. In a second experiment rats with dorsal hippocampus lesions sign-tracked more than sham-lesioned rats on omission schedules, suggesting that this case of learning not to respond is hippocampus-based. This conclusion is consistent with many previous findings on the inability of hippocampal rats to withhold or suppress responding, and with studies suggesting that one form of extinction of learned responses in normal rats is due to competition from hippocampus-based learning not to respond.

Less is more: prolonged intermittent access cocaine self-administration produces incentive-sensitization and addiction-like behavior

RATIONALE

Contemporary animal models of cocaine addiction focus on increasing the amount of drug consumption to produce addiction-like behavior. However, another critical factor is the temporal pattern of consumption, which in humans is characterized by intermittency, both within and between bouts of use.

OBJECTIVE

To model this, we combined prolonged access to cocaine (∼70 days in total) with an intermittent access (IntA) self-administration procedure and used behavioral economic indicators to quantify changes in motivation for cocaine.

RESULTS

IntA produced escalation of intake, a progressive increase in cocaine demand (incentive-sensitization), and robust drug- and cue-induced reinstatement of drug-seeking behavior. We also asked whether rats that vary in their propensity to attribute incentive salience to reward cues (sign-trackers [STs] vs. goal-trackers [GTs]) vary in the development of addiction-like behavior. Although STs were more motivated to take cocaine after limited drug experience, after IntA, STs and GTs no longer differed on any measure of addiction-like behavior.

CONCLUSIONS

Exposure to large quantities of cocaine is not necessary for escalation of intake, incentive-sensitization, or other addiction-like behaviors (IntA results in far less total cocaine consumption than 'long access' procedures). Also, the ST phenotype may increase susceptibility to addiction, not because STs are inherently susceptible to incentive-sensitization (perhaps all individuals are at risk), but because this phenotype promotes continued drug use, subjecting them to incentive-sensitization. Thus, the pharmacokinetics associated with the IntA procedure are especially effective in producing a number of addiction-like behaviors and may be valuable for studying associated neuroadaptations and for assessing individual variation in vulnerability.

The tendency to sign-track predicts cue-induced reinstatement during nicotine self-administration, and is enhanced by nicotine but not ethanol

RATIONALE

Some individuals are particularly responsive to reward-associated stimuli ("cues"), including the effects of these cues on craving and relapse to drug-seeking behavior. In the cases of nicotine and alcohol, cues may acquire these abilities via the incentive-enhancing properties of the drug.

OBJECTIVES

To determine the interaction between cue-responsivity and nicotine reinforcement, we studied the patterns of nicotine self-administration in rats categorized based on their tendency to approach a food-predictive cue ("sign-trackers") or a reward-delivery location ("goal-trackers"). In a second experiment, we determined whether nicotine and ethanol altered the incentive value of a food cue.

METHODS

Rats were classified as sign- or goal-trackers during a Pavlovian conditioned approach paradigm. Rats then self-administered intravenous nicotine (0.03 mg/kg infusions) followed by extinction and cue-induced reinstatement tests. We also tested the effects of nicotine (0.4 mg/kg base s.c.) or ethanol (0.7 g/kg i.p.) on the approach to, and reinforcing efficacy of, a food cue.

RESULTS

Sign-trackers showed greater reinstatement in response to a nicotine cue. Further, nicotine enhanced sign-tracking but not goal-tracking to a food cue and also enhanced responding for the food cue during the conditioned reinforcement test. Conversely, ethanol reduced sign-tracking and increased goal-tracking, but had no effect on conditioned reinforcement.

CONCLUSIONS

Our studies demonstrate that the tendency to attribute incentive value to a food cue predicts enhanced cue-induced reinstatement. Additionally, the incentive value of food cues is differentially modulated by nicotine and ethanol, which may be related to the reinforcing effects of these drugs.

Toward isolating the role of dopamine in the acquisition of incentive salience attribution

Stimulus-reward learning has been heavily linked to the reward-prediction error learning hypothesis and dopaminergic function. However, some evidence suggests dopaminergic function may not strictly underlie reward-prediction error learning, but may be specific to incentive salience attribution. Utilizing a Pavlovian conditioned approach procedure consisting of two stimuli that were equally reward-predictive (both undergoing reward-prediction error learning) but functionally distinct in regard to incentive salience (levers that elicited sign-tracking and tones that elicited goal-tracking), we tested the differential role of D1 and D2 dopamine receptors and nucleus accumbens dopamine in the acquisition of sign- and goal-tracking behavior and their associated conditioned reinforcing value within individuals. Overall, the results revealed that both D1 and D2 inhibition disrupted performance of sign- and goal-tracking. However, D1 inhibition specifically prevented the acquisition of sign-tracking to a lever, instead promoting goal-tracking and decreasing its conditioned reinforcing value, while neither D1 nor D2 signaling was required for goal-tracking in response to a tone. Likewise, nucleus accumbens dopaminergic lesions disrupted acquisition of sign-tracking to a lever, while leaving goal-tracking in response to a tone unaffected. Collectively, these results are the first evidence of an intraindividual dissociation of dopaminergic function in incentive salience attribution from reward-prediction error learning, indicating that incentive salience, reward-prediction error, and their associated dopaminergic signaling exist within individuals and are stimulus-specific. Thus, individual differences in incentive salience attribution may be reflective of a differential balance in dopaminergic function that may bias toward the attribution of incentive salience, relative to reward-prediction error learning only.

Examining the role of dopamine D2 and D3 receptors in Pavlovian conditioned approach behaviors

Elucidating the neurobiological mechanisms underlying individual differences in the extent to which reward cues acquire the ability to act as incentive stimuli may contribute to the development of successful treatments for addiction and related disorders. We used the sign-tracker/goal-tracker animal model to examine the role of dopamine D2 and D3 receptors in the propensity to attribute incentive salience to reward cues. Following Pavlovian training, wherein a discrete lever-cue was paired with food reward, rats were classified as sign- or goal-trackers based on the resultant conditioned response. We examined the effects of D2/D3 agonists, 7-OH-DPAT (0.01-0.32mg/kg) or pramipexole (0.032-0.32mg/kg), the D2/D3 antagonist raclopride (0.1mg/kg), and the selective D3 antagonist, SB-277011A (6 or 24mg/kg), on the expression of sign- and goal-tracking conditioned responses. The lever-cue acquired predictive value and elicited a conditioned response for sign- and goal-trackers, but only for sign-trackers did it also acquire incentive value. Following administration of either 7-OH-DPAT, pramipexole, or raclopride, the performance of the previously acquired conditioned response was attenuated for both sign- and goal-trackers. For sign-trackers, the D2/D3 agonist, 7-OH-DPAT, also attenuated the conditioned reinforcing properties of the lever-cue. The selective D3 antagonist did not affect either conditioned response. Alterations in D2/D3 receptor signaling, but not D3 signaling alone, transiently attenuate a previously acquired Pavlovian conditioned response, regardless of whether the response is a result of incentive motivational processes. These findings suggest activity at the dopamine D2 receptor is critical for a reward cue to maintain either its incentive or predictive qualities.

Sex and strain influence attribution of incentive salience to reward cues in mice

The propensity to attribute incentive salience to reward cues, measured by Pavlovian sign-tracking, is strongly associated with addiction-related traits including cocaine self-administration, impulsivity, novelty reactivity, and novelty preference. Despite its critical role in addiction, the genetic underpinnings of incentive salience attribution and its relationship to drug addiction are unknown. Mouse genetics can be a powerful means to discover genetic mechanisms underlying this relationship. However, feasibility of genetic dissection of sign-tracking in mice is unknown as only a single study limited to male C57BL/6J mice has rigorously examined this behavior, and limited sign-tracking was observed. Highly diverse mouse populations such as the Collaborative Cross (CC) and Diversity Outbred population (DO) possess a greater range of behavioral and genetic variation than conventional laboratory strains. In the present study, we evaluated sign-tracking and the related phenotype goal-tracking in mice of both sexes from five inbred CC and DO founder strains. Male CAST/EiJ mice exhibited robust sign-tracking; male NOD, male C57BL/6J, and female A/J mice also exhibited significant sign-tracking. Male and female mice from all strains exhibited significant goal-tracking, and significant strain and sex differences were observed. Sign-tracking in males was genetically correlated with exploration of a novel environment, and heritability of sign-tracking and goal-tracking ranged from .32 to .41. These data highlight the importance of considering genetic diversity when evaluating the occurrence of specific behavioral traits in the laboratory mouse and demonstrate that the CC and DO mouse populations can be used to discover mechanisms underlying genetic relationships among sign-tracking and addiction-related behaviors.

Sign-tracking predicts increased choice of cocaine over food in rats

The purpose of this study was to determine whether the tendency to sign-track to a food cue was predictive of rats' choice of cocaine over food. First, rats were trained on a procedure where insertion of a retractable lever was paired with food. A sub-group of rats - sign-trackers - primarily approached and contacted the lever, while another sub-group - goal-trackers - approached the site of food delivery. Rats were then trained on a choice task where they could choose between an infusion of cocaine (1.0 mg/kg) and a food pellet (45 mg). Sign-trackers chose cocaine over food significantly more often than did goal-trackers. These results support the incentive-salience theory of addiction and add to a growing number of studies which suggest that sign-trackers may model an addiction-prone phenotype.

Effects of orbitofrontal cortex lesions on autoshaped lever pressing and reversal learning

A cue associated with a rewarding event can trigger behavior towards the cue itself due to the cue acquiring incentive value through its pairing with the rewarding outcome (i.e., sign-tracking). For example, rats will approach, press, and attempt to "consume" a retractable lever conditioned stimulus (CS) that signals delivery of a food unconditioned stimulus (US). Attending to food-predictive CSs is important when seeking out food, and it is just as important to be able to modify one's behavior when the relationships between CSs and USs are changed. Using a discriminative autoshaping procedure with lever CSs, the present study investigated the effects of orbitofrontal cortex (OFC) lesions on sign-tracking and reversal learning. Insertion of one lever was followed by sucrose delivery upon retraction, and insertion of another lever was followed by nothing. After the acquisition phase, the contingencies between the levers and outcomes were reversed. Bilateral OFC lesions had no effect on the acquisition of sign-tracking. However, OFC-lesioned rats showed substantial deficits in acquiring sign-tracking compared to sham-lesioned rats once the stimulus-outcome contingencies were reversed. Over the course of reversal learning, OFC-lesioned rats were able to reach comparable levels of sign-tracking as sham-lesioned rats. These findings suggest that OFC is not necessary for the ability of a CS to acquire incentive value and provide more evidence that OFC is critical for modifying behavior appropriately following a change in stimulus-outcome contingencies.

Initial uncertainty in Pavlovian reward prediction persistently elevates incentive salience and extends sign-tracking to normally unattractive cues

Uncertainty is a component of many gambling games and may play a role in incentive motivation and cue attraction. Uncertainty can increase the attractiveness for predictors of reward in the Pavlovian procedure of autoshaping, visible as enhanced sign-tracking (or approach and nibbles) by rats of a metal lever whose sudden appearance acts as a conditioned stimulus (CS+) to predict sucrose pellets as an unconditioned stimulus (UCS). Here we examined how reward uncertainty might enhance incentive salience as sign-tracking both in intensity and by broadening the range of attractive CS+s. We also examined whether initially induced uncertainty enhancements of CS+ attraction can endure beyond uncertainty itself, and persist even when Pavlovian prediction becomes 100% certain. Our results show that uncertainty can broaden incentive salience attribution to make CS cues attractive that would otherwise not be (either because they are too distal from reward or too risky to normally attract sign-tracking). In addition, uncertainty enhancement of CS+ incentive salience, once induced by initial exposure, persisted even when Pavlovian CS-UCS correlations later rose toward 100% certainty in prediction. Persistence suggests an enduring incentive motivation enhancement potentially relevant to gambling, which in some ways resembles incentive-sensitization. Higher motivation to uncertain CS+s leads to more potent attraction to these cues when they predict the delivery of uncertain rewards. In humans, those cues might possibly include the sights and sounds associated with gambling, which contribute a major component of the play immersion experienced by problematic gamblers.

Individual variation in resisting temptation: implications for addiction

When exposed to the sights, sounds, smells and/or places that have been associated with rewards, such as food or drugs, some individuals have difficulty resisting the temptation to seek out and consume them. Others have less difficulty restraining themselves. Thus, Pavlovian reward cues may motivate maladaptive patterns of behavior to a greater extent in some individuals than in others. We are just beginning to understand the factors underlying individual differences in the extent to which reward cues acquire powerful motivational properties, and therefore, the ability to act as incentive stimuli. Here we review converging evidence from studies in both human and non-human animals suggesting that a subset of individuals are more "cue reactive", in that certain reward cues are more likely to attract these individuals to them and motivate actions to get them. We suggest that those individuals for whom Pavlovian reward cues become especially powerful incentives may be more vulnerable to impulse control disorders, such as binge eating and addiction.

Environmental manipulations alter age differences in attribution of incentive salience to reward-paired cues

Cues repeatedly paired with rewards often themselves become imbued with enhanced motivational value, or incentive salience. During Pavlovian conditioned approach procedures, a cue repeatedly preceding reward delivery often elicits conditioned responses at either the reward delivery location ("goal-tracking") or the cue itself ("sign-tracking"). Sign-tracking behavior is thought to reflect the individual differences in attribution of incentive salience to reward-paired cues that may contribute to addiction vulnerability. Adolescent rats typically demonstrate less sign-tracking behavior than adult rats, a surprising finding given that adolescence is hypothesized to be a time of heightened addiction vulnerability. Given evidence that adult sign-tracking behavior can be influenced by environmental conditions, the present study compared the effects of isolate housing and food deprivation on expression of sign-tacking and goal-tracking behavior in adolescent and adult male rats across eight days of a Pavlovian conditioned approach procedure. Pair-housed adults exhibited more sign-tracking behavior than pair-housed adolescents; however, this age difference was not apparent in isolate-housed subjects. Adolescents often appeared more sensitive than adults to both food restriction- and isolate housing-induced changes in behavior, with food restriction promoting an increase in sign-tracking among isolate-housed adolescents and an increase in goal-tracking among pair-housed adolescents. For adults, food restriction resulted in a modest increase in overall expression of both sign- and goal-tracking behavior. To the extent that sign-tracking behavior reflects attribution of incentive salience to reward-paired cues, results from the present study provide evidence that reactivity to rewards during adolescence is strongly related to the nature of the surrounding environment.

On the motivational properties of reward cues: Individual differences

Cues associated with rewards, such as food or drugs of abuse, can themselves acquire motivational properties. Acting as incentive stimuli, such cues can exert powerful control over motivated behavior, and in the case of cues associated with drugs, they can goad continued drug-seeking behavior and relapse. However, recent studies reviewed here suggest that there are large individual differences in the extent to which food and drug cues are attributed with incentive salience. Rats prone to approach reward cues (sign-trackers) attribute greater motivational value to discrete localizable cues and interoceptive cues than do rats less prone to approach reward cues (goal-trackers). In contrast, contextual cues appear to exert greater control over motivated behavior in goal-trackers than sign-trackers. It is possible to predict, therefore, before any experience with drugs, in which animals specific classes of drug cues will most likely reinstate drug-seeking behavior. The finding that different individuals may be sensitive to different triggers capable of motivating behavior and producing relapse suggests there may be different pathways to addiction, and has implications for thinking about individualized treatment. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.