Drug versus sweet reward: greater attraction to and preference for sweet versus drug cues

A Review of Behavioral Economic Manipulations Affecting Drug versus Nondrug Choice in Rats

Many recent studies have investigated rats' choice between drug and nondrug reinforcers to model variables influencing drug taking in humans. As research using this model accumulates, the complexity of factors affecting drug choice has become increasingly apparent. This review applies a behavioral economic perspective to research that has used this model. The focus is on experiments that have manipulated behavioral economic variables in studies of rats' choice between drugs like cocaine or heroin and nondrug reinforcers like saccharin or social interaction. Price effects, reinforcer interactions (i.e., as substitutes or complements), economy type, and income effects are described. Results of experiments testing the impact of these variables on rats' choice are presented and analyzed. Although rats' behavior in this model often conforms well with behavioral economic principles, there have also been instances where further explanation is required. By appreciating the behavioral economic context in which rats' choice between drug and nondrug reinforcers occurs, and by recognizing that both consequences and antecedents can play important roles in this behavior, our understanding of the complexity of factors involved in drug choice can be increased.

De novo biosynthesis of mogroside V by multiplexed engineered yeasts

High sugar intake has become a global health concern due to its association with various diseases. Mogroside V (MG-V), a zero-calorie sweetener with multiple medical properties, is emerging as a promising sugar substitute. However, its application is hindered by low natural abundance and the inefficiency of conventional plant extraction methods. In this study, two glycosyltransferases were introduced into an engineered mogrol-producing Saccharomyces cerevisiae strain to enable the first de novo MG-V biosynthesis. Then, MG-V titer increased by 2.3 × 104-fold through a series of efficient metabolic engineering strategies, including the enhancement of precursors, inhibition of the competitive pathway, and prevention of MG-V degradation. The challenges of enzyme spatial separation and high protein folding stress were addressed through lipid droplet (LD) compartmentalization and endoplasmic reticulum expansion, respectively. The ty1 transposon was employed to increase the copies of LD-targeted fusion protein AtCPR2-CYP87D18, which possessed higher CYP450 catalytic efficiency, resulting in an MG-V titer of 10.25 mg/L in shake flasks and 28.62 mg/L in a 5-L bioreactor. Overall, this study realized de novo MG-V synthesis in S. cerevisiae for the first time and provided a valuable reference for constructing microbial factories for triterpenoid saponin synthesis.

A large-scale c-Fos brain mapping study on extinction of cocaine-primed reinstatement

Individuals with cocaine addiction can experience many craving episodes and subsequent relapses, which represents the main obstacle to recovery. Craving is often favored when abstinent individuals ingest a small dose of cocaine, encounter cues associated with drug use or are exposed to stressors. Using a cocaine-primed reinstatement model in rat, we recently showed that cocaine-conditioned interoceptive cues can be extinguished with repeated cocaine priming in the absence of drug reinforcement, a phenomenon we called extinction of cocaine priming. Here, we applied a large-scale c-Fos brain mapping approach following extinction of cocaine priming in male rats to identify brain regions implicated in processing the conditioned interoceptive stimuli of cocaine priming. We found that cocaine-primed reinstatement is associated with increased c-Fos expression in key brain regions (e.g., dorsal and ventral striatum, several prefrontal areas and insular cortex), while its extinction mostly disengages them. Moreover, while reinstatement behavior was correlated with insular and accumbal activation, extinction of cocaine priming implicated parts of the ventral pallidum, the mediodorsal thalamus and the median raphe. These brain patterns of activation and inhibition suggest that after repeated priming, interoceptive signals lose their conditioned discriminative properties and that action-outcome associations systems are mobilized in search for new contingencies, a brain state that may predispose to rapid relapse.

A novel technique for delineating the effect of variation in the learning rate on the neural correlates of reward prediction errors in model-based fMRI

Introduction

Computational models play an increasingly important role in describing variation in neural activation in human neuroimaging experiments, including evaluating individual differences in the context of psychiatric neuroimaging. In particular, reinforcement learning (RL) techniques have been widely adopted to examine neural responses to reward prediction errors and stimulus or action values, and how these might vary as a function of clinical status. However, there is a lack of consensus around the importance of the precision of free parameter estimation for these methods, particularly with regard to the learning rate. In the present study, I introduce a novel technique which may be used within a general linear model (GLM) to model the effect of mis-estimation of the learning rate on reward prediction error (RPE)-related neural responses.

Methods

Simulations employed a simple RL algorithm, which was used to generate hypothetical neural activations that would be expected to be observed in functional magnetic resonance imaging (fMRI) studies of RL. Similar RL models were incorporated within a GLM-based analysis method including derivatives, with individual differences in the resulting GLM-derived beta parameters being evaluated with respect to the free parameters of the RL model or being submitted to other validation analyses.

Results

Initial simulations demonstrated that the conventional approach to fitting RL models to RPE responses is more likely to reflect individual differences in a reinforcement efficacy construct (lambda) rather than learning rate (alpha). The proposed method, adding a derivative regressor to the GLM, provides a second regressor which reflects the learning rate. Validation analyses were performed including examining another comparable method which yielded highly similar results, and a demonstration of sensitivity of the method in presence of fMRI-like noise.

Conclusion

Overall, the findings underscore the importance of the lambda parameter for interpreting individual differences in RPE-coupled neural activity, and validate a novel neural metric of the modulation of such activity by individual differences in the learning rate. The method is expected to find application in understanding aberrant reinforcement learning across different psychiatric patient groups including major depression and substance use disorder.

A contextualized reinforcer pathology approach to addiction

Behavioural economic accounts of addiction conceptualize harmful drug use as an operant reinforcer pathology, emphasizing that a drug is consumed because of overvaluation of smaller immediate rewards relative to larger delayed rewards (delay discounting) and high drug reinforcing value (drug demand). These motivational processes are within-individual determinants of behaviour. A third element of learning theory posits that harmful drug use depends on the relative constraints on access to other available activities and commodities in the choice context (alternative reinforcers), reflecting the substantial influence of environmental factors. In this Perspective, we integrate alternative reinforcers into the contemporary behavioural economic account of harmful drug use - the contextualized reinforcer pathology model - and review empirical literature across the translational spectrum in support of this model. Furthermore, we consider how increases in drug-related mortality and health disparities in addiction can be understood and potentially ameliorated via a contextualized reinforcer pathology model in which lack of alternative reinforcement is a major risk factor for addiction.

Neural circuits controlling choice behavior in opioid addiction

As the opioid epidemic presents an ever-expanding public health threat, there is a growing need to identify effective new treatments for opioid use disorder (OUD). OUD is characterized by a behavioral misallocation in choice behavior between opioids and other rewards, as opioid use leads to negative consequences, such as job loss, family neglect, and potential overdose. Preclinical models of addiction that incorporate choice behavior, as opposed to self-administration of a single drug reward, are needed to understand the neural circuits governing opioid choice. These choice models recapitulate scenarios that humans suffering from OUD encounter in their daily lives. Indeed, patients with substance use disorders (SUDs) exhibit a propensity to choose drug under certain conditions. While most preclinical addiction models have focused on relapse as the outcome measure, our data suggest that choice is an independent metric of addiction severity, perhaps relating to loss of cognitive control over choice, as opposed to excessive motivational drive to seek drugs during relapse. In this review, we examine both preclinical and clinical literature on choice behavior for drugs, with a focus on opioids, and the neural circuits that mediate drug choice versus relapse. We argue that preclinical models of opioid choice are needed to identify promising new avenues for OUD therapy that are translationally relevant. Both forward and reverse translation will be necessary to identify novel treatment interventions. This article is part of the Special Issue on "Opioid-induced changes in addiction and pain circuits".

Large-scale brain correlates of sweet versus cocaine reward in rats

Cocaine induces many supranormal changes in neuronal activity in the brain, notably in learning- and reward-related regions, in comparison with nondrug rewards-a difference that is thought to contribute to its relatively high addictive potential. However, when facing a choice between cocaine and a nondrug reward (e.g., water sweetened with saccharin), most rats do not choose cocaine, as one would expect from the extent and magnitude of its global activation of the brain, but instead choose the nondrug option. We recently showed that cocaine, though larger in magnitude, is also an inherently more delayed reward than sweet water, thereby explaining why it has less value during choice and why rats opt for the more immediate nondrug option. Here, we used a large-scale Fos brain mapping approach to measure brain responses to each option in saccharin-preferring rats, with the hope to identify brain regions whose activity may explain the preference for the nondrug option. In total, Fos expression was measured in 142 brain levels corresponding to 52 brain subregions and composing 5 brain macrosystems. Overall, our findings confirm in rats with a preference for saccharin that cocaine induces more global brain activation than the preferred nondrug option does. Only very few brain regions were uniquely activated by saccharin. They included regions involved in taste processing (i.e., anterior gustatory cortex) and also regions involved in processing reward delay and intertemporal choice (i.e., some components of the septohippocampal system and its connections with the lateral habenula).

Cocaine falls into oblivion during volitional initiation of choice trials

When facing a choice, most animals quit drugs in favour of a variety of nondrug alternatives. We recently found, rather unexpectedly, that choice of the nondrug alternative is in fact inflexible and habitual. One possible contributing factor to habitual choice is the intermittency and uncontrollability of choice trials in previous studies. Here, we asked whether and to what extent volitional control over the occurrence of choice trials could change animals' preference by preventing habitual choice. To do so, rats were trained to nosepoke in a hole to trigger the presentation of two operant levers: one associated with cocaine, the other with saccharin. Rats were then free to choose among the two levers to obtain the corresponding reward, after which both levers retracted until rats self-initiated the next choice trial. Overall, we found that volitional control over choice trials did not change preference. Most rats preferred saccharin over cocaine and selected this option almost exclusively. Intriguingly, after repeated choice and consumption of saccharin, rats transiently lost interest in this option (i.e., due to sensory-specific satiety), but they did not switch to cocaine, preferring instead to pause during long periods of time before reinitiating a choice trial for saccharin. This finding suggests that during volitional initiation of a choice trial, rats fail to consider cocaine as an option. We discuss a possible associative mechanism to explain this perplexing behaviour.

Investigating discriminative stimulus modulation of opioid seeking after conflict-induced abstinence in sign- and goal-tracking rats

RATIONALE

Discriminative stimuli (DS) are cues that predict reward availability. DS are resistant to extinction and motivate drug seeking even after long periods of abstinence. Previous studies have demonstrated that sign-tracking (ST) and goal-tracking (GT) differences in Pavlovian approach predict distinct cue-modulated vulnerabilities to cocaine reinstatement. GT rats show heightened reinstatement to contextual and DS, while ST rats show heightened reinstatement to discrete stimuli. Here we examine whether DS modulate reinstatement after electric barrier-induced abstinence and whether tracking-related relapse vulnerabilities generalize to opioid relapse.

OBJECTIVES

We examine whether DS-modulated reinstatement to fentanyl seeking persists in the presence of reduced adverse consequences after electric barrier-induced abstinence. We also examine whether tracking differences predict the magnitude of DS-modulated reinstatement of fentanyl seeking after electric barrier-induced abstinence.

METHODS

We used Pavlovian lever autoshaping (PLA) training to determine sign-, goal-, and intermediate tracking groups in male and female Sprague Dawley rats. We then trained rats in a DS model of intermittent fentanyl self-administration, and extinguished drug seeking by imposing an electric barrier of increasing intensity. We then measured the level of DS-modulated reinstatement in the presence of a reduced electric barrier intensity.

RESULTS

We report that DS strongly modulate fentanyl seeking after electric barrier-induced abstinence. DS-modulation of fentanyl acquisition, electric barrier-induced abstinence, and reinstatement was similar for sign- and goal-tracking groups.

CONCLUSIONS

Discriminative stimuli powerfully motivate opioid seeking, despite continued aversive consequences. Pavlovian approach differences do not predict the level of DS-modulated reinstatement to fentanyl seeking after conflict-induced abstinence.

Choosing between cocaine and sucrose under the influence: testing the effect of cocaine tolerance

RATIONALE

Cocaine use not only depends on the reinforcing properties of the drug, but also on its pharmacological effects on alternative nondrug activities. In animal models investigating choice between cocaine and alternative sweet rewards, the latter influence can have a dramatic impact on choice outcomes. When choosing under cocaine influence is prevented by imposing sufficiently long intervals between choice trials, animals typically prefer the sweet reward. However, when choosing under the drug influence is permitted, animals shift their preference in favor of cocaine.

OBJECTIVES

We previously hypothesized that this preference shift is mainly due to a direct suppression of responding for sweet reward by cocaine pharmacological effects. Here we tested this hypothesis by making rats tolerant to this drug-induced behavioral suppression.

RESULTS

Contrary to our expectation, tolerance did not prevent rats from shifting their preference to cocaine when choosing under the influence.

CONCLUSION

Thus, other mechanisms must be invoked to explain the influence of cocaine intoxication on choice outcomes.

Carrots for the donkey: Influence of evaluative conditioning and training on self-paced exercise intensity and delay discounting of exercise in healthy adults

To choose exercise over alternative behaviours, subjective reward evaluation of the potential choices is a principal step in decision making. However, the selection of exercise intensity might integrate acute visceral responses (i.e. pleasant or unpleasant feelings) and motives related to goals (i.e. enjoyment, competition, health). To understand the factors determining the selection of exercise in its intensity and evaluation as a modality, we conducted a study combining exercise training and evaluative conditioning. Evaluative conditioning was performed by using a novel technique using a primary reinforcer (sweetness) as the unconditioned stimulus and physical strain i.e. heart rate elevation as the conditioned stimulus during interval training, using a randomized control design (N = 58). Pre, post-three weeks interval training w/o conditioning, and after 4 weeks follow-up, participants were tested on self-paced speed selection on treadmill measuring heart rate, subjective pleasantness, and effort levels, as well as delay-discounting of exercise and food rewards. Results revealed that the selection of exercise intensity was significantly increased by adaptation to training and evaluative conditioning, revealing the importance of visceral factors as well as learned expected rewards. Delay discounting rates of self-paced exercise were transiently reduced by training but not affected by evaluative conditioning. In conclusion, exercise decisions are suggested to separate the decision-making process into a modality-specific cognitive evaluation of exercise, and an exercise intensity selection based on acute visceral experience integrating effort, pleasantness, and learned rewards.

A common limiter circuit for opioid choice and relapse identified in a rodent addiction model

Activity in numerous brain regions drives heroin seeking, but no circuits that limit heroin seeking have been identified. Furthermore, the neural circuits controlling opioid choice are unknown. In this study, we examined the role of the infralimbic cortex (IL) to nucleus accumbens shell (NAshell) pathway during heroin choice and relapse. This model yielded subpopulations of heroin versus food preferring rats during choice, and choice was unrelated to subsequent relapse rates to heroin versus food cues, suggesting that choice and relapse are distinct behavioral constructs. Supporting this, inactivation of the IL with muscimol produced differential effects on opioid choice versus relapse. A pathway-specific chemogenetic approach revealed, however, that the IL-NAshell pathway acts as a common limiter of opioid choice and relapse. Furthermore, dendritic spines in IL-NAshell neurons encode distinct aspects of heroin versus food reinforcement. Thus, opioid choice and relapse share a common addiction-limiting circuit in the IL-NAshell pathway.

Animal Models of the Behavioral Symptoms of Substance Use Disorders

To more effectively manage substance use disorders, it is imperative to understand the neural, genetic, and psychological underpinnings of addictive behavior. To contribute to this understanding, considerable efforts have been made to develop translational animal models that capture key behavioral characteristics of addiction on the basis of DSM5 criteria of substance use disorders. In this review, we summarize empirical evidence for the occurrence of addiction-like behavior in animals. These symptoms include escalation of drug use, neurocognitive deficits, resistance to extinction, exaggerated motivation for drugs, increased reinstatement of drug seeking after extinction, preference for drugs over nondrug rewards, and resistance to punishment. The occurrence of addiction-like behavior in laboratory animals has opened the opportunity to investigate the neural, genetic, and psychological background of key aspects of addiction, which may ultimately contribute to the prevention and treatment of substance use disorders.

Sugar, a powerful substitute for ethanol in ethanol postdependent rats: Relevance for clinical consideration?

Sugar has been shown to be a powerful substitute for drugs in preclinical studies on addiction. However, the link between sugar intake and alcohol use disorder (AUD) is poorly understood. We assessed the influence of sucrose on ethanol drinking in both nondependent (ND) and dependent (D) Long-Evans rats during acute withdrawal using the postdependent state model. Ethanol (10%-40%) and sucrose (1%-4%) solutions were offered in an operant paradigm either independently or concurrently under ratio schedules of reinforcement. We showed that D rats displayed an enhanced motivation for both 10% ethanol solution (10E) and 4% sucrose solution (4S) as compared with ND rats, and a clear preference for 4S was observed in both groups. During acute withdrawal, D rats showed a strong motivation for 30% ethanol (30E), even when adulterated with quinine, but still preferred 4S despite the fact that a high level of negative reinforcement could be expected. However, when a premix solution (30E4S) was offered concurrently with 4S, the preference for 4S was lost in D animals, which consumed as much premix as 4S, whereas ND animals displayed preference for 4S. Altogether, those results suggest that reinforcing properties of sucrose surpass those of ethanol in D rats under acute withdrawal, which indicates that sugar is a powerful substitute for ethanol. Our results suggest that craving for sugar may be increased in AUD patients during withdrawal and raise the issue of dependence transfer from alcohol to sugar.

Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and β-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the β-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.

Pharmacokinetics trumps pharmacodynamics during cocaine choice: a reconciliation with the dopamine hypothesis of addiction

Cocaine is known to increase brain dopamine at supranormal levels in comparison to alternative nondrug rewards. According to the dopamine hypothesis of addiction, this abnormally large dopamine response would explain why cocaine use is initially highly rewarding and addictive. Though resting on solid neuroscientific foundations, this hypothesis has nevertheless proven difficult to reconcile with research on cocaine choice in experimental animals. When facing a choice between an intravenous bolus of cocaine and a nondrug alternative (e.g., sweet water), both delivered immediately after choice, rats do not choose the drug, as would be predicted, but instead develop a strong preference for the nondrug alternative. Here we report evidence that reconciles this finding with the dopamine hypothesis of addiction. First, a systematic literature analysis revealed that the delays of effects of intravenous cocaine on nucleus accumbens dopamine are of the order of tens of seconds and are considerably longer than those of nondrug reward. Second, this was confirmed by measuring response times to cocaine omission during self-administration as a behavioral proxy of these delays. Finally, when the influence of the drug delays was reduced during choice by adding an increasing delay to both the drug and nondrug rewards, rats shifted their choice to cocaine. Overall, this study suggests that cocaine is indeed supranormal in reward magnitude, as postulated by the dopamine hypothesis of addiction, but is less preferred during choice because its pharmacokinetics makes it an inherently more delayed reward than the alternative. Reframing previous drug choice studies in rats as intertemporal choice studies reveals that the discounting effects of delays spare no rewards, including supranormal ones, and that during choice, pharmacokinetics trumps pharmacodynamics.

Effects of high fructose corn syrup on ethanol self-administration in rats

OBJECTIVE

The addition of sweeteners to alcoholic beverages is thought to facilitate heavy alcohol consumption, and this may be of particular concern when the additive is high fructose corn syrup (HFCS).

METHODS

Four experiments in male Sprague-Dawley rats were performed to investigate whether the addition of 25% HFCS to ethanol (5%, 10%, and 20% v/v ethanol) would alter its intraoral operant self-administration, palatability, and sensitivity to food deprivation stress.

RESULTS

As anticipated, HFCS drastically increased ethanol intake, and this effect appeared driven by its caloric value. Importantly, HFCS increased the persistence of operant responding following extinction in animals trained to self-administer the combination, and the addition of HFCS to ethanol changed subsequent responses to ethanol, including increased palatability and intake.

CONCLUSIONS

These results in rats suggest that the addition of HFCS to the list of ingredients in sweetened alcoholic beverages could play a significant role in the harmful consumption of ethanol-containing beverages.

Habitual Preference for the Nondrug Reward in a Drug Choice Setting

For adaptive and efficient decision making, it must be possible to select between habitual alternative courses of action. However, research in rodents suggests that, even in the context of simple decision-making, choice behavior remains goal-directed. In contrast, we recently found that during discrete trial choice between cocaine and water, water-restricted rats preferred water and this preference was habitual and inflexible (i.e., resistant to water devaluation by satiation). Here we sought to test the reproducibility and generality of this surprising finding by assessing habitual control of preference for saccharin over cocaine in non-restricted rats. Specifically, after the acquisition of preference for saccharin, saccharin was devalued and concurrent responding for both options was measured under extinction. As expected, rats responded more for saccharin than for cocaine during extinction, but this difference was unaffected by saccharin devaluation. Together with our previous research, this result indicates that preference for nondrug alternatives over cocaine is under habitual control, even under conditions that normally support goal-directed control of choice between nondrug options. The possible reasons for this difference are discussed.

Heroin choice depends on income level and economy type

RATIONALE

In a previous study, investigating choice between heroin and a non-drug alternative in animals and reductions in income (i.e., choices/day) caused the percentage of income spent on heroin to progressively decrease. In contrast, another study found that humans with opioid use disorder spent the majority of their income on heroin even though they had little income. Comparison of these two studies suggests that the seemingly conflicting results could be explained by differences in the underlying economy types of the choice alternatives.

OBJECTIVE

The present experiment tested the hypothesis that the effect of income changes on choice between heroin and a non-drug alternative depends on economy type.

METHODS

Rats chose between heroin and saccharin under three income levels. For the Closed group, the choice session was the only opportunity to obtain these reinforcers. For the Heroin Open group and the Saccharin Open group, choice sessions were followed by 3-h periods of unlimited access to heroin or saccharin, respectively.

RESULTS

As income decreased, the Closed and Heroin Open groups, but not the Saccharin Open group, spent an increasingly greater percentage of income on saccharin than on heroin. The Saccharin Open group, compared to the other groups, spent a greater percentage of income on heroin as income decreased.

CONCLUSIONS

Results confirm that the effects of income and economy type can interact and this may explain the apparently discrepant results of earlier studies. More generally, findings suggest that situations where heroin choice has little consequence for consumption of non-drug alternatives may promote heroin use.

Non-pharmacological factors that determine drug use and addiction

Based on their pharmacological properties, psychoactive drugs are supposed to take control of the natural reward system to finally drive compulsory drug seeking and consumption. However, psychoactive drugs are not used in an arbitrary way as pure pharmacological reinforcement would suggest, but rather in a highly specific manner depending on non-pharmacological factors. While pharmacological effects of psychoactive drugs are well studied, neurobiological mechanisms of non-pharmacological factors are less well understood. Here we review the emerging neurobiological mechanisms beyond pharmacological reinforcement which determine drug effects and use frequency. Important progress was made on the understanding of how the character of an environment and social stress determine drug self-administration. This is expanded by new evidence on how behavioral alternatives and opportunities for drug instrumentalization generate different patterns of drug choice. Emerging evidence suggests that the neurobiology of non-pharmacological factors strongly determines pharmacological and behavioral drug action and may, thus, give rise for an expanded system's approach of psychoactive drug use and addiction.

Role of Projections between Piriform Cortex and Orbitofrontal Cortex in Relapse to Fentanyl Seeking after Palatable Food Choice-Induced Voluntary Abstinence

We recently developed a rat model of relapse to drug seeking after food choice-induced voluntary abstinence. Here, we used this model to study the role of the orbitofrontal cortex (OFC) and its afferent projections in relapse to fentanyl seeking. We trained male and female rats to self-administer palatable food pellets for 6 d (6 h/d) and intravenous fentanyl (2.5 μg/kg/infusion) for 12 d (6 h/d). We assessed relapse to fentanyl seeking after 13-14 voluntary abstinence days, achieved through a discrete choice procedure between fentanyl infusions and palatable food (20 trials/d). In both sexes, relapse after food choice-induced abstinence was associated with increased expression of the activity marker Fos in the OFC. Pharmacological inactivation of the OFC with muscimol plus baclofen (50 + 50 ng/side) decreased relapse to fentanyl seeking. We then determined projection-specific activation of OFC afferents during the relapse test by using Fos plus the retrograde tracer cholera toxin B (injected into the OFC). Relapse to fentanyl seeking was associated with increased Fos expression in the piriform cortex (Pir) neurons projecting to the OFC, but not in projections from the basolateral amygdala and thalamus. Pharmacological inactivation of the Pir with muscimol plus baclofen decreased relapse to fentanyl seeking after voluntary abstinence. Next, we used an anatomical disconnection procedure to determine whether projections between the Pir and OFC are critical for relapse to fentanyl seeking. Unilateral muscimol plus baclofen injections into the Pir in one hemisphere plus unilateral muscimol plus baclofen injections into the OFC in the contralateral, but not ipsilateral, hemisphere decreased relapse. Our results identify Pir-OFC projections as a new motivation-related pathway critical to relapse to opioid seeking after voluntary abstinence.SIGNIFICANCE STATEMENT There are few preclinical studies of fentanyl relapse, and these studies have used experimenter-imposed extinction or forced abstinence procedures. In humans, however, abstinence is often voluntary, with drug available in the drug environment but forgone in favor of nondrug alternative reinforcers. We recently developed a rat model of drug relapse after palatable food choice-induced voluntary abstinence. Here, we used classical pharmacology, immunohistochemistry, and retrograde tracing to demonstrate a critical role of the piriform and orbitofrontal cortices in relapse to opioid seeking after voluntary abstinence.

The effect of economy type on heroin and saccharin essential value

According to behavioral economics, reinforcer value should be lower in an open economy than in a closed economy. An animal model was used to determine how economy type affected the value of heroin and saccharin. In a first phase, separate groups of rats worked for heroin or saccharin. The price of these reinforcers increased over sessions. For rats in the open heroin or open saccharin economies, the work period of each session was followed by a postwork period where a cheaper source of heroin or saccharin was available for three hours. For rats in the closed economies, the work period was their only opportunity to obtain the reinforcer. Rats in the open saccharin economy worked less hard to defend consumption of saccharin as price increased than rats in the closed saccharin economy. That is, opening the saccharin economy reduced its essential value. In contrast, economy type had no effect on heroin's essential value. In a second phase, rats were allowed to choose between heroin and saccharin. The majority of rats strongly preferred saccharin over heroin regardless of economy type. The finding that economy type changed the essential value of saccharin, but not heroin, adds to previous findings suggesting that the value of drug reinforcers is unaffected by future drug availability. The difference in effect of economy type on drug versus nondrug reinforcers could be relevant to addiction. (PsycINFO Database Record (c) 2019 APA, all rights reserved).

Sex differences in opioid reinforcement under a fentanyl vs. food choice procedure in rats

Clinical evidence suggest that men are more sensitive than women to the abuse-related effects of mu-opioid agonists. In contrast, preclinical studies suggest the opposite sex difference. The aim of the present study was to clarify this discrepancy using a fentanyl vs. diluted Ensure^® choice procedure to assess sex differences in opioid reinforcement. Sex differences in intravenous (IV) fentanyl self-administration were examined under a fixed-ratio (FR5) schedule, a multi-day progressive-ratio (PR) schedule for behavioral economic analysis, and a concurrent (choice) schedule of fentanyl and diluted Ensure^® reinforcement in Sprague-Dawley male and female rats. The fentanyl dose-effect function under the FR5 schedule was significantly shifted upward in females compared to males. Similarly, the reinforcing effectiveness of both fentanyl (3.2 and 10 µg/kg per injection, IV) and diluted Ensure^® (18 and 56%) were greater in females than in males as assessed using behavioral economic analysis, irrespective of dose or concentration. However, under a fentanyl vs. foodchoice procedure, males chose 3.2 µg/kg per injection fentanyl injections over 18%, but not 56%, diluted Ensure^® at a higher percentage compared to females. Overall, these results suggest that the expression of sex differences in opioid reinforcement depends upon the schedule of reinforcement and that preclinical opioid vs. food choice procedures provide a translationally relevant measure (i.e., behavioral allocation) consistent with the direction of sex differences reported in the clinical literature.

Preference for Cocaine is Represented in the Orbitofrontal Cortex by an Increased Proportion of Cocaine Use-Coding Neurons

Cocaine addiction is a harmful preference for drug use over and at the expense of other nondrug-related activities. Here we identify in the rat orbitofrontal cortex (OFC) a mechanism that explains individual preferences between cocaine use and an alternative, nondrug action. OFC neuronal activity was recorded while rats performed each of these 2 actions separately or while they chose between them. First, we found that these actions are encoded by 2 nonoverlapping neuronal populations and that the relative size of the cocaine population represented individual preferences. A larger relative size was only observed in cocaine-preferring individuals. Second, OFC neurons encoding a given individual's preferred action progressively fired more than other action-coding neurons few seconds before the preferred action was actually chosen, suggesting a prechoice neuronal competition for action selection. In cocaine-preferring rats, this manifested by a prechoice ramping-up activity in favor of the cocaine population. Finally, pharmacological manipulation of prechoice activity in favor of the cocaine population caused nondrug-preferring rats to shift their choice to cocaine. Overall, this study suggests that an individual preference for cocaine is represented in the OFC by a population size bias that systematically advantages cocaine use-coding neurons during prechoice competition for action selection.

Inflexible habitual decision-making during choice between cocaine and a nondrug alternative

The concept of compulsive cocaine-seeking habits is difficult to reconcile with other evidence showing that humans and even rats remain able to shift their choice away from the drug and toward an alternative nondrug reward, when available. This paradox could dissolve if preference for the nondrug option reflected in fact inflexible habitual decision-making (i.e., fixed in a habitual control mode, with no return to a goal-directed control mode). Previous research in rats has shown that prior drug use can favor habit formation, but whether the resulting habits are inflexible or not is largely unknown. Here we addressed this question by manipulating the value of water in rats that chose between water and cocaine in a discrete-trials procedure. Rats preferred water when thirsty and maintained this preference despite water devaluation by satiation. Only with repeated daily testing under water satiation did they progressively reverse their preference toward cocaine. Additional evidence showed that this progressive reversal of preference reflected in fact new interoceptive discrimination learning. Overall, this study suggests that rats seem to be stuck in a habitual decision-making mode, unable to return to a goal-directed mode upon experiencing a change in options value. It also reveals that inflexible decision-making does not necessarily promote drug choice, but can also under some circumstances favor abstinence.

Trying to make sense of rodents' drug choice behavior

Since the first experimental hint for the existence of "an actual desire or striving for the drug" in nonhuman animals by Sidney Spragg in the late 1930s, much effort has been expended by lab researchers to try to model in a valid manner the key behavioral aspects and signs of addiction in animals, typically in rodents (i.e., mainly rats and, to a lesser extent, mice). Despite much advances, there still remains a lingering doubt about the disordered status of drug use in rodents. This is mainly because drug use occurs in a particular setting where animals have access to a drug for self-administration but without access to other valuable behavioral options that could compete with and divert from drug use. Here I review evidence showing that enriching the drug setting with other behavioral options can dramatically influence the pattern of drug choices in rodents. Overall, access to other options during drug access can divert the vast majority of rats from continued drug use. Only few individuals continue to engage in drug use despite access to and at the expense of other options. However, there exist certain high-risk settings in which virtually all animals are vulnerable to develop a harmful pattern of exclusive drug use that can even become fatal in the long run if not discontinued by an outside intervention. Paradoxically, it appears that the behavioral trait that is hypothesized to uniquely render rodents vulnerable to the latter settings (i.e., a narrow focus on the local, current choice, with no consideration of the global pattern of choice) would also protect most of them from using drugs in other choice settings. I conclude with an attempt to make sense of this peculiar setting-specific behavior and with some general propositions for future research.

A neuronal population code for resemblance between drug and nondrug reward outcomes in the orbitofrontal cortex

The orbitofrontal cortex (OFC) is implicated in choice and decision-making in both human and non-human animals. We previously identified in the rat OFC a mechanism that influences individual drug choices and preferences between a drug and a nondrug (i.e., sweet) outcome that is common across different types of drugs (cocaine and heroin). Importantly, this research also revealed some intriguing drug-specific differences. Notably, the size of non-selective OFC neurons that indiscriminately encode both the drug and the sweet outcomes varies as a function of the drug outcome available (cocaine or heroin). Here we tested the hypothesis that the relative size of the non-selective OFC population somehow represents the degree of resemblance between the drug and nondrug reward outcomes. We recorded OFC neuronal activity in vivo in the same individual rats while they were choosing between two outcomes with varying degrees of resemblance: high (two concentrations of sweet), intermediate (sweet versus heroin) and low (sweet versus cocaine). We found that the percentage of non-selective OFC neurons dramatically increased with the degree of resemblance between choice outcomes, from 26 to 62%. Overall, these findings reveal the existence of a neuronal population code for resemblance between different kinds of choice outcomes in the OFC.

Food addiction: a valid concept?

Can food be addictive? What does it mean to be a food addict? Do common underlying neurobiological mechanisms contribute to drug and food addiction? These vexing questions have been the subject of considerable interest and debate in recent years, driven in large part by the major health concerns associated with dramatically increasing body weights and rates of obesity in the United States, Europe, and other regions with developed economies. No clear consensus has yet emerged on the validity of the concept of food addiction and whether some individuals who struggle to control their food intake can be considered food addicts. Some, including Fletcher, have argued that the concept of food addiction is unsupported, as many of the defining features of drug addiction are not seen in the context of feeding behaviors. Others, Kenny included, have argued that food and drug addiction share similar features that may reflect common underlying neural mechanisms. Here, Fletcher and Kenny argue the merits of these opposing positions on the concept of food addiction.

Exposure to environmental enrichment attenuates addiction-like behavior and alters molecular effects of heroin self-administration in rats

Environmental factors profoundly affect the addictive potential of drugs of abuse and may also modulate the neuro-anatomical/neuro-chemical impacts of uncontrolled drug use and relapse propensity. This study examined the impact of environmental enrichment on heroin self-administration, addiction-related behaviors, and molecular processes proposed to underlie these behaviors. Male Sprague-Dawley rats in standard and enriched housing conditions intravenously self-administered similar amounts of heroin over 14 days. However, environmental enrichment attenuated progressive ratio, extinction, and reinstatement session responding after 14 days of enforced abstinence. Molecular mechanisms, namely DNA methylation and gene expression, are proposed to underlie abstinence-persistent behaviors. A global reduction in methylation is reported to coincide with addiction, but no differences in total genomic methylation or repeat element methylation were observed in CpG or non-CpG (CH) contexts across the mesolimbic circuitry as assessed by multiple methods including whole genome bisulfite sequencing. Immediate early gene expression associated with drug seeking, taking, and abstinence also were examined. EGR1 and EGR2 were suppressed in mesolimbic regions with heroin-taking and environmental enrichment. Site-specific methylation analysis of EGR1 and EGR2 promoter regions using bisulfite amplicon sequencing (BSAS) revealed hypo-methylation in the EGR2 promoter region and EGR1 intragenic CpG sites with heroin-taking and environmental enrichment that was associated with decreased mRNA expression. Taken together, these findings illuminate the impact of drug taking and environment on the epigenome in a locus and gene-specific manner and highlight the need for positive, alternative rewards in the treatment and prevention of drug addiction.

Challenges to Body Fluid Homeostasis Differentially Recruit Phasic Dopamine Signaling in a Taste-Selective Manner

The internal environment of an organism must remain stable to ensure optimal performance and ultimately survival. The generation of motivated behaviors is an adaptive mechanism for defending homeostasis. Although physiological state modulates motivated behaviors, the influence of physiological state on phasic dopamine signaling, an underlying neurobiological substrate of reward-driven behavior, is underexplored. Here, we use sodium depletion and water restriction, manipulations of body fluid homeostasis, to determine the flexibility and specificity of dopamine responses. Changes in dopamine concentration were measured using fast-scan cyclic voltammetry in the nucleus accumbens shell of male rats in response to intraoral infusions of fluids that either satisfied or did not satisfy homeostatic need. Increases in dopamine concentration during intraoral infusions were observed only under conditions of physiological deficit. Furthermore, dopamine increases were selective and limited to those that satisfied the need state of the animal. Thus, dopamine neurons track fluid balance and respond to salt and water stimuli in a state- and taste-dependent manner. Using Fluoro-Gold tracing and immunohistochemistry for c-Fos and Foxp2, a marker of sodium-deprivation responsive neurons, we revealed brainstem populations of neurons that are activated by sodium depletion and project directly to the ventral tegmental area. The identified projections may modulate dopamine neuron excitability and consequently the state-specific dopamine release observed in our experiments. This work illustrates the impact of physiological state on mesolimbic dopamine signaling and a potential circuit by which homeostatic disruptions are communicated to mesolimbic circuitry to drive the selective reinforcement of biologically-required stimuli under conditions of physiological need.SIGNIFICANCE STATEMENT Motivated behaviors arise during physiological need and are highly selective for homeostasis-restoring stimuli. Although phasic dopamine signaling has been shown to contribute to the generation of motivated behaviors, the state and stimulus specificity of phasic dopamine signaling is less clear. These studies use thirst and sodium appetite to show that dopamine neurons dynamically track body fluid homeostasis and respond to water and salt stimuli in a state- and taste-dependent manner. We also identify hindbrain sodium deprivation-responsive neurons that project directly to the ventral tegmental area, where dopamine neuron cell bodies reside. This work demonstrates command of homeostasis over dopamine signaling and proposes a circuit by which physiological need drives motivated behavior by state- and taste-selective recruitment of phasic dopamine signaling.

Pre-trial cocaine biases choice toward cocaine through suppression of the nondrug option

Being under the influence during choice between drug and nondrug options can have a dramatic effect on choice outcomes. When rats face a choice between cocaine and sweet water and are not under the influence, they prefer sweet water. In contrast, when they are under the influence of cocaine, this causes them to shift their choice to cocaine nearly exclusively. Here we sought to characterize the behavioral mechanisms underlying the influence of cocaine on choice. In theory, rats under the influence of cocaine should be in a mixed motivational state, at least temporarily, with both their motivation for cocaine and their motivation for the nondrug option suppressed by the drug satiating and anorexic effects of cocaine, respectively. For this mixed state to shift choice to cocaine, the satiated motivation for cocaine should recover before the suppressed motivation for the preferred nondrug option. The goal of the present study was to test this prediction in rats that expressed a preference for sweet water after extended access to cocaine self-administration. We measured their choice and response latencies to each option after pre-trial, passive administration of cocaine to estimate the duration of its drug satiating and anorexic effects. As expected, pre-trial cocaine caused most rats to shift their choice to cocaine. Though this shift was not simply due to a longer latency to respond for sweet water than for cocaine after pre-trial cocaine, it nevertheless occurred while rats' motivation for the nondrug option was still partially suppressed. Thus, cocaine seems to bias choice toward more cocaine mainly via suppression of the nondrug option.

Evaluation of reinforcing and aversive effects of voluntary Δ9-tetrahydrocannabinol ingestion in rats

Edible cannabis-infused products are an increasingly popular method of using cannabis in the United States. Yet, preclinical research to determine mechanisms underlying abuse of Δ⁹-tetrahydrocannabinol (THC), the primary psychoactive constituent of cannabis, has focused primarily on the effects of parenteral administration. The purpose of this study was to examine the rewarding and aversive effects of oral THC in a novel rodent voluntary ingestion model. Adult male and female Sprague Dawley rats were given access to sucrose-sweetened solutions during daily sessions. A range of THC concentrations, each paired with a unique flavor previously tested alone, was introduced into these solutions for four-session exposure periods and drinking volumes were measured. Injected (i.p.) THC doses were also paired with unique flavors to compare the effects of route of THC administration on drinking. Introduction of THC into sucrose solutions dose-dependently decreased drinking upon initial exposure, though drinking generally increased in subsequent sessions. By contrast, i.p. THC produced sustained dose-dependent decreases in drinking in rats of both sexes. Subsequent exposure to paired flavors in the absence of THC resulted in further decreases in drinking, suggesting route-specific aversion. Additional testing using saccharin-sweetened solutions in a two-bottle choice paradigm was also conducted, with THC producing sustained dose-dependent decreases in drinking after initial exposure in rats of both sexes. Though self-administration of ingested THC was not demonstrated, evidence of route-specific THC aversion was observed, which suggests that certain routes and/or rates of THC administration may mitigate some of its aversive effects.

Neuronal representation of individual heroin choices in the orbitofrontal cortex

Drug addiction is a harmful preference for drug use over and at the expense of other non-drug-related activities. We previously identified in the rat orbitofrontal cortex (OFC) a mechanism that influences individual preferences between cocaine use and an alternative action rewarded by a non-drug reward (i.e. sweet water). Here, we sought to test the generality of this mechanism to a different addictive drug, heroin. OFC neuronal activity was recorded while rats responded for heroin or the alternative non-drug reward separately or while they chose between the two. First, we found that heroin-rewarded and sweet water-rewarded actions were encoded by two non-overlapping OFC neuronal populations and that the relative size of the heroin population represented individual drug choices. Second, OFC neurons encoding the preferred action-which was the non-drug action in the large majority of individuals-progressively fired more than non-preferred action-coding neurons 1 second after the onset of choice trials and around 1 second before the preferred action was actually chosen, suggesting a pre-choice neuronal competition for action selection. Together with a previous study on cocaine choice, the present study on heroin choice reveals important commonalities in how OFC neurons encode individual drug choices and preferences across different classes of drugs. It also reveals some drug-specific differences in OFC encoding activity. Notably, the proportion of neurons that non-selectively encode both the drug and the non-drug reward was higher when the drug was heroin (present study) than when it was cocaine (previous study). We will discuss the potential functional significance of these commonalities and differences in OFC neuronal activity across different drugs for understanding drug choice.

Choice for Drug or Natural Reward Engages Largely Overlapping Neuronal Ensembles in the Infralimbic Prefrontal Cortex

Cue-reward associations form distinct memories that can drive appetitive behaviors and are involved in craving for both drugs and natural rewards. Distinct sets of neurons, so-called neuronal ensembles, in the infralimbic area (IL) of the medial prefrontal cortex (mPFC) play a key role in alcohol seeking. Whether this ensemble is specific for alcohol or controls reward seeking in general remains unclear. Here, we compared IL ensembles formed upon recall of drug (alcohol) or natural reward (saccharin) memories in male Wistar rats. Using an experimental framework that allows identification of two distinct reward-associated ensembles within the same animal, we found that cue-induced seeking of either alcohol or saccharin activated ensembles of similar size and organization, whereby these ensembles consist of largely overlapping neuronal populations. Thus, the IL seems to act as a general integration hub for reward seeking behavior, but also contains subsets of neurons that encode for the different rewards.SIGNIFICANCE STATEMENT Cue-reward associations form distinct memories that can act as drivers of appetitive behaviors and are involved in craving for natural rewards as well as for drugs. Distinct sets of neurons, so-called neuronal ensembles, in the infralimbic area of the mPFC play a key role in cue-triggered reward seeking. However, it is unclear whether these ensembles act as broadly tuned controllers of approach behavior or represent the learned associations between specific cues and rewards. Using an experimental framework that allows identification of two distinct reward-associated ensembles within the same animal we find largely overlapping neuronal populations. Repeated activation by two distinct events could reflect the linking of the two memory traces within the same neuron.

Drosophila: An Emergent Model for Delineating Interactions between the Circadian Clock and Drugs of Abuse

Endogenous circadian oscillators orchestrate rhythms at the cellular, physiological, and behavioral levels across species to coordinate activity, for example, sleep/wake cycles, metabolism, and learning and memory, with predictable environmental cycles. The 21st century has seen a dramatic rise in the incidence of circadian and sleep disorders with globalization, technological advances, and the use of personal electronics. The circadian clock modulates alcohol- and drug-induced behaviors with circadian misalignment contributing to increased substance use and abuse. Invertebrate models, such as Drosophila melanogaster, have proven invaluable for the identification of genetic and molecular mechanisms underlying highly conserved processes including the circadian clock, drug tolerance, and reward systems. In this review, we highlight the contributions of Drosophila as a model system for understanding the bidirectional interactions between the circadian system and the drugs of abuse, alcohol and cocaine, and illustrate the highly conserved nature of these interactions between Drosophila and mammalian systems. Research in Drosophila provides mechanistic insights into the corresponding behaviors in higher organisms and can be used as a guide for targeted inquiries in mammals.

Essential values of cocaine and non-drug alternatives predict the choice between them

This study investigated the relationship between reinforcer value and choice between cocaine and two non-drug alternative reinforcers in rats. The essential value (EV, a behavioral economic measure based on elasticity of demand) of intravenous cocaine and food (Experiment 1) or saccharin (Experiment 2) was determined in the first phase of each experiment. Food had higher EV than cocaine, whereas the EVs of cocaine and saccharin did not differ. In the second phase of each experiment, rats were allowed to make mutually exclusive choices between cocaine and the non-drug alternative reinforcer. The main findings were that the EV of cocaine was a positive predictor of cocaine preference and the EV of food or saccharin was a negative predictor of cocaine preference. An analysis of within-session patterns of choice behavior revealed sequential dependencies, whereby rats were more likely to choose cocaine on a particular trial after having chosen the non-drug alternative on previous trials. When the time between choices was increased, these sequential dependencies disappeared. The results of these experiments are consistent with the suggestion that addiction-like behavior involves both overvaluation of drug reinforcers and undervaluation of non-drug reinforcers.

Heroin and saccharin demand and preference in rats

BACKGROUND

Several recent studies have investigated the choice between heroin and a non-drug alternative reinforcer in rats. A common finding in these studies is that there are large individual differences in preference, with some rats preferring heroin and some preferring the non-drug alternative. The primary goal of the present study was to determine whether individual differences in how heroin or saccharin is valued, based on demand analysis, predicts choice.

METHODS

Rats lever-pressed for heroin infusions and saccharin reinforcers on fixed-ratio schedules. The essential value of each reinforcer was obtained from resulting demand curves. Rats were then trained on a mutually exclusive choice procedure where pressing one lever resulted in heroin and pressing another resulted in saccharin. After seven sessions of increased access to heroin or saccharin, rats were reexposed to the demand and choice procedures.

RESULTS

Demand for heroin was more elastic than demand for saccharin (i.e., heroin had lower essential value than saccharin). When allowed to choose, most rats preferred saccharin. The essential value of heroin, but not saccharin, predicted preference. The essential value of both heroin and saccharin increased following a week of increased access to heroin, but similar saccharin exposure had no effect on essential value. Preference was unchanged after increased access to either reinforcer.

CONCLUSION

Heroin-preferring rats differed from saccharin-preferring rats in how they valued heroin, but not saccharin. To the extent that choice models addiction-related behavior, these results suggest that overvaluation of opioids specifically, rather than undervaluation of non-drug alternatives, could identify susceptible individuals.

Modeling the development of drug addiction in male and female animals

An increasing emphasis has been placed on the development and use of animal models of addiction that capture defining features of human drug addiction, including escalation/binge drug use, enhanced motivation for the drug, preference for the drug over other reward options, use despite negative consequences, and enhanced drug-seeking/relapse vulnerability. The need to examine behavior in both males and females has also become apparent given evidence demonstrating that the addiction process occurs differently in males and females. This review discusses the procedures that are used to model features of addiction in animals, as well as factors that influence their development. Individual differences are also discussed, with a particular focus on sex differences. While no one procedure consistently produces all characteristics, different models have been developed to focus on certain characteristics. A history of escalating/binge patterns of use appears to be critical for producing other features characteristic of addiction, including an enhanced motivation for the drug, enhanced drug seeking, and use despite negative consequences. These characteristics tend to emerge over abstinence, and appear to increase rather than decrease in magnitude over time. In females, these characteristics develop sooner during abstinence and/or following less drug exposure as compared to males, and for psychostimulant addiction, may require estradiol. Although preference for the drug over other reward options has been demonstrated in non-human primates, it has been more difficult to establish in rats. Future research is needed to define the parameters that optimally induce each of these features of addiction in the majority of animals. Such models are essential for advancing our understanding of human drug addiction and its treatment in men and women.

Blaming the Brain for Obesity: Integration of Hedonic and Homeostatic Mechanisms

The brain plays a key role in the controls of energy intake and expenditure, and many genes associated with obesity are expressed in the central nervous system. Technological and conceptual advances in both basic and clinical neurosciences have expanded the traditional view of homeostatic regulation of body weight by mainly the hypothalamus to include hedonic controls of appetite by cortical and subcortical brain areas processing external sensory information, reward, cognition, and executive functions. Hedonic controls interact with homeostatic controls to regulate body weight in a flexible and adaptive manner that takes environmental conditions into account. This new conceptual framework has several important implications for the treatment of obesity. Because much of this interactive neural processing is outside awareness, cognitive restraint in a world of plenty is made difficult and prevention and treatment of obesity should be more rationally directed to the complex and often redundant mechanisms underlying this interaction.

Brain Stimulation Reward Supports More Consistent and Accurate Rodent Decision-Making than Food Reward

Animal models of decision-making rely on an animal's motivation to decide and its ability to detect differences among various alternatives. Food reinforcement, although commonly used, is associated with problematic confounds, especially satiety. Here, we examined the use of brain stimulation reward (BSR) as an alternative reinforcer in rodent models of decision-making and compared it with the effectiveness of sugar pellets. The discriminability of various BSR frequencies was compared to differing numbers of sugar pellets in separate free-choice tasks. We found that BSR was more discriminable and motivated greater task engagement and more consistent preference for the larger reward. We then investigated whether rats prefer BSR of varying frequencies over sugar pellets. We found that animals showed either a clear preference for sugar reward or no preference between reward modalities, depending on the frequency of the BSR alternative and the size of the sugar reward. Overall, these results suggest that BSR is an effective reinforcer in rodent decision-making tasks, removing food-related confounds and resulting in more accurate, consistent, and reliable metrics of choice.

Incubation of Methamphetamine but not Heroin Craving After Voluntary Abstinence in Male and Female Rats

We recently introduced an animal model of incubation of methamphetamine craving after choice-based voluntary abstinence in male rats. Here we studied the generality of this phenomenon to (1) female rats, and (2) male and female rats with a history of heroin self-administration. We first trained rats to self-administer palatable food pellets for 6 days (6 h per day) for either methamphetamine (0.1 mg/kg/infusion) or heroin (0.1 mg/kg/infusion) for 12 days (6 h/day). We then assessed relapse to drug seeking under extinction conditions after 1 and 21 abstinence days. Between tests, the rats underwent either voluntary abstinence (achieved via a discrete choice procedure between drug and palatable food; 20 trials/day) or home-cage forced abstinence. We found no sex differences in methamphetamine self-administration or in the strong preference for the palatable food over methamphetamine during the choice-based voluntary abstinence. In both sexes, methamphetamine seeking in the relapse tests was higher after 21 days of either voluntary or forced abstinence than after 1 day (incubation of methamphetamine craving). We also found no sex differences in heroin self-administration or the strong preference for the palatable food over heroin during the choice-based voluntary abstinence. However, male and female rats with a history of heroin self-administration showed incubation of heroin craving after forced but not voluntary abstinence. Our results show that incubation of methamphetamine craving after voluntary abstinence generalizes to female rats. Unexpectedly, prolonged voluntary abstinence prevented the emergence of incubation of heroin craving in both sexes.

The dual orexin receptor antagonist TCS1102 does not affect reinstatement of nicotine-seeking

The orexin/hypocretin system is important for appetitive motivation towards multiple drugs of abuse, including nicotine. Both OX1 and OX2 receptors individually have been shown to influence nicotine self-administration and reinstatement. Due to the increasing clinical use of dual orexin receptor antagonists in the treatment of disorders such as insomnia, we examined whether a dual orexin receptor antagonist may also be effective in reducing nicotine seeking. We tested the effect of intracerebroventricular (i.c.v.) administration of the potent and selective dual orexin receptor antagonist TCS1102 on orexin-A-induced food self-administration, nicotine self-administration and reinstatement of nicotine-seeking in rats. Our results show that 30 μg of TCS1102 i.c.v. abolishes orexin-A-induced increases in food self-administration but does not reduce nicotine self-administration. Neither i.c.v. 10 μg nor 30 μg of TCS1102 reduced compound reinstatement after short-term (15 days) self-administration nicotine, but 30 μg transiently reduced cue/nicotine compound reinstatement after chronic self-administration (29 days). These results indicate that TCS1102 has no substantial effect on motivation for nicotine seeking following chronic self-administration and no effect after shorter periods of intake. Orexin receptor antagonists may therefore have little clinical utility against nicotine addiction.

Rats quit nicotine for a sweet reward following an extensive history of nicotine use

Drug use may be exacerbated in environments which lack alternative means of engaging in rewarding behaviour. When alternative rewards are available, drug use may decrease-an effect that can be harnessed for therapeutic benefit. This idea is particularly well-supported by recent preclinical evidence demonstrating that a majority of rats will readily choose a potent non-drug reward over cocaine or heroin. Here we examine whether the same holds true for nicotine, a drug considered to have one of the highest addiction liabilities amongst drugs of abuse. Rats were trained to nose-poke separately for saccharin or nicotine on alternate days. Using a discrete-trial, forced-choice procedure, rats were then allowed to choose between nicotine and saccharin. This was followed by choice testing after a decrease in saccharin concentration (0.2-0%), omission of the fluid reward, an increase in nicotine concentration and following an extended nicotine self-administration history. All rats demonstrated a clear and immediate preference for saccharin at all times. This was despite variations in reward concentrations, or after an extensive nicotine history. Notably, rats preferred to nose-poke for water over nicotine and would omit responses when no fluid was delivered, rather than resume responding for nicotine. Overall, this study confirms and extends to nicotine previous research on other drugs of abuse, including cocaine and heroin. The ease with which rats quit nicotine in the present study contrasts with the well-known difficulty of humans to quit tobacco smoking. Possible factors that could explain this apparent discrepancy are discussed.

Choice between delayed food and immediate oxycodone in rats

RATIONALE

The choice to seek immediate drug effects instead of more meaningful but delayed rewards is a defining feature of addiction.

OBJECTIVES

To develop a rodent model of this behavior, we allowed rats to choose between immediate intravenous delivery of the prescription opioid oxycodone (50 μg/kg) and delayed delivery of palatable food pellets.

RESULTS

Rats preferred food at delays up to 30 s, but they chose oxycodone and food equally at 60-s delay and preferred oxycodone over food at 120-s delay. Comparison of food-drug choice, food-only, and drug-only conditions indicated that food availability decreased drug intake, but drug availability increased food intake. In the food-only condition, food was effective as a reinforcer even when delayed by 120 s. Pre-session feeding with chow slowed acquisition of food and drug self-administration, but did not affect choice. To establish procedures for testing potential anti-addiction medications, noncontingent pre-treatment with oxycodone or naltrexone (analogous to substitution and antagonist therapies, respectively) were tested on a baseline in which oxycodone was preferred over delayed food. Naltrexone pre-treatment decreased drug intake and increased food intake. Oxycodone pre-treatment decreased drug intake, but also produced extended periods with no food or drug responding.

CONCLUSIONS

These findings show that the contingencies that induce preference for drugs over more meaningful but less immediate rewards in humans can be modeled in rodents, and they suggest that the model could be useful for assessing the therapeutic potential of treatments and exploring the underlying behavioral and neural mechanisms involved in addiction.

Behavioral effects of Splenda, Equal and sucrose: Clues from planarians on sweeteners

Sweetened diets share commonalities with drugs of abuse, but studies comparing behavioral effects of different sweeteners are lacking. Common table sugar produces rewarding and withdrawal effects in planarians. We postulated that Splenda and Equal would produce similar responses and used a tetrad of behavioral assays to test this hypothesis. Acute exposure to a relatively high concentration (10%) of each sweetener produced stereotyped responses (C-shapes) and reduced motility, with Equal producing greater motor effects than sucrose or Splenda. In experiments testing for anxiogenic-like effects, planarians withdrawn from Splenda (1, 3%) or sucrose (1, 3%), but not Equal, and placed into a petri dish with dark and light compartments spent more time in the dark compared to water controls. In place conditioning experiments, both Splenda (0.01%) and sucrose (0.01%) produced an environmental preference shift. Maltodextrin (0.1%), a principal ingredient of Splenda and Equal, produced a significant preference shift. In contrast, sucralose, an indigestible polysaccharide contained in Splenda and Equal, was ineffective. Our data reveal that Splenda produces sucrose-like rewarding and withdrawal effects in planarians that may be dependent on maltodextrin and dextrose. The ineffectiveness of Equal may be due to the presence of aspartame, which is too water insoluble to test in our planarian assay, or to its bitter aftertaste that could mask any rewarding effects produce by maltodextrin or dextrose.