Pre-trial cocaine biases choice toward cocaine through suppression of the nondrug option

Time to choose: impact of intertrial interval on selecting between methamphetamine and food reinforcement in male and female rats

RATIONALE

A central component of substance use disorder is the maladaptive choice of the drug over natural reinforcers. Compared to other drugs of abuse, methamphetamine (METH) choice has received limited study.

OBJECTIVE

We sought to characterize the role of intertrial interval on METH choice behavior.

METHODS

We examined the choice of METH versus food, across multiple METH doses (0.05-0.2 mg/kg/infusion), between male and female rats, employing a fixed ratio (FR1) reinforcement schedule with intertrial intervals (ITIs) of 20 and 600 s. Rats learned to lever-press for either the METH or the food reinforcer during separate, alternating training sessions. Rats then underwent choice testing, where both levers were presented for 25 discreet trials per session. Lastly, under a progressive ratio (PR) schedule, breakpoints for METH and food were assessed during separate, alternating sessions.

RESULTS

METH choice was substantially higher when using the 20 s versus 600 s ITI. When the 20 s ITI was used, choice was dose- but not sex-dependent. When using the 600 s ITI, choice was influenced by dose and sex, with female rats in the higher dose group choosing METH more than other groups. PR breakpoints were higher for METH than for food, and this effect was more pronounced among female rats. METH choice was positively correlated with the ratio of METH/food breakpoints.

CONCLUSION

Reinforcement schedule parameters, namely ITI, during discrete choice testing can markedly influence METH choice behavior; thus, this should be carefully considered during experiment design and selected based on overarching study aims.

Cocaine falls into oblivion during volitional initiation of choice trials

When facing a choice, most animals quit drugs in favour of a variety of nondrug alternatives. We recently found, rather unexpectedly, that choice of the nondrug alternative is in fact inflexible and habitual. One possible contributing factor to habitual choice is the intermittency and uncontrollability of choice trials in previous studies. Here, we asked whether and to what extent volitional control over the occurrence of choice trials could change animals' preference by preventing habitual choice. To do so, rats were trained to nosepoke in a hole to trigger the presentation of two operant levers: one associated with cocaine, the other with saccharin. Rats were then free to choose among the two levers to obtain the corresponding reward, after which both levers retracted until rats self-initiated the next choice trial. Overall, we found that volitional control over choice trials did not change preference. Most rats preferred saccharin over cocaine and selected this option almost exclusively. Intriguingly, after repeated choice and consumption of saccharin, rats transiently lost interest in this option (i.e., due to sensory-specific satiety), but they did not switch to cocaine, preferring instead to pause during long periods of time before reinitiating a choice trial for saccharin. This finding suggests that during volitional initiation of a choice trial, rats fail to consider cocaine as an option. We discuss a possible associative mechanism to explain this perplexing behaviour.

Choosing between cocaine and sucrose under the influence: testing the effect of cocaine tolerance

RATIONALE

Cocaine use not only depends on the reinforcing properties of the drug, but also on its pharmacological effects on alternative nondrug activities. In animal models investigating choice between cocaine and alternative sweet rewards, the latter influence can have a dramatic impact on choice outcomes. When choosing under cocaine influence is prevented by imposing sufficiently long intervals between choice trials, animals typically prefer the sweet reward. However, when choosing under the drug influence is permitted, animals shift their preference in favor of cocaine.

OBJECTIVES

We previously hypothesized that this preference shift is mainly due to a direct suppression of responding for sweet reward by cocaine pharmacological effects. Here we tested this hypothesis by making rats tolerant to this drug-induced behavioral suppression.

RESULTS

Contrary to our expectation, tolerance did not prevent rats from shifting their preference to cocaine when choosing under the influence.

CONCLUSION

Thus, other mechanisms must be invoked to explain the influence of cocaine intoxication on choice outcomes.

New directions in modelling dysregulated reward seeking for food and drugs

Behavioral models are central to behavioral neuroscience. To study the neural mechanisms of maladaptive behaviors (including binge eating and drug addiction), it is essential to develop and utilize appropriate animal models that specifically focus on dysregulated reward seeking. Both food and cocaine are typically consumed in a regulated manner by rodents, motivated by reward and homeostatic mechanisms. However, both food and cocaine seeking can become dysregulated, resulting in binge-like consumption and compulsive patterns of intake. The speakers in this symposium for the 2021 International Behavioral Neuroscience Meeting utilize behavioral models of dysregulated reward-seeking to investigate the neural mechanisms of binge-like consumption, enhanced cue-driven reward seeking, excessive motivation, and continued use despite negative consequences. In this review, we outline examples of maladaptive patterns of intake and explore recent animal models that drive behavior to become dysregulated, including stress exposure and intermittent access to rewards. Lastly, we explore select behavioral and neural mechanisms underlying dysregulated reward-seeking for both food and drugs.

Individual differences in addiction-like behaviors and choice between cocaine versus food in Heterogeneous Stock rats

RATIONALE AND OBJECTIVES

Recent studies reported that when given a mutually exclusive choice between cocaine and palatable food, most rats prefer the non-drug reward over cocaine. However, these studies used rat strains with limited genetic and behavioral diversity. Here, we used a unique outbred strain of rats (Heterogeneous Stock, HS) that mimic the genetic variability of humans.

METHODS

We first identified individual differences in addiction-like behaviors (low and high). Next, we tested choice between cocaine and palatable food using a discrete choice procedure. We characterized the individual differences using an addiction score that incorporates key features of addiction: escalated intake, highly motivated responding (progressive ratio), and responding despite adverse consequences (footshock punishment). We assessed food versus cocaine choice at different drug-free days (without pre-choice cocaine self-administration) during acquisition of cocaine self-administration or after escalation of cocaine self-administration. We also assessed drug versus food choice immediately after 1-, 2-, or 6-h cocaine self-administration.

RESULTS

Independent of the addiction score, without pre-choice cocaine (1 or more abstinence days), HS rats strongly preferred the palatable food over cocaine, even if the food reward was delayed or its size was reduced. However, rats with high but not low addiction score modestly increased cocaine choice immediately after 1-, 2-, or 6-h cocaine self-administration.

CONCLUSIONS

Like other strains, HS rats strongly prefer palatable food over cocaine. Individual differences in addiction score were associated with increased drug choice in the presence but not absence (abstinence) of cocaine. The HS strain may be useful in studies on mechanisms of addiction vulnerability.

Opioid withdrawal produces sex-specific effects on fentanyl-vs.-food choice and mesolimbic transcription

BACKGROUND

Opioid withdrawal is a key driver of opioid addiction and an obstacle to recovery. However, withdrawal effects on opioid reinforcement and mesolimbic neuroadaptation are understudied and the role of sex is largely unknown.

METHODS

Male (n=13) and female (n=12) rats responded under a fentanyl-vs.-food "choice" procedure during daily 2h sessions. In addition to the daily choice sessions, rats were provided extended access to fentanyl during 12h self-administration sessions. After two weeks of this self-administration regimen, the nucleus accumbens (NAc) and ventral tegmental area (VTA) of a subset of rats were subjected to RNA sequencing. In the remaining rats, a third week of this self-administration regimen was conducted, during which methadone effects on fentanyl-vs.-food choice were determined.

RESULTS

Prior to opioid dependence, male and female rats similarly allocated responding between fentanyl and food. Abstinence from extended fentanyl access elicited similar increases in somatic withdrawal signs in both sexes. Despite similar withdrawal signs and extended access fentanyl intake, opioid withdrawal was accompanied by a maladaptive increase in fentanyl choice in males, but not females. Behavioral sex differences corresponded with a greater number of differentially expressed genes in the NAc and VTA of opioid-withdrawn females relative to males. Methadone blocked withdrawal-associated increases in fentanyl choice in males, but failed to further decrease fentanyl choice in females.

CONCLUSIONS

These results provide foundational evidence of sex-specific neuroadaptations to opioid withdrawal, which may be relevant to the female-specific resilience to withdrawal-associated increases in opioid choice and aid in the identification of novel therapeutic targets.

Probing the decision-making mechanisms underlying choice between drug and nondrug rewards in rats

Delineating the decision-making mechanisms underlying choice between drug and nondrug rewards remains a challenge. This study adopts an original approach to probe these mechanisms by comparing response latencies during sampling versus choice trials. While lengthening of latencies during choice is predicted in a deliberative choice model (DCM), the race-like response competition mechanism postulated by the Sequential choice model (SCM) predicts a shortening of latencies during choice compared to sampling. Here, we tested these predictions by conducting a retrospective analysis of cocaine-versus-saccharin choice experiments conducted in our laboratory. We found that rats engage deliberative decision-making mechanisms after limited training, but adopt a SCM-like response selection mechanism after more extended training, while their behavior is presumably habitual. Thus, the DCM and SCM may not be general models of choice, as initially formulated, but could be dynamically engaged to control choice behavior across early and extended training.

A drug-vs-food "choice" self-administration procedure in rats to investigate pharmacological and environmental mechanisms of substance use disorders

BACKGROUND

Preclinical drug self-administration procedures are commonly used to investigate expression, mechanisms, and treatment of substance use disorders.

NEW METHOD

The aims were to back-translate an intravenous drug-vs-food choice procedure primarily utilized in monkeys to male and female rats and to develop a surgical method for sustained intravenous catheter patency suitable for long-term drug-choice studies.

RESULTS

The surgical protocol resulted in a median intravenous jugular catheter patency in male and female rats of 126 days (range: 25-365 days). Drug-vs-food choice was established with opioids (fentanyl and heroin), psychostimulants (cocaine, methamphetamine, and amphetamine), and an opioid/psychostimulant mixture (fentanyl + methamphetamine). The average time from catheter implantation to stable choice behavior across all drugs was 27 sessions (range: 16-44 sessions). Choice behavior stabilized more quickly for cocaine and fentanyl than for other drugs. Manipulations of both environmental variables (e.g., response requirement or food reinforcer magnitude) and pharmacological variables (e.g., extended access drug self-administration or continuous buprenorphine treatment via osmotic pump) significantly shifted opioid-vs-food choice consistent with previous monkey studies.

COMPARISON WITH EXISTING METHODS

Duration of intravenous catheter patency in rats was suitable for long-term, within-subject drug choice studies. Effects of environmental and pharmacological manipulations in rats confirmed and extended previous results from monkeys.

CONCLUSIONS

The concordance of behavioral results between rats and monkeys using the present drug-vs-food choice procedure supports its utility to improve our basic understanding of the expression and mechanisms of substance use disorders towards to development of more effective therapeutics.

Associative processes in addiction relapse models: A review of their Pavlovian and instrumental mechanisms, history, and terminology

Animal models of relapse to drug-seeking have borrowed heavily from associative learning approaches. In studies of relapse-like behaviour, animals learn to self-administer drugs then receive a period of extinction during which they learn to inhibit the operant response. Several triggers can produce a recovery of responding which form the basis of a variety of models. These include the passage of time (spontaneous recovery), drug availability (rapid reacquisition), extinction of an alternative response (resurgence), context change (renewal), drug priming, stress, and cues (reinstatement). In most cases, the behavioural processes driving extinction and recovery in operant drug self-administration studies are similar to those in the Pavlovian and behavioural literature, such as context effects. However, reinstatement in addiction studies have several differences with Pavlovian reinstatement, which have emerged over several decades, in experimental procedures, associative mechanisms, and terminology. Interestingly, in cue-induced reinstatement, drug-paired cues that are present during acquisition are omitted during lever extinction. The unextinguished drug-paired cue may limit the model’s translational relevance to cue exposure therapy and renders its underlying associative mechanisms ambiguous. We review major behavioural theories that explain recovery phenomena, with a particular focus on cue-induced reinstatement because it is a widely used model in addiction. We argue that cue-induced reinstatement may be explained by a combination of behavioural processes, including reacquisition of conditioned reinforcement and Pavlovian to Instrumental Transfer. While there are important differences between addiction studies and the behavioural literature in terminology and procedures, it is clear that understanding associative learning processes is essential for studying relapse.

A Circuit-Based Information Approach to Substance Abuse Research

Recent animal research on substance-use disorders (SUDs) has emphasized learning models and the identification of 'addiction-prone' animals. Meanwhile, basic neuroscientific research has elucidated molecular, cellular, and circuit functions with increasing sophistication. However, SUD-related research is hampered by continued arguments over which animal models are more 'addiction like', as well as the facile assignment of behaviors to a given brain region and vice versa. We argue that SUD-related research would benefit from a 'bottom-up' approach including: (i) the characterization of different brain circuits to understand their normal function as well as how they respond to drugs and contribute to SUDs; and (ii) a focus on the use patterns and neurobiological effects of different substances to understand the range of critical SUD-related in vivo phenotypes.

Pharmacokinetics trumps pharmacodynamics during cocaine choice: a reconciliation with the dopamine hypothesis of addiction

Cocaine is known to increase brain dopamine at supranormal levels in comparison to alternative nondrug rewards. According to the dopamine hypothesis of addiction, this abnormally large dopamine response would explain why cocaine use is initially highly rewarding and addictive. Though resting on solid neuroscientific foundations, this hypothesis has nevertheless proven difficult to reconcile with research on cocaine choice in experimental animals. When facing a choice between an intravenous bolus of cocaine and a nondrug alternative (e.g., sweet water), both delivered immediately after choice, rats do not choose the drug, as would be predicted, but instead develop a strong preference for the nondrug alternative. Here we report evidence that reconciles this finding with the dopamine hypothesis of addiction. First, a systematic literature analysis revealed that the delays of effects of intravenous cocaine on nucleus accumbens dopamine are of the order of tens of seconds and are considerably longer than those of nondrug reward. Second, this was confirmed by measuring response times to cocaine omission during self-administration as a behavioral proxy of these delays. Finally, when the influence of the drug delays was reduced during choice by adding an increasing delay to both the drug and nondrug rewards, rats shifted their choice to cocaine. Overall, this study suggests that cocaine is indeed supranormal in reward magnitude, as postulated by the dopamine hypothesis of addiction, but is less preferred during choice because its pharmacokinetics makes it an inherently more delayed reward than the alternative. Reframing previous drug choice studies in rats as intertemporal choice studies reveals that the discounting effects of delays spare no rewards, including supranormal ones, and that during choice, pharmacokinetics trumps pharmacodynamics.

Relative expected value of drugs versus competing rewards underpins vulnerability to and recovery from addiction

Behavioural economic theories of addiction contend that greater expected value of drug relative to alternative non-drug rewards is the core mechanism underpinning vulnerability to and recovery from addiction. To evaluate this claim, we exhaustively review studies with human drug users that have measured concurrent choice between drugs vs. alternative rewards, and explored individual differences. These studies show that drug choice can be modulated by drug cues, drug devaluation, imposition of costs/punishment and negative mood induction. Regarding individual differences, dependence severity was reliably associated with overall drug preference, and self-reported drug use to cope with negative affect was reliably associated with greater sensitivity to mood induced increases in drug choice. By contrast, there were no reliable individual differences in sensitivity to the effect of drug cues, drug devaluation or punishment on drug choice. These findings provide insight into the mechanisms that underpin vulnerability to dependence: vulnerability is conferred by greater relative value ascribed to drugs, and relative drug value is further augmented by negative affective states in those who report drug use coping motives. However, dependence does not appear to be characterised by abnormal cue-reactivity, habit learning or compulsion. We then briefly review emerging literature which demonstrates that therapeutic interventions and recovery from addiction might be attributed to changes in the expected relative value of drug versus alternative rewards. Finally, we outline a speculative computational account of the distortions in decision-making that precede action selection in addiction, and we explain how this account provides a blueprint for future research on the determinants of drug choice, and mechanisms of treatment and recovery from addiction. We conclude that a unified economic decision-making account of addiction has great promise in reconciling diverse addiction theories, and neuropsychological evaluation of the underlying decision mechanisms is a fruitful area for future research and treatment.

Reorganization of theta phase-locking in the orbitofrontal cortex drives cocaine choice under the influence

Cortical theta oscillations of neuronal activity are a fundamental mechanism driving goal-directed behavior. We previously identified in the rat orbitofrontal cortex (OFC) a neuronal correlate of individual preferences between cocaine use and an alternative nondrug reward (i.e. saccharin). Whether theta oscillations are also associated with choice behavior between a drug and a nondrug reward remains unknown. Here we investigated the temporal structure between single unit activity and theta band oscillations (4-12 Hz) in the OFC of rats choosing between cocaine and saccharin. First, we found that the relative amplitude of theta oscillations is associated with subjective value and preference between two rewards. Second, OFC phase-locked neurons fired on opposite phase of the theta oscillation during saccharin and cocaine rewards, suggesting the existence of two separable neuronal assemblies. Finally, the pharmacological influence of cocaine at the moment of choice altered both theta band power and theta phase-locking in the OFC. That is, this drug influence shifted spike-phase relative to theta cycle and decreased the synchronization of OFC neurons relative to the theta oscillation. Overall, this study indicates that the reorganization of theta phase-locking under the influence of cocaine biases OFC neuronal assemblies in favor of cocaine choice and at the expense of a normally preferred alternative, a neuronal change that may contribute to drug preference in cocaine addiction.

Sex differences in opioid reinforcement under a fentanyl vs. food choice procedure in rats

Clinical evidence suggest that men are more sensitive than women to the abuse-related effects of mu-opioid agonists. In contrast, preclinical studies suggest the opposite sex difference. The aim of the present study was to clarify this discrepancy using a fentanyl vs. diluted Ensure^® choice procedure to assess sex differences in opioid reinforcement. Sex differences in intravenous (IV) fentanyl self-administration were examined under a fixed-ratio (FR5) schedule, a multi-day progressive-ratio (PR) schedule for behavioral economic analysis, and a concurrent (choice) schedule of fentanyl and diluted Ensure^® reinforcement in Sprague-Dawley male and female rats. The fentanyl dose-effect function under the FR5 schedule was significantly shifted upward in females compared to males. Similarly, the reinforcing effectiveness of both fentanyl (3.2 and 10 µg/kg per injection, IV) and diluted Ensure^® (18 and 56%) were greater in females than in males as assessed using behavioral economic analysis, irrespective of dose or concentration. However, under a fentanyl vs. foodchoice procedure, males chose 3.2 µg/kg per injection fentanyl injections over 18%, but not 56%, diluted Ensure^® at a higher percentage compared to females. Overall, these results suggest that the expression of sex differences in opioid reinforcement depends upon the schedule of reinforcement and that preclinical opioid vs. food choice procedures provide a translationally relevant measure (i.e., behavioral allocation) consistent with the direction of sex differences reported in the clinical literature.

Cocaine-associated decision-making: Toward isolating preference

Ever-increasing evidence suggests that substance use disorder is mediated by decision-making processes, and as such, providing nondrug alternatives can shift maladaptive preferences away from drug reinforcers, such as cocaine. Of note, a recent hypothesis suggests that preference for cocaine is simply a byproduct of cocaine intake, such that the 'direct' effects of cocaine weaken the impact of non-drug alternatives while measuring choice. Conversely, existing quantitative theories of decision-making suggest preference is determined by various dimensions of concurrent reinforcers that in turn determine the relative value of available alternatives. Toward teasing apart the conflicting theories above, we developed a novel drug-choice procedure to control for reinforcer frequency and magnitude (two reinforcer dimensions well known to influence preference) that consequently controls for overall cocaine intake. As predicted by quantitative choice theory, results suggest that cocaine intake and preference are dissociable while measuring choice, with reinforcer frequency and magnitude having independent influence on the relative value of choice alternatives. Furthermore, we demonstrate that the choice procedure is sensitive to various manipulations known to alter cocaine reinforcement, all while keeping cocaine intake constant. Finally, the results point to the process of economic substitution as an important avenue of future neurobehavioral investigation toward the improvement of behavioral and pharmacological therapies for substance use disorders. Overall, the proposed choice procedure will allow for improved isolation of the neurobehavioral processes that mediate drug-associated decision-making in future studies.

Food addiction: a valid concept?

Can food be addictive? What does it mean to be a food addict? Do common underlying neurobiological mechanisms contribute to drug and food addiction? These vexing questions have been the subject of considerable interest and debate in recent years, driven in large part by the major health concerns associated with dramatically increasing body weights and rates of obesity in the United States, Europe, and other regions with developed economies. No clear consensus has yet emerged on the validity of the concept of food addiction and whether some individuals who struggle to control their food intake can be considered food addicts. Some, including Fletcher, have argued that the concept of food addiction is unsupported, as many of the defining features of drug addiction are not seen in the context of feeding behaviors. Others, Kenny included, have argued that food and drug addiction share similar features that may reflect common underlying neural mechanisms. Here, Fletcher and Kenny argue the merits of these opposing positions on the concept of food addiction.