Repeated intermittent administration of psychomotor stimulant drugs alters the acquisition of Pavlovian approach behavior in rats: differential effects of cocaine, d-amphetamine and 3,4- methylenedioxymethamphetamine ("Ecstasy")

Repeated chemogenetic activation of dopaminergic neurons induces reversible changes in baseline and amphetamine-induced behaviors

RATIONALE

Repeated chemogenetic stimulation is often employed to study circuit function and behavior. Chronic or repeated agonist administration can result in homeostatic changes, but this has not been extensively studied with designer receptors exclusively activated by designer drugs (DREADDs).

OBJECTIVES

We sought to evaluate the impact of repeated DREADD activation of dopaminergic (DA) neurons on basal behavior, amphetamine response, and spike firing. We hypothesized that repeated DREADD activation would mimic compensatory effects that we observed with genetic manipulations of DA neurons.

METHODS

Excitatory hM3D(Gq) DREADDs were virally expressed in adult TH-Cre and WT mice. In a longitudinal design, clozapine N-oxide (CNO, 1.0 mg/kg) was administered repeatedly. We evaluated basal and CNO- or amphetamine (AMPH)-induced locomotion and stereotypy. DA neuronal activity was assessed using in vivo single-unit recordings.

RESULTS

Acute CNO administration increased locomotion, but basal locomotion decreased after repeated CNO exposure in TH-CrehM3Dq mice relative to littermate controls. Further, after repeated CNO administration, AMPH-induced hyperlocomotion and stereotypy were diminished in TH-CrehM3Dq mice relative to controls. Repeated CNO administration reduced DA neuronal firing in TH-CrehM3Dq mice relative to controls. A two-month CNO washout period rescued the decreases in basal locomotion and AMPH response.

CONCLUSIONS

We found that repeated DREADD activation of DA neurons evokes homeostatic changes that should be factored into the interpretation of chronic DREADD applications and their impact on circuit function and behavior. These effects are likely to also be seen in other neuronal systems and underscore the importance of studying neuroadaptive changes with chronic or repeated DREADD activation.

Persistence of Operant Responding for Food After Prior Cocaine Exposure in Fischer 344 But Not Lewis Rats

BACKGROUND AND OBJECTIVES

Chronic cocaine exposure has differential neural effects in Fischer 344 (F344) vs Lewis inbred rats that may explain strain-dependent differences during acquisition vs maintenance of cocaine self-administration. We assessed whether prior cocaine exposure alters operant responding for food across various phases (acquisition, maintenance, extinction, spontaneous recovery, reinitiation) in these strains.

METHODS

Lewis and F344 rats (N = 12) were administered three cocaine (15 mg/kg) or saline injections at hourly intervals for 3 consecutive days. Beginning the next day for 24 days, rats had access to operant chambers in which one lever depression resulted in the delivery of a food pellet. Then, four extinction sessions were conducted in which food was no longer available, but other stimulus conditions remained the same. After a 2-day break, spontaneous recovery was assessed over four sessions. Food delivery was then restored for 3 days to test reinitiation followed by a progressive ratio session.

RESULTS

Lewis rats acquired the operant faster than F344 rats. F344 rats showed lower maintenance rates than Lewis rats but higher spontaneous recovery responding. Cocaine exposure caused persistence of responding during extinction in F344 but not Lewis rats. All groups reinitiated responding when food was available again and did not differ in final ratios completed under the progressive ratio schedule.

DISCUSSION AND CONCLUSIONS

That prior cocaine exposure led to persistence of responding in F344 rats during extinction may reflect heightened contextual conditioning that interferes with the ability to extinguish responding.

SCIENTIFIC SIGNIFICANCE

Results have implications for the genetic contribution to relapse-like behaviors. (Am J Addict 2021;00:00-00).

What is reinforcement sensitivity? Neuroscience paradigms for approach‐avoidance process theories of personality

Reinforcement sensitivity is a concept proposed by Gray (1973) to describe the biological antecedents of personality, and has become the common mechanism among a family of personality theories concerning approach and avoidance processes. These theories suggest that 2–3 biobehavioural systems mediate the effects of reward and punishment on emotion and motivation, and that individual differences in the functioning of these systems manifest as personality. Identifying paradigms for operationalising reinforcement sensitivity is therefore critical for testing and developing these theories, and evaluating their footprint in personality space. In this paper I suggest that, while traditional self‐report paradigms in personality psychology may be less‐than‐ideal for this purpose, neuroscience paradigms may offer operations of reinforcement sensitivity at multiple levels of approach and avoidance processes. After brief reflection on the use of such methods in animal models—which first spawned the concept of reinforcement sensitivity—recent developments in four domains of neuroscience are reviewed. These are psychogenomics, psychopharmacology, neuroimaging and category‐learning. By exploring these paradigms as potential operations of reinforcement sensitivity we may enrich our understanding of the putative biobehavioural bases of personality. Copyright © 2008 John Wiley & Sons, Ltd.

The presence of a social stimulus reduces cocaine-seeking in a place preference conditioning paradigm

BACKGROUND

One challenge in the treatment of substance use disorders is to re-engage the interest toward non-drug-related activities. Among these activities, social interaction has had a prominent role due to its positive influence on treatment outcome.

AIMS AND METHODS

Our aim was to study whether the presence of a social stimulus during the cocaine-induced conditioned place preference test was able to reduce the time spent in the drug-paired compartment. For that purpose, mice were trained for four days on a conditioned place preference task with one compartment paired with cocaine and the opposite with saline. On the test day, we introduced an unfamiliar juvenile male mouse into the saline-conditioned compartment (inside a pencil cup) to analyse the animal preference towards the two rewarding stimuli (cocaine vs mouse). Additionally, to discard the possible effect of novelty, as well as the housing condition (social isolation) on social preference, we decided to include a novel object during the test session, as well as perform the same conditioned place preference protocol with a group of animals in social housing conditions.

RESULTS

The social stimulus was able to reduce the preference for cocaine and enhance the active interaction with the juvenile mouse (sniffing) compared to the empty pencil cup paired with the drug. The introduction of a novel object during the test session did not reduce the preference for the cocaine-paired compartment, and interestingly, the preference for the social stimulus was independent of the housing condition. c-Fos immunohistochemistry revealed a different pattern of activation based on cocaine-paired conditioning or the presence of social stimulus.

CONCLUSIONS

These results suggest that social interaction could constitute a valuable component in the treatment of substance use disorders by reducing the salience of the drug.

Repeated cocaine exposure dysregulates cognitive control over cue-evoked reward-seeking behavior during Pavlovian-to-instrumental transfer

Drug-paired cues acquire powerful motivational properties, but only lead to active drug-seeking behavior if they are potent enough to overwhelm the cognitive control processes that serve to suppress such urges. Studies using the Pavlovian-to-instrumental transfer (PIT) task have shown that rats pretreated with cocaine or amphetamine exhibit heightened levels of cue-motivated food-seeking behavior, suggesting that exposure to these drugs sensitizes the incentive motivational system. However, the PIT testing protocol can also create conflict between two competing behavioral responses to the reward-paired cue: active reward seeking (e.g., lever pressing) and passive conditioned food-cup approach behavior. We therefore investigated whether repeated cocaine exposure alters the way in which rats use cue-based reward expectations to resolve such conflict. In-depth analysis of previously published and new research confirmed that when drug-naïve rats are given a cue that signals the timing of a delayed noncontingent reward, they adaptively transition from reward seeking to conditioned approach behavior, facilitating efficient collection of the predicted reward. In contrast, cocaine-exposed rats exhibit pronounced behavioral dysregulation, increasing, rather than suppressing, their reward-seeking behavior over time, disrupting their ability to passively collect reward. Such findings speak to the important and sometimes overlooked role that cognitive control plays in determining the motivational impact of cues associated with drug and nondrug rewards.

Animal models of drug addiction: Where do we go from here?

Compulsion and impulsivity are both primary features of drug addiction. Based on decades of animal research, we have a detailed understanding of the factors (both environmental and physiological) that influence compulsive drug use, but still know relatively little about the impulsive aspects of drug addiction. This review outlines our current knowledge of the relationship between impulsivity and drug addiction, focusing on cognitive and motor impulsivity, which are particularly relevant to this disorder. Topics to be discussed include the influence of chronic drug administration on impulsivity, the mechanisms that may explain drug-induced impulsivity, and the role of individual differences in the development of impulsive drug use. In addition, the manner in which contemporary theories of drug addiction conceptualize the relationship between impulsivity and compulsion is examined. Most importantly, this review emphasizes a critical role for animal research in understanding the role of impulsivity in the development and maintenance of drug addiction.

Sex differences in addiction

Women exhibit more rapid escalation from casual drug taking to addiction, exhibit a greater withdrawal response with abstinence, and tend to exhibit greater vulnerability than men in terms of treatment outcome. In rodents, short-term estradiol intake in female rats enhances acquisition and escalation of drug taking, motivation for drugs of abuse, and relapse-like behaviors. There is also a sex difference in the dopamine response in the nucleus accumbens. Ovariectomized female rats exhibit a smaller initial dopamine increase after cocaine treatment than castrated males. Estradiol treatment of ovariectomized female rats enhances stimulated dopamine release in the dorsolateral striatum, but not in the nucleus accumbens, resulting in a sex difference in the balance between these two dopaminergic projections. In the situation where drug-taking behavior becomes habitual, dopamine release has been reported to be enhanced in the dorsolateral striatum and attenuated in the nucleus accumbens. The sex difference in the balance between these neural systems is proposed to underlie sex differences in addiction.

Interaction of chronic food restriction and methylphenidate in sensation seeking of rats

RATIONALE

It is necessary to understand better how chronic food restriction (CFR) and psychostimulant drugs interact in motivated behavior unrelated to food or energy homeostasis.

OBJECTIVES

We examined whether CFR augments methylphenidate (MPH)-potentiated responding reinforced by visual sensation (VS) and whether repeated MPH injections or prolonged CFR further augments such responses.

METHODS

Before starting the following experiments, rats on a CFR diet received a limited daily ration in such a way that their body weights decreased to 85-90% of their original weights over 2 weeks. In experiment 1, rats on CFR and ad libitum diet received four injections of varying MPH doses (0, 2.5, 5, and 10 mg/kg). In experiment 2, CFR and ad libitum groups received repeated injections of MPH (2.5 mg/kg). In experiment 3, half of CFR rats received repeated injections of MPH (2.5 mg/kg), and the other half received saline, and following a 7-day abstinence, they all received the 2.5-mg/kg dose of MPH.

RESULTS

CFR rats increased VS-reinforced responding more than ad libitum rats when they received MPH. Repeated injections of MPH with prolonged CFR further increased VS-reinforced responding. We found a double dissociation where prolonged CFR (3 vs. 6 weeks) made VS-reinforced responding, but not locomotor activity, more responsive to MPH, whereas repeated MPH injections made locomotor activity, but not VS-reinforced responding, more responsive to MPH.

CONCLUSIONS

CFR markedly potentiates effects of MPH on VS-reinforced responding. The present study demonstrates that the longer CFR continues, the greater psychostimulant drugs augment behavioral interaction with salient stimuli.

Nicotine Acutely Enhances Reinforcement from Non-Drug Rewards in Humans

Preclinical research documents that, aside from the primary and secondary reinforcing effects of nicotine intake itself, nicotine also acutely enhances the reinforcing efficacy of non-drug reinforcers ("rewards"). Study of these effects in humans has largely been overlooked, but very recent findings suggest they may have clinical implications for more fully understanding the persistence of tobacco dependence. This overview first outlines the topic and notes some recent human studies indirectly addressing nicotine effects on related responses (e.g., subjective ratings), explaining why those findings do not directly confirm enhancement of behavioral reinforcement per se due to nicotine. Then, the methodology used in the subsequently presented studies is described, demonstrating how those studies specifically did demonstrate enhancement of reinforced responding for non-drug rewards. The main section focuses on the limited controlled research to date directly assessing nicotine's acute reinforcement-enhancing effects in humans, particularly as it relates to reinforced behavioral responding for non-drug rewards in non-human animal models. After detailing those few existing human studies, we address potential consequences of these effects for dependence and tobacco cessation efforts and then suggest directions for future research. This research indicates that nicotine per se increases responding in humans that is reinforced by some rewards (auditory stimuli via music, visual stimuli via video), but perhaps not by others (e.g., money). These reinforcement-enhancing effects in smokers are not due to dependence or withdrawal relief and can be restored by a small amount of nicotine (similar to a smoking lapse), including from e-cigarettes, a non-tobacco nicotine product. Future clinical research should examine factors determining which types of rewards are (or are not) enhanced by nicotine, consequences of the loss of these nicotine effects after quitting smoking, potential individual differences in these effects, and the possibility that nicotine via nicotine replacement therapy and non-nicotine quit medications may attenuate loss of these effects upon quitting. Further study with humans of nicotine's reinforcement-enhancing effects may provide a more complete understanding of smoking persistence and added mechanisms of cessation medication efficacy.

Stable immediate early gene expression patterns in medial prefrontal cortex and striatum after long-term cocaine self-administration

The transition from casual to compulsive drug use is thought to occur as a consequence of repeated drug taking leading to neuroadaptive changes in brain circuitry involved in emotion and cognition. At the basis of such neuroadaptations lie changes in the expression of immediate early genes (IEGs) implicated in transcriptional regulation, synaptic plasticity and intracellular signalling. However, little is known about how IEG expression patterns change during long-term drug self-administration. The present study, therefore, compares the effects of 10 and 60-day self-administration of cocaine and sucrose on the expression of 17 IEGs in brain regions implicated in addictive behaviour, i.e. dorsal striatum, ventral striatum and medial prefrontal cortex (mPFC). Increased expression after cocaine self-administration was found for 6 IEGs in dorsal and ventral striatum (c-fos, Mkp1, Fosb/ΔFosb, Egr2, Egr4, and Arc) and 10 IEGs in mPFC (same 6 IEGs as in striatum, plus Bdnf, Homer1, Sgk1 and Rgs2). Five of these 10 IEGs (Egr2, Fosb/ΔFosb, Bdnf, Homer1 and Jun) and Trkb in mPFC were responsive to long-term sucrose self-administration. Importantly, no major differences were found between IEG expression patterns after 10 or 60 days of cocaine self-administration, except Fosb/ΔFosb in dorsal striatum and Egr2 in mPFC, whereas the amount of cocaine obtained per session was comparable for short-term and long-term self-administration. These steady changes in IEG expression are, therefore, associated with stable self-administration behaviour rather than the total amount of cocaine consumed. Thus, sustained impulses to IEG regulation during prolonged cocaine self-administration may evoke neuroplastic changes underlying compulsive drug use.

Thinking Outside the Box: Orbitofrontal Cortex, Imagination, and How We Can Treat Addiction

Addiction involves an inability to control drug-seeking behavior. While this may be thought of as secondary to an overwhelming desire for drugs, it could equally well reflect a failure of the brain mechanisms that allow addicts to learn about and mentally simulate non-drug consequences. Importantly, this process of mental simulation draws upon, but is not normally bound by, our past experiences. Rather we have the ability to think outside the box of our past, integrating knowledge gained from a variety of similar and not-so-similar life experiences to derive estimates or imagine what might happen next. These estimates influence our current behavior directly and also affect future behavior by serving as the background against which outcomes are evaluated to support learning. Here we will review evidence, from our own work using a Pavlovian over-expectation task as well as from other sources, that the orbitofrontal cortex is a critical node in the neural circuit that generates these estimates. Further we will offer the specific hypothesis that degradation of this function secondary to drug-induced changes is a critical and likely addressable part of addiction.

Nucleus accumbens core dopamine signaling tracks the need-based motivational value of food-paired cues

Environmental reward-predictive stimuli provide a major source of motivation for instrumental reward-seeking activity and this has been linked to dopamine signaling in the nucleus accumbens (NAc) core. This cue-induced incentive motivation can be quite general, not restricted to instrumental actions that earn the same unique reward, and is also typically regulated by one's current need state, such that cues only motivate actions when this is adaptive. But it remains unknown whether cue-evoked dopamine signaling is similarly regulated by need state. Here, we used fast-scan cyclic voltammetry to monitor dopamine concentration changes in the NAc core of rats during a Pavlovian-to-instrumental transfer task in which the motivating influence of two cues, each signaling a distinct food reward (sucrose or food pellets), over an action earning a third unique food reward (polycose) was assessed in a state of hunger and of satiety. Both cues elicited a robust NAc dopamine response when hungry. The magnitude of the sucrose cue-evoked dopamine response correlated with the Pavlovian-to-instrumental transfer effect that was selectively induced by this stimulus. Satiety attenuated these cue-evoked dopamine responses and behavioral responding, even though rats had never experienced the specific food rewards in this state. These data demonstrate that cue-evoked NAc core responses are sensitive to current need state, one critical variable that determines the current adaptive utility of cue-motivated behavior. Food-predictive stimuli motivate food-seeking behavior. Here, we show that food cues evoke a robust nucleus accumbens core dopamine response when hungry that correlates with the cue's ability to invigorate general food seeking. This response is attenuated when sated, demonstrating that food cue-evoked accumbens dopamine responses are sensitive to the need state information that determines the current adaptive utility of cue-motivated action.

Dopamine Prediction Errors in Reward Learning and Addiction: From Theory to Neural Circuitry

Midbrain dopamine (DA) neurons are proposed to signal reward prediction error (RPE), a fundamental parameter in associative learning models. This RPE hypothesis provides a compelling theoretical framework for understanding DA function in reward learning and addiction. New studies support a causal role for DA-mediated RPE activity in promoting learning about natural reward; however, this question has not been explicitly tested in the context of drug addiction. In this review, we integrate theoretical models with experimental findings on the activity of DA systems, and on the causal role of specific neuronal projections and cell types, to provide a circuit-based framework for probing DA-RPE function in addiction. By examining error-encoding DA neurons in the neural network in which they are embedded, hypotheses regarding circuit-level adaptations that possibly contribute to pathological error signaling and addiction can be formulated and tested.

A Closer Look at the Effects of Repeated Cocaine Exposure on Adaptive Decision-Making under Conditions That Promote Goal-Directed Control

It has been proposed that compulsive drug seeking reflects an underlying dysregulation in adaptive behavior that favors habitual (automatic and inflexible) over goal-directed (deliberative and highly flexible) action selection. Rodent studies have established that repeated exposure to cocaine or amphetamine facilitates the development of habits, producing behavior that becomes unusually insensitive to a reduction in the value of its outcome. The current study more directly investigated the effects of cocaine pre-exposure on goal-directed learning and action selection using an approach that discourages habitual performance. After undergoing a 15-day series of cocaine (15 or 30 mg/kg, i.p.) or saline injections and a drug withdrawal period, rats were trained to perform two different lever-press actions for distinct reward options. During a subsequent outcome devaluation test, both cocaine- and saline-treated rats showed a robust bias in their choice between the two actions, preferring whichever action had been trained with the reward that retained its value. Thus, it appears that the tendency for repeated cocaine exposure to promote habit formation does not extend to a more complex behavioral scenario that encourages goal-directed control. To further explore this issue, we assessed how prior cocaine treatment would affect the rats' ability to learn about a selective reduction in the predictive relationship between one of the two actions and its outcome, which is another fundamental feature of goal-directed behavior. Interestingly, we found that cocaine-treated rats showed enhanced, rather than diminished, sensitivity to this action-outcome contingency degradation manipulation. Given their mutual dependence on striatal dopamine signaling, we suggest that cocaine's effects on habit formation and contingency learning may stem from a common adaptation in this neurochemical system.

Neuroscience of learning and memory for addiction medicine: from habit formation to memory reconsolidation

Identifying effective pharmacological treatments for addictive disorders has remained an elusive goal. Many different classes of drugs have shown some efficacy in preclinical models, but the number of effective clinical therapeutics has remained stubbornly low. The persistence of drug use and the high frequency of relapse is at least partly attributable to the enduring ability of environmental stimuli associated with drug use to maintain behavioral patterns of drug use and induce craving during abstinence. We propose that stimuli associated with drug use exert such powerful control over behavior through the development of abnormally strong memories, and their ability to initiate subconscious sequences of motor actions (habits) that promote uncontrolled drug use. In this chapter, we will review the evidence suggesting that drugs of abuse strengthen associations with cues in the environment and facilitate habit formation. We will also discuss potential mechanisms for disrupting memories associated with drug use to help improve treatments for addiction.

Compromised NMDA/Glutamate Receptor Expression in Dopaminergic Neurons Impairs Instrumental Learning, But Not Pavlovian Goal Tracking or Sign Tracking

Behavior is shaped to a dramatic degree by the occurrence of rewards, through both pavlovian and instrumental conditioning processes; these mechanisms give rise to both normal and abnormal behavior. It is crucial to understand the neural mechanisms that give rise to normal actions and how they lead to pathological behaviors, such as overeating and drug addictions.

Two theories regarding the role for dopamine neurons in learning include the concepts that their activity serves as a (1) mechanism that confers incentive salience onto rewards and associated cues and/or (2) contingency teaching signal reflecting reward prediction error. While both theories are provocative, the causal role for dopamine cell activity in either mechanism remains controversial. In this study mice that either fully or partially lacked NMDARs in dopamine neurons exclusively, as well as appropriate controls, were evaluated for reward-related learning; this experimental design allowed for a test of the premise that NMDA/glutamate receptor (NMDAR)-mediated mechanisms in dopamine neurons, including NMDA-dependent regulation of phasic discharge activity of these cells, modulate either the instrumental learning processes or the likelihood of pavlovian cues to become highly motivating incentive stimuli that directly attract behavior. Loss of NMDARs in dopamine neurons did not significantly affect baseline dopamine utilization in the striatum, novelty evoked locomotor behavior, or consumption of a freely available, palatable food solution. On the other hand, animals lacking NMDARs in dopamine cells exhibited a selective reduction in reinforced lever responses that emerged over the course of instrumental learning. Loss of receptor expression did not, however, influence the likelihood of an animal acquiring a pavlovian conditional response associated with attribution of incentive salience to reward-paired cues (sign tracking). These data support the view that reductions in NMDAR signaling in dopamine neurons affect instrumental reward-related learning but do not lend support to hypotheses that suggest that the behavioral significance of this signaling includes incentive salience attribution.

Impact of repeated intravenous cocaine administration on incentive motivation depends on mode of drug delivery

The incentive sensitization theory of addiction posits that repeated exposure to drugs of abuse, like cocaine, can lead to long-term adaptations in the neural circuits that support motivated behavior, providing an account of pathological drug-seeking behavior. Although pre-clinical findings provide strong support for this theory, much remains unknown about the conditions that support incentive sensitization. The current study examined whether the mode of cocaine administration is an important factor governing that drug's long-term impact on behavior. Separate groups of rats were allowed either to self-administer intravenous cocaine or were given an equivalent number and distribution of unsignaled cocaine or saline infusions. During the subsequent test of incentive motivation (Pavlovian-to-instrumental transfer), we found that rats with a history of cocaine self-administration showed strong cue-evoked food seeking, in contrast to rats given unsignaled cocaine or saline. This finding indicates that the manner in which cocaine is administered can determine its lasting behavioral effects, suggesting that subjective experiences during drug use play a critical role in the addiction process. Our findings may therefore have important implications for the study and treatment of compulsive drug seeking.

Phasic mesolimbic dopamine signaling encodes the facilitation of incentive motivation produced by repeated cocaine exposure

Drug addiction is marked by pathological drug seeking and intense drug craving, particularly in response to drug-related stimuli. Repeated psychostimulant administration is known to induce long-term alterations in mesolimbic dopamine (DA) signaling that are hypothesized to mediate this heightened sensitivity to environmental stimuli. However, there is little direct evidence that drug-induced alteration in mesolimbic DA function underlies this hypersensitivity to motivational cues. In the current study, we tested this hypothesis using fast-scan cyclic voltammetry to monitor phasic DA signaling in the nucleus accumbens core of cocaine-pretreated (6 once-daily injections of 15 mg/kg, i.p.) and drug-naive rats during a test of cue-evoked incentive motivation for food-the Pavlovian-to-instrumental transfer task. We found that prior cocaine exposure augmented both reward seeking and DA release triggered by the presentation of a reward-paired cue. Furthermore, cue-evoked DA signaling positively correlated with cue-evoked food seeking and was found to be a statistical mediator of this behavioral effect of cocaine. Taken together, these findings provide support for the hypothesis that repeated cocaine exposure enhances cue-evoked incentive motivation through augmented phasic mesolimbic DA signaling. This work sheds new light on a fundamental neurobiological mechanism underlying motivated behavior and its role in the expression of compulsive reward seeking.

The form of a conditioned stimulus can influence the degree to which it acquires incentive motivational properties

There is considerable individual variation in the extent to which food- and drug-associated cues (conditioned stimuli, CSs) acquire incentive salience, as indicated by whether they elicit approach towards them, and/or act as conditioned reinforcers. Here we asked whether this variation is influenced by properties of the CS itself. In rats, we assessed both the attractiveness and conditioned reinforcing properties of two CSs: a manipulable lever CS versus an auditory (tone) CS. There was considerable individual variation in the extent to which a lever CS acquired incentive motivational properties, as indicated by whether it became attractive (evoked a sign-tracking or goal-tracking conditioned response) or acted as a conditioned reinforcer. However, with a tone CS all rats learned a goal-tracking response, and the tone CS was an equally effective conditioned reinforcer in sign-trackers and goal-trackers. Even when presented in compound (a lever-tone CS), the two elements of the compound differentially acquired motivational properties. In contrast, amphetamine and stress potentiated the conditioned reinforcing properties of both visual and auditory CSs similarly in rats that primarily sign-tracked or goal-tracked. We conclude that variation in the to the ability of CSs to acquire incentive salience, and thus their ability to act as incentive stimuli capable of motivating behavior, is determined in part by properties of the CS itself.

Food consumption and weight gain after cessation of chronic amphetamine administration

Cessation of drug use often coincides with increased food consumption and weight gain in recovering addicts. However, it is not known whether this phenomenon (particularly the weight gain) is uniquely human, or whether it represents a consequence of drug cessation common across species. To address this issue, rats (n = 10/group) were given systemic injections of D-amphetamine (3 mg/kg) or an equal volume of saline vehicle for 9 consecutive days. Beginning 2 days after the final injection, rats were given free access to a highly palatable food mixture (consisting of sugar and butter) along with their standard chow diet, and food consumption and body weight were measured every 48 h for 30 days. Consistent with clinical observations, amphetamine-treated rats showed a greater increase in body weight over the course of the 30 days relative to vehicle-treated rats. Surprisingly, there was no difference in highly palatable food consumption between amphetamine- and vehicle-treated groups, but the amphetamine-treated group consumed significantly more standard chow than the control group. The finding that a history of chronic amphetamine exposure increases food consumption is consistent with previous work in humans showing that withdrawal from drugs of abuse is associated with overeating and weight gain. The current findings may reflect amphetamine-induced sensitization of mechanisms involved in reward motivation, suggesting that weight gain following drug cessation in humans could be due to similar mechanisms.

Transition from 'model-based' to 'model-free' behavioral control in addiction: Involvement of the orbitofrontal cortex and dorsolateral striatum

Cocaine addiction is a complex and multidimensional process involving a number of behavioral and neural forms of plasticity. The behavioral transition from voluntary drug use to compulsive drug taking may be explained at the neural level by drug-induced changes in function or interaction between a flexible planning system, associated with prefrontal cortical regions, and a rigid habit system, associated with the striatum. The dichotomy between these two systems is operationalized in computational theory by positing model-based and model-free learning mechanisms, the former relying on an "internal model" of the environment and the latter on pre-computed or cached values to control behavior. In this review, we will suggest that model-free and model-based learning mechanisms appear to be differentially affected, at least in the case of psychostimulants such as cocaine, with the former being enhanced while the latter are disrupted. As a result, the behavior of long-term drug users becomes less flexible and responsive to the desirability of expected outcomes and more habitual, based on the long history of reinforcement. To support our specific proposal, we will review recent neural and behavioral evidence on the effect of psychostimulant exposure on orbitofrontal and dorsolateral striatum structure and function. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Repeated nicotine exposure during adolescence alters reward-related learning in male and female rats

RATIONALE

Repeated nicotine exposure causes neuroadaptations in limbic cortico-striatal circuits involved in learning and motivation. Such alterations are relevant to addiction because they are suggested to mediate the ability of smoking-associated stimuli to control behavior and to enhance nicotine-seeking and -taking behaviors. Female smokers report higher cue reactivity relative to their male counter parts, yet little is known about putative gender-specific effects of adolescent nicotine exposure on reward-related learning. Prior repeated nicotine exposure in adult male rats enhances Pavlovian approach behavior and conditioned reinforcement.

OBJECTIVE

Given that smoking is typically initiated during adolescence, here we assessed the extent to which adolescent nicotine exposure impacts Pavlovian approach and conditioned reinforcement in male and female rats.

METHODS

Rats were injected with nicotine on postnatal days 31-45 prior to training on Pavlovian approach behavior starting on day 51. They were trained to associate a conditioned stimulus (CS), illumination of a magazine light, and tone, with an unconditioned stimulus (US), the delivery of water, for 10-daily sessions, and then were tested on the acquisition of responding with conditioned reinforcement.

RESULTS

Adolescent nicotine exposure selectively increased approach to the magazine during the CS in males but decreased approach to the magazine during the CS in female rats. Vehicle-exposed female rats, however, showed greater magazine approach during the CS than did male control rats. Prior nicotine exposure also enhanced conditioned reinforcement in both male and female rats.

CONCLUSIONS

Repeated exposure to nicotine during adolescence had opposite effects on Pavlovian approach behavior in male and female rats but enhanced acquisition of a new response with conditioned reinforcement. Novel information on how nicotine exposure influences reward-related learning during adolescence may increase our understanding of neurobiological mechanisms involved in the initiation of smoking behavior.

The effects of amphetamine sensitization on conditioned inhibition during a Pavlovian-instrumental transfer task in rats

RATIONALE

Psychostimulant sensitization heightens behavioral and motivational responses to reward-associated stimuli; however, its effects on stimuli associated with reward absence are less understood.

OBJECTIVES

We examined whether amphetamine sensitization alters performance during Pavlovian-instrumental transfer (PIT) to conditioned excitors and inhibitors. We further sought to characterize the effects of amphetamine sensitization on learning versus performance by exposing rats to amphetamine prior to Pavlovian training or between training and test.

METHODS

Adult male Long-Evans rats were given conditioned inhibition (A+/AX-) and Pavlovian (B+) training, followed by variable-interval instrumental conditioning. Rats were sensitized to D-amphetamine (2 mg/kg daily injections for 7 days) or served as non-exposed controls. Rats were given a PIT test, in which they were presented with stimulus B alone or in compound with the conditioned inhibitor (BX).

RESULTS

During the PIT test, control rats significantly reduced instrumental responding on BX trials (to approximately 50 % of responding to B). Amphetamine sensitization prior to Pavlovian conditioning increased lever pressing on BX trials and reduced lever pressing on B trials compared to controls. Amphetamine sensitization between training and test increased lever pressing on B and BX trials compared to controls. No effects of sensitization were observed on conditioned food cup approach.

CONCLUSIONS

Amphetamine sensitization increases instrumental responding during PIT to a conditioned inhibitor by enhancing the excitation of conditioned stimuli and reducing the inhibition of conditioned inhibitors.

Disruption of model-based behavior and learning by cocaine self-administration in rats

RATIONALE

Addiction is characterized by maladaptive decision-making, in which individuals seem unable to use adverse outcomes to modify their behavior. Adverse outcomes are often infrequent, delayed, and even rare events, especially when compared to the reliable rewarding drug-associated outcomes. As a result, recognizing and using information about their occurrence put a premium on the operation of so-called model-based systems of behavioral control, which allow one to mentally simulate outcomes of different courses of action based on knowledge of the underlying associative structure of the environment. This suggests that addiction may reflect, in part, drug-induced dysfunction in these systems. Here, we tested this hypothesis.

OBJECTIVES

This study aimed to test whether cocaine causes deficits in model-based behavior and learning independent of requirements for response inhibition or perception of costs or punishment.

METHODS

We trained rats to self-administer sucrose or cocaine for 2 weeks. Four weeks later, the rats began training on a sensory preconditioning and inferred value blocking task. Like devaluation, normal performance on this task requires representations of the underlying task structure; however, unlike devaluation, it does not require either response inhibition or adapting behavior to reflect aversive outcomes.

RESULTS

Rats trained to self-administer cocaine failed to show conditioned responding or blocking to the preconditioned cue. These deficits were not observed in sucrose-trained rats nor did they reflect any changes in responding to cues paired directly with reward.

CONCLUSIONS

These results imply that cocaine disrupts the operation of neural circuits that mediate model-based behavioral control.

Age of exposure-dependent effects of amphetamine on behavioral flexibility

Drug use typically begins during adolescence, which is a period of ongoing neurobiological development that may confer heightened vulnerability to develop drug dependence. Previously, our lab has shown that amphetamine (AMPH)-induced deficits in a medial prefrontal cortex (mPFC)-sensitive working memory task are greater in rats exposed to the drug during adolescence compared to adulthood. Here, we examine potential age-dependent effects of AMPH exposure on behavioral flexibility tasks that are sensitive to disruptions in mPFC and orbitofrontal cortex (OFC) function. Male Sprague-Dawley rats were injected (i.p.) with saline or 3mg/kg AMPH every other day between postnatal days (PNDs) 27-45 and PNDs 85-103. Starting around PND 125, rats were tested in an attentional set-shifting task and a subset of those was then tested in an operant strategy shifting task. Following completion of the operant task, rats were challenged with 3mg/kg AMPH and monitored in open field chambers. Our results demonstrate that AMPH-exposed rats were faster to acquire simple and compound discriminations, but were impaired during the first stimulus-reward reversal when compared to controls. In the operant strategy shifting task, adolescent-exposed rats shifted more rapidly between strategies and completed reversals faster than adult-exposed and control rats, respectively. The final AMPH challenge revealed evidence for sensitization in drug pre-exposed rats, with adult-exposed animals exhibiting the most significant effects. Together, these results suggest that AMPH induces long-lasting changes in behavioral flexibility that are at least partially dependent on age of exposure and may be due to adaptations in OFC function.

Repeated cocaine exposure facilitates the expression of incentive motivation and induces habitual control in rats

There is growing evidence that mere exposure to drugs can induce long-term alterations in the neural systems that mediate reward processing, motivation, and behavioral control, potentially causing the pathological pursuit of drugs that characterizes the addicted state. The incentive sensitization theory proposes that drug exposure potentiates the influence of reward-paired cues on behavior. It has also been suggested that drug exposure biases action selection towards the automatic execution of habits and away from more deliberate goal-directed control. The current study investigated whether rats given repeated exposure to peripherally administered cocaine would show alterations in incentive motivation (assayed using the Pavlovian-to-instrumental transfer (PIT) paradigm) or habit formation (assayed using sensitivity to reward devaluation). After instrumental and Pavlovian training for food pellet rewards, rats were given 6 daily injections of cocaine (15 mg/kg, IP) or saline, followed by a 10-d period of rest. Consistent with the incentive sensitization theory, cocaine-treated rats showed stronger cue-evoked lever pressing than saline-treated rats during the PIT test. The same rats were then trained on a new instrumental action with a new food pellet reward before undergoing a reward devaluation testing. Although saline-treated rats exhibited sensitivity to reward devaluation, indicative of goal-directed performance, cocaine-treated rats were insensitive to this treatment, suggesting a reliance on habitual processes. These findings, when taken together, indicate that repeated exposure to cocaine can cause broad alterations in behavioral control, spanning both motivational and action selection processes, and could therefore help explain aberrations of decision-making that underlie drug addiction.

Amphetamine paradoxically augments exocytotic dopamine release and phasic dopamine signals

Drugs of abuse hijack brain-reward circuitry during the addiction process by augmenting action potential-dependent phasic dopamine release events associated with learning and goal-directed behavior. One prominent exception to this notion would appear to be amphetamine (AMPH) and related analogs, which are proposed instead to disrupt normal patterns of dopamine neurotransmission by depleting vesicular stores and promoting nonexocytotic dopamine efflux via reverse transport. This mechanism of AMPH action, though, is inconsistent with its therapeutic effects and addictive properties, which are thought to be reliant on phasic dopamine signaling. Here we used fast-scan cyclic voltammetry in freely moving rats to interrogate principal neurochemical responses to AMPH in the striatum and relate these changes to behavior. First, we showed that AMPH dose-dependently enhanced evoked dopamine responses to phasic-like current pulse trains for up to 2 h. Modeling the data revealed that AMPH inhibited dopamine uptake but also unexpectedly potentiated vesicular dopamine release. Second, we found that AMPH increased the amplitude, duration, and frequency of spontaneous dopamine transients, the naturally occurring, nonelectrically evoked, phasic increases in extracellular dopamine. Finally, using an operant sugar reward paradigm, we showed that low-dose AMPH augmented dopamine transients elicited by sugar-predictive cues. However, operant behavior failed at high-dose AMPH, which was due to phasic dopamine hyperactivity and the decoupling of dopamine transients from the reward predictive cue. These findings identify upregulation of exocytotic dopamine release as a key AMPH action in behaving animals and support a unified mechanism of abused drugs to activate phasic dopamine signaling.

Differential influence of morphine sensitization on accumbens shell and core dopamine responses to morphine- and food-conditioned stimuli

RATIONALE

Sensitization of the incentive and dopamine (DA) stimulant properties of drug-conditioned stimuli (CSs) by repeated exposure to drugs of abuse has been assigned an important role in the genesis of drug addiction.

OBJECTIVE

To test in rats if morphine-induced sensitization potentiates incentive and DA-releasing properties in the nucleus accumbens (NAc) shell and core elicited by presentation of a morphine-conditioned stimulus(CS) and if this property generalizes to a non-drug-(palatable food, Fonzies)-CS.

METHODS

Controls and rats previously sensitized by morphine were trained via three daily sessions consisting of a 10-min presentation of CS (Fonzies filled box, FB) followed by s.c. saline and morphine (1 mg/kg) or by standard food and Fonzies. Rats were implanted with microdialysis probes and the next-day incentive reactions and NAc shell and core DA were monitored during CS presentation and subsequent morphine (1 mg/kg) administration or Fonzies feeding.

RESULTS

Morphine sensitization increased incentive and NAc shell and core DA responses to morphine-CS. Morphine conditioning per se increased incentive reactions and NAc shell but not core DA responses to FB presentation. Morphine sensitization potentiated incentive responses but did not affect NAc shell and core DA responses to Fonzies-CS. Fonzies conditioning increased incentive reactions and NAc core but not shell DA responses to FB presentation.

CONCLUSIONS

These observations confirm the prediction of the incentive sensitization theory in the case of drug-CS but not of non-drug-CS. NAc DA might be differentially involved in the expression of incentive sensitization of drug- and non-drug-CSs, thus providing a clue for the abnormal incentive properties of drug CSs.

The effects of amphetamine exposure on outcome-selective Pavlovian-instrumental transfer in rats

RATIONALE

Repeated exposure to psychostimulants alters behavioral responses to reward-related cues; however, the motivational underpinnings of this effect have not been fully characterized.

OBJECTIVES

The following study was designed to examine how amphetamine sensitization affects performance in rats on a series of Pavlovian and operant tasks that distinguish between general-incentive and outcome-selective forms of conditioned responses.

METHODS

Adult male rats underwent Pavlovian and instrumental training for food pellet rewards. Following training, rats were sensitized to D-amphetamine (2 mg/kg for 7 days). Rats were subsequently tested on an outcome-selective Pavlovian-instrumental transfer (PIT) task, an outcome-reinstatement task, and an outcome devaluation task. Additionally, in a separate experiment, PIT was assessed in amphetamine-sensitized and control rats using a Pavlovian backward-conditioned stimulus.

RESULTS

Repeated amphetamine exposure sensitized locomotor activity to acute amphetamine challenge. Amphetamine altered responses to CS presentations by increasing conditioned approach. During tests of PIT, amphetamine-treated rats showed no outcome-selectivity in their responding, responding to a CS whether or not it shared a common outcome with the instrumental response. No effect of amphetamine sensitization was observed on tests of outcome-selective reinstatement by outcome delivery or action selection based on outcome value. Amphetamine-sensitized rats showed impaired outcome-selective PIT to a backward CS but were unaltered in conditioned approach.

CONCLUSIONS

Amphetamine sensitization prevents outcome-selective responding during PIT, which is dissociable from amphetamine's effects on conditioned approach. These data suggest fundamental alterations in how stimuli motivate action in addiction.

Performance on an impulse control task is altered in adult rats exposed to amphetamine during adolescence

Repeated exposure to psychostimulant drugs is associated with long-lasting changes in cognition, particularly in behavioral tasks that are sensitive to prefrontal cortex function. Adolescents may be especially vulnerable to these drug-induced cognitive changes because of the widespread adaptations in brain anatomy and function that are characteristic of normal development during this period. Here, we used a differential reinforcement of low rates of responding task in rats to determine if amphetamine (AMPH) exposure during adolescence would alter behavioral inhibition in adulthood. Between postnatal days (PND) 27 and 45, rats received every other day injections of saline or AMPH (3 mg/kg). At PND 125, rats were trained progressively through a series of four reinforcement schedules (DRL 5, 10, 15, and 30 s) that required them to withhold responding for the appropriate amount of time before a lever press was reinforced. Relative to controls, AMPH-treated rats displayed transient deficits in behavioral inhibition (i.e., decreases in efficiency ratio) that were only evident at DRL 5. In addition, they had increased responding during nonreinforced periods, which suggested increased perseveration and propensity to attribute incentive salience to reward-paired cues. Following challenge injections with AMPH (.25-1 mg/kg, i.p.), which were given 10 min before the start of DRL 30 test sessions, both groups exhibited dose-dependent decreases in efficiency. These results suggest that AMPH-induced alterations in incentive-motivation and perseveration are more robust and longer-lasting than its effects on impulse control.

The impact of orbitofrontal dysfunction on cocaine addiction

Cocaine addiction is characterized by poor judgment and maladaptive decision-making. Here we review evidence implicating the orbitofrontal cortex in such behavior. This evidence suggests that cocaine-induced changes in orbitofrontal cortex disrupt the representation of states and transition functions that form the basis of flexible and adaptive 'model-based' behavioral control. By impairing this function, cocaine exposure leads to an overemphasis on less flexible, maladaptive 'model-free' control systems. We propose that such an effect accounts for the complex pattern of maladaptive behaviors associated with cocaine addiction.

A single administration of methamphetamine to mice early in the light period decreases running wheel activity observed during the dark period

Repeated intermittent administration of amphetamines acutely increases appetitive and consummatory aspects of motivated behaviors as well as general activity and exploratory behavior, including voluntary running wheel activity. Subsequently, if the drug is withdrawn, the frequency of these behaviors decreases, which is thought to be indicative of dysphoric symptoms associated with amphetamine withdrawal. Such decreases may be observed after chronic treatment or even after single drug administrations. In the present study, the effect of acute methamphetamine (METH) on running wheel activity, horizontal locomotion, appetitive behavior (food access), and consummatory behavior (food and water intake) was investigated in mice. A multi-configuration behavior apparatus designed to monitor the five behaviors was developed, where combined measures were recorded simultaneously. In the first experiment, naïve male ICR mice showed gradually increasing running wheel activity over three consecutive days after exposure to a running wheel, while mice without a running wheel showed gradually decreasing horizontal locomotion, consistent with running wheel activity being a positively motivated form of natural motor activity. In experiment 2, increased horizontal locomotion and food access, and decreased food intake, were observed for the initial 3h after acute METH challenge. Subsequently, during the dark phase period decreased running wheel activity and horizontal locomotion were observed. The reductions in running wheel activity and horizontal locomotion may be indicative of reduced dopaminergic function, although it remains to be seen if these changes may be more pronounced after more prolonged METH treatments.

Influence of morphine sensitization on the responsiveness of mesolimbic and mesocortical dopamine transmission to appetitive and aversive gustatory stimuli

RATIONALE

Repeated treatment with morphine has been shown to sensitize rats to its stimulant effects on motor activity and mesolimbic dopamine (DA) transmission.

OBJECTIVES

The aim of this study is to investigate if morphine sensitization is associated to changes in the behavioral reactions to appetitive and aversive taste stimuli and in the response of in vivo DA transmission in the nucleus accumbens (NAc) shell and core and medial prefrontal cortex (PFCX) to the same stimuli.

METHODS

Rats were administered twice a day for three consecutive days with increasing doses of morphine [10, 20, and 40 mg/kg, subcutaneously (sc)] or with saline. After 15 days of withdrawal, rats were infused intraorally with either an appetitive (sweet chocolate, 1 ml) or an aversive solution (quinine HCl 5 × 10(-4) M, 1 ml). The behavioral taste reactions were recorded during microdialysis of DA in the NAc shell and core and PFCX.

RESULTS

Opiate sensitization did not affect behavioral reactions to intraoral chocolate or quinine. In rats naive to the taste stimuli, morphine sensitization was associated to potentiation of stimulatory DA response to appetitive and aversive taste stimuli in the NAc core. Morphine sensitization reciprocally affected habituation of DA responsiveness after one trial exposure to appetitive and aversive taste stimuli (abolition it in the shell, induction in the PFCX). No habituation of DA responsiveness to taste was observed in the NAc core in controls as well as in morphine-sensitized rats.

CONCLUSIONS

These results suggest that opiate sensitization is associated to differential adaptive changes of the responsiveness of DA transmission to taste stimuli in DA terminal areas.

Cell adhesion signaling pathways: First responders to cocaine exposure?

The 100 billion neurons comprising the human brain are wired together using structural extensions termed axons, dendrites and dendritic spines. Addictive drugs remodel dendritic spine structure in certain brain regions and with repeated exposure, induce psychomotor sensitization and impair behavioral flexibility. We recently reported that low-dose cocaine exposure, in combination with knockout of Arg-an adhesion-regulated nonreceptor tyrosine kinase that stabilizes neuronal shape starting in adolescence-recapitulates both features of chronic drug exposure in rodents. In light of these and other recent findings in the field, we suggest that cell adhesion receptors and their downstream cytoskeletal effectors act as "first responders" to psychostimulant exposure. In this model, cell adhesion factors act to stabilize existing dendritic spines in response to cocaine, and reduced expression/function is expected to increase vulnerability. Moreover, this model anticipates that increased sensitivity to psychostimulants in adolescence relates to neuronal pruning processes that occur during this developmental period.

Post-training cocaine exposure facilitates spatial memory consolidation in C57BL/6 mice

In this study, we examined the ability of post-training injections of cocaine to facilitate spatial memory performance using the Morris water maze (MWM). We also investigated the role that hippocampal protein kinase A (PKA) and extracellular signal-regulated kinase 1/2 (ERK) signaling may play in cocaine-mediated spatial memory consolidation processes. Male and female C57BL/6 mice were first trained in a MWM task (eight consecutive trials) then injected with cocaine (0, 1.25, 2.5, 5, or 20 mg/kg), and memory for the platform location was retested after a 24 h delay. Cocaine had a dose-dependent effect on spatial memory performance because only the mice receiving 2.5 mg/kg cocaine displayed a significant reduction in latency to locate the platform. No sex differences in MWM performance were observed; however, females showed higher hippocampal levels of PKA when compared with males. A second experiment demonstrated that 2.5 mg/kg cocaine enhanced MWM performance only when administered within 2, but not 4 h after spatial training. We also found that cocaine (2.5 mg/kg) increased ERK2 phosphorylation within the hippocampus and one of its downstream targets (ribosomal S6 kinase), a mechanism that may be responsible, at least in part, for the enhanced cocaine-mediated spatial memory performance. Overall, these data demonstrate that a low dose of cocaine (2.5 mg/kg) administered within 2 h after training facilitates MWM spatial memory performance in C57BL/6 mice.

Aberrant learning and memory in addiction

Over the past several years, drug addiction has increasingly been accepted to be a disease of the brain as opposed to simply being due to a lack of willpower or personality flaw. Exposure to addictive substances has been shown to create enduring changes in brain structure and function that are thought to underlie the transition to addiction. Specific genetic and environmental vulnerability factors also influence the impact of drugs of abuse on the brain and can enhance the likelihood of becoming an addict. Long-lasting alterations in brain function have been found in neural circuits that are known to be responsible for normal appetitive learning and memory processes and it has been hypothesized that drugs of abuse enhance positive learning and memory about the drug while inhibiting learning about the negative consequences of drug use. Therefore, the addict's behavior becomes increasingly directed towards obtaining and using drugs of abuse, while at the same time developing a poorer ability to stop using, even when the drug is less rewarding or interferes with functioning in other facets of life. In this review we will discuss the clinical evidence that addicted individuals have altered learning and memory and describe the possible neural substrates of this dysfunction. In addition, we will explore the pre-clinical evidence that drugs of abuse cause a progressive disorder of learning and memory, review the molecular and neurobiological changes that may underlie this disorder, determine the genetic and environmental factors that may increase vulnerability to addiction, and suggest potential strategies for treating addiction through manipulations of learning and memory.

Locomotor activity in a novel environment predicts both responding for a visual stimulus and self-administration of a low dose of methamphetamine in rats

There is evidence that visual stimuli used to signal drug delivery in self-administration procedures have primary reinforcing properties, and that drugs of abuse enhance the reinforcing properties of such stimuli. Here, we explored the relationships between locomotor activity, responding for a visual stimulus, and self-administration of methamphetamine (METH). Rats were classified as high or low responders based on activity levels in a novel locomotor chamber and were subsequently tested for responding to produce a visual stimulus followed by self-administration of a low dose of METH (0.025 mg/kg/infusion) paired with the visual stimulus. High responder rats responded more for the visual stimulus than low responder rats indicating that the visual stimulus was reinforcing and that operant responding for a visual stimulus has commonalities with locomotor activity in a novel environment. Similarly, high responder rats responded more for METH paired with a visual stimulus than low responder rats. Because of the reinforcing properties of the visual stimulus, it was not possible to determine if the rats were responding to produce the visual stimulus, METH or the combination. We speculate that responding to produce sensory reinforcers may be a measure of sensation seeking. These results indicate that visual stimuli have unconditioned reinforcing effects which may have a significant role in acquisition of drug self-administration, a role that is not yet well understood.

Contributions of ERK signaling in the striatum to instrumental learning and performance

The striatum is critical for learning and decision making; however, the molecular mechanisms that govern striatum function are not fully understood. The extracellular signal regulated kinase (ERK) cascade is an important signaling pathway that underlies synaptic plasticity, cellular excitability, learning and arousal. This review focuses on the role of ERK signaling in striatum function. ERK is activated in the striatum by coordinated dopamine and glutamate receptor signaling, where it underlies corticostriatal synaptic plasticity and influences striatal cell excitability. ERK activation in the dorsal striatum is necessary for action-outcome learning and performance of goal-directed actions. In the ventral striatum, ERK is necessary for the motivating effects of reward-associated stimuli on instrumental performance. Dysregulation of ERK signaling in the striatum by repeated drug exposure contributes to the development of addictive behavior. These results highlight the importance of ERK signaling in the striatum as a critical substrate for learning and as a regulator of ongoing behavior. Furthermore, they suggest that ERK may be a suitable target for therapeutics to treat disorders of learning and decision making that arise from compromised striatum function.

Amphetamine exposure selectively enhances hippocampus-dependent spatial learning and attenuates amygdala-dependent cue learning

Behaviorally sensitizing regimen of amphetamine (AMPH) exposure has diverse effects on learning, memory, and cognition that are likely to be a consequence of long-term neural adaptations occurring in the cortico-limbic-striatal circuitry. In particular, altered dopamine signaling in the nucleus accumbens and medial prefrontal cortex has been implicated to underlie AMPH-induced changes in behavior. This study sought to test the hypothesis that repeated AMPH exposure disrupts the regulation of limbic information processing and the balance of competing limbic control over appetitive behavior. Mice received seven intraperitoneal injections of D-AMPH (2.5 mg/kg or 5 mg/kg) or vehicle solution (saline) and were trained in (1) a simultaneous conditioned cue and place preference task using a six-arm radial maze, found to depend on the integrity of the hippocampus (HPC) and basolateral amygdala (BLA), respectively and (2) a conditional BLA-dependent cue, and HPC-dependent place learning task using an elevated T-maze. In both tasks, the vehicle pretreatment group initially acquired cue learning, followed by the emergence of significant place/spatial learning. In contrast, pretreatment with repeated AMPH caused marked deviations from normal acquisition patterns of place and cue conditioning, significantly facilitating HPC-dependent place conditioning in the first task while attenuating BLA-dependent cue conditioning in both tasks. These findings provide the first demonstration of an aberrant regulation of HPC- and BLA-dependent learning as a result of AMPH exposure, highlighting the importance of the meso-coticolimbic dopamine system in maintaining the balance of limbic control over appetitive behavior.

Sensitization processes in drug addiction

In 1993, Robinson and Berridge published their first review that laid out the incentive sensitization theory of addiction (Robinson and Berridge 1993 Brain Res Rev 18:247). Its basic point is that repeated exposure to drugs of abuse causes hypersensitivity to drugs and drug-associated stimuli of the neural circuits mediating incentive salience, an important way in which motivational stimuli influence behavior. In laymen's terms, it states that this drug-induced hypersensitivity of motivational circuitry would mediate an increase in drug "wanting," thus being responsible for the dramatically exaggerated motivation for drugs displayed by addicts. This theory has been exceptionally influential, as evidenced by the fact that the original review paper about this theory (Robinson and Berridge 1993 Brain Res Rev 18:247) has been cited 2,277 times so far, and subsequent updates of this view (Robinson and Berridge 2000 Addiction 95(Suppl 2):S91; Robinson and Berridge 2001 Addiction 96:103; Robinson and Berridge 2003 Ann Rev Psychol 54:25) have been cited 274, 297, and 365 times, respectively, adding up to more than 3,200 citations within 15 years. The present chapter aims to delineate the merits and limitations of the incentive sensitization view of addiction, and whether incentive sensitization occurs in humans. We conclude that since incentive sensitization most prominently occurs after the first few drug exposures, it may represent an important initial step in the addiction process. During the expression of full-blown addiction, characterized by loss of control over drug intake and use of large quantities of drugs, the expression of incentive sensitization may be transiently suppressed. However, detoxification and the gradual disappearance of tolerance and withdrawal symptoms may unmask sensitization, which could then play an important role in the high risk of relapse.

Effects of acute amphetamine exposure on two kinds of Pavlovian approach behavior

Two kinds of Pavlovian conditioned approach behavior are possible: approach of the CS (sign-tracking) and approach of the US (goal-tracking). We hypothesized that administration of AMP would increase sign-tracking and decrease goal-tracking. However, increasing doses of AMP (up to 2.0mg/kg) decreased measures of sign-tracking while simultaneously increasing measures of goal-tracking. Administration of AMP may shift responding from cues distant from the CS to cues closer to the CS.

Differential changes in mesolimbic dopamine following contingent and non-contingent MDMA self-administration in mice

RATIONALE

There is evidence demonstrating changes in dopamine (DA) transmission in the nucleus accumbens (NAc) related to contingent versus non-contingent drug administration.

OBJECTIVES

The aim of this study was to evaluate basal and 3,4-methylenedioxymethamphetamine (MDMA)-stimulated DA levels in the NAc of mice that had previously received contingent and non-contingent infusions of MDMA. Contingent mice were trained to self-administer MDMA (0.125 mg/kg/infusion) in 2-h sessions for 10 days. Yoked mice received either MDMA at the same dose or saline. Forty-eight hours after the last MDMA or saline administration, DA levels were measured by in vivo microdialysis before and after an MDMA (10 mg/kg, i.p.) challenge. Binding of [(3)H]-mazindol and [(3)H]-citalopram was evaluated by autoradiography.

RESULTS

Animals receiving MDMA infusions showed significantly lower basal DA levels than the yoked saline group. A reduced activation of DA was observed following MDMA in contingent mice with respect to both yoked MDMA and saline mice. No significant alterations in DA transporter or serotonin transporter were observed in the three groups of mice.

CONCLUSIONS

These results suggest that prolonged exposure to MDMA in mice produces changes in basal DA levels after drug withdrawal and a decreased neurochemical response at the level of the mesolimbic DA reward pathway that is, in part, related to instrumental learning during self-administration.

Effects of prior amphetamine exposure on approach strategy in appetitive Pavlovian conditioning in rats

RATIONALE

Pavlovian conditioning with a discrete reward-predictive visual cue can elicit two classes of behaviors: "sign-tracking" (approach toward and contact with the cue) and "goal-tracking" (approach toward the site of reward delivery). Sign-tracking has been proposed to be linked to behavioral disorders involving compulsive reward-seeking, such as addiction. Prior exposure to psychostimulant drugs of abuse can facilitate reward-seeking behaviors through enhancements in incentive salience attribution. Thus, it was predicted that a sensitizing regimen of amphetamine exposure would increase sign-tracking behavior.

OBJECTIVE

The purpose of these experiments was to determine how a regimen of exposure to amphetamine affects subsequent sign-tracking behavior.

MATERIALS AND METHODS

Male Long-Evans rats were given daily injections of d-amphetamine (2.0 mg/kg) or saline for 5 days, then given a 7-day drug-free period followed by testing in a Pavlovian conditioning task. In experiment 1, rats were presented with a visual cue (simultaneous illumination of a light and extension of a lever) located either to the left or right of a centrally located food trough. One cue (CS+) was always followed by food delivery, whereas the other (CS-) was not. In experiment 2, rats were tested in a nondiscriminative (CS+ only) version of the task.

RESULTS

In both experiments, amphetamine-exposed rats showed less sign-tracking and more goal-tracking compared to saline controls.

CONCLUSIONS

Contrary to predictions, prior amphetamine exposure decreased sign-tracking and increased goal-tracking behavior. However, these results do support the hypothesis that psychostimulant exposure and incentive sensitization enhance behavior directed toward reward-proximal cues at the expense of reward-distal cues.

Long-lasting sensitization of reward-directed behavior by amphetamine

Exposure to psychostimulant drugs of abuse such as amphetamine can result in long-lasting "sensitization" of reward-directed behavior, such that subjects display enhancements in behavior directed by and toward rewards and reward-predictive cues (i.e. "incentive sensitization"). The purpose of these experiments was to determine the degree to which such sensitization resulting from chronic amphetamine exposure influences both appetitive and consummatory food-motivated behavior. Adult male Long-Evans rats received daily i.p. injections of D-amphetamine (2.0 mg/kg) or saline vehicle for five consecutive days. This amphetamine exposure regimen produced lasting sensitization to the acute locomotor stimulant effect of the drug. One month after drug exposure rats were tested for instrumental responding (lever pressing) for food reward under various response schedules. Two months after drug exposure, rats were tested for food consumption in a discriminative Pavlovian context-potentiated eating task, involving pairings of one context with food and another context with no food. Amphetamine exposed rats showed significantly greater instrumental responding for food reward than saline controls, particularly under conditions of high response ratios. In the potentiated eating task, testing under conditions of food satiation revealed that amphetamine exposed rats ate significantly more than saline controls in the food-paired context. These experiments demonstrate that amphetamine exposure can cause enduring increases in both appetitive and consummatory aspects of natural reward-directed behavior. Such long-lasting incentive sensitization could account in part for the propensity for relapse in drug addiction, as well as for reported enhancements in non-drug reward-related behavior.

Amphetamine exposure enhances accumbal responses to reward-predictive stimuli in a pavlovian conditioned approach task

Acute and repeated exposure to psychostimulants such as amphetamine enhances the effects of pavlovian conditioned stimuli on conditioned behavior. It is hypothesized that amphetamine facilitates conditioned stimulus (CS) effects by selectively enhancing accumbal neuronal responses to stimuli. To test this hypothesis, rats were trained to discriminate between two pavlovian stimuli. One stimulus (i.e., CS+) was paired with sucrose delivery [i.e., unconditioned stimulus (US)], and the other stimulus (i.e., CS-) was paired with the absence of sucrose. Animals developed a conditioned approach response that occurred during the CS+ but not during the CS-. We tested the effect of different doses of amphetamine (0, 0.25, 0.5, or 1.0 mg/kg) on this conditioned approach behavior as well as on accumbal neuronal responses time locked to the CS+, the CS-, and the US. Acute amphetamine exposure increased conditioned approach behavior during the CS+, but not during the CS-. This change in behavior was associated with a selective increase in the magnitude of accumbal responses during the CS+. Repeated amphetamine administration followed by a drug-free period and reexposure did not affect the conditioned behavior, but increased accumbal responses to the CS+. These findings support the hypothesis that amphetamine exposure enhances behavioral responses to pavlovian conditioned stimuli by amplifying accumbal responses to those stimuli.