Neurobehavioral Precursors of Compulsive Cocaine Seeking in Dual Frontostriatal Circuits

Background

Only some individuals who use drugs recreationally eventually develop a substance use disorder, characterized in part by the rigid engagement in drug foraging behavior (drug seeking), which is often maintained in the face of adverse consequences (i.e., is compulsive). The neurobehavioral determinants of this individual vulnerability have not been fully elucidated.

Methods

Using a prospective longitudinal study involving 39 male rats, we combined multidimensional characterization of behavioral traits of vulnerability to stimulant use disorder (impulsivity and stickiness) and resilience (sign tracking and sensation seeking/locomotor reactivity to novelty) with magnetic resonance imaging to identify the structural and functional brain correlates of the later emergence of compulsive drug seeking in drug-naïve subjects. We developed a novel behavioral procedure to investigate the individual tendency to persist in drug-seeking behavior in the face of punishment in a drug-free state in subjects with a prolonged history of cocaine seeking under the control of the conditioned reinforcing properties of a drug-paired Pavlovian conditioned stimulus.

Results

In drug-naïve rats, the tendency to develop compulsive cocaine seeking was characterized by behavioral stickiness-related functional hypoconnectivity between the prefrontal cortex and posterior dorsomedial striatum in combination with impulsivity-related structural alterations in the infralimbic cortex, anterior insula, and nucleus accumbens.

Conclusions

These findings show that the vulnerability to developing compulsive cocaine-seeking behavior stems from preexisting structural or functional changes in two distinct corticostriatal systems that underlie deficits in impulse control and goal-directed behavior.

The development of compulsive coping behavior depends on dorsolateral striatum dopamine-dependent mechanisms

Humans greatly differ in how they cope with stress, a natural behavior learnt through negative reinforcement. Some individuals engage in displacement activities, others in exercise or comfort eating, and others still in alcohol use. Across species, adjunctive behaviors, such as polydipsic drinking, are used as a form of displacement activity that reduces stress. Some individuals, in particular those that use alcohol to self-medicate, tend to lose control over such coping behaviors, which become excessive and compulsive. However, the psychological and neural mechanisms underlying this individual vulnerability have not been elucidated. Here we tested the hypothesis that the development of compulsive adjunctive behaviors stems from the functional engagement of the dorsolateral striatum (DLS) dopamine-dependent habit system after a prolonged history of adjunctive responding. We measured in longitudinal studies in male Sprague Dawley rats the sensitivity of early established vs compulsive polydipsic water or alcohol drinking to a bilateral infusion into the anterior DLS (aDLS) of the dopamine receptor antagonist α-flupentixol. While most rats acquired a polydipsic drinking response with water, others only did so with alcohol. Whether drinking water or alcohol, the acquisition of this coping response was insensitive to aDLS dopamine receptor blockade. In contrast, after prolonged experience, adjunctive drinking became dependent on aDLS dopamine at a time when it was compulsive in vulnerable individuals. These data suggest that habits may develop out of negative reinforcement and that the engagement of their underlying striatal system is necessary for the manifestation of compulsive adjunctive behaviors.

Negative Urgency Exacerbates Relapse to Cocaine Seeking After Abstinence

BACKGROUND

The mechanisms through which drug-cue-induced negative affective states are involved in relapse have not been defined. We tested the hypothesis that in individuals having developed a dorsolateral striatum (DLS)-dependent cue-controlled cocaine-seeking habit, the loss of the opportunity to enact the drug-seeking response during abstinence results in an urge to act that exacerbates relapse severity mediated by negative urgency.

METHODS

Eighty-seven male Sprague Dawley rats were trained to seek cocaine under the influence of the conditioned reinforcing properties of drug-paired cues or not. We investigated whether the tendency to relapse depended on the aversive state of withdrawal or instead on the loss of opportunity to perform the ingrained drug-seeking response after periods of abstinence. The striatal locus of control over cocaine seeking at baseline and relapse was investigated using in situ hybridization of the cellular activity marker C-fos and assessment of the sensitivity of instrumental drug seeking to dopamine receptor blockade in the dorsomedial striatum-dependent goal-directed and DLS-dependent habit systems.

RESULTS

The development of a DLS-dependent cue-controlled cocaine-seeking habit prior to abstinence resulted in a marked increase in drug seeking at relapse, which was not motivated by a cocaine withdrawal state and was no longer dependent on the DLS habit system. Instead, it reflected the emergence of negative urgency caused by the prevention of the performance of the habit during abstinence and underpinned by transient engagement of the goal-directed system.

CONCLUSIONS

These results show that ingrained cue-controlled drug-seeking habits increase the pressure to relapse.

Individual differences in the engagement of habitual control over alcohol seeking predict the development of compulsive alcohol seeking and drinking

Excessive drinking is an important behavioural characteristic of alcohol addiction, but not the only one. Individuals addicted to alcohol crave alcoholic beverages, spend time seeking alcohol despite negative consequences and eventually drink to intoxication. With prolonged use, control over alcohol seeking devolves to anterior dorsolateral striatum, dopamine-dependent mechanisms implicated in habit learning and individuals in whom alcohol seeking relies more on these mechanisms are more likely to persist in seeking alcohol despite the risk of punishment. Here, we tested the hypothesis that the development of habitual alcohol seeking predicts the development of compulsive seeking and that, once developed, it is associated with compulsive alcohol drinking. Male alcohol-preferring rats were pre-exposed intermittently to a two-bottle choice procedure and trained on a seeking-taking chained schedule of alcohol reinforcement until some individuals developed punishment-resistant seeking behaviour. The associative basis of their seeking responses was probed with an outcome-devaluation procedure, early or late in training. After seeking behaviour was well established, subjects that had developed greater resistance to outcome devaluation (were more habitual) were more likely to show punishment-resistant (compulsive) alcohol seeking. These individuals also drank more alcohol, despite quinine adulteration, even though having similar alcohol preference and intake before and during instrumental training. They were also less sensitive to changes in the contingency between seeking responses and alcohol outcome, providing further evidence of recruitment of the habit system. We therefore provide direct behavioural evidence that compulsive alcohol seeking emerges alongside compulsive drinking in individuals who have preferentially engaged the habit system.

Opposing roles for striatonigral and striatopallidal neurons in dorsolateral striatum in consolidating new instrumental actions

Comparatively little is known about how new instrumental actions are encoded in the brain. Using whole-brain c-Fos mapping, we show that neural activity is increased in the anterior dorsolateral striatum (aDLS) of mice that successfully learn a new lever-press response to earn food rewards. Post-learning chemogenetic inhibition of aDLS disrupts consolidation of the new instrumental response. Similarly, post-learning infusion of the protein synthesis inhibitor anisomycin into the aDLS disrupts consolidation of the new response. Activity of D1 receptor-expressing medium spiny neurons (D1-MSNs) increases and D2-MSNs activity decreases in the aDLS during consolidation. Chemogenetic inhibition of D1-MSNs in aDLS disrupts the consolidation process whereas D2-MSN inhibition strengthens consolidation but blocks the expression of previously learned habit-like responses. These findings suggest that D1-MSNs in the aDLS encode new instrumental actions whereas D2-MSNs oppose this new learning and instead promote expression of habitual actions.

Baclofen decreases compulsive alcohol drinking in rats characterized by reduced levels of GAT-3 in the central amygdala

While most individuals with access to alcohol drink it recreationally, some vulnerable individuals eventually lose control over their intake and progressively develop compulsive alcohol drinking and decreased interest in alternative sources of reinforcement, two key features of addiction. The neural and molecular mechanisms underlying this vulnerability to switch from controlled to compulsive alcohol intake have not been fully elucidated. It has been shown that rats having reduced levels of expression of the gamma-aminobutyric acid (GABA) transporter, GAT-3, in the amygdala tend to persist in seeking and drinking alcohol even when adulterated with quinine, suggesting that pharmacological interventions aimed at restoring GABA homeostasis in these individuals may provide a targeted treatment to limit compulsive alcohol drinking. Here, we tested the hypothesis that the GABA_B receptor agonist baclofen, which decreases GABA release, specifically reduces compulsive alcohol drinking in vulnerable individuals. In a large cohort of Sprague-Dawley rats allowed to drink alcohol under an intermittent two-bottle choice procedure, a cluster of individuals was identified that persisted in drinking alcohol despite adulteration with quinine or when an alternative ingestive reinforcer, saccharin, was available. In these rats, which were characterized by decreased GAT-3 mRNA levels in the central amygdala, acute baclofen administration (1.5 mg/kg, intraperitoneal) resulted in a decrease in compulsive drinking. These results indicate that low GAT-3 mRNA levels in the central amygdala may represent an endophenotype of vulnerability to develop a compulsive drinking of alcohol that is shown here to be mitigated by baclofen.

The Basolateral Amygdala to Nucleus Accumbens Core Circuit Mediates the Conditioned Reinforcing Effects of Cocaine-Paired Cues on Cocaine Seeking

BACKGROUND

Individuals addicted to cocaine spend much of their time foraging for the drug. Pavlovian drug-associated conditioned stimuli exert a major influence on the initiation and maintenance of drug seeking often long into abstinence, especially when presented response-contingently, acting as conditioned reinforcers that bridge delays to drug use. The acquisition of cue-controlled cocaine seeking has been shown to depend on functional interactions between the basolateral amygdala (BLA) and the nucleus accumbens core (NAcC). However, the precise neuronal circuits underlying the acquisition of cue-controlled cocaine-seeking behavior have not been elucidated.

METHODS

Here, we used a projection-specific Cre-dependent DREADD (designer receptor exclusively activated by designer drugs)-mediated causal approach to test the hypothesis that the direct projections from the BLA to the NAcC are required for the acquisition of cue-controlled cocaine-seeking behavior.

RESULTS

In Sprague Dawley rats with Cre-mediated expression of the inhibitory DREADD hM4D(Gi) in the NAcC-projecting BLA neurons, treatment with clozapine N-oxide, but not vehicle, selectively prevented the impact of cocaine-associated conditioned reinforcers on cocaine seeking under a second-order schedule of reinforcement. This effect was attributable to the chemogenetic inhibition of the NAcC-projecting BLA neurons, as it was reversible, and it was absent in clozapine N-oxide-treated rats expressing an empty control virus. In contrast, chemogenetic inhibition of the anterior insula, which receives collateral projections from NAcC-projecting BLA neurons, was without effect.

CONCLUSIONS

These data demonstrate that the acquisition of cue-controlled cocaine seeking that depends on the conditioned reinforcing effects of cocaine cues requires activity in the direct projections from the BLA to the NAcC.

Environment-dependent behavioral traits and experiential factors shape addiction vulnerability

The transition from controlled drug use to drug addiction depends on an interaction between a vulnerable individual, their environment and a drug. Here we tested the hypothesis that conditions under which individuals live influence behavioral vulnerability traits and experiential factors operating in the drug taking environment to determine the vulnerability to addiction. The role of behavioral vulnerability traits in mediating the influence of housing conditions on the tendency to acquire cocaine self-administration was characterized in 48 rats housed in either an enriched (EE) or a standard (SE) environment. Then, the influence of these housing conditions on the individual vulnerability to develop addiction-like behavior for cocaine or alcohol was measured in 72 EE or SE rats after several months of cocaine self-administration or intermittent alcohol drinking, respectively. The determining role of negative experiential factors in the drug taking context was further investigated in 48 SE rats that acquired alcohol drinking to self-medicate distress in a schedule-induced polydipsia procedure. The environment influenced the acquisition of drug intake through its effect on behavioral markers of resilience to addiction. In contrast, the initiation of drug taking as a coping strategy or in a negative state occasioned by the contrast between enriched housing conditions and a relatively impoverished drug taking setting, facilitated the development of compulsive cocaine and alcohol intake. These data indicate that addiction vulnerability depends on environmentally determined experiential factors, and suggest that initiating drug use through negative reinforcement-based self-medication facilitates the development of addiction in vulnerable individuals. SIGNIFICANCE STATEMENT: The factors that underlie an individual's vulnerability to switch from controlled, recreational drug use to addiction are not well understood. We showed that in individuals housed in enriched conditions, the experience of drugs in the relative social and sensory impoverishment of the drug taking context, and the associated change in behavioral traits of resilience to addiction, exacerbate the vulnerability to develop compulsive drug intake. We further demonstrated that the acquisition of alcohol drinking as a mechanism to cope with distress increases the vulnerability to develop compulsive alcohol intake. Together these results demonstrate that experiential factors in the drug taking context shape the vulnerability to addiction.

The transition to compulsion in addiction

Compulsion is a cardinal symptom of drug addiction (severe substance use disorder). However, compulsion is observed in only a small proportion of individuals who repeatedly seek and use addictive substances. Here, we integrate accounts of the neuropharmacological mechanisms that underlie the transition to compulsion with overarching learning theories, to outline how compulsion develops in addiction. Importantly, we emphasize the conceptual distinctions between compulsive drug-seeking behaviour and compulsive drug-taking behaviour (that is, use). In the latter, an individual cannot stop using a drug despite major negative consequences, possibly reflecting an imbalance in frontostriatal circuits that encode reward and aversion. By contrast, an individual may compulsively seek drugs (that is, persist in seeking drugs despite the negative consequences of doing so) when the neural systems that underlie habitual behaviour dominate goal-directed behavioural systems, and when executive control over this maladaptive behaviour is diminished. This distinction between different aspects of addiction may help to identify its neural substrates and new treatment strategies.

Impulsivity is a heritable trait in rodents and associated with a novel quantitative trait locus on chromosome 1

Impulsivity describes the tendency to act prematurely without appropriate foresight and is symptomatic of a number of neuropsychiatric disorders. Although a number of genes for impulsivity have been identified, no study to date has carried out an unbiased, genome-wide approach to identify genetic markers associated with impulsivity in experimental animals. Herein we report a linkage study of a six-generational pedigree of adult rats phenotyped for one dimension of impulsivity, namely premature responding on the five-choice serial reaction time task, combined with genome wide sequencing and transcriptome analysis to identify candidate genes associated with the expression of the impulsivity trait. Premature responding was found to be heritable (h² = 13-16%), with significant linkage (LOD 5.2) identified on chromosome 1. Fine mapping of this locus identified a number of polymorphic candidate genes, however only one, beta haemoglobin, was differentially expressed in both the founder strain and F6 generation. These findings provide novel insights into the genetic substrates and putative neurobiological mechanisms of impulsivity with broader translational relevance for impulsivity-related disorders in humans.

Withdrawal from escalated cocaine self-administration impairs reversal learning by disrupting the effects of negative feedback on reward exploitation: a behavioral and computational analysis

Addiction is regarded as a disorder of inflexible choice with behavior dominated by immediate positive rewards over longer-term negative outcomes. However, the psychological mechanisms underlying the effects of self-administered drugs on behavioral flexibility are not well understood. To investigate whether drug exposure causes asymmetric effects on positive and negative outcomes we used a reversal learning procedure to assess how reward contingencies are utilized to guide behavior in rats previously exposed to intravenous cocaine self-administration (SA). Twenty-four rats were screened for anxiety in an open field prior to acquisition of cocaine SA over six daily sessions with subsequent long-access cocaine SA for 7 days. Control rats (n = 24) were trained to lever-press for food under a yoked schedule of reinforcement. Higher rates of cocaine SA were predicted by increased anxiety and preceded impaired reversal learning, expressed by a decrease in lose-shift as opposed to win-stay probability. A model-free reinforcement learning algorithm revealed that rats with high, but not low cocaine escalation failed to exploit previous reward learning and were more likely to repeat the same response as the previous trial. Eight-day withdrawal from high cocaine escalation was associated, respectively, with increased and decreased dopamine receptor D2 (DRD2) and serotonin receptor 2C (HTR2C) expression in the ventral striatum compared with controls. Dopamine receptor D1 (DRD1) expression was also significantly reduced in the orbitofrontal cortex of high cocaine-escalating rats. These findings indicate that withdrawal from escalated cocaine SA disrupts how negative feedback is used to guide goal-directed behavior for natural reinforcers and that trait anxiety may be a latent variable underlying this interaction.

The role of prediction error and memory destabilization in extinction of cued-fear within the reconsolidation window

Extinction of a cued-fear memory within the reconsolidation window has been proposed to prevent fear reacquisition by reconsolidation interference. This 'retrieval-extinction' procedure has received interest for its therapeutic potential to reduce the impact of fear memories on behavior. To fully exploit its therapeutic potential, it is critical to understand the mechanisms that underlie the 'retrieval-extinction' effect. If the effect depends upon reconsolidation of the original memory, then it would be predicted that destabilization, induced by prediction error, would be critical for observing the effect. Here, the dependency of the retrieval-extinction effect on memory destabilization or prediction error was investigated in pavlovian cued-fear conditioned adult male rats. The requirement for memory destabilization, and thus reconsolidation, for the retrieval-extinction effect was subsequently investigated using region-specific pharmacological blockade of dopamine D1-receptors. Intra-basolateral amygdala antagonism of dopamine D1-receptors did not prevent the reacquisition of fear associated with the retrieval-extinction procedure. The requirement for prediction error was assessed by using a reinforced or non-reinforced memory retrieval trial before extinction, compared to a no-retrieval, extinction-only control. Both the reinforced (no prediction error) and non-reinforced retrieval sessions led to a decrease in fear reacquisition, suggesting that engagement of prediction error does not influence the occurrence of retrieval-extinction. Together, these data suggest that retrieval-extinction does not require memory destabilization, since behavioral or pharmacological interventions that prevent destabilization did not disrupt any capacity to attenuate fear.

Compulsive Alcohol Seeking Results from a Failure to Disengage Dorsolateral Striatal Control over Behavior

The acquisition of drug, including alcohol, use is associated with activation of the mesolimbic dopamine system. However, over the course of drug exposure the control over drug seeking progressively devolves to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms. The causal importance of this functional recruitment of aDLS in the switch from controlled to compulsive drug use in vulnerable individuals remains to be established. Here we tested the hypothesis that individual differences in the susceptibility to aDLS dopamine-dependent control over alcohol seeking predicts and underlies the development of compulsive alcohol seeking. Male alcohol-preferring rats, the alcohol-preferring phenotype of which was confirmed in an intermittent two-bottle choice procedure, were implanted bilaterally with cannulae above the aDLS and trained instrumentally on a seeking-taking chained schedule of alcohol reinforcement until some individuals developed compulsive seeking behavior. The susceptibility to aDLS dopamine control over behavior was investigated before and after the development of compulsivity by measuring the extent to which bilateral aDLS infusions of the dopamine receptor antagonist α-flupenthixol (0, 5, 10, and 15 μg/side) decreased alcohol seeking at different stages of training, as follows: (1) after acquisition of instrumental taking responses for alcohol; (2) after alcohol-seeking behavior was well established; and (3) after the development of punishment-resistant alcohol seeking. Only alcohol-seeking, not alcohol-taking, responses became dependent on aDLS dopamine. Further, marked individual differences in the susceptibility of alcohol seeking to aDLS dopamine receptor blockade actually predicted the vulnerability to develop compulsive alcohol seeking, but only in subjects dependent on aDLS dopamine-dependent control.SIGNIFICANCE STATEMENT Over the course of addictive drug exposure, there is a transition in the control over drug seeking from ventral to anterior dorsal striatum (aDLS) dopamine-dependent mechanisms, but it is unclear whether this is causally involved in the development of compulsive drug seeking. We tested the hypothesis that individual differences in the reliance of alcohol seeking on aDLS dopamine predicts and underlies the emergence of compulsive alcohol seeking. We identified individual differences in the reliance of well established alcohol seeking, but not taking behavior, on aDLS mechanisms and also showed that this predicted the subsequent development of compulsive alcohol-seeking behavior. Thus, those individuals in whom alcohol seeking depended on aDLS mechanisms were vulnerable subsequently to display compulsivity.

Addictive behaviour in experimental animals: prospects for translation

Since the introduction of intravenous drug self-administration methodology over 50 years ago, experimental investigation of addictive behaviour has delivered an enormous body of data on the neural, psychological and molecular mechanisms of drug reward and reinforcement and the neuroadaptations to chronic use. Whether or not these behavioural and molecular studies are viewed as modelling the underpinnings of addiction in humans, the discussion presented here highlights two areas-the impact of drug-associated conditioned stimuli-or drug cues-on drug seeking and relapse, and compulsive cocaine seeking. The degree to which these findings translate to the clinical state of addiction is considered in terms of the underlying neural circuitry and also the ways in which this understanding has helped develop new treatments for addiction. The psychological and neural mechanisms underlying drug memory reconsolidation and extinction established in animal experiments show particular promise in delivering new treatments for relapse prevention to the clinic.This article is part of a discussion meeting issue 'Of mice and mental health: facilitating dialogue between basic and clinical neuroscientists'.

Heroin seeking becomes dependent on dorsal striatal dopaminergic mechanisms and can be decreased by N-acetylcysteine

The alarming increase in heroin overdoses in the USA is a reminder of the need for efficacious and novel treatments for opiate addiction. This may reflect the relatively poor understanding of the neural basis of heroin, as compared to cocaine, seeking behaviour. While cocaine reinforcement depends on the mesolimbic system, well‐established cocaine seeking is dependent on dorsolateral striatum (aDLS) dopamine‐dependent mechanisms which are disrupted by N‐acetylcysteine, through normalisation of corticostriatal glutamate homeostasis. However, it is unknown whether a functional recruitment of aDLS dopamine‐dependent control over instrumental responding also occurs for heroin seeking, even though heroin reinforcement does not depend on the mesolimbic dopamine system. Lister Hooded rats acquired heroin self‐administration and were subsequently trained to seek heroin daily over prolonged periods of time under the control of drug‐paired cues, as measured under a second‐order schedule of reinforcement. At different stages of training, that is, early on and when heroin seeking behaviour was well established, we measured the sensitivity of drug‐seeking responses to either bilateral aDLS infusions of the dopamine receptor antagonist α‐flupenthixol (5, 10 and 15 μg/side) or systemic administration of N‐acetylcysteine (30, 60 and 90 mg/kg). The results demonstrate that control over heroin seeking behaviour devolves to aDLS dopamine‐dependent mechanisms after extended training. Further aDLS‐dependent well‐established, cue‐controlled heroin seeking was disrupted by N‐acetylcysteine. Comparison with previous data on cocaine suggests that the development of drug seeking habits and the alteration of corticostriatal glutamate homeostasis, which is restored by N‐acetylcysteine, are quantitatively similar between heroin and cocaine.

A Novel Retrieval-Dependent Memory Process Revealed by the Arrest of ERK1/2 Activation in the Basolateral Amygdala

Fully consolidated fear memories can be maintained or inhibited by retrieval-dependent mechanisms depending on the degree of re-exposure to fear cues. Short exposures promote memory maintenance through reconsolidation, and long exposures promote inhibition through extinction. Little is known about the neural mechanisms by which increasing cue exposure overrides reconsolidation and instead triggers extinction. Using auditory fear conditioning in male rats, we analyzed the role of a molecular mechanism common to reconsolidation and extinction of fear, ERK1/2 activation within the basolateral amygdala (BLA), after intermediate conditioned stimulus (CS) exposure events. We show that an intermediate re-exposure (four CS presentations) failed to activate ERK1/2 in the BLA, suggesting the absence of reconsolidation or extinction mechanisms. Supporting this hypothesis, pharmacologically inhibiting the BLA ERK1/2-dependent signaling pathway in conjunction with four CS presentations had no effect on fear expression, and the NMDA receptor partial agonist d-cycloserine, which enhanced extinction and ERK1/2 activation in partial extinction protocols (seven CSs), had no behavioral or molecular effect when given in association with four CS presentations. These molecular and behavioral data reveal a novel retrieval-dependent memory phase occurring along the transition between conditioned fear maintenance and inhibition. CS-dependent molecular events in the BLA may arrest reconsolidation intracellular signaling mechanism in an extinction-independent manner. These findings are critical for understanding the molecular underpinnings of fear memory persistence after retrieval both in health and disease.SIGNIFICANCE STATEMENT Consolidated fear memories can be altered by retrieval-dependent mechanisms. Whereas a brief conditioned stimulus (CS) exposure promotes fear memory maintenance through reconsolidation, a prolonged exposure engages extinction and fear inhibition. The nature of this transition and whether an intermediate degree of CS exposure engages reconsolidation or extinction is unknown. We show that an intermediate cue exposure session (four CSs) produces the arrest of ERK1/2 activation in the basolateral amygdala, a common mechanism for reconsolidation and extinction. Amnestic or hypermnestic treatments given in association with four CSs had no behavioral or molecular effects, respectively. This evidence reveals a novel retrieval-dependent memory phase. Intermediate degrees of CS exposure fail to trigger reconsolidation or extinction, leaving the original memory in an insensitive state.

Evidence for a Long-Lasting Compulsive Alcohol Seeking Phenotype in Rats

Excessive drinking to intoxication is the major behavioral characteristic of those addicted to alcohol but it is not the only one. Indeed, individuals addicted to alcohol also crave alcoholic beverages and spend time and put much effort into compulsively seeking alcohol, before eventually drinking large amounts. Unlike this excessive drinking, for which treatments exist, compulsive alcohol seeking is therefore another key feature of the persistence of alcohol addiction since it leads to relapse and for which there are few effective treatments. Here we provide novel evidence for the existence in rats of an individual vulnerability to switch from controlled to compulsive, punishment-resistant alcohol seeking. Alcohol-preferring rats given access to alcohol under an intermittent 2-bottle choice procedure to establish their alcohol-preferring phenotype were subsequently trained instrumentally to seek and take alcohol on a chained schedule of reinforcement. When stable seeking-taking performance had been established, completion of cycles of seeking responses resulted unpredictably either in punishment (0.45 mA foot-shock) or the opportunity to make a taking response for access to alcohol. Compulsive alcohol seeking, maintained in the face of the risk of punishment, emerged in only a subset of rats with a predisposition to prefer and drink alcohol, and was maintained for almost a year. We show further that a selective and potent μ-opioid receptor antagonist (GSK1521498) reduced both alcohol seeking and alcohol intake in compulsive and non-compulsive rats, indicating its therapeutic potential to promote abstinence and prevent relapse in individuals addicted to alcohol.

Knockdown of zif268 in the Posterior Dorsolateral Striatum Does Not Enduringly Disrupt a Response Memory of a Rewarded T-Maze Task

•

Zif268 expression in the pDLS is not required for retrieval of habit-like memory.

•

Knockdown of pDLS Zif268 expression reduces habit-like memory restabilization.

•

Zif268 expression increased in the BLA after reward memory retrieval.

•

Despite extended T-Maze training rats did not use a S-R strategy.

Under certain conditions pavlovian memories undergo reconsolidation, whereby the reactivated memory can be disrupted by manipulations such as knockdown of zif268. For instrumental memories, reconsolidation disruption is less well established. Our previous, preliminary data identified that there was an increase in Zif268 in the posterior dorsolateral striatum (pDLS) after expression of an instrumental habit-like 'response' memory, but not an instrumental goal-directed 'place' memory on a T-maze task. Here, the requirement for Zif268 in the reconsolidation of a response memory was tested by knockdown of Zif268, using antisense oligodeoxynucleotide infusion into the pDLS, at memory reactivation. Zif268 knockdown reduced response memory expression 72H, but not 7d later. Western blotting revealed a non-significant increase in Zif268 in the pDLS in rats using response memories, but there was no change in Zif268 expression in the hippocampus following retrieval of a place memory. Zif268 expression increased in the basolateral amygdala after memory reactivation whether a response or place strategy was used during reactivation. We propose that Zif268 expression in the basolateral amygdala may be linked to prediction error, generated by the absence of reward at reactivation. Taken together, these results suggest a complex role for Zif268 in the maintenance of instrumental memories.

Drug Addiction: Updating Actions to Habits to Compulsions Ten Years On

A decade ago, we hypothesized that drug addiction can be viewed as a transition from voluntary, recreational drug use to compulsive drug-seeking habits, neurally underpinned by a transition from prefrontal cortical to striatal control over drug seeking and taking as well as a progression from the ventral to the dorsal striatum. Here, in the light of burgeoning, supportive evidence, we reconsider and elaborate this hypothesis, in particular the refinements in our understanding of ventral and dorsal striatal mechanisms underlying goal-directed and habitual drug seeking, the influence of drug-associated Pavlovian-conditioned stimuli on drug seeking and relapse, and evidence for impairments in top-down prefrontal cortical inhibitory control over this behavior. We further review animal and human studies that have begun to define etiological factors and individual differences in the propensity to become addicted to drugs, leading to the description of addiction endophenotypes, especially for cocaine addiction. We consider the prospect of novel treatments for addiction that promote abstinence from and relapse to drug use.

N-acetylcysteine Facilitates Self-Imposed Abstinence After Escalation of Cocaine Intake

BACKGROUND

N-acetylcysteine (NAC) has been suggested to prevent relapse to cocaine seeking. However, the psychological processes underlying its potential therapeutic benefit remain largely unknown.

METHODS

We investigated the hallmark features of addiction that were influenced by chronic NAC treatment in rats given extended access to cocaine: escalation, motivation, self-imposed abstinence in the face of punishment, or propensity to relapse. For this, Sprague Dawley rats were given access either to 1 hour (short access) or 6 hours (long access [LgA]) self-administration (SA) sessions until LgA rats displayed a robust escalation. Rats then received daily saline or NAC (60 mg/kg, intraperitoneal) treatment and were tested under a progressive ratio and several consecutive sessions in which lever presses were punished by mild electric foot shocks.

RESULTS

NAC increased the sensitivity to punishment in LgA rats only, thereby promoting abstinence. Following the cessation of punishment, NAC-treated LgA rats failed to recover fully their prepunishment cocaine intake levels and resumed cocaine SA at a lower rate than short access and vehicle-treated LgA rats. However, NAC altered neither the escalation of SA nor the motivation for cocaine. At the neurobiological level, NAC reversed cocaine-induced decreases in the glutamate type 1 transporter observed in both the nucleus accumbens and the dorsolateral striatum. NAC also increased the expression of Zif268 in the nucleus accumbens and dorsolateral striatum of LgA rats.

CONCLUSIONS

Our results indicate that NAC contributes to the restoration of control over cocaine SA following adverse consequences, an effect associated with plasticity mechanisms in both the ventral and dorsolateral striatum.

From impulses to maladaptive actions: the insula is a neurobiological gate for the development of compulsive behavior

Impulsivity is an endophenotype of vulnerability for compulsive behaviors. However, the neural mechanisms whereby impulsivity facilitates the development of compulsive disorders, such as addiction or obsessive compulsive disorder, remain unknown. We first investigated, in rats, anatomical and functional correlates of impulsivity in the anterior insular (AI) cortex by measuring both the thickness of, and cellular plasticity markers in, the AI with magnetic resonance imaging and in situ hybridization of the immediate early gene zif268, respectively. We then investigated the influence of bilateral AI cortex lesions on the high impulsivity trait, as measured in the five-choice serial reaction time task (5-CSRTT), and the associated propensity to develop compulsivity as measured by high drinking levels in a schedule-induced polydipsia procedure (SIP). We demonstrate that the AI cortex causally contributes to individual vulnerability to impulsive-compulsive behavior in rats. Motor impulsivity, as measured by premature responses in the 5-CSRTT, was shown to correlate with the thinness of the anterior region of the insular cortex, in which highly impulsive (HI) rats expressed lower zif268 mRNA levels. Lesions of AI reduced impulsive behavior in HI rats, which were also highly susceptible to develop compulsive behavior as measured in a SIP procedure. AI lesions also attenuated both the development and the expression of SIP. This study thus identifies the AI as a novel neural substrate of maladaptive impulse control mechanisms that may facilitate the development of compulsive disorders.

Bidirectional Modulation of Alcohol-Associated Memory Reconsolidation through Manipulation of Adrenergic Signaling

Alcohol addiction is a problem of great societal concern, for which there is scope to improve current treatments. One potential new treatment for alcohol addiction is based on disrupting the reconsolidation of the maladaptive Pavlovian memories that can precipitate relapse to drug-seeking behavior. In alcohol self-administering rats, we investigated the effects of bidirectionally modulating adrenergic signaling on the strength of a Pavlovian cue-alcohol memory, using a behavioral procedure that isolates the specific contribution of one maladaptive Pavlovian memory to relapse, the acquisition of a new alcohol-seeking response for an alcohol-associated conditioned reinforcer. The β-adrenergic receptor antagonist propranolol, administered in conjunction with memory reactivation, persistently disrupted the memory that underlies the capacity of a previously alcohol-associated cue to act as a conditioned reinforcer. By contrast, enhancement of adrenergic signaling by administration of the adrenergic prodrug dipivefrin at reactivation increased the strength of the cue-alcohol memory and potentiated alcohol seeking. These data demonstrate the importance of adrenergic signaling in alcohol-associated memory reconsolidation, and suggest a pharmacological target for treatments aiming to prevent relapse through the disruption of maladaptive memories.

The Novel μ-Opioid Receptor Antagonist GSK1521498 Decreases Both Alcohol Seeking and Drinking: Evidence from a New Preclinical Model of Alcohol Seeking

Distinct environmental and conditioned stimuli influencing ethanol-associated appetitive and consummatory behaviors may jointly contribute to alcohol addiction. To develop an effective translational animal model that illuminates this interaction, daily seeking responses, maintained by alcohol-associated conditioned stimuli (CSs), need to be dissociated from alcohol drinking behavior. For this, we established a procedure whereby alcohol seeking maintained by alcohol-associated CSs is followed by a period during which rats have the opportunity to drink alcohol. This cue-controlled alcohol-seeking procedure was used to compare the effects of naltrexone and GSK1521498, a novel selective μ-opioid receptor antagonist, on both voluntary alcohol-intake and alcohol-seeking behaviors. Rederived alcohol-preferring, alcohol-nonpreferring, and high-alcohol-drinking replicate 1 line of rats (Indiana University) first received 18 sessions of 24 h home cage access to 10% alcohol and water under a 2-bottle choice procedure. They were trained subsequently to respond instrumentally for access to 15% alcohol under a second-order schedule of reinforcement, in which a prolonged period of alcohol-seeking behavior was maintained by contingent presentations of an alcohol-associated CS acting as a conditioned reinforcer. This seeking period was terminated by 20 min of free alcohol drinking access that achieved significant blood alcohol concentrations. The influence of pretreatment with either naltrexone (0.1-1-3 mg/kg) or GSK1521498 (0.1-1-3 mg/kg) before instrumental sessions was measured on both seeking and drinking behaviors, as well as on drinking in the 2-bottle choice procedure. Naltrexone and GSK1521498 dose-dependently reduced both cue-controlled alcohol seeking and alcohol intake in the instrumental context as well as alcohol intake in the choice procedure. However, GSK1521498 showed significantly greater effectiveness than naltrexone, supporting its potential use for promoting abstinence and preventing relapse in alcohol addiction.

Brain pathways to recovery from alcohol dependence

This article highlights the research presentations at the satellite symposium on "Brain Pathways to Recovery from Alcohol Dependence" held at the 2013 Society for Neuroscience Annual Meeting. The purpose of this symposium was to provide an up to date overview of research efforts focusing on understanding brain mechanisms that contribute to recovery from alcohol dependence. A panel of scientists from the alcohol and addiction research field presented their insights and perspectives on brain mechanisms that may underlie both recovery and lack of recovery from alcohol dependence. The four sessions of the symposium encompassed multilevel studies exploring mechanisms underlying relapse and craving associated with sustained alcohol abstinence, cognitive function deficit and recovery, and translational studies on preventing relapse and promoting recovery. Gaps in our knowledge and research opportunities were also discussed.

Differential vulnerability to the punishment of cocaine related behaviours: effects of locus of punishment, cocaine taking history and alternative reinforcer availability

BACKGROUND

The availability of alternative reinforcement has been shown to reduce drug use, but it remains unclear whether it facilitates a reduction or cessation of drug seeking or taking.

OBJECTIVES

We compared the effects of punishment of cocaine seeking or taking behaviour after brief or extended cocaine-taking histories when behavioural reallocation was facilitated or not by making available an alternative ingestive reinforcer (sucrose).

METHODS

In the first experiment, punishment of either seeking or taking responses was introduced immediately after training on the seeking-taking chained schedule. In the second experiment, punishment of cocaine seeking was introduced after 12 additional days of either 1 or 6 h daily access to cocaine self-administration. In both experiments, beginning 1 week before the introduction of punishment, a subset of rats had concurrent nose poke access to sucrose while seeking or taking cocaine.

RESULTS

The presence of an alternative source of reinforcement markedly facilitated behavioural reallocation from punished cocaine taking after acquisition. It also facilitated punishment-induced suppression of cocaine seeking after an extensive cocaine self-administration history likely by prompting goal-directed motivational control over drug use. However, a significant proportion of rats were deemed compulsive-maintaining drug use after an extensive cocaine history despite the presence of abstinence-promoting positive and negative incentives.

CONCLUSION

Making available an alternative reinforcer facilitates disengagement from punished cocaine use through at least two different processes but remains ineffective in a subpopulation of vulnerable animals, which continued to seek cocaine despite the aversive consequence of punishment and the presence of the alternative positive reinforcer.

Amygdala Dopamine Receptors Are Required for the Destabilization of a Reconsolidating Appetitive Memory

Disrupting maladaptive memories may provide a novel form of treatment for neuropsychiatric disorders, but little is known about the neurochemical mechanisms underlying the induction of lability, or destabilization, of a retrieved consolidated memory. Destabilization has been theoretically linked to the violation of expectations during memory retrieval, which, in turn, has been suggested to correlate with prediction error (PE). It is well-established that PE correlates with dopaminergic signaling in limbic forebrain structures that are critical for emotional learning. The basolateral amygdala is a key neural substrate for the reconsolidation of pavlovian reward-related memories, but the involvement of dopaminergic mechanisms in inducing lability of amygdala-dependent memories has not been investigated. Therefore, we tested the hypothesis that dopaminergic signaling within the basolateral amygdala is required for the destabilization of appetitive pavlovian memories by investigating the effects dopaminergic and protein synthesis manipulations on appetitive memory reconsolidation in rats. Intra-amygdala administration of either the D1-selective dopamine receptor antagonist SCH23390 or the D2-selective dopamine receptor antagonist raclopride prevented memory destabilization at retrieval, thereby protecting the memory from the effects of an amnestic agent, the protein synthesis inhibitor anisomycin. These data show that dopaminergic transmission within the basolateral amygdala is required for memory labilization during appetitive memory reconsolidation.

The CB1 receptor antagonist AM251 impairs reconsolidation of pavlovian fear memory in the rat basolateral amygdala

We have investigated the requirement for signaling at CB1 receptors in the reconsolidation of a previously consolidated auditory fear memory, by infusing the CB1 receptor antagonist AM251, or the FAAH inhibitor URB597, directly into the basolateral amygdala (BLA) in conjunction with memory reactivation. AM251 disrupted memory restabilization, but only when administered after reactivation. URB597 produced a small, transient enhancement of memory restabilization when administered after reactivation. The amnestic effect of AM251 was rescued by coadministration of the GABAA receptor antagonist bicuculline at reactivation, indicating that the disruption of reconsolidation was mediated by altered GABAergic transmission in the BLA. These data show that the endocannabinoid system in the BLA is an important modulator of fear memory reconsolidation and that its effects on memory are mediated by an interaction with the GABAergic system. Thus, targeting the endocannabinoid system may have therapeutic potential to reduce the impact of maladaptive memories in neuropsychiatric disorders such as posttraumatic stress disorder.

High trait impulsivity predicts food addiction-like behavior in the rat

Impulsivity is a behavioral trait frequently seen not only in drug-addicted individuals but also in individuals who pathologically overeat. However, whether impulsivity predates the development of uncontrollable feeding is unknown. In this study, we hypothesized that a high impulsivity trait precedes and confers vulnerability for food addiction-like behavior. For this purpose, we trained ad libitum-fed male Wistar rats in a differential reinforcement of low rates of responding (DRL) task to select Low- and High-impulsive rats. Then, we allowed Low- and High-impulsive rats to self-administer a highly palatable diet (Palatable group) or a regular chow diet (Chow group) in 1-h daily sessions, under fixed ratio (FR) 1, FR3, FR5, and under a progressive ratio (PR) schedules of reinforcement. In addition, we tested the compulsiveness for food in Low- and High-impulsive rats by measuring the food eaten in the aversive, open compartment of a light/dark conflict test. Finally, we measured the expression of the transcription factor ΔFosB in the shell and the core of the nucleus accumbens, which is a marker for neuroadaptive changes following addictive drug exposure. The data we obtained demonstrate that impulsivity is a trait that predicts the development of food addiction-like behaviors, including: (i) excessive intake, (ii) heightened motivation for food, and (iii) compulsive-like eating, when rats are given access to highly palatable food. In addition, we show that the food addiction phenotype in high impulsive subjects is characterized by an increased expression of the transcription factor ΔFosB in the nucleus accumbens shell. These results reveal that impulsivity confers an increased propensity to develop uncontrollable overeating of palatable food.

Increased impulsivity retards the transition to dorsolateral striatal dopamine control of cocaine seeking

BACKGROUND

Development of maladaptive drug-seeking habits occurs in conjunction with a ventral-to-dorsal striatal shift in dopaminergic control over behavior. Although these habits readily develop as drug use continues, high impulsivity predicts loss of control over drug seeking and taking. However, whether impulsivity facilitates the transition to dorsolateral striatum (DLS) dopamine-dependent cocaine-seeking habits or whether impulsivity and cocaine-induced intrastriatal shifts are additive processes is unknown.

METHODS

High- and low-impulsive rats identified in the five-choice serial reaction-time task were trained to self-administer cocaine (.25 mg/infusion) with infusions occurring in the presence of a cue-light conditioned stimulus. Dopamine transmission was blocked in the DLS after three stages of training: early, transition, and late-stage, by bilateral intracranial infusions of α-flupenthixol (0, 5, 10, or 15 μg/side) during 15-min cocaine-seeking test sessions in which each response was reinforced by a cocaine-associated conditioned stimulus presentation.

RESULTS

In early-stage tests, neither group was affected by DLS dopamine receptor blockade. In transition-stage tests, low-impulsive rats showed a significant dose-dependent reduction in cocaine seeking, whereas high-impulsive rats were still unaffected by α-flupenthixol infusions. In the final, late-stage seeking test, both groups showed dose-dependent sensitivity to dopamine receptor blockade.

CONCLUSIONS

The results demonstrate that high impulsivity is associated with a delayed transition to DLS-dopamine-dependent control over cocaine seeking. This suggests that, if impulsivity confers an increased propensity to addiction, it is not simply through a more rapid development of habits but instead through interacting corticostriatal and striato-striatal processes that result ultimately in maladaptive drug-seeking habits.

Neural and psychological mechanisms underlying compulsive drug seeking habits and drug memories--indications for novel treatments of addiction

This review discusses the evidence for the hypothesis that the development of drug addiction can be understood in terms of interactions between Pavlovian and instrumental learning and memory mechanisms in the brain that underlie the seeking and taking of drugs. It is argued that these behaviours initially are goal-directed, but increasingly become elicited as stimulus-response habits by drug-associated conditioned stimuli that are established by Pavlovian conditioning. It is further argued that compulsive drug use emerges as the result of a loss of prefrontal cortical inhibitory control over drug seeking habits. Data are reviewed that indicate these transitions from use to abuse to addiction depend upon shifts from ventral to dorsal striatal control over behaviour, mediated in part by serial connectivity between the striatum and midbrain dopamine systems. Only some individuals lose control over their drug use, and the importance of behavioural impulsivity as a vulnerability trait predicting stimulant abuse and addiction in animals and humans, together with consideration of an emerging neuroendophenotype for addiction are discussed. Finally, the potential for developing treatments for addiction is considered in light of the neuropsychological advances that are reviewed, including the possibility of targeting drug memory reconsolidation and extinction to reduce Pavlovian influences on drug seeking as a means of promoting abstinence and preventing relapse.

Reconsolidation and extinction are dissociable and mutually exclusive processes: behavioral and molecular evidence

Memory persistence is critically influenced by retrieval. In rats, a single presentation of a conditioned fear stimulus induces memory reconsolidation and fear memory persistence, while repeated fear cue presentations result in loss of fear through extinction. These two opposite behavioral outcomes are operationally linked by the number of cue presentations at memory retrieval. However, the behavioral properties and mechanistic determinants of the transition have not yet been explored; in particular, whether reconsolidation and extinction processes coexist or are mutually exclusive, depending on the exposure to non-reinforced retrieval events. We characterized both behaviorally and molecularly the transition from reconsolidation to extinction of conditioned fear and showed that an increase in calcineurin (CaN) in the basolateral amygdala (BLA) supports the shift from fear maintenance to fear inhibition. Gradually increasing the extent of retrieval induces a gradual decrease in freezing responses to the conditioned stimulus and a gradual increase in amygdala CaN level. This newly synthesized CaN is required for the extinction, but not the reconsolidation, of conditioned fear. During the transition from reconsolidation to extinction, we have revealed an insensitive state of the fear memory where NMDA-type glutamate receptor agonist and antagonist drugs are unable either to modulate CaN levels in the BLA or alter the reconsolidation or extinction processes. Together, our data indicate both that reconsolidation and extinction are mutually exclusive processes and also reveal the presence of a transitional, or "limbo," state of the original memory between these two alternative outcomes of fear memory retrieval, when neither process is engaged.

Gamma aminobutyric acidergic and neuronal structural markers in the nucleus accumbens core underlie trait-like impulsive behavior

BACKGROUND

Pathological forms of impulsivity are manifest in a number of psychiatric disorders listed in DSM-5, including attention-deficit/hyperactivity disorder and substance use disorder. However, the molecular and cellular substrates of impulsivity are poorly understood. Here, we investigated a specific form of motor impulsivity in rats, namely premature responding, on a five-choice serial reaction time task.

METHODS

We used in vivo voxel-based magnetic resonance imaging and ex vivo Western blot analyses to investigate putative structural, neuronal, and glial protein markers in low-impulsive (LI) and high-impulsive rats. We also investigated whether messenger RNA interference targeting glutamate decarboxylase 65/67 (GAD65/67) gene expression in the nucleus accumbens core (NAcbC) is sufficient to increase impulsivity in LI rats.

RESULTS

We identified structural and molecular abnormalities in the NAcbC associated with motor impulsivity in rats. We report a reduction in gray matter density in the left NAcbC of high-impulsive rats, with corresponding reductions in this region of glutamate decarboxylase (GAD65/67) and markers of dendritic spines and microtubules. We further demonstrate that the experimental reduction of de novo of GAD65/67 expression bilaterally in the NAcbC is sufficient to increase impulsivity in LI rats.

CONCLUSIONS

These results reveal a novel mechanism of impulsivity in rats involving gamma aminobutyric acidergic and structural abnormalities in the NAcbC with potential relevance to the etiology and treatment of attention-deficit/hyperactivity disorder and related disorders.

Differential roles of the prefrontal cortical subregions and basolateral amygdala in compulsive cocaine seeking and relapse after voluntary abstinence in rats

Compulsive drug use and a persistent vulnerability to relapse are key features of addiction. Imaging studies have suggested that these features may result from deficits in prefrontal cortical structure and function, and thereby impaired top-down inhibitory control over limbic-striatal mechanisms of drug-seeking behaviour. We tested the hypothesis that selective damage to distinct subregions of the prefrontal cortex, or to the amygdala, after a short history of cocaine taking would: (i) result in compulsive cocaine seeking at a time when it would not usually be displayed; or (ii) facilitate relapse to drug seeking after abstinence. Rats with selective, bilateral excitotoxic lesions of the basolateral amygdala or anterior cingulate, prelimbic, infralimbic, orbitofrontal or anterior insular cortices were trained to self-administer cocaine under a seeking-taking chained schedule. Intermittent mild footshock punishment of the cocaine-seeking response was then introduced. No prefrontal cortical lesion affected the ability of rats to withhold their seeking responses. However, rats with lesions to the basolateral amygdala increased their cocaine-seeking responses under punishment and were impaired in their acquisition of conditioned fear. Following a 7-day abstinence period, rats were re-exposed to the drug-seeking environment for assessment of relapse in the absence of punishment or cocaine. Rats with prelimbic cortex lesions showed decreased seeking responses during relapse, whereas those with anterior insular cortex lesions showed an increase. Combined, these results show that acute impairment of prefrontal cortical function does not result in compulsive cocaine seeking after a short history of self-administering cocaine, but further implicates subregions of the prefrontal cortex in relapse.

Baseline-dependent effects of cocaine pre-exposure on impulsivity and D2/3 receptor availability in the rat striatum: possible relevance to the attention-deficit hyperactivity syndrome

We have previously shown that impulsivity in rats predicts the emergence of compulsive cocaine seeking and taking, and is coupled to decreased D2/3 receptor availability in the ventral striatum. As withdrawal from cocaine normalises high impulsivity in rats, we investigated, using positron emission tomography (PET), the effects of response-contingent cocaine administration on D2/3 receptor availability in the striatum. Rats were screened for impulsive behavior on the five-choice serial reaction time task. After a baseline PET scan with the D2/3 ligand [(18)F]fallypride, rats were trained to self-administer cocaine for 15 days under a long-access schedule. As a follow-up, rats were assessed for impulsivity and underwent a second [(18)F]fallypride PET scan. At baseline, we found that D2/3 receptor availability was significantly lower in the left, but not right, ventral striatum of high-impulsive rats compared with low-impulsive rats. While the number of self-administered cocaine infusions was not different between the two impulsivity groups, impulsivity selectively decreased in high-impulsive rats withdrawn from cocaine. This effect was accompanied by a significant increase in D2/3 receptor availability in the left, but not right, ventral striatum. We further report that D2/3 receptor availability was inversely related to baseline D2/3 receptor availability in the ventral striatum of high-impulsive rats, as well as to the left and right dorsal striatum of both low-impulsive and high-impulsive rats. These findings indicate that the reduction in impulsivity in high-impulsive rats by prior cocaine exposure may be mediated by a selective correction of deficient D2/3 receptor availability in the ventral striatum. A similar baseline-dependent mechanism may account for the therapeutic effects of stimulant drugs in clinical disorders such as ADHD.

Ketamine effects on memory reconsolidation favor a learning model of delusions

Delusions are the persistent and often bizarre beliefs that characterise psychosis. Previous studies have suggested that their emergence may be explained by disturbances in prediction error-dependent learning. Here we set up complementary studies in order to examine whether such a disturbance also modulates memory reconsolidation and hence explains their remarkable persistence. First, we quantified individual brain responses to prediction error in a causal learning task in 18 human subjects (8 female). Next, a placebo-controlled within-subjects study of the impact of ketamine was set up on the same individuals. We determined the influence of this NMDA receptor antagonist (previously shown to induce aberrant prediction error signal and lead to transient alterations in perception and belief) on the evolution of a fear memory over a 72 hour period: they initially underwent Pavlovian fear conditioning; 24 hours later, during ketamine or placebo administration, the conditioned stimulus (CS) was presented once, without reinforcement; memory strength was then tested again 24 hours later. Re-presentation of the CS under ketamine led to a stronger subsequent memory than under placebo. Moreover, the degree of strengthening correlated with individual vulnerability to ketamine's psychotogenic effects and with prediction error brain signal. This finding was partially replicated in an independent sample with an appetitive learning procedure (in 8 human subjects, 4 female). These results suggest a link between altered prediction error, memory strength and psychosis. They point to a core disruption that may explain not only the emergence of delusional beliefs but also their persistence.

Addiction: failure of control over maladaptive incentive habits

Drug addiction may be associated with a loss of executive control over maladaptive incentive habits. We hypothesize that these incentive habits result from a pathological coupling of drug-influenced motivational states and a rigid stimulus-response habit system by which drug-associated stimuli through automatic processes elicit and maintain drug seeking. Neurally, incentive habits may depend upon an interaction between the basolateral amygdala and nucleus accumbens core, together with the progressive development of a ventral-to-dorsolateral striatum functional coupling through the recruitment of striato-nigro-striatal dopamine-dependent loop circuitry. Recent evidence suggests that both ventral striatal and central nucleus pathways from the amygdala may be required for the recruitment of DLS-dependent control over habitual behavior.

From the ventral to the dorsal striatum: devolving views of their roles in drug addiction

We revisit our hypothesis that drug addiction can be viewed as the endpoint of a series of transitions from initial voluntarily drug use to habitual, and ultimately compulsive drug use. We especially focus on the transitions in striatal control over drug seeking behaviour that underlie these transitions since functional heterogeneity of the striatum was a key area of Ann Kelley's research interests and one in which she made enormous contributions. We also discuss the hypothesis in light of recent data that the emergence of a compulsive drug seeking habit both reflects a shift to dorsal striatal control over behaviour and impaired prefontal cortical inhibitory control mechanisms. We further discuss aspects of the vulnerability to compulsive drug use and in particular the impact of impulsivity. In writing this review we acknowledge the untimely death of an outstanding scientist and a dear personal friend.

Double dissociation of the dorsomedial and dorsolateral striatal control over the acquisition and performance of cocaine seeking

The present study investigated the involvement of dopamine-dependent mechanisms in the anterior dorsolateral (aDLS) and posterior dorsomedial (pDMS) striatum during the early- and late-stage performance of cocaine-seeking behavior. Rats were trained to self-administer cocaine under continuous reinforcement (fixed-ratio 1, FR1) with a 20-s light conditioned stimulus (CS) presented contingently upon each infusion. After a week, rats were challenged by a change in contingency to seek cocaine during a 15-min period uninfluenced by cocaine during which each response was reinforced by a 1-s CS presentation. Dopamine transmission blockade by intracranial infusions of α-flupenthixol only in the pDMS, but not in the aDLS, dose dependently reduced performance of cue-controlled cocaine seeking at the early stage of self-administration. One cohort of rats was then trained with increasing response requirements until completing 15 sessions under a second-order schedule [FI15(FR10:S)] so that cocaine-seeking performance became well established. At this stage, intra-aDLS, but not pDMS, α-flupenthixol infusions dose dependently reduced active lever presses. The second cohort of rats continued to self-administer cocaine under the FR1 schedule such that their drug intake was matched to the late-stage performance group. α-Flupenthixol in the pDMS, but not in the aDLS, again prevented the performance of cocaine seeking. These results show that dopamine transmission in the pDMS is required for initial performance of goal-directed cocaine seeking, and that its role is ultimately subverted and devolves instead to the aDLS only following training with high rates of cocaine-seeking behavior, supporting the theory of dynamic shifts in the striatal control over cocaine seeking between goal-directed and habitual performance.

Norepinephrine and dopamine modulate impulsivity on the five-choice serial reaction time task through opponent actions in the shell and core sub-regions of the nucleus accumbens

Impulsive behavior is a hallmark of several neuropsychiatric disorders (eg, attention-deficit/hyperactivity disorder, ADHD). Although dopamine (DA) and norepinephrine (NE) have a significant role in the modulation of impulsivity their neural loci of action is not well understood. Here, we investigated the effects of the selective NE re-uptake inhibitor atomoxetine (ATO) and the mixed DA/NE re-uptake inhibitor methylphenidate (MPH), both with proven clinical efficacy in ADHD, on the number of premature responses on a five-choice serial reaction time task, an operational measure of impulsivity. Microinfusions of ATO into the shell, but not the core, sub-region of the nucleus accumbens (NAcb) significantly decreased premature responding whereas infusions of MPH in the core, but not the shell, sub-region significantly increased premature responding. However, neither ATO nor MPH significantly altered impulsive behavior when infused into the prelimbic or infralimbic cortices. The opposing effects of ATO and MPH in the NAcb core and shell on impulsivity were unlikely mediated by ancillary effects on behavioral activation as locomotor activity was either unaffected, as in the case of ATO infusions in the core and shell, or increased when MPH was infused into either the core and shell sub-region. These findings indicate an apparently 'opponent' modulation of premature responses by NE and DA in the NAcb shell or core, respectively, and suggest that the symptom clusters of hyperactive-impulsive type ADHD may have distinct neural and neurochemical substrates.

N-Acetylcysteine reduces early- and late-stage cocaine seeking without affecting cocaine taking in rats

N-acetylcysteine (NAC) has been suggested to have therapeutic potential in the treatment of drug addiction through its effects on brain glutamate homeostasis. Here we show that NAC treatment resulted in dose-dependent reductions in cocaine seeking at both early and late stages of acquisition and maintenance of cocaine-seeking behavior, while confirming it had no effect on cocaine reinforcement. The results indicate that NAC is able to significantly diminish the propensity to seek cocaine early and late in the development of addiction and, taken together with previous work, indicates significant potential in relapse prevention.

The persistence of maladaptive memory: addiction, drug memories and anti-relapse treatments

Addiction is a chronic, relapsing disorder, characterised by the long-term propensity of addicted individuals to relapse. A major factor that obstructs the attainment of abstinence is the persistence of maladaptive drug-associated memories, which can maintain drug-seeking and taking behaviour and promote unconscious relapse of these habits. Thus, addiction can be conceptualised as a disorder of aberrant learning of the formation of strong instrumental memories linking actions to drug-seeking and taking outcomes that ultimately are expressed as persistent stimulus-response habits; of previously neutral environmental stimuli that become associated with drug highs (and/or withdrawal states) through pavlovian conditioning, and of the subsequent interactions between pavlovian and instrumental memories to influence relapse behaviour. Understanding the psychological, neurobiological and molecular basis of these drug memories may produce new methods of pro-abstinence, anti-relapse treatments for addiction.