Firing patterns of nucleus accumbens neurons during cocaine self-administration in rats

Kappa opioid receptors diminish spontaneous dopamine signals in awake mice through multiple mechanisms

The role of the dynorphin/kappa opioid receptor (KOR) system in dopamine (DA) regulation has been extensively investigated. KOR activation reduces extracellular DA concentrations, but the exact mechanism(s) through which this is accomplished are not fully elucidated. To explore KOR influences on real-time DA fluctuations, we used the photosensor dLight1.2 with fiber photometry in the nucleus accumbens (NAc) core of freely moving male and female C57BL/6J mice. First, we established that the rise and fall of spontaneously arising DA signals were due to DA release and reuptake, respectively. Next, mice were systemically administered the KOR agonist U50,488H in the presence or absence of the KOR antagonist aticaprant. U50,488H reduced both the amplitude and width of spontaneous signals in both sexes. Further, the slope of the correlation between amplitude and width was increased, indicating that DA uptake rates were increased. U50,488H also reduced the frequency of occurrence of signals in males and females. The effects of KOR activation were stronger in males, while effects of KOR antagonism were stronger in females. Overall, KORs exerted significant inhibitory control over spontaneous DA signaling, acting through at least three mechanisms - inhibiting DA release, promoting DA transporter-mediated uptake, and reducing the frequency of signals.

Kappa Opioid Receptors Negatively Regulate Real Time Spontaneous Dopamine Signals by Reducing Release and Increasing Uptake

The role of the dynorphin/kappa opioid receptor (KOR) system in dopamine (DA) regulation has been extensively investigated. KOR activation reduces extracellular DA concentrations and increases DA transporter (DAT) activity and trafficking to the membrane. To explore KOR influences on real-time DA fluctuations, we used the photosensor dLight1.2 with fiber photometry in the nucleus accumbens (NAc) core of freely moving male and female C57BL/6 mice. First, we established that the rise and fall of spontaneous DA signals were due to DA release and reuptake, respectively. Then mice were systemically administered the KOR agonist U50,488H (U50), with or without pretreatment with the KOR antagonist aticaprant (ATIC). U50 reduced both the amplitude and width of spontaneous signals in males, but only reduced width in females. Further, the slope of the correlation between amplitude and width was increased in both sexes, suggesting that DA uptake rates were increased. U50 also reduced the frequency of signals in both males and females. All effects of KOR activation were stronger in males. Overall, KORs exerted significant inhibitory control over spontaneous DA signaling, acting through at least three mechanisms - inhibiting DA release, promoting DAT-mediated uptake, and reducing the frequency of signals.

Approaches and considerations of studying neuronal ensembles: a brief review

First theorized by Hebb, neuronal ensembles have provided a framework for understanding how the mammalian brain operates, especially regarding learning and memory. Neuronal ensembles are discrete, sparsely distributed groups of neurons that become activated in response to a specific stimulus and are thought to provide an internal representation of the world. Beyond the study of region-wide or projection-wide activation, the study of ensembles offers increased specificity and resolution to identify and target specific memories or associations. Neuroscientists interested in the neurobiology of learning, memory, and motivated behavior have used electrophysiological-, calcium-, and protein-based proxies of neuronal activity in preclinical models to better understand the neurobiology of learned and motivated behaviors. Although these three approaches may be used to pursue the same general goal of studying neuronal ensembles, technical differences lead to inconsistencies in the output and interpretation of data. This mini-review highlights some of the methodologies used in electrophysiological-, calcium-, and protein-based studies of neuronal ensembles and discusses their strengths and weaknesses.

Cellular and molecular basis of drug addiction: The role of neuronal ensembles in addiction

Addiction has been conceptualized as a disease of learning and memory. Learned associations between environmental cues and unconditioned rewards induced by drug administration, which play a critical role in addiction, have been shown to be encoded in sparsely distributed populations of neurons called neuronal ensembles. This review aims to highlight how synaptic remodeling and alterations in signaling pathways that occur specifically in neuronal ensembles contribute to the pathogenesis of addiction. Furthermore, a causal link between transcriptional and epigenetic modifications in neuronal ensembles and the development of the addictive state is proposed. Translational studies of molecular and cellular changes in neuronal ensembles that contribute to drug-seeking behavior, will allow the identification of molecular and circuit targets and interventions for substance use disorders.

Modafinil Administration to Preadolescent Rat Impairs Non-Selective Attention, Frontal Cortex D2 Expression and Mesolimbic GABA Levels

The misuse of psychostimulants is an increasing behavior among young people, highlighting in some countries the abuse of modafinil (MOD) as a neuropotentiator. However, several clinical trials are investigating MOD as an alternative pharmacological treatment for attentional deficit and hyperactivity disorder (ADHD) in children and adolescents. On the other hand, the early use of psychostimulants and the misdiagnosis rates in ADHD make it crucial to investigate the brain effects of this type of drug in young healthy individuals. The aim of this work was to evaluate the effects of chronic MOD treatment on neurochemicals (γ-aminobutyric acid and glutamate), dopamine receptor 2 (D₂) expression and behavior (non-selective attention "NSA") in the mesocorticolimbic system of young healthy Sprague-Dawley rats. Preadolescent male rats were injected with MOD (75 mg/kg, i.p.) or a vehicle for 14 days (from postnatal day 22 to 35). At postnatal day 36, we measured the GLU and GABA contents and their extracellular levels in the nucleus accumbens (NAc). In addition, the GLU and GABA contents were measured in the ventral tegmental area (VTA) and D₂ protein levels in the prefrontal cortex (PFC). Chronic use of MOD during adolescence induces behavioral and neurochemical changes associated with the mesocorticolimbic system, such as a reduction in PFC D₂ expression, VTA GABA levels and NSA. These results contribute to the understanding of the neurological effects of chronic MOD use on a young healthy brain.

Choice-selective sequences dominate in cortical relative to thalamic inputs to NAc to support reinforcement learning

How are actions linked with subsequent outcomes to guide choices? The nucleus accumbens, which is implicated in this process, receives glutamatergic inputs from the prelimbic cortex and midline regions of the thalamus. However, little is known about whether and how representations differ across these input pathways. By comparing these inputs during a reinforcement learning task in mice, we discovered that prelimbic cortical inputs preferentially represent actions and choices, whereas midline thalamic inputs preferentially represent cues. Choice-selective activity in the prelimbic cortical inputs is organized in sequences that persist beyond the outcome. Through computational modeling, we demonstrate that these sequences can support the neural implementation of reinforcement-learning algorithms, in both a circuit model based on synaptic plasticity and one based on neural dynamics. Finally, we test and confirm a prediction of our circuit models by direct manipulation of nucleus accumbens input neurons.

Cocaine-induced projection-specific and cell type-specific adaptations in the nucleus accumbens

Cocaine craving, seeking, and relapse are mediated, in part, by cocaine-induced adaptive changes in the brain reward circuits. The nucleus accumbens (NAc) integrates and prioritizes different emotional and motivational inputs to the reward system by processing convergent glutamatergic projections from the medial prefrontal cortex, basolateral amygdala, ventral hippocampus, and other limbic and paralimbic brain regions. Medium spiny neurons (MSNs) are the principal projection neurons in the NAc, which can be divided into two major subpopulations, namely dopamine receptor D1- versus D2-expressing MSNs, with complementing roles in reward-associated behaviors. After cocaine experience, NAc MSNs exhibit complex and differential adaptations dependent on cocaine regimen, withdrawal time, cell type, location (NAc core versus shell), and related input and output projections, or any combination of these factors. Detailed characterization of these cellular adaptations has been greatly facilitated by the recent development of optogenetic/chemogenetic techniques combined with transgenic tools. In this review, we discuss such cell type- and projection-specific adaptations induced by cocaine experience. Specifically, (1) D1 and D2 NAc MSNs frequently exhibit differential adaptations in spinogenesis, glutamatergic receptor trafficking, and intrinsic membrane excitability, (2) cocaine experience differentially changes the synaptic transmission at different afferent projections onto NAc MSNs, (3) cocaine-induced NAc adaptations exhibit output specificity, e.g., being different at NAc-ventral pallidum versus NAc-ventral tegmental area synapses, and (4) the input, output, subregion, and D1/D2 cell type may together determine cocaine-induced circuit plasticity in the NAc. In light of the projection- and cell-type specificity, we also briefly discuss ensemble and circuit mechanisms contributing to cocaine craving and relapse after drug withdrawal.

Dynamic dichotomy of accumbal population activity underlies cocaine sensitization

Locomotor sensitization (LS) is an early behavioral adaptation to addictive drugs, driven by the increase of dopamine in the Nucleus Accumbens (NAc). However, the effect on accumbal population activity remains elusive. Here, we used single-cell calcium imaging in mice to record the activity of dopamine-1-receptor (D1R) and dopamine-2-receptor (D2R) expressing spiny projection neurons (SPNs) during cocaine LS. Acute exposure to cocaine elevated D1R SPN activity and reduced D2R SPN activity, albeit with high variability between neurons. During LS, the number of D1R and D2R neurons responding in opposite directions increased. Moreover, preventing LS by inhibition of the ERK signaling pathway decreased the number of cocaine responsive D1R SPNs, but had little effect on D2R SPNs. These results indicate that accumbal population dichotomy is dynamic and contains a subgroup of D1R SPNs that eventually drives LS. Insights into the drug-related activity dynamics provides a foundation for understanding the circuit-level addiction pathogenesis.

BEHAVIORAL AND NEUROBIOLOGICAL MECHANISMS OF PAVLOVIAN AND INSTRUMENTAL EXTINCTION LEARNING

This article reviews the behavioral neuroscience of extinction, the phenomenon in which a behavior that has been acquired through Pavlovian or instrumental (operant) learning decreases in strength when the outcome that reinforced it is removed. Behavioral research indicates that neither Pavlovian nor operant extinction depends substantially on erasure of the original learning but instead depends on new inhibitory learning that is primarily expressed in the context in which it is learned, as exemplified by the renewal effect. Although the nature of the inhibition may differ in Pavlovian and operant extinction, in either case the decline in responding may depend on both generalization decrement and the correction of prediction error. At the neural level, Pavlovian extinction requires a tripartite neural circuit involving the amygdala, prefrontal cortex, and hippocampus. Synaptic plasticity in the amygdala is essential for extinction learning, and prefrontal cortical inhibition of amygdala neurons encoding fear memories is involved in extinction retrieval. Hippocampal-prefrontal circuits mediate fear relapse phenomena, including renewal. Instrumental extinction involves distinct ensembles in corticostriatal, striatopallidal, and striatohypothalamic circuits as well as their thalamic returns for inhibitory (extinction) and excitatory (renewal and other relapse phenomena) control over operant responding. The field has made significant progress in recent decades, although a fully integrated biobehavioral understanding still awaits.

Vulnerability to addiction

Addiction is a chronic brain disease that has dramatic health and socioeconomic consequences worldwide. Multiple approaches have been used for decades to clarify the neurobiological basis of this disease and to identify novel potential treatments. This review summarizes the main brain networks involved in the vulnerability to addiction and specific innovative technological approaches to investigate these neural circuits. First, the evolution of the definition of addiction across the Diagnostic and Statistical Manual of Mental Disorders (DSM) is revised. We next discuss several innovative experimental techniques that, combined with behavioral approaches, have allowed recent critical advances in understanding the neural circuits involved in addiction, including DREADDs, calcium imaging, and electrophysiology. All these techniques have been used to investigate specific neural circuits involved in vulnerability to addiction and have been extremely useful to clarify the neurobiological basis of each specific component of the addictive process. These novel tools targeting specific brain regions are of great interest to further understand the different aspects of this complex disease. This article is part of the special issue on 'Vulnerabilities to Substance Abuse.'.

The Tubular Striatum

In the mid-19th century, a misconception was born, which understandably persists in the minds of many neuroscientists today. The eminent scientist Albert von Kölliker named a tubular-shaped piece of tissue found in the brains of all mammals studied to date, the tuberculum olfactorium - or what is commonly known as the olfactory tubercle (OT). In doing this, Kölliker ascribed "olfactory" functions and an "olfactory" purpose to the OT. The OT has since been classified as one of several olfactory cortices. However, further investigations of OT functions, especially over the last decade, have provided evidence for roles of the OT beyond olfaction, including in learning, motivated behaviors, and even seeking of psychoactive drugs. Indeed, research to date suggests caution in assigning the OT with a purely olfactory role. Here, I build on previous research to synthesize a model wherein the OT, which may be more appropriately termed the "tubular striatum" (TuS), is a neural system in which sensory information derived from an organism's experiences is integrated with information about its motivational states to guide affective and behavioral responses.

Chasing the addicted engram: identifying functional alterations in Fos-expressing neuronal ensembles that mediate drug-related learned behavior

Given that addiction has been characterized as a disorder of maladaptive learning and memory, one critical question is whether there are unique physical adaptations within neuronal ensembles that support addiction-related learned behavior. The search for the physical mechanisms of encoding these and other memories in the brain, often called the engram as a whole, continues despite decades of research. As we develop new technologies and tools that allow us to study cue- and behavior-activated Fos-expressing neuronal ensembles, the possibility of identifying the engrams of learning and memory is moving into the realm of reality rather than speculation. It has become clear from recent studies that there are specific functional, electrophysiological alterations unique to Fos-expressing ensemble neurons that may participate in encoding memories. The ultimate goal is to identify the addicted engram and reverse the physical changes that support this maladaptive form of learning.

Cerebellum Transcriptome of Mice Bred for High Voluntary Activity Offers Insights into Locomotor Control and Reward-Dependent Behaviors

The role of the cerebellum in motivation and addictive behaviors is less understood than that in control and coordination of movements. High running can be a self-rewarding behavior exhibiting addictive properties. Changes in the cerebellum transcriptional networks of mice from a line selectively bred for High voluntary running (H) were profiled relative to an unselected Control (C) line. The environmental modulation of these changes was assessed both in activity environments corresponding to 7 days of Free (F) access to running wheel and to Blocked (B) access on day 7. Overall, 457 genes exhibited a significant (FDR-adjusted P-value < 0.05) genotype-by-environment interaction effect, indicating that activity genotype differences in gene expression depend on environmental access to running. Among these genes, network analysis highlighted 6 genes (Nrgn, Drd2, Rxrg, Gda, Adora2a, and Rab40b) connected by their products that displayed opposite expression patterns in the activity genotype contrast within the B and F environments. The comparison of network expression topologies suggests that selection for high voluntary running is linked to a predominant dysregulation of hub genes in the F environment that enables running whereas a dysregulation of ancillary genes is favored in the B environment that blocks running. Genes associated with locomotor regulation, signaling pathways, reward-processing, goal-focused, and reward-dependent behaviors exhibited significant genotype-by-environment interaction (e.g. Pak6, Adora2a, Drd2, and Arhgap8). Neuropeptide genes including Adcyap1, Cck, Sst, Vgf, Npy, Nts, Penk, and Tac2 and related receptor genes also exhibited significant genotype-by-environment interaction. The majority of the 183 differentially expressed genes between activity genotypes (e.g. Drd1) were under-expressed in C relative to H genotypes and were also under-expressed in B relative to F environments. Our findings indicate that the high voluntary running mouse line studied is a helpful model for understanding the molecular mechanisms in the cerebellum that influence locomotor control and reward-dependent behaviors.

Associative Learning Drives the Formation of Silent Synapses in Neuronal Ensembles of the Nucleus Accumbens

BACKGROUND

Learned associations between environmental stimuli and rewards play a critical role in addiction. Associative learning requires alterations in sparsely distributed populations of strongly activated neurons, or neuronal ensembles. Until recently, assessment of functional alterations underlying learned behavior was restricted to global neuroadaptations in a particular brain area or cell type, rendering it impossible to identify neuronal ensembles critically involved in learned behavior.

METHODS

We used Fos-GFP transgenic mice that contained a transgene with a Fos promoter driving expression of green fluorescent protein (GFP) to detect neurons that were strongly activated during associative learning, in this case, context-independent and context-specific cocaine-induced locomotor sensitization. Whole-cell electrophysiological recordings were used to assess synaptic alterations in specifically activated GFP-positive (GFP+) neurons compared with surrounding nonactivated GFP-negative (GFP-) neurons 90 min after the sensitized locomotor response.

RESULTS

After context-independent cocaine sensitization, cocaine-induced locomotion was equally sensitized by repeated cocaine injections in two different sensitization contexts. Correspondingly, silent synapses in these mice were induced in GFP+ neurons, but not GFP- neurons, after sensitization in both of these contexts. After context-specific cocaine sensitization, cocaine-induced locomotion was sensitized exclusively in mice trained and tested in the same context (paired group), but not in mice that were trained in one context and then tested in a different context (unpaired group). Silent synapses increased in GFP+ neurons, but not in GFP- neurons from mice in the paired group, but not from mice in the unpaired group.

CONCLUSIONS

Our results indicate that silent synapses are formed only in neuronal ensembles of the nucleus accumbens shell that are related to associative learning.

Frontostriatal Circuit Dynamics Correlate with Cocaine Cue-Evoked Behavioral Arousal during Early Abstinence

It is thought that frontostriatal circuits play an important role in mediating conditioned behavioral responses to environmental stimuli that were previously encountered during drug administration. However, the neural correlates of conditioned responses to drug-associated cues are not well understood at the level of large populations of simultaneously recorded neurons, or at the level of local field potential (LFP) synchrony in the frontostriatal network.

It is thought that frontostriatal circuits play an important role in mediating conditioned behavioral responses to environmental stimuli that were previously encountered during drug administration. However, the neural correlates of conditioned responses to drug-associated cues are not well understood at the level of large populations of simultaneously recorded neurons, or at the level of local field potential (LFP) synchrony in the frontostriatal network. Here we introduce a behavioral assay of conditioned arousal to cocaine cues involving pupillometry in awake head-restrained mice. After just 24 h of drug abstinence, brief exposures to olfactory stimuli previously paired with cocaine injections led to a transient dilation of the pupil, which was greater than the dilation effect to neutral cues. In contrast, there was no cue-selective change in locomotion, as measured by the rotation of a circular treadmill. The behavioral assay was combined with simultaneous recordings from dozens of electrophysiologically identified units in the medial prefrontal cortex (mPFC) and ventral striatum (VS). We found significant relationships between cocaine cue-evoked pupil dilation and the proportion of inhibited principal cells in the mPFC and VS. Additionally, LFP coherence analysis revealed a significant correlation between pupillary response and synchrony in the 25–45 Hz frequency band. Together, these results show that pupil dilation is sensitive to drug-associated cues during acute stages of abstinence, and that individual animal differences in this behavioral arousal response can be explained by two complementary measures of frontostriatal network activity.

The Neural Representation of Goal-Directed Actions and Outcomes in the Ventral Striatum's Olfactory Tubercle

The ventral striatum is critical for evaluating reward information and the initiation of goal-directed behaviors. The many cellular, afferent, and efferent similarities between the ventral striatum's nucleus accumbens and olfactory tubercle (OT) suggests the distributed involvement of neurons within the ventral striatopallidal complex in motivated behaviors. Although the nucleus accumbens has an established role in representing goal-directed actions and their outcomes, it is not known whether this function is localized within the nucleus accumbens or distributed also within the OT. Answering such a fundamental question will expand our understanding of the neural mechanisms underlying motivated behaviors. Here we address whether the OT encodes natural reinforcers and serves as a substrate for motivational information processing. In recordings from mice engaged in a novel water-motivated instrumental task, we report that OT neurons modulate their firing rate during initiation and progression of the instrumental licking behavior, with some activity being internally generated and preceding the first lick. We further found that as motivational drive decreases throughout a session, the activity of OT neurons is enhanced earlier relative to the behavioral action. Additionally, OT neurons discriminate the types and magnitudes of fluid reinforcers. Together, these data suggest that the processing of reward information and the orchestration of goal-directed behaviors is a global principle of the ventral striatum and have important implications for understanding the neural systems subserving addiction and mood disorders.

SIGNIFICANCE STATEMENT

Goal-directed behaviors are widespread among animals and underlie complex behaviors ranging from food intake, social behavior, and even pathological conditions, such as gambling and drug addiction. The ventral striatum is a neural system critical for evaluating reward information and the initiation of goal-directed behaviors. Here we show that neurons in the olfactory tubercle subregion of the ventral striatum robustly encode the onset and progression of motivated behaviors, and discriminate the type and magnitude of a reward. Our findings are novel in showing that olfactory tubercle neurons participate in such coding schemes and are in accordance with the principle that ventral striatum substructures may cooperate to guide motivated behaviors.

In vivo imaging identifies temporal signature of D1 and D2 medium spiny neurons in cocaine reward

The reinforcing and rewarding properties of cocaine are attributed to its ability to increase dopaminergic transmission in nucleus accumbens (NAc). This action reinforces drug taking and seeking and leads to potent and long-lasting associations between the rewarding effects of the drug and the cues associated with its availability. The inability to extinguish these associations is a key factor contributing to relapse. Dopamine produces these effects by controlling the activity of two subpopulations of NAc medium spiny neurons (MSNs) that are defined by their predominant expression of either dopamine D1 or D2 receptors. Previous work has demonstrated that optogenetically stimulating D1 MSNs promotes reward, whereas stimulating D2 MSNs produces aversion. However, we still lack a clear understanding of how the endogenous activity of these cell types is affected by cocaine and encodes information that drives drug-associated behaviors. Using fiber photometry calcium imaging we define D1 MSNs as the specific population of cells in NAc that encodes information about drug associations and elucidate the temporal profile with which D1 activity is increased to drive drug seeking in response to contextual cues. Chronic cocaine exposure dysregulates these D1 signals to both prevent extinction and facilitate reinstatement of drug seeking to drive relapse. Directly manipulating these D1 signals using designer receptors exclusively activated by designer drugs prevents contextual associations. Together, these data elucidate the responses of D1- and D2-type MSNs in NAc to acute cocaine and during the formation of context-reward associations and define how prior cocaine exposure selectively dysregulates D1 signaling to drive relapse.

Food reward system: current perspectives and future research needs

This article reviews current research and cross-disciplinary perspectives on the neuroscience of food reward in animals and humans, examines the scientific hypothesis of food addiction, discusses methodological and terminology challenges, and identifies knowledge gaps and future research needs. Topics addressed herein include the role of reward and hedonic aspects in the regulation of food intake, neuroanatomy and neurobiology of the reward system in animals and humans, responsivity of the brain reward system to palatable foods and drugs, translation of craving versus addiction, and cognitive control of food reward. The content is based on a workshop held in 2013 by the North American Branch of the International Life Sciences Institute.

Using c-fos to study neuronal ensembles in corticostriatal circuitry of addiction

Learned associations between drugs and environment play an important role in addiction and are thought to be encoded within specific patterns of sparsely distributed neurons called neuronal ensembles. This hypothesis is supported by correlational data from in vivo electrophysiology and cellular imaging studies in relapse models in rodents. In particular, cellular imaging with the immediate early gene c-fos and its protein product Fos has been used to identify sparsely distributed neurons that were strongly activated during conditioned drug behaviors such as drug self-administration and context- and cue-induced reinstatement of drug seeking. Here we review how Fos and the c-fos promoter have been employed to demonstrate causal roles for Fos-expressing neuronal ensembles in prefrontal cortex and nucleus accumbens in conditioned drug behaviors. This work has allowed identification of unique molecular and electrophysiological alterations within Fos-expressing neuronal ensembles that may contribute to the development and expression of learned associations in addiction.

Role of nucleus accumbens shell neuronal ensembles in context-induced reinstatement of cocaine-seeking

Environmental contexts previously associated with drug use provoke relapse to drug use in humans and reinstatement of drug seeking in animal models of drug relapse. We examined whether context-induced reinstatement of cocaine seeking is mediated by activation of context-selected nucleus accumbens neurons. We trained rats to self-administer cocaine in Context A and extinguished their lever-pressing in a distinct Context B. On test day, reexposure to the cocaine-associated Context A reinstated cocaine seeking and increased expression of the neural activity marker Fos in 3.3% of accumbens shell and 1.6% of accumbens core neurons. To assess a causal role for these activated neurons, we used the Daun02 inactivation procedure to selectively inactivate these neurons. We trained c-fos-lacZ transgenic rats to self-administer cocaine in Context A and extinguished their lever-pressing in Context B. On induction day, we exposed rats to either Context A or a novel Context C for 30 min and injected Daun02 or vehicle into accumbens shell or core 60 min later. On test day, 3 d after induction day, the ability of Context A to reinstate cocaine seeking and increase neuronal activity in accumbens shell was attenuated when Daun02 was previously injected after exposure to Context A. Daun02 injections after exposure to the novel Context C had no effect on context-induced reinstatement of cocaine seeking despite much greater numbers of Fos-expressing neurons induced by Context C. Daun02 injections in accumbens core had no effect. Our data suggest that context-induced reinstatement of cocaine seeking is mediated by activation of context-selected accumbens shell but not core neuronal ensembles.

Escalation of cocaine intake and incubation of cocaine seeking are correlated with dissociable neuronal processes in different accumbens subregions

BACKGROUND

Cocaine addiction is characterized by a progressive increase in drug intake and a persistent craving for the drug during prolonged abstinence. Whether these two prominent features of cocaine addiction are related to each other and are mediated by similar or different neuronal processes is currently unknown.

METHODS

Rats were first allowed to self-administer cocaine under long-access (6-hour) conditions to induce escalation of cocaine intake. Self-administration sessions were designed to measure both drug seeking and drug taking. After escalation, rats underwent a 1-month period of forced abstinence after which they were re-exposed to cocaine to induce re-escalation of cocaine intake. In vivo electrophysiologic recordings were conducted in the core and shell subregions of the nucleus accumbens (NAc) during cocaine intake escalation, after abstinence and during re-escalation.

RESULTS

After abstinence, escalated levels of cocaine taking decreased toward pre-escalation levels, whereas cocaine seeking increased persistently. These opposite postabstinence changes were uncorrelated. At the neuronal level, the postabstinence decrease in cocaine taking was correlated with a normalization of depressed neuronal activity in the NAc shell that had developed during escalation of cocaine intake. In contrast, the incubation-like increase in cocaine seeking was selectively correlated with a persistent increase in the proportion of neurons in the NAc core that phasically fire during cocaine seeking.

CONCLUSIONS

These findings show that cocaine taking and cocaine seeking evolve differently during abstinence from extended drug use and depend on dissociable neuronal processes in different subregions of the nucleus accumbens.

Nucleus accumbens neurons track behavioral preferences and reward outcomes during risky decision making

BACKGROUND

To make appropriate decisions, organisms must evaluate the risks and benefits of action selection. The nucleus accumbens (NAc) has been shown to be critical for this processing and is necessary for appropriate risk-based decision-making behavior. However, it is not clear how NAc neurons encode this information to promote appropriate behavioral responding.

METHODS

Here, rats (n = 17) were trained to perform a risky decision-making task in which discrete visual cues predicted the availability to respond for a smaller certain (safer) or larger uncertain (riskier) reward. Electrophysiological recordings were made in the NAc core and shell to evaluate neural activity during task performance.

RESULTS

At test, animals exhibited individual differences in risk-taking behavior; some displayed a preference for the risky option, some the safe option, and some did not have a preference. Electrophysiological analysis indicated that NAc neurons differentially encoded information related to risk versus safe outcomes. Further, during free choice trials, neural activity during reward-predictive cues reflected individual behavioral preferences. In addition, neural encoding of reward outcomes was correlated with risk-taking behavior, with safe-preferring and risk-preferring rats showing differential activity in the NAc core and shell during reward omissions.

CONCLUSIONS

Consistent with previously demonstrated alterations in prospective reward value with effort and delay, NAc neurons encode information during reward-predictive cues and outcomes in a risk task that tracked the rats' preferred responses. This processing appears to contribute to subjective encoding of anticipated outcomes and thus may function to bias future risk-based decisions.

Behavior modulates effective connectivity between cortex and striatum

It has been notoriously difficult to understand interactions in the basal ganglia because of multiple recurrent loops. Another complication is that activity there is strongly dependent on behavior, suggesting that directional interactions, or effective connections, can dynamically change. A simplifying approach would be to examine just the direct, monosynaptic projections from cortex to striatum and contrast this with the polysynaptic feedback connections from striatum to cortex. Previous work by others on effective connectivity in this pathway indicated that activity in cortex could be used to predict activity in striatum, but that striatal activity could not predict cortical activity. However, this work was conducted in anesthetized or seizing animals, making it impossible to know how free behavior might influence effective connectivity. To address this issue, we applied Granger causality to local field potential signals from cortex and striatum in freely behaving rats. Consistent with previous results, we found that effective connectivity was largely unidirectional, from cortex to striatum, during anesthetized and resting states. Interestingly, we found that effective connectivity became bidirectional during free behaviors. These results are the first to our knowledge to show that striatal influence on cortex can be as strong as cortical influence on striatum. In addition, these findings highlight how behavioral states can affect basal ganglia interactions. Finally, we suggest that this approach may be useful for studies of Parkinson's or Huntington's diseases, in which effective connectivity may change during movement.

New technologies for examining the role of neuronal ensembles in drug addiction and fear

Correlational data suggest that learned associations are encoded within neuronal ensembles. However, it has been difficult to prove that neuronal ensembles mediate learned behaviours because traditional pharmacological and lesion methods, and even newer cell type-specific methods, affect both activated and non-activated neurons. In addition, previous studies on synaptic and molecular alterations induced by learning did not distinguish between behaviourally activated and non-activated neurons. Here, we describe three new approaches--Daun02 inactivation, FACS sorting of activated neurons and Fos-GFP transgenic rats--that have been used to selectively target and study activated neuronal ensembles in models of conditioned drug effects and relapse. We also describe two new tools--Fos-tTA transgenic mice and inactivation of CREB-overexpressing neurons--that have been used to study the role of neuronal ensembles in conditioned fear.

When a good taste turns bad: Neural mechanisms underlying the emergence of negative affect and associated natural reward devaluation by cocaine

An important feature of cocaine addiction in humans is the emergence of negative affect (e.g., dysphoria, irritability, anhedonia), postulated to play a key role in craving and relapse. Indeed, the DSM-IV recognizes that social, occupational and/or recreational activities become reduced as a consequence of repeated drug use where previously rewarding experiences (e.g., food, job, family) become devalued as the addict continues to seek and use drug despite serious negative consequences. Here, research in the Carelli laboratory is reviewed that examined neurobiological mechanisms that may underlie these processes using a novel animal model. Oromotor responses (taste reactivity) were examined as rats learned that intraoral infusion of a sweet (e.g., saccharin) predicts impending but delayed access to cocaine self-administration. We showed that rats exhibit aversive taste reactivity (i.e., gapes/rejection responses) during infusion of the sweet paired with impending cocaine, similar to aversive responses observed during infusion of quinine, a bitter tastant. Critically, the expression of this pronounced aversion to the sweet predicted the subsequent motivation to self-administer cocaine. Electrophysiology studies show that this shift in palatability corresponds to an alteration in nucleus accumbens (NAc) cell firing; neurons that previously responded with inhibition during infusion of the palatable sweet shifted to excitatory activity during infusion of the cocaine-devalued tastant. This excitatory response profile is typically observed during infusion of quinine, indicating that the once palatable sweet becomes aversive following its association with impending but delayed cocaine, and NAc neurons encode this aversive state. We also review electrochemical studies showing a shift (from increase to decrease) in rapid NAc dopamine release during infusion of the cocaine-paired tastant as the aversive state developed, again, resulting in responses similar to quinine infusion. Collectively, our findings suggest that cocaine-conditioned cues elicit a cocaine-need state that is aversive, is encoded by a distinct subset of NAc neurons and rapid dopamine signaling, and promotes cocaine-seeking behavior. Finally, we present data showing that experimentally induced abstinence (30 days) exacerbates this natural reward devaluation by cocaine, and this effect is correlated with a greater motivation to lever press during extinction. Dissecting the neural mechanisms underlying these detrimental consequences of addiction is critical since it may lead to novel treatments that ameliorate negative affective states associated with drug use and decrease the drive (craving) for the drug. This article is part of a Special Issue entitled 'NIDA 40th Anniversary Issue'.

Presynaptic dopamine modulation by stimulant self-administration

The mesolimbic dopamine system is an essential participant in the initiation and modulation of various forms of goal-directed behavior, including drug reinforcement and addiction processes. Dopamine neurotransmission is increased by acute administration of all drugs of abuse, including the stimulants cocaine and amphetamine. Chronic exposure to these drugs via voluntary self-administration provides a model of stimulant abuse that is useful in evaluating potential behavioral and neurochemical adaptations that occur during addiction. This review describes commonly used methodologies to measure dopamine and baseline parameters of presynaptic dopamine regulation, including exocytotic release and reuptake through the dopamine transporter in the nucleus accumbens core, as well as dramatic adaptations in dopamine neurotransmission and drug sensitivity that occur with acute non-contingent and chronic, contingent self-administration of cocaine and amphetamine.

Hypocretin/orexin involvement in reward and reinforcement

Since the discovery of the hypocretins/orexins, a series of observations have indicated that these peptides influence a variety of physiological processes including feeding, sleep/wake function, memory, and stress. More recently, the hypocretins have been implicated in reinforcement and reward-related processes via actions on the mesolimbic dopamine system. Although investigation into the relationship between the hypocretins and reinforcement/reward remains in relatively early stages, accumulating evidence suggests that continued research into this area may offer new insights into the addiction process and provide the foundation to generate novel pharmacotherapies for drug abuse. The current chapter will focus on contemporary perspectives of hypocretin regulation of cocaine reward and reinforcement via actions on the mesolimbic dopamine system.

Rapid dopamine signaling differentially modulates distinct microcircuits within the nucleus accumbens during sucrose-directed behavior

The mesolimbic dopamine projection from the ventral tegmental area (VTA) to the nucleus accumbens (NAc) is critical in mediating reward-related behaviors, but the precise role of dopamine in this process remains unknown. We completed a series of studies to examine whether coincident changes occur in NAc cell firing and rapid dopamine release during goal-directed behaviors for sucrose and if so, to determine whether the two are causally linked. We show that distinct populations of NAc neurons differentially encode sucrose-directed behaviors, and using a combined electrophysiology/electrochemistry technique, further show that it is at those locations that rapid dopamine signaling is observed. To determine causality, NAc cell firing was recorded during selective pharmacological inactivation of dopamine burst firing using the NMDA receptor antagonist, AP-5. We show that phasic dopamine selectively modulates excitatory but not inhibitory responses of NAc neurons during sucrose-seeking behavior. Thus, rapid dopamine signaling does not exert global actions in the NAc but selectively modulates discrete NAc microcircuits that ultimately influence goal-directed actions.

Opiate versus psychostimulant addiction: the differences do matter

The publication of the psychomotor stimulant theory of addiction in 1987 and the finding that addictive drugs increase dopamine concentrations in the rat mesolimbic system in 1988 have led to a predominance of psychobiological theories that consider addiction to opiates and addiction to psychostimulants as essentially identical phenomena. Indeed, current theories of addiction - hedonic allostasis, incentive sensitization, aberrant learning and frontostriatal dysfunction - all argue for a unitary account of drug addiction. This view is challenged by behavioural, cognitive and neurobiological findings in laboratory animals and humans. Here, we argue that opiate addiction and psychostimulant addiction are behaviourally and neurobiologically distinct and that the differences have important implications for addiction treatment, addiction theories and future research.

Nucleus accumbens neurons encode predicted and ongoing reward costs in rats

Efficient decision-making requires that animals consider both the benefits and the costs of potential actions, such as the amount of effort or temporal delay involved in reward seeking. The nucleus accumbens (NAc) has been implicated in the ability to choose between options with different costs and overcome high costs when necessary, but it is not clear how NAc processing contributes to this role. Here, neuronal activity in the rat NAc was monitored using multi-neuron electrophysiology during two cost-based decision tasks in which either reward effort or reward delay was manipulated. In each task, distinct visual cues predicted high-value (low effort/immediate) and low-value (high effort/delayed) rewards. After training, animals exhibited a behavioral preference for high-value rewards, yet overcame high costs when necessary to obtain rewards. Electrophysiological analysis indicated that a subgroup of NAc neurons exhibited phasic increases in firing rate during cue presentations. In the effort-based decision task (but not the delay-based task), this population reflected the cost-discounted value of the future response. In contrast, other subgroups of cells were activated during response initiation or reward delivery, but activity did not differ on the basis of reward cost. Finally, another population of cells exhibited sustained changes in firing rate while animals completed high-effort requirements or waited for delayed rewards. These findings are consistent with previous reports that implicate NAc function in reward prediction and behavioral allocation during reward-seeking behavior, and suggest a mechanism by which NAc activity contributes to both cost-based decisions and actual cost expenditure.

Electrophysiological evidence of mediolateral functional dichotomy in the rat nucleus accumbens during cocaine self-administration II: phasic firing patterns

In the cocaine self-administering rat, individual nucleus accumbens (NAcc) neurons exhibit phasic changes in firing rate within minutes and/or seconds of lever presses (i.e. slow phasic and rapid phasic changes, respectively). To determine whether neurons that demonstrate these changes during self-administration sessions are differentially distributed in the NAcc, rats were implanted with jugular catheters and microwire arrays in different NAcc subregions (core, dorsal shell, ventromedial shell, ventrolateral shell, or rostral pole). Neural recording sessions were typically conducted on days 13-17 of cocaine self-administration (0.77 mg/kg per 0.2-mL infusion; fixed-ratio 1 schedule of reinforcement; 6-h daily sessions). Pre-press rapid phasic firing rate changes were greater in lateral accumbal (core and ventrolateral shell) than in medial accumbal (dorsal shell and rostral pole shell) subregions. Slow phasic pattern analysis revealed that reversal latencies of neurons that exhibited change + reversal patterns differed mediolaterally: medial NAcc neurons exhibited more early reversals and fewer progressive/late reversals than lateral NAcc neurons. Comparisons of firing patterns within individual neurons across time bases indicated that lateral NAcc pre-press rapid phasic increases were correlated with tonic increases. Tonic decreases were correlated with slow phasic patterns in individual medial NAcc neurons, indicative of greater pharmacological sensitivity of neurons in this region. On the other hand, the bias of the lateral NAcc towards increased pre-press rapid phasic activity, coupled with a greater prevalence of tonic increase firing, may reflect particular sensitivity of these neurons to excitatory afferent signaling and perhaps differential pharmacological influences on firing rates between regions.

Orbitofrontal and insular cortex: neural responses to cocaine-associated cues and cocaine self-administration

Based on neuro-imaging studies in cocaine-addicted humans, it is hypothesized that increases in neural activity within several regions of the prefrontal cortex contribute to cue-induced cocaine seeking and cocaine-induced compulsive drug self-administration. However, electrophysiological tests of these hypotheses are lacking. In the present study, animals were trained to self-administer cocaine (0.75 mg/kg) for 14 days. On the 14th day, we conducted electrophysiological recordings of lateral orbitofrontal (LO) and ventral anterior insula (AIV) neurons. A subset of the combined population of recorded neurons showed a change in firing rate in association with one or more of the following discrete events: (1) presentation of a discriminative stimulus that signaled the onset of the self-administration session, (2) occurrence of the first cocaine-directed operant response, (3) occurrence of a cocaine-reinforced press, and (4) presentation of cues normally paired with delivery of the cocaine reinforcer. The majority of the stimulus- and response-related changes in firing involved a brief increase in firing during the stimulus and response event, respectively. In addition to these event-specific responses, approximately half of the recorded neurons exhibited a sustained change in average firing (i.e., discharges per 30-s bin) during the cocaine self-administration session, relative to average firing during a presession, drug-free period (referred to as session changes). The prevalence of session-increases and decreases were not significantly different. These and other findings are discussed in relation to hypotheses about cue-evoked and cocaine-maintained cocaine-directed behavior.

Electrophysiological evidence of mediolateral functional dichotomy in the rat accumbens during cocaine self-administration: tonic firing patterns

Given the increasing research emphasis on putative accumbal functional compartmentation, we sought to determine whether neurons that demonstrate changes in tonic firing rate during cocaine self-administration are differentially distributed across subregions of the NAcc. Rats were implanted with jugular catheters and microwire arrays targeting NAcc subregions (core, dorsal shell, ventromedial shell, ventrolateral shell and rostral pole shell). Recordings were obtained after acquisition of stable cocaine self-administration (0.77 mg/kg/0.2mL infusion; fixed-ratio 1 schedule of reinforcement; 6-h daily sessions). During the self-administration phase of the experiment, neurons demonstrated either: (i) tonic suppression (or decrease); (ii) tonic activation (or increase); or (iii) no tonic change in firing rate with respect to rates of firing during pre- and post-drug phases. Consistent with earlier observations, tonic decrease was the predominant firing pattern observed. Differences in the prevalence of tonic increase firing were observed between the core and the dorsal shell and dorsal shell-core border regions, with the latter two areas exhibiting a virtual absence of tonic increases. Tonic suppression was exhibited to a greater extent by the dorsal shell-core border region relative to the core. These differences could reflect distinct subregional afferent processing and/or differential sensitivity of subpopulations of NAcc neurons to cocaine. Ventrolateral shell firing topographies resembled those of core neurons. Taken together, these observations are consistent with an emerging body of literature that differentiates the accumbens mediolaterally and further advances the likelihood that distinct functions are subserved by NAcc subregions in appetitive processing.

Distinct subsets of nucleus accumbens neurons encode operant responding for ethanol versus water

Subsets of nucleus accumbens (NAc) neurons process information about operant responses for drugs as well as natural rewards (food and water) by excitations and inhibitions in firing rate time-locked to the operant response. The degree to which ensembles of neurons exhibit similar firing patterns when encoding cues and operant responses across different reinforcer conditions will provide critical information regarding the functional organization of this nucleus. The present experiment evaluated the relative contribution of subsets of accumbens neurons that encode distinct features of lever press responding for ethanol vs. water. Electrophysiological recordings (n = 153 neurons) were made in the accumbens of rats trained on concurrent reinforcement schedules for ethanol and water throughout a self-administration session. During operant responding, 52% of neurons exhibited patterned discharges characterized by significant increases or decreases in firing rate of +/- 1 s relative to lever presses for ethanol and/or water. Of these phasic cells, 85% discriminated between presses for ethanol and water (i.e. exhibited firing patterns unique to one reinforcer type), while 15% exhibited identical firing patterns relative to lever presses for both reinforcers. Notably, the data revealed that both high ethanol preference and spatially distinct lever positions contributed to the reinforcer specificity. Together, these data demonstrate that subsets of NAc neurons encode conditioned and instrumental aspects of ethanol vs. water reinforcement in well-trained rats, and that reinforcer preference and spatial cues are important components of this differential information processing.

Behavioral responding and nucleus accumbens cell firing are unaltered following periods of abstinence from sucrose

A critical feature of cocaine addiction is the strong propensity to relapse following periods of abstinence. Here, we examined whether abstinence from sucrose self-administration in rats altered behavioral responding and nucleus accumbens (NAc) cell firing in a manner similar to that observed following cocaine abstinence. Rats (n = 22) were trained to self-administer sucrose on a short-access schedule, previously shown to increase motivated behavior following sucrose abstinence, and then underwent either a 0, 7, or 30 day period of abstinence. Next, electrophysiological recording procedures were used to examine NAc activity (n = 199 neurons) during resumption of sucrose self-administration. Results showed no increase in sucrose-seeking or changes in cell firing of NAc neurons following any abstinence period. Furthermore, in a separate group of animals (n = 17) trained under identical conditions, sucrose-seeking behaviors were assessed during extinction and cue-induced reinstatement to further examine if any changes in motivated responding are evident following abstinence. Again, no evidence was obtained for any alterations in sucrose-seeking across abstinence conditions. These results suggest that natural rewards, such as sucrose, when provided in short access, do not always elicit robust changes in motivated responding, or NAc cell firing following abstinence unlike that observed in prior studies with cocaine. These findings are discussed with respect to the role of the NAc in processing goal-directed behaviors for drug vs. natural rewards following periods of abstinence.

The nucleus accumbens and reward: neurophysiological investigations in behaving animals

The nucleus accumbens (Acb) is a crucial component of the brain reward system. This report reviews electrophysiological studies that examined Acb cell firing during goal-directed behaviors for natural reinforcers (food, water, sucrose) and drugs of abuse (cocaine, heroin, ethanol). Studies that examined the role of environmental stimuli and operant contingencies on Acb activity during behavior are also explored. Given the extensive literature that links dopamine in the Acb with drug reinforcement, experiments are considered that examined the influence of dopamine in modulating Acb cell firing during drug-seeking behaviors. Finally, because the Acb is one neural substrate of a larger brain reward circuit, the influence of afferent input (hippocampus and prefrontal cortex) on Acb cell firing during behavior is also discussed. These findings provide a unique insight into the cellular mechanisms underlying reward-related processing and goal-directed behaviors and reveal a level of functional organization in the Acb not identified by other experimental approaches.

Accumbal neurons that are activated during cocaine self-administration are spared from inhibitory effects of repeated cocaine self-administration

Hypoactivity of the accumbens is induced by repeated cocaine exposure and is hypothesized to play a role in cocaine addiction. However, it is difficult to understand how a general hypoactivity of the accumbens, which facilitates multiple types of motivated behaviors, could contribute to the selective increase in drug-directed behavior that defines addiction. Electrophysiological recordings, made during sessions in which rats self-administer cocaine, show that most accumbal neurons that encode events related to drug-directed behavior achieve and maintain higher firing rates during the period of cocaine exposure (Task-Activated neurons) than do other accumbal neurons (Task-Non-Activated neurons). We have hypothesized that this difference in activity makes the neurons that facilitate drug-directed behavior less susceptible than other neurons to the chronic inhibitory effects of cocaine. A sparing of neurons that facilitate drug-directed behavior from chronic hypoactivity might lead to a relative increase in the transmission of neuronal signals that facilitate drug-directed behavior through accumbal circuits and thereby contribute to changes in behavior that characterize addiction (ie differential inhibition hypothesis). A prediction of the hypothesis is that neurons that are activated in relation to task events during cocaine self-administration sessions will show less of a decrease in firing across repeated self-administration sessions than will other neurons. To test this prediction, rats were exposed to 30 daily (6 h/day) cocaine self-administration sessions. Chronic extracellular recordings of single accumbal neurons were made during the second to third session and the 30th session. Between-session comparisons showed that decreases in firing were exhibited by Task-Non-Activated, but not by Task-Activated, neurons. During the day 30 session, the magnitude of the difference in firing rate between the two groups of neurons was positively related to the propensity of animals to seek and take cocaine. The findings of the present study are consistent with a basic prediction of the differential inhibition hypothesis and may be relevant to understanding cocaine addiction.

Accumbens neurochemical adaptations produced by binge-like alcohol consumption

RATIONALE

The Scheduled High Alcohol Consumption (SHAC) binge drinking model is a simple, partial murine model with which to investigate some of the neurobiological underpinnings of alcoholism.

OBJECTIVES

The SHAC model was used to characterize monoamine and amino acid adaptations produced in the nucleus accumbens (NAC) by repeated bouts of high alcohol consumption.

METHODS

In vivo microdialysis was conducted in the NAC of C57BL/6J (B6) mice during consumption of water, a 5% alcohol (v/v) solution for the first time (SHAC1) or a 5% alcohol solution for the sixth time (SHAC6). A second set of microdialysis experiments assessed the neurotransmitter response to an alcohol challenge injection (1.5 or 2 g/kg, IP).

RESULTS

In both drinking experiments, SHAC1 and SHAC6 mice consumed comparable amounts of alcohol during the 40-min period of alcohol availability (approximately 1.5 g/kg) and total fluid intake was similar between water and SHAC1/6 mice. Despite the similarity in alcohol consumption, alcohol-mediated increases in the extracellular concentration of GABA and serotonin were reduced, but glutamate was increased in the NAC of SHAC6 mice, relative to SHAC1 animals. No differences were observed in extracellular dopamine between SHAC1 and SHAC6 mice during alcohol consumption. After alcohol injection, SHAC6 mice also exhibited sensitized glutamate release, but did not differ from water or SHAC1 animals for any of the other neurotransmitters examined. Brain alcohol concentrations did not differ between groups after injection.

CONCLUSIONS

Repeated bouts of high alcohol consumption induce an imbalance between inhibitory and excitatory neurotransmission within the NAC that may drive excessive drinking behavior.

Nucleus accumbens neurons encode Pavlovian approach behaviors: evidence from an autoshaping paradigm

Environmental stimuli predictive of appetitive events can elicit Pavlovian approach responses that enhance an organism's ability to track and secure natural rewards, but may also contribute to the compulsive nature of drug addiction. Here, we examined the activity of individual nucleus accumbens (NAc) neurons during an autoshaping paradigm. One conditioned stimulus (CS+, a retractable lever presented for 10 s) was immediately followed by the delivery of a 45-mg sucrose pellet to a food receptacle, while another stimulus (CS-, a separate retractable lever presented for 10 s) was never followed by sucrose. Approach responses directed at the CS+ and CS- were recorded as lever presses and had no experimental consequence. Rats (n = 9) selectively approached the CS+ on more than 80% of trials and were surgically prepared for electrophysiological recording. Of 76 NAc neurons, 57 cells (75%) exhibited increases and/or decreases in firing rate (i.e. termed 'phasically active') during the CS+ presentation and corresponding approach response. Forty-seven percent of phasically active cells (27 out of 57) were characterized by time-locked but transient increases in cell firing, while 53% (30 out of 57) showed a significant reduction in firing for the duration of the CS+. In contrast, the same excitatory subpopulation exhibited smaller increases in activity relative to CS- onset, while the inhibitory subpopulation showed no change in firing during the CS- period. The magnitude and prevalence of cue-related neural responses reported here indicates that the NAc encodes biologically significant, repetitive approach responses that may model the compulsive nature of drug addiction in humans.

Neuronal substrates of relapse to cocaine-seeking behavior: role of prefrontal cortex

The return to drug seeking, even after prolonged periods of abstinence, is a defining feature of cocaine addiction. The neural circuitry underlying relapse has been identified in neuropharmacological studies of experimental animals, typically rats, and supported in brain imaging studies of human addicts. Although the nucleus accumbens (NAcc), which has long been implicated in goal-directed behavior, plays a critical role in this circuit, the prefrontal cortex (PFC) appears to process the events that directly trigger relapse: exposure to acute stress, cues previously associated with the drug, and the drug itself. In this paper, we review animal models of relapse and what they have revealed about the mechanisms underlying the involvement of the NAcc and PFC in cocaine-seeking behavior. We also present electrophysiological data from PFC illustrating how the hedonic, motor, motivational, and reinforcing effects of cocaine can be analyzed at the neuronal level. Our preliminary findings suggest a role for PFC in processing information related to cocaine seeking but not the hedonic effects of the drug. Further use of this recording technology can help dissect the functions of PFC and other components of the neural circuitry underlying relapse.

Higher magnitude accumbal phasic firing changes among core neurons exhibiting tonic firing increases during cocaine self-administration

Studies using i.v. cocaine self-administration in rats have documented rapid-phasic changes in the firing rate of nucleus accumbens neurons within seconds of cocaine-reinforced lever presses, as well as changes that occur over the course of the cocaine self-administration experiment, i.e. tonic changes in firing rate. During the self-administration period of the experiment, individual neurons exhibit either a tonic increase, a tonic decrease, or no tonic change in firing rate, relative to the neuron's firing rate during the pre-drug period. We evaluated whether rapid-phasic changes in firing were differentially associated with tonically reduced or tonically elevated firing of nucleus accumbens core and shell neurons in cocaine self-administering rats. Rapid-phasic firing patterns within seconds of the cocaine-reinforced lever press were exhibited predominantly by core neurons that also exhibited tonic increases in firing. Conversely, core neurons that did not exhibit such rapid-phasic firing patterns were more likely to show tonically reduced firing. Moreover, core neurons were more likely than shell neurons to exhibit: 1) tonic increases in firing and 2) rapid-phasic increases in firing preceding the cocaine-reinforced lever press. These differences between accumbens subterritories may be related to their distinct involvement in operant responding; the present findings are consistent with an emerging literature which implicates shell in contextual stimulus-induced responding, and core in processing the instrumental response via its discrete output to classic basal ganglia structures. The distinct tendency of the core to exhibit increased firing, coupled with its dichotomous firing outputs (i.e. tonic decreases without rapid phasic responses or tonic increases with rapid phasic responses), may reflect particular sensitivity of these neurons to excitatory limbic afferent signaling involved in instrumental responding. Enhanced phasic responsivity in the core may be an integral component of the mechanism inherent in normal reward processing which is subverted by chronic drug exposure.

Effects of the competitive N-methyl-D-aspartate receptor antagonist, LY235959 [(-)-6-phosphonomethyl-deca-hydroisoquinoline-3-carboxylic acid], on responding for cocaine under both fixed and progressive ratio schedules of reinforcement

It is difficult to determine the precise role of the N-methyl-D-aspartate (NMDA) receptor system in the reinforcing effects of cocaine since uncompetitive NMDA receptor antagonists alter cocaine self-administration in different ways, depending on the antagonist examined and the behavior being measured. To increase understanding of the role of the NMDA system in cocaine's reinforcing effects, this study measured the effects of the competitive NMDA receptor antagonist, LY235959 [(-)-6-phosphonomethyl-deca-hydroisoquinoline-3-carboxylic acid], in rats that self-administered cocaine under both fixed ratio (FR) 1 and progressive ratio (PR) schedules of reinforcement. Rats were trained to self-administer cocaine (0.33 mg/infusion) under an FR1 schedule of reinforcement. Thereafter, the effects of pretreatment with LY235959, or the uncompetitive antagonists dextromethorphan and dizocilpine, were examined. The number of infusions earned during the first 10 min of responding under the FR1 schedule was analyzed separately. When rats responded for 0.33 mg/infusion cocaine under an FR1 schedule of reinforcement, 3 mg/kg LY235959 decreased cocaine self-administration only during the first 10 min of the responding. This effect was dose and time dependent and blocked by the competitive NMDA receptor agonist, NMDA. LY235959 (3 mg/kg) decreased total responding for cocaine only when the self-administered dose of cocaine was small (0.02-0.04 mg/infusion) or when responding was reinforced under the PR schedule. In contrast, dizocilpine decreased responding under the FR1 schedule but increased responding under the PR schedule. These data suggest that LY235959 decreased the reinforcing effectiveness of cocaine, a finding reported with systemically administered NMDA receptor antagonists other than dizocilpine.

Abstinence from cocaine self-administration heightens neural encoding of goal-directed behaviors in the accumbens

Cocaine addiction in humans is characterized by cycles of abstinence from drug-taking and relapse. Here, electrophysiological recording procedures were used to determine whether nucleus accumbens (Acb) neuronal firing properties are altered following interruption and resumption of cocaine self-administration. Rats (n = 12) were trained to self-administer cocaine (2 h daily sessions) then divided into two groups. Acb activity was recorded for Group 1 (controls) during two additional self-administration sessions completed over the next 2 days (test sessions 1 and 2). Acb activity was recorded for Group 2 (1-month) during one self-administration session completed the next day (test 1), and during a second self-administration session 1 month later (test 2). As in prior reports, a subset of Acb neurons exhibited patterned discharges (short duration and/or long-term cyclic alterations, termed 'phasically active') relative to cocaine-reinforced responding during test session 1. Remarkably, the percentage of phasically active cells dramatically increased (nearly two-fold) following 1-month abstinence, in the core but not the shell of the Acb. Likewise, the strength of the neural correlates (determined via signal-to-baseline ratios) also increased as a function of abstinence. Extinction experiments in another set of rats (n = 12) revealed an increased motivational state for the drug following abstinence. The results show that abstinence from cocaine self-administration causes a dramatic increase in the number and strength of Acb neurons that encode cocaine-related information, thus representing the first neurophysiological correlate of heightened activation of the 'brain reward system' following abstinence and resumption (relapse) of cocaine consumption.

Spatially selective reward site responses in tonically active neurons of the nucleus accumbens in behaving rats

To study how hippocampal output signals conveying spatial and other contextual information might be integrated in the nucleus accumbens, tonically active accumbens neurons were recorded in three unrestrained rats as they performed spatial orientation tasks on an elevated round rotatable platform with four identical reward boxes symmetrically placed around the edge. The partially water-deprived rats were required to shuttle either between the pair of reward boxes indicated by beacon cues (lights in the boxes) or between the pair of boxes occupying particular locations in relation to environmental landmark cues. In 43/82 neurons, behaviorally correlated phasic modulations in discharge activity occurred, primarily prior to or after water was provided at the reward boxes. Twenty-two had inhibitory modulation, 12 excitatory, and nine were mixed excitatory and inhibitory. Although tonically active neurons (TANs) have rarely been reported in the rodent, the inhibitory and mixed responses correspond to previously reports in the macaque accumbens of tonically active neurons with activity correlated with reward delivery and, following conditioning, to sensory stimuli associated with rewards. Eighteen of the 43 tonically active accumbens neurons showed spatial selectivity, i.e., behaviorally correlated increases or decreases in firing rate were of different magnitudes at the respective reward boxes. This is the first demonstration that the configuration of environmental sensory cues associated with reward sites are also an effective stimulus for these neurons and that different neurons are selective for different places. These results are consistent with a role for the nucleus accumbens in the initiation of goal-directed displacement behaviors.

Nucleus accumbens cell firing and rapid dopamine signaling during goal-directed behaviors in rats

The nucleus accumbens (Acb) is a key neural substrate underlying goal-directed behaviors for both drugs of abuse as well as 'natural' rewards. Here, I review electrophysiological and electrochemical studies completed in our laboratory that examined Acb cell firing and rapid dopamine signaling during behaviors directed toward reward procurement. Electrophysiological studies are reviewed showing that Acb neurons exhibit patterned discharges relative to operant responding for intravenous self-administration of cocaine versus 'natural' reinforcement in rodents. Importantly, subsequent studies showed that discrete subsets of Acb neurons are selectively activated during multiple schedules for a natural reward (water or food) versus cocaine self-administration. These later findings indicate that separate neural circuits selectively process information about goal-directed behaviors for cocaine versus natural reward. In addition, recent findings are reviewed showing that reinforcer selective firing of Acb neurons is not a direct consequence of chronic drug exposure. Next, electrochemical studies are summarized that used fast scan cyclic voltammetry to measure rapid (subsecond) changes in dopamine in the Acb during cocaine self-administration as well as 'natural' reinforcement in rodents. These findings are considered with respect to the role of dopamine in modulating the activity of Acb neurons that encode goal-directed behaviors, the functional organization of the Acb on a microcircuit level, and proposed directions for future studies.

Dynamics of neural coding in the accumbens during extinction and reinstatement of rewarded behavior

Neural correlates of reward-seeking behavior are observed in the nucleus accumbens (NAC). The dependence of these correlates upon the presence of a reward was studied by comparing the behavioral correlates observed when the presence of the reward was manipulated within a single behavioral session. Rats were well-trained on a continuous reinforcement instrumental task reinforced by 0.1 ml drops of 5% sucrose. Extracellular single-unit neural activity was recorded from electrode arrays implanted into the NAC when instrumental behavior was and then was not reinforced with sucrose (within-session extinction). A variable delay between the instrumental response and the sucrose delivery allowed for separation of neural activity related to these task events. A spike activity increase around the time of the instrumental response was the most common behavioral correlate, while a decrease in spike activity upon sucrose delivery was the second most common behavioral correlate. Following removal of the reinforcer, subjects continued to perform the instrumental response, allowing for the examination of response-related spike activity under extinction conditions in which the response was no longer reinforced by sucrose. A majority of the response-related neural activity patterns were lost when sucrose was no longer available. New neural responses also were detected during this period. For some subjects, the reinforcer was again made available during the same session. Encoding of the primary behavioral events during this period of reinstated reinforcer was similar, but not identical, to that observed during the first period of reinforced responding. These findings reveal that instrumental task-associated spike activity within the NAC is partially dependent upon the presence of the reinforcer, and that encoding across the population is distinct under reinforced and extinction conditions.

Neuroadaptive effects of active versus passive drug administration in addiction research

Increasing knowledge of the genome sequences of several organisms and the development of genome-wide, high-throughput screening techniques for gene expression are likely to generate a vast amount of data aimed at elucidating the molecular mechanisms of addiction. These findings are likely to have potential for future addiction pharmacotherapies. However, it is important to employ animal models that dissociate the molecular and cellular consequences of the direct pharmacological effects of addictive drugs from those that result from the cognitive processes associated with self-administration of these drugs. In this article, we suggest that the short-term and long-term neuroadaptive effects of addictive drugs in the brain depend crucially on the drug-exposure paradigm used [i.e. passive (non-contingent) drug exposure and active (contingent) self-administration]. This has important ramifications for future molecular and cellular studies of drug addiction.

Differences between accumbens core and shell neurons exhibiting phasic firing patterns related to drug-seeking behavior during a discriminative-stimulus task

The habit-forming effects of abused drugs depend on the mesocorticolimbic dopamine system innervating the nucleus accumbens (NAcc). To examine whether different NAcc subterritories (core and medial shell) exhibit a differential distribution of neurons showing phasic firing patterns correlated with drug-seeking behavior, rats were trained to self-administer cocaine, and activity of single NAcc neurons was recorded. In the presence of a discriminative-stimulus (S(D)) tone, a single lever press produced an intravenous infusion of cocaine (0.35 mg/kg), terminated the tone, and started an intertone interval ranging from 3 to 6 min. Lever presses during this intertone interval had no programmed consequences. In addition to evaluating neuronal firing patterns associated with cocaine-reinforced presses, we also evaluated firing patterns associated with unreinforced lever presses to allow interpretation of firing free of factors other than the instrumental response (such as tone-off and onset of the pump signaling drug infusion). Core neurons exhibited a greater change in firing than medial shell neurons both in the seconds preceding the reinforced and unreinforced lever press response and in the seconds following the unreinforced response. Core and medial shell neurons exhibited similar changes in firing during the seconds following the cocaine-reinforced press. The differential distribution of neurons exhibiting phasic changes in firing preceding the lever press suggests that the physiological activity of core neurons may play a greater role than that of medial shell neurons in processes related to the execution of conditioned drug-seeking responses.