Separate vmPFC Ensembles Control Cocaine Self-Administration Versus Extinction in Rats

A Cocaine-Activated Ensemble Exerts Increased Control Over Behavior While Decreasing in Size

BACKGROUND

Substance use disorder is characterized by long-lasting changes in reward-related brain regions, such as the nucleus accumbens. Previous work has shown that cocaine exposure induces plasticity in broad, genetically defined cell types in the nucleus accumbens; however, in response to a stimulus, only a small percentage of neurons are transcriptionally active-termed an ensemble. Here, we identify an Arc-expressing neuronal ensemble that has a unique trajectory of recruitment and causally controls drug self-administration after repeated, but not acute, cocaine exposure.

METHODS

Using Arc-CreERT2 transgenic mice, we expressed transgenes in Arc+ ensembles activated by cocaine exposure (either acute [1 × 10 mg/kg intraperitoneally] or repeated [10 × 10 mg/kg intraperitoneally]). Using genetic, optical, and physiological recording and manipulation strategies, we assessed the contribution of these ensembles to behaviors associated with substance use disorder.

RESULTS

Repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its control over behavior. Neurons within the repeated cocaine ensemble were hyperexcitable, and their optogenetic excitation was sufficient for reinforcement. Finally, lesioning the repeated cocaine, but not the acute cocaine, ensemble blunted cocaine self-administration. Thus, repeated cocaine exposure reduced the size of the ensemble while simultaneously increasing its contributions to drug reinforcement.

CONCLUSIONS

We showed that repeated, but not acute, cocaine exposure induced a physiologically distinct ensemble characterized by the expression of the immediate early gene Arc, which was uniquely capable of modulating reinforcement behavior.

Engrams across diseases: Different pathologies - unifying mechanisms?

Memories are our reservoir of knowledge and thus, are crucial for guiding decisions and defining our self. The physical correlate of a memory in the brain is termed an engram and since decades helps researchers to elucidate the intricate nature of our imprinted experiences and knowledge. Given the importance that memories have for our lives, their impairment can present a tremendous burden. In this review we aim to discuss engram malfunctioning across diseases, covering dementia-associated pathologies, epilepsy, chronic pain and psychiatric disorders. Current neuroscientific tools allow to witness the emergence and fate of engram cells and enable their manipulation. We further suggest that specific mechanisms of mnemonic malfunction can be derived from engram cell readouts. While depicting the way diseases act on the mnemonic component - specifically, on the cellular engram - we emphasize a differentiation between forms of amnesia and hypermnesia. Finally, we highlight commonalities and distinctions of engram impairments on the cellular level across diseases independent of their pathogenic origins and discuss prospective therapeutic measures.

Distinct prelimbic cortex ensembles encode response execution and inhibition

Learning when to initiate or withhold actions is essential for survival and requires integration of past experiences with new information to adapt to changing environments. While stable prelimbic cortex (PL) ensembles have been identified during reward learning, it remains unclear how they adapt when contingencies shift. Does the same ensemble adjust its activity to support behavioral suppression upon reward omission, or is a distinct ensemble recruited for this new learning? We used single-cell calcium imaging to longitudinally track PL neurons in rats across operant food reward Training, Extinction and Reinstatement, trained rat-specific decoders to predict trial-wise behavior, and implemented an in-silico deletion approach to characterize ensemble contributions to behavior. We show that operant training and extinction recruit distinct PL ensembles that encode response execution and inhibition, and that both ensembles are re-engaged and maintain their roles during Reinstatement. These findings highlight ensemble-based encoding of multiple learned associations within a region, with selective ensemble recruitment supporting behavioral flexibility under changing contingencies.

Individual differences in prelimbic neural representation of food and cocaine seeking

The prelimbic cortex is involved in operant reward seeking. However, the precise nature of its activity patterns and whether/how they differ between different types of rewards are largely unknown. We use miniscope calcium imaging to observe prelimbic activity during both food and cocaine seeking in freely behaving mice. We find that neurobehavioral representations remain stable across days within individual mice. Unexpectedly, our data reveal significant individual differences: some mice display high similarity in their prelimbic cortex activity patterns for both food and cocaine seeking, while others show no such overlap. These findings suggest that individual differences in the neural mechanisms underlying food and cocaine seeking could be a critical factor to consider when developing future addiction treatment strategies.

Dissociable dorsal medial prefrontal cortex ensembles are necessary for cocaine seeking and fear conditioning in mice

The dorsal medial prefrontal cortex (dmPFC) plays a dual role in modulating drug seeking and fear-related behaviors. Learned associations between cues and drug seeking are encoded by a specific ensemble of neurons. This study explored the stability of a dmPFC cocaine seeking ensemble over 2 weeks and its influence on persistent cocaine seeking and fear memory retrieval. In the first series of experiments, we trained TetTag c-fos-driven-EGFP mice in cocaine self-administration and tagged strongly activated neurons with EGFP during the initial day 7 cocaine seeking session. Subsequently, a follow-up seeking test was conducted 2 weeks later to examine ensemble reactivation between two seeking sessions via c-Fos immunostaining. In the second series of experiments, we co-injected viruses expressing TRE-cre and a cre-dependent inhibitory PSAM-GlyR into the dmPFC of male and female c-fos-tTA mice to enable "tagging" of cocaine seeking ensemble or cued fear ensemble neurons with inhibitory chemogenetic receptors. These c-fos-tTA mice have the c-fos promoter that drives expression of the tetracycline transactivator (tTA). The tTA can bind to the tetracycline response element (TRE) site on the viral construct, resulting in the expression of cre-recombinase, which enables the expression of cre-dependent inhibitory chemogenetic receptors and fluorescent reporters. Then we investigated ensemble contribution to subsequent cocaine seeking and fear recall during inhibition of the tagged ensemble by administering uPSEM792s (0.3 mg/kg), a selective ligand for PSAM-GlyR. In both sexes, there was a positive association between the persistence of cocaine seeking and the proportion of reactivated EGFP+ neurons within the dmPFC. More importantly, inhibition of the cocaine seeking ensemble suppressed cocaine seeking, but not recall of fear memory, while inhibition of the fear ensemble reduced conditioned freezing but not cocaine seeking. The results demonstrate that cocaine and fear recall ensembles in the dmPFC are stable, but largely exclusive from one another.

Self-administration acquisition latency predicts locomotor sensitivity to cocaine in male rats

Individual differences in drug use emerge soon after initial exposure, and only a fraction of individuals who initiate drug use go on to develop a substance use disorder. Variability in vulnerability to establishing drug self-administration behavior is also evident in preclinical rodent models. Latent characteristics that underlie this variability and the relationship between early drug use patterns and later use remain unclear. Here, we attempt to determine whether propensity to establish cocaine self-administration is related to subsequent cocaine self-administration behavior in male Sprague-Dawley rats (n = 14). Prior to initiating training, we evaluated basal locomotor and anxiety-like behavior in a novel open field test. We then trained rats to self-administer cocaine in daily 3 h cocaine (0.75 mg/kg/infusion) self-administration sessions until acquisition criteria (≥30 active lever presses with ≥70 % responding on the active lever in one session) was met and divided rats into Early and Late groups by median-split analysis based on their latency to meet acquisition criteria. After each rat met acquisition criteria, we gave them 10 additional daily cocaine self-administration sessions. We then conducted a progressive ratio, cocaine-induced locomotor sensitivity test, and non-reinforced cocaine seeking test after two weeks of forced abstinence. Early Learners exhibited significantly less locomotion after an acute injection of cocaine, but the groups did not differ in any other behavioral parameter examined. These results indicate that cocaine self-administration acquisition latency is not predictive of subsequent drug-taking behavior, but may be linked to physiological factors like drug sensitivity that can predispose rats to learn the operant task.

After a period of forced abstinence, rats treated with the norepinephrine neurotoxin DSP-4 still exhibit preserved food-seeking behavior and prefrontal cortex fos-expressing neurons

Aims

Relapse is a common characteristic of compulsive behaviors like addiction, where individuals tend to return to drug use or overeating after a period of abstinence. PFC (prefrontal cortex) neuronal ensembles are required for drug and food-seeking behaviors and are partially regulated by Norepinephrine (NE). However, the contributions of neuromodulators, such as the adrenergic system, in food-seeking behavior are not fully understood.

Main methods

To investigate this, we trained male and female rats to press a lever in an operant chamber to obtain banana-flavored food pellets for ten days. We then administered DSP-4 (N-(2-chloroethyl)-N-ethyl-2-bromobenzylamine hydrochloride), a neurotoxin that diminishes norepinephrine levels in the brain. The rats were kept in their home cages for ten more days before being returned to the operant chambers to measure food-seeking behavior.

Key findings

Despite receiving DSP-4, the PFC neuronal ensembles measured by Fos and food-seeking behavior did not differ between groups, but rather sex.

Significance

Although both NE and Fos expressing neurons are implicated in food-seeking, they do not seem to be involved in a cue-contextual induced re-exposure response.

Corticostriatal ensemble dynamics across heroin self-administration to reinstatement

Corticostriatal projection neurons from prelimbic medial prefrontal cortex to the nucleus accumbens core critically regulate drug-seeking behaviors, yet the underlying encoding dynamics whereby these neurons contribute to drug seeking remain elusive. Here we use two-photon calcium imaging to visualize the activity of corticostriatal neurons in mice from the onset of heroin use to relapse. We find that the activity of these neurons is highly heterogeneous during heroin self-administration and seeking, with at least 8 distinct neuronal ensembles that display both excitatory and inhibitory encoding dynamics. These neuronal ensembles are particularly apparent during relapse, where excitatory responses are amplified compared to heroin self-administration. Moreover, we find that optogenetic inhibition of corticostriatal projection neurons attenuates heroin seeking regardless of the relapse trigger. Our results reveal the precise corticostriatal activity dynamics underlying drug-seeking behaviors and support a key role for this circuit in mediating relapse to drug seeking.

Dissociable dorsal medial prefrontal cortex ensembles are necessary for cocaine seeking and fear conditioning in mice

The dmPFC plays a dual role in modulating drug seeking and fear-related behaviors. Learned associations between cues and drug seeking are encoded by a specific ensemble of neurons. This study explored the stability of a dmPFC cocaine seeking ensemble over two weeks and its influence on persistent cocaine seeking and fear memory retrieval. In the first series of experiments, we trained TetTag mice in cocaine self-administration and tagged strongly activated neurons with EGFP during the initial day 7 cocaine seeking session. Subsequently, a follow-up seeking test was conducted two weeks later to examine ensemble reactivation between two seeking sessions via c-Fos immunostaining. In the second series of experiments, we co-injected viruses expressing TRE-cre and a cre-dependent inhibitory PSAM-GlyR into the dmPFC of male and female c-fos -tTA mice to enable "tagging" of cocaine seeking ensemble or cued fear ensemble neurons with an inhibitory chemogenetic receptors. Then we investigated their contribution to subsequent cocaine seeking and fear recall during inhibition of the tagged ensemble by administering uPSEM792s (0.3 mg/kg), a selective ligand for PSAM-GlyR. In both sexes, there was a positive association between the persistence of cocaine seeking and the proportion of reactivated EGFP+ neurons within the dmPFC. More importantly, inhibition of the cocaine seeking ensemble suppressed cocaine seeking, but not recall of fear memory, while inhibition of the fear ensemble reduced conditioned freezing but not cocaine seeking. The results demonstrate that cocaine and fear recall ensembles in the dmPFC are stable, but largely exclusive from one another.

Approaches and considerations of studying neuronal ensembles: a brief review

First theorized by Hebb, neuronal ensembles have provided a framework for understanding how the mammalian brain operates, especially regarding learning and memory. Neuronal ensembles are discrete, sparsely distributed groups of neurons that become activated in response to a specific stimulus and are thought to provide an internal representation of the world. Beyond the study of region-wide or projection-wide activation, the study of ensembles offers increased specificity and resolution to identify and target specific memories or associations. Neuroscientists interested in the neurobiology of learning, memory, and motivated behavior have used electrophysiological-, calcium-, and protein-based proxies of neuronal activity in preclinical models to better understand the neurobiology of learned and motivated behaviors. Although these three approaches may be used to pursue the same general goal of studying neuronal ensembles, technical differences lead to inconsistencies in the output and interpretation of data. This mini-review highlights some of the methodologies used in electrophysiological-, calcium-, and protein-based studies of neuronal ensembles and discusses their strengths and weaknesses.

Cellular and molecular basis of drug addiction: The role of neuronal ensembles in addiction

Addiction has been conceptualized as a disease of learning and memory. Learned associations between environmental cues and unconditioned rewards induced by drug administration, which play a critical role in addiction, have been shown to be encoded in sparsely distributed populations of neurons called neuronal ensembles. This review aims to highlight how synaptic remodeling and alterations in signaling pathways that occur specifically in neuronal ensembles contribute to the pathogenesis of addiction. Furthermore, a causal link between transcriptional and epigenetic modifications in neuronal ensembles and the development of the addictive state is proposed. Translational studies of molecular and cellular changes in neuronal ensembles that contribute to drug-seeking behavior, will allow the identification of molecular and circuit targets and interventions for substance use disorders.

Acquired Alterations in Nucleus Accumbens Responsiveness to a Cocaine-Paired Discriminative Stimulus Preceding Rats' Daily Cocaine Consumption

Resumption of drug taking is a primary focus for substance use disorder research and can be triggered by drug-associated environmental stimuli. The Nucleus Accumbens (NAc) is a key brain region which guides motivated behavior and is implicated in resumption. There remains a pressing need to characterize NAc neurons' responsiveness to drug associated stimuli during withdrawal and abstinence. We recorded discriminative stimulus (DS) induced NAc activity via in vivo single-unit electrophysiology in rats that self-administered cocaine. Male and female rats implanted with a jugular catheter and a microwire array in NAc Core and Shell self-administered cocaine under control of a 30s auditory DS for 6 hours per session across 14 consecutive days. Rats acquired tone discrimination within 4 sessions. To exclude pharmacological effects of circulating cocaine from all neural analyses, we studied changes in DS-induced firing only for trials preceding the first infusion of cocaine in each of the 14 sessions, which were defined as "pre-drug trials." NAc neuron responses were assessed prior to tone-evoked movement onset. Responsiveness to the DS tone was exhibited throughout all sessions by the NAc Core population, but only during Early sessions by the NAc Shell population. Both Core and Shell responded selectively to the DS, i.e., more strongly on drug taking trials, or Hits, than on Missed opportunities. These findings suggest that NAc Core and Shell play distinct roles in initiating cocaine seeking prior to daily cocaine consumption, and align with reports suggesting that as drug use becomes chronic, cue-evoked activity shifts from NAc Shell to NAc Core.

The Role of Ryanodine Receptor 2 in Drug-Associated Learning

Type-2 ryanodine receptor (RyR2) ion channels facilitate the release of Ca 2+ from stores and serve an important function in neuroplasticity. The role for RyR2 in hippocampal-dependent learning and memory is well established and chronic hyperphosphorylation of RyR2 (RyR2P) is associated with pathological calcium leakage and cognitive disorders, including Alzheimer's disease. By comparison, little is known about the role of RyR2 in the ventral medial prefrontal cortex (vmPFC) circuitry important for working memory, decision making, and reward seeking. Here, we evaluated the basal expression and localization of RyR2 and RyR2P in the vmPFC. Next, we employed an operant model of sucrose, cocaine, or morphine self-administration (SA) followed by a (reward-free) recall test, to reengage vmPFC neurons and reactivate reward-seeking and re-evaluated the expression and localization of RyR2 and RyR2P in vmPFC. Under basal conditions, RyR2 was expressed in pyramidal cells but not regularly detected in PV/SST interneurons. On the contrary, RyR2P was rarely observed in PFC somata and was restricted to a different subcompartment of the same neuron - the apical dendrites of layer-5 pyramidal cells. Chronic SA of drug (cocaine or morphine) and nondrug (sucrose) rewards produced comparable increases in RyR2 protein expression. However, recalling either drug reward impaired the usual localization of RyR2P in dendrites and markedly increased its expression in somata immunoreactive for Fos, a marker of highly activated neurons. These effects could not be explained by chronic stress or drug withdrawal and instead appeared to require a recall experience associated with prior drug SA. In addition to showing the differential distribution of RyR2/RyR2P and affirming the general role of vmPFC in reward learning, this study provides information on the propensity of addictive drugs to redistribute RyR2P ion channels in a neuronal population engaged in drug-seeking. Hence, focusing on the early impact of addictive drugs on RyR2 function may serve as a promising approach to finding a treatment for substance use disorders.

Quantification of prefrontal cortical neuronal ensembles following conditioned fear learning in a Fos-LacZ transgenic rat with photoacoustic imaging in Vivo

Understanding the neurobiology of complex behaviors requires measurement of activity in the discrete population of active neurons, neuronal ensembles, which control the behavior. Conventional neuroimaging techniques ineffectively measure neuronal ensemble activity in the brain in vivo because they assess the average regional neuronal activity instead of the specific activity of the neuronal ensemble that mediates the behavior. Our functional molecular photoacoustic tomography (FM-PAT) system allows direct imaging of Fos-dependent neuronal ensemble activation in Fos-LacZ transgenic rats in vivo. We tested four experimental conditions and found increased FM-PAT signal in prefrontal cortical areas in rats undergoing conditioned fear or novel context exposure. A parallel immunofluorescence ex vivo study of Fos expression found similar findings. These findings demonstrate the ability of FM-PAT to measure Fos-expressing neuronal ensembles directly in vivo and support a mechanistic role for the prefrontal cortex in higher-order processing of response to specific stimuli or environmental cues.

Circulating ovarian hormones interact with protein interacting with C kinase (PICK1) within the medial prefrontal cortex to influence cocaine seeking in female mice

Protein interacting with C kinase 1 (PICK1) is an AMPA receptor binding protein that works in conjunction with glutamate receptor interacting protein (GRIP) to balance the number of GluA2-containing AMPARs in the synapse. In male mice, disrupting PICK1 in the medial prefrontal cortex (mPFC) leads to a decrease in cue-induced cocaine seeking and disrupting GRIP in the mPFC has the opposing effect, consistent with other evidence that removal of GluA2-containing AMPARs potentiates reinstatement. However, PICK1 does not seem to play the same role in female mice, as knockdown of either PICK1 or GRIP in the mPFC leads to similar increases in cue-induced cocaine seeking. These previous findings indicate that the role of PICK1 in the prefrontal cortex is sex specific. The goal of the current study was to examine whether ovarian hormones contribute to the effect of prefrontal PICK1 knockdown on reinstatement of cocaine seeking. While we replicated the increased cue-induced cocaine seeking in prefrontal PICK1 knockdown sham mice, we did not see any difference between the GFP control mice and PICK1 knockdowns following ovariectomy. However, this effect was driven primarily by an increase in cocaine seeking in ovariectomized GFP control mice while there was no effect ovariectomy in PICK1 knockdown mice. Taken together, these findings suggest that circulating ovarian hormones interact with the effects of PICK1 on cue-induced reinstatement.

Mu Opioid Receptor Activation Mediates (S)-ketamine Reinforcement in Rats: Implications for Abuse Liability

BACKGROUND

(S)-ketamine is an NMDA receptor antagonist, but it also binds to and activates mu opioid receptors (MORs) and kappa opioid receptors in vitro. However, the extent to which these receptors contribute to (S)-ketamine's in vivo pharmacology is unknown.

METHODS

We investigated the extent to which (S)-ketamine interacts with opioid receptors in rats by combining in vitro and in vivo pharmacological approaches, in vivo molecular and functional imaging, and behavioral procedures relevant to human abuse liability.

RESULTS

We found that the preferential opioid receptor antagonist naltrexone decreased (S)-ketamine self-administration and (S)-ketamine-induced activation of the nucleus accumbens, a key brain reward region. A single reinforcing dose of (S)-ketamine occupied brain MORs in vivo, and repeated doses decreased MOR density and activity and decreased heroin reinforcement without producing changes in NMDA receptor or kappa opioid receptor density.

CONCLUSIONS

These results suggest that (S)-ketamine's abuse liability in humans is mediated in part by brain MORs.

Flow Cytometry of Synaptoneurosomes (FCS) Reveals Increased Ribosomal S6 and Calcineurin Proteins in Activated Medial Prefrontal Cortex to Nucleus Accumbens Synapses

Learning and behavior activate cue-specific patterns of sparsely distributed cells and synapses called ensembles that undergo memory-encoding engram alterations. While Fos is often used to label selectively activated cell bodies and identify neuronal ensembles, there is no comparable endogenous marker to label activated synapses and identify synaptic ensembles. For the purpose of identifying candidate synaptic activity markers, we optimized a flow cytometry of synaptoneurosome (FCS) procedure for assessing protein alterations in activated synapses from male and female rats. After injecting yellow fluorescent protein (YFP)-expressing adeno-associated virus into medial prefrontal cortex (mPFC) to label terminals in nucleus accumbens (NAc) of rats, we injected 20 mg/kg cocaine in a novel context (cocaine+novelty) to activate synapses, and prepared NAc synaptoneurosomes 0-60 min following injections. For FCS, we used commercially available antibodies to label presynaptic and postsynaptic markers synaptophysin and PSD-95 as well as candidate markers of synaptic activity [activity-regulated cytoskeleton protein (Arc), CaMKII and phospho-CaMKII, ribosomal protein S6 (S6) and phospho-S6, and calcineurin and phospho-calcineurin] in YFP-labeled synaptoneurosomes. Cocaine+novelty increased the percentage of S6-positive synaptoneurosomes at 5-60 min and calcineurin-positive synaptoneurosomes at 5-10 min. Electron microscopy verified that S6 and calcineurin levels in synaptoneurosomes were increased 10 min after cocaine+novelty. Pretreatment with the anesthetic chloral hydrate blocked cocaine+novelty-induced S6 and calcineurin increases in synaptoneurosomes, and novel context exposure alone (without cocaine) increased S6, both of which indicate that these increases were due to neural activity per se. Overall, FCS can be used to study protein alterations in activated synapses coming from specifically labeled mPFC projections to NAc.SIGNIFICANCE STATEMENT Memories are formed during learning and are stored in the brain by long-lasting molecular and cellular alterations called engrams formed within specific patterns of cue-activated neurons called neuronal ensembles. While Fos has been used to identify activated ensemble neurons and the engrams within them, we have not had a similar marker for activated synapses that can be used to identify synaptic engrams. Here we developed a procedure for high-throughput in-line analysis of flow cytometry of synaptoneurosome (FCS) and found that ribosomal S6 protein and calcineurin were increased in activated mPFC-NAc synapses. FCS can be used to study protein alterations in activated synapses within specifically labeled circuits.

INVOLVEMENT OF CORTICAL PROJECTIONS TO BASOLATERAL AMYGDALA IN CONTEXT-INDUCED REINSTATEMENT OF ETHANOL-SEEKING IN RATS

Ethanol is the most consumed substance of abuse in the world, and its misuse may lead to the development of alcohol use disorder (AUD). High relapse rates remain a relevant problem in the treatment of AUD. Exposure to environmental cues previously associated with ethanol intake could trigger ethanol-seeking behavior. However, the neural mechanisms involved in this phenomenon are not entirely clear. In this context, cortical projections to the basolateral amygdala (BLA) play a role in appetitive and aversive learned behaviors. Therefore, we aimed to evaluate the activation of the cortical projections from the prelimbic (PL), orbitofrontal (OFC), and infralimbic (IL), to the BLA in the context-induced reinstatement of ethanol-seeking. Male Long-Evans rats were trained to self-administer 10% ethanol in Context A. Subsequently, lever pressing in the presence of the discrete cue was extinguished in Context B. After nine extinction sessions, rats underwent intracranial surgery for the unilateral injection of red fluorescent retrograde tracer into the BLA. The context-induced reinstatement of ethanol-seeking was assessed by re-exposing the rats to Context A or B under extinction conditions. Finally, we combined retrograde neuronal tracing with Fos to identify activated cortical inputs to BLA during the reinstatement of ethanol-seeking behavior. We found that PL, but not OFC or IL, retrogradely-labeled neurons from BLA presented increased Fos expression during the re-exposure to the ethanol-associated context, suggesting that PL projection to BLA is involved in the context-induced reinstatement of ethanol-seeking behavior.

Prelimbic and infralimbic medial prefrontal cortex neuron activity signals cocaine seeking variables across multiple timescales

RATIONALE AND OBJECTIVES

The prefrontal cortex is critical for execution and inhibition of reward seeking. Neural manipulation of rodent medial prefrontal cortex (mPFC) subregions differentially impacts execution and inhibition of cocaine seeking. Dorsal, or prelimbic (PL), and ventral, or infralimbic (IL) mPFC are implicated in cocaine seeking or extinction of cocaine seeking, respectively. This differentiation is not seen across all studies, indicating that further research is needed to understand specific mPFC contributions to drug seeking.

METHODS

We recorded neuronal activity in mPFC subregions during cocaine self-administration, extinction, and cue- and cocaine-induced reinstatement of cocaine seeking.

RESULTS

Both PL and IL neurons were phasically responsive around lever presses during cocaine self-administration, and activity in both areas was reduced during extinction. During both cue- and, to a greater extent, cocaine-induced reinstatement, PL neurons exhibited significantly elevated responses, in line with previous studies demonstrating a role for the region in relapse. The enhanced PL signaling in cocaine-induced reinstatement was driven by strong excitation and inhibition in different groups of neurons. Both of these response types were stronger in PL vs. IL neurons. Finally, we observed tonic changes in activity in all tasks phases, reflecting both session-long contextual modulation as well as minute-to-minute activity changes that were highly correlated with brain cocaine levels and motivation associated with cocaine seeking.

CONCLUSIONS

Although some differences were observed between PL and IL neuron activity across sessions, we found no evidence of a go/stop dichotomy in PL/IL function. Instead, our results demonstrate temporally heterogeneous prefrontal signaling during cocaine seeking and extinction in both PL and IL, revealing novel and complex functions for both regions during these behaviors. This combination of findings argues that mPFC neurons, in both PL and IL, provide multifaceted contributions to the regulation of drug seeking and addiction.

Optogenetic stimulation of infralimbic cortex projections to the paraventricular thalamus attenuates context-induced renewal

Contexts associated with prior reinforcement can renew extinguished conditioned responding. The prelimbic (PL) and infralimbic (IL) cortices are thought to mediate the expression and suppression of conditioned responding, respectively. Evidence suggests that PL inputs to the paraventricular nucleus of the thalamus (PVT) drive the expression of cue-induced reinstatement of drug seeking and that IL inputs to the PVT mediate fear extinction retrieval. However, the role of these projections in renewal of appetitive Pavlovian conditioned responding is unknown. We trained male and female Long-Evans rats to associate a conditioned stimulus (CS; 10 s white noise) with delivery of a 10% sucrose unconditioned stimulus (US; .2 ml/CS) to a fluid port in a distinct context (Context A). We then extinguished responding by presenting the CS without the US in a different context (Context B). At test, rats were returned to Context A, and optogenetic stimulation was delivered to either the IL-to-PVT or PL-to-PVT pathway during CS presentations. Optically stimulating the IL-to-PVT, but not the PL-to-PVT pathway, attenuated ABA renewal of CS port entries, and this effect was similar in males and females. Further, rats self-administered optical stimulation of the IL-to-PVT but not the PL-to-PVT pathway suggesting that activation of the IL-to-PVT pathway is reinforcing. The effectiveness of optical stimulation parameters to activate neurons in the IL, PL and PVT was confirmed using Fos immunohistochemistry. These findings provide evidence for novel neural mechanisms in renewal of responding to a sucrose-predictive CS, as well as more generally in contextual processing and appetitive associative learning.

Neural correlates of recall and extinction in a rat model of appetitive Pavlovian conditioning

Extinction is a fundamental form of inhibitory learning that is important for adapting to changing environmental contingencies. While numerous studies have investigated the neural correlates of extinction using Pavlovian fear conditioning and appetitive operant reward-seeking procedures, less is known about the neural circuitry mediating the extinction of appetitive Pavlovian responding. Here, we aimed to generate an extensive brain activation map of extinction learning in a rat model of appetitive Pavlovian conditioning. Male Long-Evans rats were trained to associate a conditioned stimulus (CS; 20 s white noise) with the delivery of a 10% sucrose unconditioned stimulus (US; 0.3 ml/CS) to a fluid port. Control groups also received CS presentations, but sucrose was delivered either during the inter-trial interval or in the home-cage. After conditioning, 1 or 6 extinction sessions were conducted in which the CS was presented but sucrose was withheld. We performed Fos immunohistochemistry and network connectivity analyses on a set of cortical, striatal, thalamic, and amygdalar brain regions. Neural activity in the prelimbic cortex, ventral orbitofrontal cortex, nucleus accumbens core, and paraventricular nucleus of the thalamus was greater during recall relative to extinction. Conversely, prolonged extinction following 6 sessions induced increased neural activity in the infralimbic cortex, medial orbitofrontal cortex, and nucleus accumbens shell compared to home-cage controls. All these structures were similarly recruited during recall on the first extinction session. These findings provide novel evidence for the contribution of brain areas and neural networks that are differentially involved in the recall versus extinction of appetitive Pavlovian conditioned responding.

The Recruitment of a Neuronal Ensemble in the Central Nucleus of the Amygdala During the First Extinction Episode Has Persistent Effects on Extinction Expression

BACKGROUND

Adaptive behavior depends on the delicate and dynamic balance between acquisition and extinction memories. Disruption of this balance, particularly when the extinction of memory loses control over behavior, is the root of treatment failure of maladaptive behaviors such as substance abuse or anxiety disorders. Understanding this balance requires a better understanding of the underlying neurobiology and its contribution to behavioral regulation.

METHODS

We microinjected Daun02 in Fos-lacZ transgenic rats following a single extinction training episode to delete extinction-recruited neuronal ensembles in the basolateral amygdala (BLA) and central nucleus of the amygdala (CN) and examined their contribution to behavior in an appetitive Pavlovian task. In addition, we used immunohistochemistry and neuronal staining methods to identify the molecular markers of activated neurons in the BLA and CN during extinction learning or retrieval.

RESULTS

CN neurons were preferentially engaged following extinction, and deletion of these extinction-activated ensembles in the CN but not the BLA impaired the retrieval of extinction despite additional extinction training and promoted greater levels of behavioral restoration in spontaneous recovery and reinstatement. Disrupting extinction processing in the CN in turn increased activity in the BLA. Our results also show a specific role for CN PKCδ+ neurons in behavioral inhibition but not during initial extinction learning.

CONCLUSIONS

We showed that the initial extinction-recruited CN ensemble is critical to the acquisition-extinction balance and that greater behavioral restoration does not mean weaker extinction contribution. These findings provide a novel avenue for thinking about the neural mechanisms of extinction and for developing treatments for cue-triggered appetitive behaviors.

Psychostimulant Drugs Activate Cell-type Specific and Topographic cFos Expression in the Lumbar Spinal Cord

Psychostimulant drugs, such as cocaine, d-amphetamine and methylphenidate, alter a wide range of behaviors including locomotor activity and somatosensory perception. These altered behaviors are accompanied by the activation of specific neuronal populations within reward-, emotion- and locomotion-related circuits. However, whether such regulation occurs at the level of the spinal cord, a key node for neural circuits integrating and coordinating sensory and motor functions has never been addressed. By evaluating the temporal and spatial expression pattern of the phosphorylated form of the immediate early gene cFos at Ser32 (pS32-cFos), used as a proxy of neuronal activation, we demonstrate that, in adult male mice, d-amphetamine increases pS32-cFos expression in both inhibitory and excitatory neurons in dorsal and ventral horns at the lumbar spinal cord level. Interestingly, a fraction of neurons activated by a first exposure to d-amphetamine can be re-activated following d-amphetamine re-exposure. Similar expression patterns were observed in response to cocaine and methylphenidate, but not following morphine and dozilcipine administration. Finally, the blockade of dopamine reuptake was sufficient to recapitulate the increase in pS32-cFos expression induced by psychostimulant drugs. Our work provides evidence that cFos expression can be activated in lumbar spinal cord in response to acute psychostimulants administration.

Role of ventral subiculum neuronal ensembles in incubation of oxycodone craving after electric barrier-induced voluntary abstinence

High relapse rate is a key feature of opioid addiction. In humans, abstinence is often voluntary due to negative consequences of opioid seeking. To mimic this human condition, we recently introduced a rat model of incubation of oxycodone craving after electric barrier-induced voluntary abstinence. Incubation of drug craving refers to time-dependent increases in drug seeking after cessation of drug self-administration. Here, we used the activity marker Fos, muscimol-baclofen (GABAa + GABAb receptor agonists) global inactivation, Daun02-selective inactivation of putative relapse-associated neuronal ensembles, and fluorescence-activated cell sorting of Fos-positive cells and quantitative polymerase chain reaction to demonstrate a key role of vSub neuronal ensembles in incubation of oxycodone craving after voluntary abstinence, but not homecage forced abstinence. We also used a longitudinal functional magnetic resonance imaging method and showed that functional connectivity changes in vSub-related circuits predict opioid relapse after abstinence induced by adverse consequences of opioid seeking.

Retrieval-extinction of drug memory requires AMPA receptor trafficking

Disruption of drug-associated memory reduces relapse. Transient memory retrieval facilitates the upcoming extinction of addiction memory, while the neural basis for this beneficial outcome remains unelucidated. Here, we report that AMPA receptor trafficking acts as the central component for retrieval-extinction-based drug memory intervention. Drug memory retrieval transiently reduces AMPA receptor-mediated synaptic transmission in prefrontal cortical neurons (lasting for 2 to 4 hours) through rapid removal of calcium-permeable AMPA receptors from the synapse, which returned to basal state level after 6 hours. The receptor trafficking is orchestrated by dopamine D1 but not D2 receptor signaling. Blocking AMPA receptor trafficking abolishes retrieval-extinction-mediated addiction memory degradation. These results reveal the molecular mechanism underlying the efficacy of transient memory retrieval on helping to erase addiction memory and support targeting the prefrontal cortex to reduce relapse (e.g., with noninvasive brain stimulation).

Adolescent alcohol exposure reduces dopamine 1 receptor modulation of prelimbic neurons projecting to the nucleus accumbens and basolateral amygdala

Binge drinking during adolescence is highly prevalent despite increasing evidence of its long-term impact on behaviors associated with modulation of behavioral flexibility by the medial prefrontal cortex (mPFC). In the present study, male and female rats underwent adolescent intermittent ethanol (AIE) exposure by vapor inhalation. After aging to adulthood, retrograde bead labelling and viral tagging were used to identify populations of neurons in the prelimbic region (PrL) of the mPFC that project to specific subcortical targets. Electrophysiological recording from bead-labelled neurons in PrL slices revealed that AIE did not alter the intrinsic excitability of PrL neurons that projected to either the NAc or the BLA. Similarly, recordings of spontaneous inhibitory and excitatory post-synaptic currents revealed no AIE-induced changes in synaptic drive onto either population of projection neurons. In contrast, AIE exposure was associated with a loss of dopamine receptor 1 (D1), but no change in dopamine receptor 2 (D2), modulation of evoked firing of both populations of projection neurons. Lastly, confocal imaging of proximal and apical dendritic tufts of viral-labelled PrL neurons that projected to the nucleus accumbens (NAc) revealed AIE did not alter the density of dendritic spines. Together, these observations provide evidence that AIE exposure results in disruption of D1 receptor modulation of PrL inputs to at least two major subcortical target regions that have been implicated in AIE-induced long-term changes in behavioral control.

The roles of rat medial prefrontal and orbitofrontal cortices in relapse to cocaine-seeking: A comparison across methods for identifying neurocircuits

A large body of research supports the notion that regions of the rodent frontal cortex regulate reinstatement of cocaine seeking after cessation of intravenous cocaine self-administration. However, earlier studies identifying the roles of medial (mPFC) and orbital prefrontal cortices (OFC) in reinstatement relied on pharmacological inactivation methods, which indiscriminately inhibited cells within a target region. Here, we first review the anatomical borders and pathways of the rat mPFC and OFC. Next, we compare and contrast findings from more recent cocaine seeking and reinstatement studies that used chemogenetics, optogenetics, or advanced tracing to manipulate specific local cell types or input/output projections of the mPFC and OFC subregions. We found that these studies largely corroborated the roles for mPFC subregions as ascribed by pharmacological inactivation studies. Namely, the prelimbic cortex generally drives cocaine seeking behaviors while the infralimbic cortex is recruited to inhibit cocaine seeking by extinction training but may contribute to seeking after prolonged abstinence. While the OFC remains understudied, we suggest it should not be overlooked, and, as with prelimbic and infralimbic cortices, we identify specific pathways of interest for future studies.

From ensembles to meta-ensembles: Specific reward encoding by correlated network activity

Neuronal ensembles are local, sparsely distributed populations of neurons that are reliably re-activated by a specific stimulus, context or task. Such discrete cell populations can be defined either functionally, by electrophysiological recordings or in vivo calcium imaging, or anatomically, using the expression of markers such as the immediate early gene cFos. A typical example of tasks that involve the formation of neuronal ensembles is reward learning, such as the cue-reward pairing during operant conditioning. These ensembles are re-activated during cue-presentation and increasing evidence suggests that this re-activation is the neurophysiological basis for the execution of reward-seeking behavior. Whilst the pursuit of rewards is a common daily activity, it is also related to the consumption of drugs, such as alcohol, and may result in problematic behaviors including addiction. Recent research has identified neuronal ensembles in several reward-related brain regions that control distinct aspects of a conditioned response, e.g., contextual information about the availability of a specific reward or the actions needed to retrieve this reward under the given circumstances. Here, we review studies using the activity marker cFos to identify and characterize neuronal ensembles related to alcohol and non-drug rewards with a special emphasis on the discrimination between different rewards by meta-ensembles, i.e., by dynamic co-activation of multiple ensembles across different brain areas.

Prelimbic Ensembles Mediate Cocaine Seeking After Behavioral Acquisition and Once Rats Are Well-Trained

Substance use disorder (SUD) is a chronic relapsing condition characterized by continued use of drugs despite negative consequences. SUD is thought to involve disordered learning and memory wherein drug-paired cues gain increased salience, and ultimately drive craving and relapse. These types of associations are thought to be encoded within sparsely distributed sets of neurons, called neuronal ensembles, that drive encoded behaviors through synchronous activity of the participant neurons. We have previously found that Fos-expressing neuronal ensembles within the prefrontal cortex are required for well-trained cocaine seeking. However, less is known about how quickly cortical neuronal ensembles form during the initiation of cocaine seeking behavior. Here, we seek to further elucidate the role of Fos-expressing neuronal ensembles within the prelimbic cortex (PL) after the initial acquisition of cocaine self-administration (SA), or, after 10 days of additional SA training (well-trained). We trained Fos-LacZ transgenic rats to lever press for cocaine under an FR1 schedule of reinforcement. Once rats met acquisition criteria for cocaine self-administration, we ablated Fos-expressing neuronal ensembles in the PL using the Daun02 inactivation method, either 1 or 10 days after the rats met the acquisition criteria. Targeted ablation of Fos-expressing neuronal ensembles in the PL attenuated active lever pressing both 1 day and 10 days after rats acquired cocaine self-administration. Together, this suggests that Fos-expressing neuronal ensembles rapidly form in the PL and continue to mediate maintained cocaine seeking behavior.

Molecular characteristics and laminar distribution of prefrontal neurons projecting to the mesolimbic system

Prefrontal cortical influence over the mesolimbic system - including the nucleus accumbens (NAc) and the ventral tegmental area (VTA) - is implicated in various cognitive processes and behavioral malfunctions. The functional versatility of this system could be explained by an underlying anatomical complexity; however, the detailed characterization of the medial prefrontal cortical (mPFC) innervation of the NAc and VTA is still lacking. Therefore, combining classical retrograde and conditional viral tracing techniques with multiple fluorescent immunohistochemistry, we sought to deliver a precise, cell- and layer-specific anatomical description of the cortico-mesolimbic pathways in mice. We demonstrated that NAc- (mPFC_NAc) and VTA-projecting mPFC (mPFC_VTA) populations show different laminar distribution (layers 2/3-5a and 5b-6, respectively) and express different molecular markers. Specifically, calbindin and Ntsr1 are specific to mPFC_NAc neurons, while mPFC_VTA neurons express high levels of Ctip2 and FoxP2, indicating that these populations are mostly separated at the cellular level. We directly tested this with double retrograde tracing and Canine adenovirus type 2-mediated viral labeling and found that there is indeed minimal overlap between the two populations. Furthermore, whole-brain analysis revealed that the projection pattern of these populations is also different throughout the brain. Taken together, we demonstrated that the NAc and the VTA are innervated by two, mostly nonoverlapping mPFC populations with different laminar distribution and molecular profile. These results can contribute to the advancement in our understanding of mesocorticolimbic functions and its disorders in future studies.

Cocaine preference and neuroadaptations are maintained by astrocytic NMDA receptors in the nucleus accumbens

Cocaine-associated memories induce cravings and interfere with the ability of users to cease cocaine use. Reducing the strength of cue-drug memories by facilitating extinction may have therapeutic value for the treatment of cocaine addiction. Here, we demonstrate the expression of GluN1/2A/2C NMDA receptor currents in astrocytes in the nucleus accumbens core. Selective ablation of GluN1 subunit from astrocytes in the nucleus accumbens enhanced extinction of cocaine preference memory but did not affect cocaine conditioning or reinstatement. Repeated cocaine exposure up-regulated GluN2C subunit expression and increased astrocytic NMDA receptor currents. Furthermore, intra-accumbal inhibition of GluN2C/2D-containing receptors and GluN2C subunit deletion facilitated extinction of cocaine memory. Cocaine-induced neuroadaptations including dendritic spine maturation and AMPA receptor recruitment were absent in GluN2C knockout mice. Impaired retention of cocaine preference memory in GluN2C knockout mice was restored by exogenous administration of recombinant glypican 4. Together, these results identify a previously unknown astrocytic GluN2C-containing NMDA receptor mechanism underlying maintenance of cocaine preference memory.

Extinction of Cocaine Memory Depends on a Feed-Forward Inhibition Circuit Within the Medial Prefrontal Cortex

BACKGROUND

Cocaine-associated environments (i.e., contexts) evoke persistent memories of cocaine reward and thereby contribute to the maintenance of addictive behavior in cocaine users. From a therapeutic perspective, enhancing inhibitory control over cocaine-conditioned responses is of pivotal importance but requires a more detailed understanding of the neural circuitry that can suppress context-evoked cocaine memories, e.g., through extinction learning. The ventral medial prefrontal cortex (vmPFC) and dorsal medial prefrontal cortex (dmPFC) are thought to bidirectionally regulate responding to cocaine cues through their projections to other brain regions. However, whether these mPFC subregions interact to enable adaptive responding to cocaine-associated contextual stimuli has remained elusive.

METHODS

We used antero- and retrograde tracing combined with chemogenetic intervention to examine the role of vmPFC-to-dmPFC projections in extinction of cocaine-induced place preference in mice. In addition, electrophysiological recordings and optogenetics were used to determine whether parvalbumin-expressing inhibitory interneurons and pyramidal neurons in the dmPFC are innervated by vmPFC projections.

RESULTS

We found that vmPFC-to-dmPFC projecting neurons are activated during unreinforced re-exposure to a cocaine-associated context, and selective suppression of these cells impairs extinction learning. Parvalbumin-expressing inhibitory interneurons in the dmPFC receive stronger monosynaptic excitatory input from vmPFC projections than local dmPFC pyramidal neurons, consequently resulting in disynaptic inhibition of pyramidal neurons. In line with this, we show that chemogenetic suppression of dmPFC parvalbumin-expressing inhibitory interneurons impairs extinction learning.

CONCLUSIONS

Our data reveal that vmPFC projections mediate extinction of a cocaine-associated contextual memory through recruitment of feed-forward inhibition in the dmPFC, thereby providing a novel neuronal substrate that promotes extinction-induced inhibitory control.

Cortico-Striatal Control over Adaptive Goal-Directed Responding Elicited by Cues Signaling Sucrose Reward or Punishment

The medial prefrontal cortex (mPFC) and nucleus accumbens (NAc) have been associated with the expression of adaptive and maladaptive behavior elicited by fear-related and drug-associated cues. However, reported effects of mPFC manipulations on cue-elicited natural reward-seeking and inhibition thereof have been varied, with few studies examining cortico-striatal contributions in tasks that require adaptive responding to cues signaling reward and punishment within the same session. The current study aimed to better elucidate the role of mPFC and NAc subdivisions, and their functional connectivity in cue-elicited adaptive responding using a novel discriminative cue responding task. Male Long-Evans rats learned to lever-press on a VR5 schedule for a discriminative cue signaling reward, and to avoid pressing the same lever in the presence of another cue signaling punishment. Postacquisition, prelimbic (PL) and infralimbic (IL) areas of the mPFC, NAc core, shell, PL-core, or IL-shell circuits were pharmacologically or chemogenetically inhibited while animals performed under (1) nonreinforced (extinction) conditions, where the appetitive and aversive cues were presented in alternating trials alone or as a compound stimulus; and (2) reinforced conditions, whereby cued responding was accompanied by associated outcomes. PL and IL inactivation attenuated nonreinforced and reinforced goal-directed cue responding, whereas NAc core and shell inactivation impaired nonreinforced responding for the appetitive, but not aversive cue. Furthermore, PL-core and IL-shell inhibition disinhibited nonreinforced but not reinforced cue responding. Our findings implicate the mPFC as a site of confluence of motivationally significant cues and outcomes, and in the regulation of nonreinforced cue responding via downstream NAc targets.SIGNIFICANCE STATEMENT The ability to discriminate and respond appropriately to environmental cues that signal availability of reward or punishment is essential for survival. The medial prefrontal cortex (mPFC) and nucleus accumbens (NAc) have been implicated in adaptive and maladaptive behavior elicited by fear-related and drug-associated cues. However, less is known about the role they play in orchestrating adaptive responses to natural reward and punishment cues within the same behavioral task. Here, using a novel discriminative cue responding task combined with pharmacological or chemogenetic inhibition of mPFC, NAc and mPFC-NAc circuits, we report that mPFC is critically involved in responding to changing cued response-outcomes, both when the responses are reinforced, and nonreinforced. Furthermore, the mPFC coordinates nonreinforced discriminative cue responding by suppressing inappropriate responding via downstream NAc targets.

SMART: An Open-Source Extension of WholeBrain for Intact Mouse Brain Registration and Segmentation

Mapping immediate early gene (IEG) expression across intact mouse brains allows for unbiased identification of brain-wide activity patterns underlying complex behaviors. Accurate registration of sample brains to a common anatomic reference is critical for precise assignment of IEG-positive ("active") neurons to known brain regions of interest (ROIs). While existing automated voxel-based registration methods provide a high-throughput solution, they require substantial computing power, can be difficult to implement and fail when brains are damaged or only partially imaged. Additionally, it is challenging to cross-validate these approaches or compare them to any preexisting literature based on serial coronal sectioning. Here, we present the open-source R package SMART (Semi-Manual Alignment to Reference Templates) that extends the WholeBrain R package framework to automated segmentation and semi-automated registration of intact mouse brain light-sheet fluorescence microscopy (LSFM) datasets. The SMART package was created for novice programmers and introduces a streamlined pipeline for aligning, registering, and segmenting LSFM volumetric datasets across the anterior-posterior (AP) axis, using a simple "choice game" and interactive menus. SMART provides the flexibility to register whole brains, partial brains or discrete user-chosen images, and is fully compatible with traditional sectioned coronal slice-based analyses. We demonstrate SMART's core functions using example datasets and provide step-by-step video tutorials for installation and implementation of the package. We also present a modified iDISCO+ tissue clearing procedure for uniform immunohistochemical labeling of the activity marker Fos across intact mouse brains. The SMART pipeline, in conjunction with the modified iDISCO+ Fos procedure, is ideally suited for examination and orthogonal cross-validation of brain-wide neuronal activation datasets.

Drug versus non-drug behaviors: A dual-reward model of sex differences and neurobiological mechanisms in rats

Substance Use Disorders (SUDs) are an impactful problem characterized by chronic relapse and engagement in drug-related behaviors at the expense of non-drug behaviors. Brain regions implicated in drug and non-drug-related behaviors often overlap, complicating investigations of neurobiological mechanisms underlying SUDs. Here we presented a within-subject model for studying self-administration, reinforcer competition, extinction, and cued reinstatement of cocaine- and food-seeking in rats. Due to differences in cocaine- and food-reinforced behavior, we transformed data to proportions of baseline, revealing increased resistance to extinction and disproportionately greater cued reinstatement of cocaine seeking relative to food seeking. Consistent with previous reports, females showed greater preference for cocaine reinforcement than males, though these findings failed to reach statistical significance. To demonstrate the model's utility for investigating neurobiological mechanisms, we included proof-of-concept calcium imaging data demonstrating the utility of the behavioral model for detecting cellular activity patterns associated with cocaine- and food-seeking behaviors. Future studies utilizing this model should improve understanding of the development and expression of pathological behaviors characteristic of SUDs in humans, sex differences in these behaviors, and their neurobiological correlates. Thus, the model has utility for improving understanding of SUDs, leading to novel treatments to reduce the pathological behaviors associated with SUDs.

The rodent medial prefrontal cortex and associated circuits in orchestrating adaptive behavior under variable demands

Emerging evidence implicates rodent medial prefrontal cortex (mPFC) in tasks requiring adaptation of behavior to changing information from external and internal sources. However, the computations within mPFC and subsequent outputs that determine behavior are incompletely understood. We review the involvement of mPFC subregions, and their projections to the striatum and amygdala in two broad types of tasks in rodents: 1) appetitive and aversive Pavlovian and operant conditioning tasks that engage mPFC-striatum and mPFC-amygdala circuits, and 2) foraging-based tasks that require decision making to optimize reward. We find support for region-specific function of the mPFC, with dorsal mPFC and its projections to the dorsomedial striatum supporting action control with higher cognitive demands, and ventral mPFC engagement in translating affective signals into behavior via discrete projections to the ventral striatum and amygdala. However, we also propose that defined mPFC subdivisions operate as a functional continuum rather than segregated functional units, with crosstalk that allows distinct subregion-specific inputs (e.g., internal, affective) to influence adaptive behavior supported by other subregions.

Fos-expressing neuronal ensembles in rat infralimbic cortex encode initial and maintained oxycodone seeking in rats

Neuronal ensembles within the infralimbic cortex (IL) and their projections to the nucleus accumbens (NAc) mediate opiate seeking in well-trained rats. However, it is unclear how early this circuitry is recruited during oxycodone self-administration. Here, we used retrograde labelling (CTb) and immunohistochemistry to identify NAc-projecting neurons in the IL that were activated during initial oxycodone seeking. Next, we sought to determine the role of IL neuronal ensembles in initial oxycodone self-administration. We used the Daun02 procedure in male and female Fos-LacZ rats to chemogenetically inactivate IL Fos-expressing neurons at different time points in oxycodone self-administration training: immediately after meeting criteria for acquisition of behaviour and following nine daily sessions with increasing schedules of reinforcement (FR1, FR2 and FR3) in which rats demonstrated stable oxycodone intake under increasing effort to self-administer. We found that Daun02 infusions attenuated oxycodone seeking at both the initial learning and well-trained time points. These results suggest that IL neuronal ensembles are formed during initial learning of oxycodone self-administration and required for the maintenance and expression of oxycodone seeking.

Comparison of prefrontal cortex sucrose seeking ensembles engaged in multiple seeking sessions: Context is key

Encoding of memories, including those associated with prior drug or reward, is thought to take place within distinct populations of neurons, termed ensembles. Neuronal ensembles for drug- and reward-seeking have been identified in regions of the medial prefrontal cortex, but much of our understanding of these ensembles is based on experiments that take place in a single reward-associated environment and measure ensemble encoding over short durations of time. In contrast, reward seeking behavior is evident across different reward-associated environments and persists over time. Using TetTag mice and Fos immunohistochemistry, we examined the relationship between persistent sucrose-seeking and ensemble encoding in mice that undergo seeking sessions in the same or different sucrose self-administration contexts 2 weeks apart. We found that prelimbic (PrL) and anterior cingulate cortex ensembles tagged in the first seeking session were highly sensitive to the context in which a second seeking session took place: reactivation of these ensembles was reduced in the same context but elevated in a distinct sucrose self-administration context. Correlational analyses revealed that ensemble reactivation in the PrL was proportional to the persistence of sucrose seeking behavior across sessions in differing ways in female mice. In the same context, reactivation was proportional to the persistence of non-reinforced operant responses, whereas in a distinct context, reactivation was proportional to the persistence of non-reinforced head entries into the sucrose receptacle. This study underlines the importance of the medial prefrontal cortex importance in maintaining a reward-seeking ensemble over time and identifies context-dependent changes in behavioral correlates of ensemble reactivation.

Corticostriatal Suppression of Appetitive Pavlovian Conditioned Responding

The capacity to suppress learned responses is essential for animals to adapt in dynamic environments. Extinction is a process by which animals learn to suppress conditioned responding when an expected outcome is omitted. The infralimbic (IL) cortex to nucleus accumbens shell (NAcS) neural circuit is implicated in suppressing conditioned responding after extinction, especially in the context of operant cocaine-seeking behavior. However, the role of the IL-to-NAcS neural circuit in the extinction of responding to appetitive Pavlovian cues is unknown, and the psychological mechanisms involved in response suppression following extinction are unclear. We trained male Long Evans rats to associate a 10 s auditory conditioned stimulus (CS; 14 trials per session) with a sucrose unconditioned stimulus (US; 0.2 ml per CS) in a specific context, and then following extinction in a different context, precipitated a renewal of CS responding by presenting the CS alone in the original Pavlovian conditioning context. Unilateral, optogenetic stimulation of the IL-to-NAcS circuit selectively during CS trials suppressed renewal. In a separate experiment, IL-to-NAcS stimulation suppressed CS responding regardless of prior extinction and impaired extinction retrieval. Finally, IL-to-NAcS stimulation during the CS did not suppress the acquisition of Pavlovian conditioning but was required for the subsequent expression of CS responding. These results are consistent with multiple studies showing that the IL-to-NAcS neural circuit is involved in the suppression of operant cocaine-seeking, extending these findings to appetitive Pavlovian cues. The suppression of appetitive Pavlovian responding following IL-to-NAcS circuit stimulation, however, does not appear to be an extinction-dependent process.SIGNIFICANCE STATEMENT Extinction is a form of inhibitory learning through which animals learn to suppress conditioned responding in the face of nonreinforcement. We investigated the role of the IL cortex inputs to the NAcS in the extinction of responding to appetitive Pavlovian cues and the psychological mechanisms involved in response suppression following extinction. Using in vivo optogenetics, we found that stimulating the IL-to-NAcS neural circuit suppressed context-induced renewal of conditioned responding after extinction. In a separate experiment, stimulating the IL-to-NAcS circuit suppressed conditioned responding in an extinction-independent manner. These findings can be used by future research aimed at understanding how corticostriatal circuits contribute to behavioral flexibility and mental disorders that involve the suppression of learned behaviors.

Theta oscillations in rat infralimbic cortex are associated with the inhibition of cocaine seeking during extinction

Infralimbic cortical (IL) manipulations indicate that this region mediates extinction learning and suppresses cocaine seeking following cocaine self‐administration. However, little work has recorded IL activity during the inhibition of cocaine seeking due to the difficulty of determining precisely when cocaine‐seeking behaviour is inhibited within a cocaine‐seeking session. The present study used in vivo electrophysiology to examine IL activity across extinction as well as during cocaine self‐administration and reinstatement. Sprague–Dawley rats underwent 6‐h access cocaine self‐administration in which the response lever was available during discrete signalled trials, a procedure which allowed for the comparison between epochs of cocaine seeking versus the inhibition thereof. Subsequently, rats underwent extinction and cocaine‐primed reinstatement using the same procedure. Results indicate that theta rhythms (4–10 Hz) dominated IL local‐field potential (LFP) activity during all experimental stages. During extinction, theta power fluctuated significantly surrounding the lever press and was lower when rats engaged in cocaine seeking versus when they withheld from doing so. These patterns of oscillatory activity differed from self‐administration and reinstatement stages. Single‐unit analyses indicate heterogeneity of IL unit responses, supporting the idea that multiple neuronal subpopulations exist within the IL and promote the expression of different and even opposing cocaine‐seeking behaviours. Together, these results are consistent with the idea that aggregate synaptic and single‐unit activity in the IL represent the engagement of the IL in action monitoring to promote adaptive behaviour in accordance with task contingencies and reveal critical insights into the relationship between IL activity and the inhibition of cocaine seeking.

Direct measurement of neuronal ensemble activity using photoacoustic imaging in the stimulated Fos-LacZ transgenic rat brain: A proof-of-principle study

Measuring neuroactivity underlying complex behaviors facilitates understanding the microcircuitry that supports these behaviors. We have developed a functional and molecular photoacoustic tomography (F/M-PAT) system which allows direct imaging of Fos-expressing neuronal ensembles in Fos-LacZ transgenic rats with a large field-of-view and high spatial resolution. F/M-PAT measures the beta-galactosidase catalyzed enzymatic product of exogenous chromophore X-gal within ensemble neurons. We used an ex vivo imaging method in the Wistar Fos-LacZ transgenic rat, to detect neuronal ensembles in medial prefrontal cortex (mPFC) following cocaine administration or a shock-tone paired stimulus. Robust and selective F/M-PAT signal was detected in mPFC neurons after both conditions (compare to naive controls) demonstrating successful and direct detection of Fos-expressing neuronal ensembles using this approach. The results of this study indicate that F/M-PAT can be used in conjunction with Fos-LacZ rats to monitor neuronal ensembles that underlie a range of behavioral processes, such as fear learning or addiction.

Infralimbic cortex functioning across motivated behaviors: Can the differences be reconciled?

The rodent infralimbic cortex (IL) is implicated in higher order executive functions such as reward seeking and flexible decision making. However, the precise nature of its role in these processes is unclear. Early evidence indicated that the IL promotes the extinction and ongoing inhibition of fear conditioning and cocaine seeking. However, evidence spanning other behavioral domains, such as natural reward seeking and habit-based learning, suggests a more nuanced understanding of IL function. As techniques have advanced and more studies have examined IL function, identifying a unifying explanation for its behavioral function has become increasingly difficult. Here, we discuss evidence of IL function across motivated behaviors, including associative learning, drug seeking, natural reward seeking, and goal-directed versus habit-based behaviors, and emphasize how context-specific encoding and heterogeneous IL neuronal populations may underlie seemingly conflicting findings in the literature. Together, the evidence suggests that a major IL function is to facilitate the encoding and updating of contingencies between cues and behaviors to guide subsequent behaviors.

Inactivation of the infralimbic cortex decreases discriminative stimulus-controlled relapse to cocaine seeking in rats

Persistent susceptibility to cue-induced relapse is a cardinal feature of addiction. Discriminative stimuli (DSs) are one type of drug-associated cue that signal drug availability (DS+) or unavailability (DS-) and control drug seeking prior to relapse. We previously established a trial-based procedure in rats to isolate DSs from context, conditioned stimuli, and other drug-associated cues during cocaine self-administration and demonstrated DS-controlled cocaine seeking up to 300 abstinence days. The behavioral and neural mechanisms underlying trial-based DS-control of drug seeking have rarely been investigated. Here we show that following discrimination training in our trial-based procedure, the DS+ and DS- independently control the expression and suppression of cocaine seeking during abstinence. Using microinjections of GABAA + GABAB receptor agonists (muscimol + baclofen) in medial prefrontal cortex, we report that infralimbic, but not prelimbic, subregion of medial prefrontal cortex is critical to persistent DS-controlled relapse to cocaine seeking after prolonged abstinence, but not DS-guided discriminated cocaine seeking or DS-controlled cocaine self-admininstration. Finally, using ex vivo whole-cell recordings from pyramidal neurons in the medial prefrontal cortex, we demonstrate that the disruption of DS-controlled cocaine seeking following infralimbic cortex microinjections of muscimol+baclofen is likely a result of suppression of synaptic transmission in the region via a presynaptic mechanism of action.

A common limiter circuit for opioid choice and relapse identified in a rodent addiction model

Activity in numerous brain regions drives heroin seeking, but no circuits that limit heroin seeking have been identified. Furthermore, the neural circuits controlling opioid choice are unknown. In this study, we examined the role of the infralimbic cortex (IL) to nucleus accumbens shell (NAshell) pathway during heroin choice and relapse. This model yielded subpopulations of heroin versus food preferring rats during choice, and choice was unrelated to subsequent relapse rates to heroin versus food cues, suggesting that choice and relapse are distinct behavioral constructs. Supporting this, inactivation of the IL with muscimol produced differential effects on opioid choice versus relapse. A pathway-specific chemogenetic approach revealed, however, that the IL-NAshell pathway acts as a common limiter of opioid choice and relapse. Furthermore, dendritic spines in IL-NAshell neurons encode distinct aspects of heroin versus food reinforcement. Thus, opioid choice and relapse share a common addiction-limiting circuit in the IL-NAshell pathway.

Circuit selectivity in drug versus natural reward seeking behaviors

Substance use disorder (SUD) is characterized, in part by behavior biased toward drug use and away from natural sources of reward (e.g., social interaction, food, sex). The neurobiological underpinnings of SUDs reveal distinct brain regions where neuronal activity is necessary for the manifestation of SUD-characteristic behaviors. Studies that specifically examine how these regions are involved in behaviors motivated by drug versus natural reward allow determinations of which regions are necessary for regulating seeking of both reward types, and appraisals of novel SUD therapies for off-target effects on behaviors motivated by natural reward. Here, we evaluate studies directly comparing regulatory roles for specific brain regions in drug versus natural reward. While it is clear that many regions drive behaviors motivated by all reward types, based on the literature reviewed we propose a set of interconnected regions that become necessary for behaviors motivated by drug, but not natural rewards. The circuitry is selectively necessary for drug seeking includes an Action/Reward subcircuit, comprising nucleus accumbens, ventral pallidum, and ventral tegmental area, a Prefrontal subcircuit comprising prelimbic, infralimbic, and insular cortices, a Stress subcircuit comprising the central nucleus of the amygdala and the bed nucleus of the stria terminalis, and a Diencephalon circuit including lateral hypothalamus. Evidence was mixed for nucleus accumbens shell, insular cortex, and ventral pallidum. Studies for all other brain nuclei reviewed supported a necessary role in regulating both drug and natural reward seeking. Finally, we discuss emerging strategies to further disambiguate the necessity of brain regions in drug- versus natural reward-associated behaviors.

Fos-expressing neuronal ensemble in rat ventromedial prefrontal cortex encodes cocaine seeking but not food seeking in rats

Neuronal ensembles in ventromedial prefrontal cortex (vmPFC) play a role in both cocaine and palatable food seeking. However, it is unknown whether similar or different vmPFC neuronal ensembles mediate food and cocaine seeking. Here, we used the Daun02 inactivation procedure to assess whether the neuronal ensembles mediating food and cocaine seeking can be functionally distinguished. We trained male and female Fos-LacZ rats to self-administer palatable food pellets and cocaine on alternating days for 18 days. We then exposed the rats to a brief nonreinforced food- or cocaine-seeking test to induce Fos and β-gal in neuronal ensembles associated with food or cocaine seeking, respectively and infused Daun02 into vmPFC to ablate the β-gal-expressing ensembles. Two days later, we tested the rats for food or cocaine seeking under extinction conditions. Although inactivation of the food-seeking ensemble did not influence food or cocaine seeking, inactivation of the cocaine-seeking ensemble reduced cocaine seeking but not food seeking. Results indicate that the neuronal ensemble activated by cocaine seeking in vmPFC is functionally separate from the ensemble activated by food seeking.

Food-Seeking Behavior Is Mediated by Fos-Expressing Neuronal Ensembles Formed at First Learning in Rats

Neuronal ensembles in the infralimbic cortex (IL) develop after prolonged food self-administration training. However, rats demonstrate evidence of learning the food self-administration response as early as day 1, with responding quickly increasing to asymptotic levels. Since the contribution of individual brain regions to task performance shifts over the course of training, it remains unclear whether IL ensembles are gradually formed and refined over the course of extensive operant training, or whether functionally-relevant ensembles might be recruited and formed as early as the initial acquisition of food self-administration behavior. Here, we aimed to determine the role of IL ensembles at the earliest possible point after demonstrable learning of a response-outcome association. We first allowed rats to lever press for palatable food pellets and stopped training rats once their behavior evidenced the response-outcome association (learners). We compared their food-seeking behavior and neuronal activation (Fos protein expression) to similarly trained rats that did not form this association (non-learners). Learners had greater food-seeking behavior and neuronal activation within the medial prefrontal cortex (mPFC), suggesting that mPFC subregions might encode initial food self-administration memories. To test the functional relevance of mPFC Fos-expressing ensembles to subsequent food seeking, we tested region-wide inactivation of the IL using muscimol+baclofen and neuronal ensemble-specific ablation using the Daun02 inactivation procedure. Both region-wide inactivation and ensemble-specific inactivation of the IL significantly decreased food seeking. These data suggest that IL neuronal ensembles form during initial learning of food self-administration behavior, and furthermore, that these ensembles play a functional role in food seeking.

Neural Substrates and Circuits of Drug Addiction

Drug addiction is a chronic relapsing disorder, and a significant amount of research has been devoted to understand the factors that contribute to the development, loss of control, and persistence of compulsive addictive behaviors. In this review, we provide an overview of various theories of addiction to drugs of abuse and the neurobiology involved in elements of the addiction cycle. Specific focus is devoted to the role of the mesolimbic pathway in acute drug reinforcement and occasional drug use, the role of the mesocortical pathway and associated areas (e.g., the dorsal striatum) in escalation/dependence, and the contribution of these pathways and associated circuits to conditioned responses, drug craving, and loss of behavioral control that may underlie drug relapse. By enhancing the understanding of the neurobiological factors that mediate drug addiction, continued preclinical and clinical research will aid in the development of novel therapeutic interventions that can serve as effective long-term treatment strategies for drug-dependent individuals.

Acute, but not longer-term, exposure to environmental enrichment attenuates Pavlovian cue-evoked conditioned approach and Fos expression in the prefrontal cortex in mice

Exposure to environmental enrichment can modify the impact of motivationally relevant stimuli. For instance, previous studies in rats have found that even a brief, acute (~1 day), but not chronic, exposure to environmentally enriched (EE) housing attenuates instrumental lever pressing for sucrose-associated cues in a conditioned reinforcement setup. Moreover, acute EE reduces corticoaccumbens activity, as measured by decreases in expression of the neuronal activity marker "Fos." Currently, it is not known whether acute EE also reduces sucrose seeking and corticoaccumbens activity elicited by non-contingent or "forced" exposure to sucrose cues, which more closely resembles cue exposure encountered in daily life. We therefore measured the effects of acute/intermittent (1 day or 6 day of EE prior to test day) versus chronic (EE throughout conditioning lasting until test day) EE on the ability of a Pavlovian sucrose cue to elicit sucrose seeking (conditioned approach) and Fos expression in the medial prefrontal cortex (mPFC), orbitofrontal cortex (OFC), and nucleus accumbens (NAc) in mice. One day, but not 6 day or chronic EE , reduced sucrose seeking and Fos in the deep layers of the dorsal mPFC. By contrast, 1 day, 6 day, and chronic EE all reduced Fos in the shallow layers of the OFC. None of the EE manipulations modulated NAc Fos expression. We reveal how EE reduces behavioral reactivity to sucrose cues by reducing activity in select prefrontal cortical brain areas. Our work further demonstrates the robustness of EE in its ability to modulate various forms of reward-seeking across species.

Medial prefrontal cortical control of reward- and aversion-based behavioral output: Bottom-up modulation

How does the brain guide our actions? This is a complex issue, where the medial prefrontal cortex (mPFC) plays a crucial role. The mPFC is essential for cognitive flexibility and decision making. These functions are related to reward- and aversion-based learning, which ultimately drive behavior. Though, cortical projections and modulatory systems that may regulate those processes in the mPFC are less understood. How does the mPFC regulate approach-avoidance behavior in the case of conflicting aversive and appetitive stimuli? This is likely dependent on the bottom-up neuromodulation of the mPFC projection neurons. In this review, we integrate behavioral-, pharmacological-, and viral-based circuit manipulation data showing the involvement of mPFC dopaminergic, noradrenergic, cholinergic, and serotoninergic inputs in reward and aversion processing. Given that an incorrect balance of reward and aversion value could be a key problem in mental diseases such as substance use disorders, we discuss outstanding questions for future research on the role of mPFC modulation in reward and aversion.