Inactivation of the prelimbic cortex attenuates operant responding in both physical and behavioral contexts

Examining a punishment-related brain circuit with miniature fluorescence microscopes and deep learning

In humans experiencing substance use disorder (SUD), abstinence from drug use is often motivated by a desire to avoid some undesirable consequence of further use: health effects, legal ramifications, etc. This process can be experimentally modeled in rodents by training and subsequently punishing an operant response in a context-induced reinstatement procedure. Understanding the biobehavioral mechanisms underlying punishment learning is critical to understanding both abstinence and relapse in individuals with SUD. To date, most investigations into the neural mechanisms of context-induced reinstatement following punishment have utilized discrete loss-of-function manipulations that do not capture ongoing changes in neural circuitry related to punishment-induced behavior change. Here, we describe a two-pronged approach to analyzing the biobehavioral mechanisms of punishment learning using miniature fluorescence microscopes and deep learning algorithms. We review recent advancements in both techniques and consider a target neural circuit.

Chemogenetic inhibition of the ventral hippocampus but not its direct projection to the prelimbic cortex attenuates context-specific operant responding

Previous work has demonstrated the importance of the prelimbic cortex (PL) in contextual control of operant behavior. However, the associated neural circuitry responsible for providing contextual information to the PL is not well understood. In Pavlovian fear conditioning the ventral hippocampus (vH) and its projection to the PL have been shown to be important in supporting the effects of context on learning. The present experiments used chemogenetic inhibition of the direct vH-PL projection or the vH to determine involvement in expression of context-specific operant behavior. Rats were injected with an inhibitory DREADD (hM4Di) or mCherry-only into the vH, and subsequently trained to perform a lever press response for a food pellet in a distinct context. The DREADD ligand clozapine-n-oxide (CNO) was then delivered directly into the PL (experiment 1) and then systemically (experiment 2) prior to tests of the response in the training context as well as an equally familiar but untrained context. vH (systemic CNO) but not vH-PL (intra-PL CNO) inhibition was found to attenuate operant responding in its acquisition context. A third experiment, using the same rats, showed that chemogenetic inhibition of vH also reduced Pavlovian contextual fear. The present results suggest that multisynapatic connections between the vH and PL may be responsible for integration of contextual information with operant behavior.

Prelimbic cortex inactivation prevents ABA renewal based on stress state

Our recent research suggests that the interoceptive state associated with stress can function as a contextual stimulus for operant behavior. In the present experiment, we investigated the role of the rodent prelimbic cortex (PL), a brain region that is critical in contextual control of operant behavior, in the ability of a stressed state to produce ABA renewal of an extinguished operant response. Rats were trained to perform a lever press response for a food pellet reward during daily sessions that followed exposure to a stressor that changed each day. The response was then extinguished in the absence of stress. ABA renewal of extinguished responding occurred following exposure to another stressor (different from any used during acquisition) in control rats but not in rats that received a PL-inactivating infusion (baclofen/muscimol). Results confirm that the interoceptive state of stress can play the role of a contextual stimulus and initiate renewal (relapse) of an inhibited behavior when stress has previously been associated with the behavior. In conjunction with our previous work, the present results support the hypothesis that the PL is important for contexts, both exteroceptive and interoceptive, to exert such control over operant behavior. (PsycInfo Database Record (c) 2023 APA, all rights reserved).

Prelimbic Cortex Inactivation Prevents ABA Renewal Based on Satiety State

We have previously shown that the rat prelimbic cortex (PL) is necessary for contexts to promote the performance of instrumental behaviors that have been learned in them, whether the context is physical (operant chamber) or behavioral (recent performance of a behavior that has historically preceded the target in a behavior chain). In the present experiment, we investigated the role of the PL in satiety level as an interoceptive acquisition context. Rats were trained to lever-press for sweet/fat pellets while sated (22 hrs continuous food access) followed by the extinction of the response while hungry (22 hrs food deprived). Pharmacological inactivation of the PL (with baclofen/muscimol infusion) attenuated renewal of the response that occurred upon a return to the sated context. In contrast, animals that received a vehicle (saline) infusion showed renewal of the previously extinguished response. These results support the hypothesis that the PL monitors the relevant contextual elements (physical, behavioral, or satiety state) associated with reinforcement of a response and promotes the subsequent performance of that response in their presence.

Prelimbic and infralimbic medial prefrontal cortex neuron activity signals cocaine seeking variables across multiple timescales

RATIONALE AND OBJECTIVES

The prefrontal cortex is critical for execution and inhibition of reward seeking. Neural manipulation of rodent medial prefrontal cortex (mPFC) subregions differentially impacts execution and inhibition of cocaine seeking. Dorsal, or prelimbic (PL), and ventral, or infralimbic (IL) mPFC are implicated in cocaine seeking or extinction of cocaine seeking, respectively. This differentiation is not seen across all studies, indicating that further research is needed to understand specific mPFC contributions to drug seeking.

METHODS

We recorded neuronal activity in mPFC subregions during cocaine self-administration, extinction, and cue- and cocaine-induced reinstatement of cocaine seeking.

RESULTS

Both PL and IL neurons were phasically responsive around lever presses during cocaine self-administration, and activity in both areas was reduced during extinction. During both cue- and, to a greater extent, cocaine-induced reinstatement, PL neurons exhibited significantly elevated responses, in line with previous studies demonstrating a role for the region in relapse. The enhanced PL signaling in cocaine-induced reinstatement was driven by strong excitation and inhibition in different groups of neurons. Both of these response types were stronger in PL vs. IL neurons. Finally, we observed tonic changes in activity in all tasks phases, reflecting both session-long contextual modulation as well as minute-to-minute activity changes that were highly correlated with brain cocaine levels and motivation associated with cocaine seeking.

CONCLUSIONS

Although some differences were observed between PL and IL neuron activity across sessions, we found no evidence of a go/stop dichotomy in PL/IL function. Instead, our results demonstrate temporally heterogeneous prefrontal signaling during cocaine seeking and extinction in both PL and IL, revealing novel and complex functions for both regions during these behaviors. This combination of findings argues that mPFC neurons, in both PL and IL, provide multifaceted contributions to the regulation of drug seeking and addiction.

Learning to stop responding

Learning to stop responding is an important process that allows behavior to adapt to a changing and variable environment. This article reviews recent research in this laboratory and others that has studied how animals learn to stop responding in operant extinction, punishment, and feature-negative learning. Extinction and punishment are shown to be similar in two fundamental ways. First, the response-suppressing effects of both are highly context-specific. Second, the response-suppressing effects of both can be remarkably response-specific: Inhibition of one response transfers little to other responses. Learning to inhibit the response so specifically may result from the correction of "response error," the difference between the level of responding and what the current reinforcer supports. In contrast, the inhibition of responding that develops in feature-negative learning, where the response is reinforced during one discriminative stimulus (A) but not in a compound of A and stimulus B, is less response-specific: The inhibition of responding by stimulus B transfers and inhibits a second response, especially if the second response has itself been inhibited before. The results thus indicate both response-specific and response-general forms of behavioral inhibition. One possibility is that response-specific inhibition is learned when the circumstances encourage the organism to pay attention to the response-to what it is actually doing-as behavioral suppression is learned.

Detailed mapping of behavior reveals the formation of prelimbic neural ensembles across operant learning

The prelimbic cortex (PrL) is involved in the organization of operant behaviors, but the relationship between longitudinal PrL neural activity and operant learning and performance is unknown. Here, we developed deep behavior mapping (DBM) to identify behavioral microstates in video recordings. We combined DBM with longitudinal calcium imaging to quantify behavioral tuning in PrL neurons as mice learned an operant task. We found that a subset of PrL neurons were strongly tuned to highly specific behavioral microstates, both task and non-task related. Overlapping neural ensembles were tiled across consecutive microstates in the response-reinforcer sequence, forming a continuous map. As mice learned the operant task, weakly tuned neurons were recruited into new ensembles, with a bias toward behaviors similar to their initial tuning. In summary, our data suggest that the PrL contains neural ensembles that jointly encode a map of behavioral states that is fine grained, is continuous, and grows during operant learning.

New functions of the rodent prelimbic and infralimbic cortex in instrumental behavior

The prelimbic and infralimbic cortices of the rodent medial prefrontal cortex mediate the effects of context and goals on instrumental behavior. Recent work from our laboratory has expanded this understanding. Results have shown that the prelimbic cortex is important for the modulation of instrumental behavior by the context in which the behavior is learned (but not other contexts), with context potentially being broadly defined (to include at least previous behaviors). We have also shown that the infralimbic cortex is important in the expression of extensively-trained instrumental behavior, regardless of whether that behavior is expressed as a stimulus-response habit or a goal-directed action. Some of the most recent data suggest that infralimbic cortex may control the currently active behavioral state (e.g., habit vs. action or acquisition vs. extinction) when two states have been learned. We have also begun to examine prelimbic and infralimbic cortex function as key nodes of discrete circuits and have shown that prelimbic cortex projections to an anterior region of the dorsomedial striatum are important for expression of minimally-trained instrumental behavior. Overall, the use of an associative learning perspective on instrumental learning has allowed the research to provide new perspectives on how these two "cognitive" brain regions contribute to instrumental behavior.