Ventral pallidal encoding of reward-seeking behavior depends on the underlying associative structure

Ventral Pallidal GABAergic Neurons Drive Consumption in Male, But Not Female, Rats

Food intake is controlled by multiple converging signals: hormonal signals that provide information about energy homeostasis and hedonic and motivational aspects of food and food cues that can drive nonhomeostatic or "hedonic" feeding. The ventral pallidum (VP) is a brain region implicated in the hedonic and motivational impact of food and food cues, as well as consumption of rewards. Disinhibition of VP neurons has been shown to generate intense hyperphagia, or overconsumption. While VP GABA neurons have been implicated in cue-elicited reward-seeking and motivation, the role of these neurons in the hyperphagia resulting from VP activation remains unclear. Here, we used designer receptors exclusively activated by designer drugs to activate VP GABA neurons in nonrestricted male and female rats during chow and sucrose consumption. We found that activation of VP GABA neurons increases consumption of chow and sucrose in male rats, but not female rats. Together, these findings suggest that activation of VP GABA neurons can stimulate consumption of routine or highly palatable rewards selectively in male rats.

Ventral pallidal GABAergic neurons drive consumption in male, but not female rats

Food intake is controlled by multiple converging signals: hormonal signals that provide information about energy homeostasis, but also hedonic and motivational aspects of food and food cues that can drive non-homeostatic or "hedonic "feeding. The ventral pallidum (VP) is a brain region implicated in the hedonic and motivational impact of food and foods cues, as well as consumption of rewards. Disinhibition of VP neurons has been shown to generate intense hyperphagia, or overconsumption. While VP gamma-Aminobutyric acidergic (GABA) neurons have been implicated in cue-elicited reward seeking and motivation, the role of these neurons in the hyperphagia resulting from VP activation remains unclear. Here, we used Designer Receptors Exclusively Activated by Designer Drugs (DREADDs) to activate or inhibit VP GABA neurons in sated male and female rats during chow and sucrose consumption. We found that activation of VP GABA neurons increases consumption of chow and sucrose in male rats, but not female rats. We also found that, while inhibition of VP GABA neurons tended to decrease sucrose consumption, this effect was not statistically significant. Together, these findings suggest that activation of VP GABA neurons can stimulate consumption of routine or highly palatable rewards selectively in male rats.

Pavlovian cue-evoked alcohol seeking is disrupted by ventral pallidal inhibition

Cues paired with alcohol can be potent drivers of craving, alcohol-seeking, consumption, and relapse. While the ventral pallidum is implicated in appetitive and consummatory responses across several reward classes and types of behaviors, its role in behavioral responses to Pavlovian alcohol cues has not previously been established. Here, we tested the impact of optogenetic inhibition of ventral pallidum on Pavlovian-conditioned alcohol-seeking in male Long Evans rats. Rats underwent Pavlovian conditioning with an auditory cue predicting alcohol delivery to a reward port and a control cue predicting no alcohol delivery, until they consistently entered the reward port more during the alcohol cue than the control cue. We then tested the within-session effects of optogenetic inhibition during 50% of cue presentations. We found that optogenetic inhibition of ventral pallidum during the alcohol cue reduced port entry likelihood and time spent in the port, and increased port entry latency. Overall, these results suggest that normal ventral pallidum activity is necessary for Pavlovian alcohol-seeking.

Ventral Pallidum and Amygdala Cooperate to Restrain Reward Approach under Threat

Foraging decisions involve assessing potential risks and prioritizing food sources, which can be challenging when confronted with changing and conflicting circumstances. A crucial aspect of this decision-making process is the ability to actively overcome defensive reactions to threats and focus on achieving specific goals. The ventral pallidum (VP) and basolateral amygdala (BLA) are two brain regions that play key roles in regulating behavior motivated by either rewards or threats. However, it is unclear whether these regions are necessary in decision-making processes involving competing motivational drives during conflict. Our aim was to investigate the requirements of the VP and BLA for foraging choices in conflicts involving overcoming defensive responses. Here, we used a novel foraging task and pharmacological techniques to inactivate either the VP or BLA or to disconnect these brain regions before conducting a conflict test in male rats. Our findings showed that BLA is necessary for making risky choices during conflicts, whereas VP is necessary for invigorating the drive to obtain food, regardless of the presence of conflict. Importantly, our research revealed that the connection between VP and BLA is critical in controlling risky food-seeking choices during conflict situations. This study provides a new perspective on the collaborative function of VP and BLA in driving behavior, aimed at achieving goals in the face of dangers.

Pavlovian cue-evoked alcohol seeking is disrupted by ventral pallidal inhibition

Cues paired with alcohol can be potent drivers of craving, alcohol-seeking, consumption, and relapse. While the ventral pallidum is implicated in appetitive and consummatory responses across several reward classes and types of behaviors, its role in behavioral responses to Pavlovian alcohol cues has not previously been established. Here, we tested the impact of optogenetic inhibition of ventral pallidum on Pavlovian-conditioned alcohol-seeking in male Long Evans rats. Rats underwent Pavlovian conditioning with an auditory cue predicting alcohol delivery to a reward port and a control cue predicting no alcohol delivery, until they consistently entered the reward port more during the alcohol cue than the control cue. We then tested the within-session effects of optogenetic inhibition during 50% of cue presentations. We found that optogenetic inhibition of ventral pallidum during the alcohol cue reduced port entry likelihood and time spent in the port, and increased port entry latency. Overall, these results suggest that normal ventral pallidum activity is necessary for Pavlovian alcohol-seeking.

Ventral pallidum neurons projecting to the ventral tegmental area reinforce but do not invigorate reward-seeking behavior

Reward-predictive cues acquire motivating and reinforcing properties that contribute to the escalation and relapse of drug use in addiction. The ventral pallidum (VP) and ventral tegmental area (VTA) are two key nodes in brain reward circuitry implicated in addiction and cue-driven behavior. In the current study, we use in vivo fiber photometry and optogenetics to record from and manipulate VP→VTA in rats performing a discriminative stimulus task to determine the role these neurons play in invigoration and reinforcement by reward cues. We find that VP→VTA neurons are active during reward consumption and that optogenetic stimulation of these neurons biases choice behavior and is reinforcing. Critically, we find no encoding of reward-seeking vigor, and optogenetic stimulation does not enhance the probability or vigor of reward seeking in response to cues. Our results suggest that VP→VTA activity is more important for reinforcement than for invigoration of reward seeking by cues.

Ventral Pallidal GABAergic Neuron Calcium Activity Encodes Cue-Driven Reward Seeking and Persists in the Absence of Reward Delivery

Reward-seeking behavior is often initiated by environmental cues that signal reward availability. This is a necessary behavioral response; however, cue reactivity and reward-seeking behavior can become maladaptive. To better understand how cue-elicited reward seeking becomes maladaptive, it is important to understand the neural circuits involved in assigning appetitive value to rewarding cues and actions. Ventral pallidum (VP) neurons are known to contribute to cue-elicited reward-seeking behavior and have heterogeneous responses in a discriminative stimulus (DS) task. The VP neuronal subtypes and output pathways that encode distinct aspects of the DS task remain unknown. Here, we used an intersectional viral approach with fiber photometry to record bulk calcium activity in VP GABAergic (VP GABA) neurons in male and female rats as they learned and performed the DS task. We found that VP GABA neurons are excited by reward-predictive cues but not neutral cues and that this response develops over time. We also found that this cue-evoked response predicts reward-seeking behavior and that inhibiting this VP GABA activity during cue presentation decreases reward-seeking behavior. Additionally, we found increased VP GABA calcium activity at the time of expected reward delivery, which occurred even on trials when reward was omitted. Together, these findings suggest that VP GABA neurons encode reward expectation, and calcium activity in these neurons encodes the vigor of cue-elicited reward seeking.SIGNIFICANCE STATEMENT VP circuitry is a major driver of cue-evoked behaviors. Previous work has found that VP neurons have heterogenous responses and contributions to reward-seeking behavior. This functional heterogeneity is because of differences of neurochemical subtypes and projections of VP neurons. Understanding the heterogenous responses among and within VP neuronal cell types is a necessary step in further understanding how cue-evoked behavior becomes maladaptive. Our work explores the canonical GABAergic VP neuron and how the calcium activity of these cells encodes components of cue-evoked reward seeking, including the vigor and persistence of reward seeking.

Reinstatement of Pavlovian responses to alcohol cues by stress

RATIONALE

Stress may contribute to relapse to alcohol use in part by enhancing reactivity to cues previously paired with alcohol. Yet, standard models of stress-induced reinstatement generally use contingent presentations of alcohol-paired cues to reinforce instrumental behaviors, making it difficult to isolate the ability of cues to invigorate alcohol-seeking.

OBJECTIVE

Here we sought to test the impact of stress on behavioral responses to alcohol-paired cues, using a model of stress-induced reinstatement of Pavlovian conditioned approach, inspired by Nadia Chaudhri's work on context-induced reinstatement.

METHODS

Long Evans rats were trained to associate one auditory cue with delivery of alcohol or sucrose and an alternative auditory cue with no reward. Following extinction training, rats were exposed to a stressor prior to being re-exposed to the cues under extinction conditions. We assessed the effects of yohimbine, intermittent footshock and olfactory cues paired with social defeat on responses to alcohol-paired cues and the effects of yohimbine on responses to sucrose-paired cues.

RESULTS

The pharmacological stressor, yohimbine, enhanced alcohol seeking in a Pavlovian setting, but not in a cue-selective manner. Intermittent footshock and social defeat cues did not enhance alcohol seeking in this paradigm.

CONCLUSIONS

While yohimbine elicited reinstatement of reward-seeking in a Pavlovian setting, these effects may be unrelated to activation of stress systems or to interactions with specific cues.

Ventral pallidal regulation of motivated behaviors and reinforcement

The interconnected nuclei of the ventral basal ganglia have long been identified as key regulators of motivated behavior, and dysfunction of this circuit is strongly implicated in mood and substance use disorders. The ventral pallidum (VP) is a central node of the ventral basal ganglia, and recent studies have revealed complex VP cellular heterogeneity and cell- and circuit-specific regulation of reward, aversion, motivation, and drug-seeking behaviors. Although the VP is canonically considered a relay and output structure for this circuit, emerging data indicate that the VP is a central hub in an extensive network for reward processing and the regulation of motivation that extends beyond classically defined basal ganglia borders. VP neurons respond temporally faster and show more advanced reward coding and prediction error processing than neurons in the upstream nucleus accumbens, and regulate the activity of the ventral mesencephalon dopamine system. This review will summarize recent findings in the literature and provide an update on the complex cellular heterogeneity and cell- and circuit-specific regulation of motivated behaviors and reinforcement by the VP with a specific focus on mood and substance use disorders. In addition, we will discuss mechanisms by which stress and drug exposure alter the functioning of the VP and produce susceptibility to neuropsychiatric disorders. Lastly, we will outline unanswered questions and identify future directions for studies necessary to further clarify the central role of VP neurons in the regulation of motivated behaviors. Significance: Research in the last decade has revealed a complex cell- and circuit-specific role for the VP in reward processing and the regulation of motivated behaviors. Novel insights obtained using cell- and circuit-specific interrogation strategies have led to a major shift in our understanding of this region. Here, we provide a comprehensive review of the VP in which we integrate novel findings with the existing literature and highlight the emerging role of the VP as a linchpin of the neural systems that regulate motivation, reward, and aversion. In addition, we discuss the dysfunction of the VP in animal models of neuropsychiatric disorders.

Lack of action monitoring as a prerequisite for habitual and chunked behavior: Behavioral and neural correlates

We previously reported the rapid development of habitual behavior in a discrete-trials instrumental task in which lever insertion and retraction act as reward-predictive cues delineating sequence execution. Here we asked whether lever cues or performance variables reflective of skill and automaticity might account for habitual behavior in male rats. Behavior in the discrete-trials habit-promoting task was compared with two task variants lacking the sequence-delineating cues of lever extension and retraction. We find that behavior is under goal-directed control in absence of sequence-delineating cues but not in their presence, and that skilled performance does not predict goal-directed vs. habitual behavior. Neural activity recordings revealed an engagement of dorsolateral striatum and a disengagement of dorsomedial striatum during the sequence execution of the habit-promoting task, specifically. Together, these results indicate that sequence delineation cues promote habit and differential engagement of striatal subregions during instrumental responding, a pattern that may reflect cue-elicited behavioral chunking.

Alcohol availability during withdrawal gates the impact of alcohol vapor exposure on responses to alcohol cues

RATIONALE

Chronic intermittent ethanol (CIE) vapor inhalation is a widely used model of alcohol dependence, but the impact of CIE on cue-elicited alcohol seeking is poorly understood.

OBJECTIVE

Here, we assessed the effects of CIE on alcohol-seeking elicited by cues paired with alcohol before or after CIE vapor inhalation.

METHODS

In experiment 1, male and female Long-Evans rats were trained in a discriminative stimulus (DS) task, in which one auditory cue (the DS) predicts the availability of 15% ethanol and a control cue (the NS) predicts no ethanol. Rats then underwent CIE or served as controls. Subsets of each group received access to oral ethanol twice a week during acute withdrawal. After CIE, rats were presented with the DS and NS cues under extinction and retraining conditions to determine whether they would alter their responses to these cues. In experiment 2, rats underwent CIE prior to training in the DS task.

RESULTS

CIE enhanced behavioral responses to cues previously paired with alcohol, but only in rats that received access to alcohol during acute withdrawal. When CIE occurred before task training, male rats were slower to develop cue responses and less likely to enter the alcohol port, even though they had received alcohol during acute withdrawal.

CONCLUSIONS

These results suggest that CIE vapor inhalation alone does not potentiate the motivational value of alcohol cues but that an increase in cue responses requires alcohol experience during acute withdrawal. Furthermore, under some conditions, CIE may disrupt responses to alcohol-paired cues.

Ventral pallidum regulates the default mode network, controlling transitions between internally and externally guided behavior

Daily life requires transitions between performance of well-practiced, automatized behaviors reliant upon internalized representations and behaviors requiring external focus. Such transitions involve differential activation of the default mode network (DMN), a group of brain areas associated with inward focus. We asked how optogenetic modulation of the ventral pallidum (VP), a subcortical DMN node, impacts task switching between internally to externally guided lever-pressing behavior in the rat. Excitation of the VP dramatically compromised acquisition of an auditory discrimination task, trapping animals in a DMN state of automatized internally focused behavior and impairing their ability to direct attention to external sensory stimuli. VP inhibition, on the other hand, facilitated task acquisition, expediting escape from the DMN brain state, thereby allowing rats to incorporate the contingency changes associated with the auditory stimuli. We suggest that VP, instant by instant, regulates the DMN and plays a deterministic role in transitions between internally and externally guided behaviors.

Vigor Encoding in the Ventral Pallidum

The ventral pallidum (VP) is the major downstream nucleus of the nucleus accumbens (NAc). Both VP and NAc neurons are responsive to reward-predictive stimuli and are critical drivers of reward-seeking behavior. The cue-evoked excitations and inhibitions of NAc neurons predict the vigor (latency and speed) of the cue-elicited locomotor approach response and encode the animal’s proximity to the movement target, but do not encode more specific movement features such as turn direction. VP neurons also encode certain vigor parameters, but it remains unknown whether they also encode more specific movement features, and whether such encoding could account for vigor encoding. To address these questions, we recorded the firing of neurons in the VP of freely moving male rats performing a discriminative stimulus (DS) task. Similar to NAc neurons, VP neurons’ cue-evoked excitations were correlated with the speed of the upcoming approach movement and the animal’s proximity to the movement target at cue onset. Unlike NAc neurons, VP neurons’ firing reflected the efficiency of the approach movement path but not the latency to initiate locomotion. VP cue-evoked excitations are unlikely to be directly influenced by NAc cue-evoked excitations because unilateral treatment of the NAc with a dopamine D1 receptor antagonist, a manipulation that reduces NAc neurons’ cue-evoked excitations, did not alter ipsilateral VP cue-evoked excitations. These observations suggest that the two structures receive simultaneous activation by inputs conveying similar but not identical information, and work in parallel to set the vigor of the behavioral response.

Ventral pallidal GABAergic neurons control wakefulness associated with motivation through the ventral tegmental pathway

The ventral pallidum (VP) regulates motivation, drug addiction, and several behaviors that rely on heightened arousal. However, the role and underlying neural circuits of the VP in the control of wakefulness remain poorly understood. In the present study, we sought to elucidate the specific role of VP GABAergic neurons in controlling sleep-wake behaviors in mice. Fiber photometry revealed that the population activity of VP GABAergic neurons was increased during physiological transitions from non-rapid eye movement (non-REM, NREM) sleep to either wakefulness or REM sleep. Moreover, chemogenetic and optogenetic manipulations were leveraged to investigate a potential causal role of VP GABAergic neurons in initiating and/or maintaining arousal. In vivo optogenetic stimulation of VP GABAergic neurons innervating the ventral tegmental area (VTA) strongly promoted arousal via disinhibition of VTA dopaminergic neurons. Functional in vitro mapping revealed that VP GABAergic neurons, in principle, inhibited VTA GABAergic neurons but also inhibited VTA dopaminergic neurons. In addition, optogenetic stimulation of terminals of VP GABAergic neurons revealed that they promoted arousal by innervating the lateral hypothalamus, but not the mediodorsal thalamus or lateral habenula. The increased wakefulness chemogenetically evoked by VP GABAergic neuronal activation was completely abolished by pretreatment with dopaminergic D1 and D2/D3 receptor antagonists. Furthermore, activation of VP GABAergic neurons increased exploration time in both the open-field and light-dark box tests but did not modulate depression-like behaviors or food intake. Finally, chemogenetic inhibition of VP GABAergic neurons decreased arousal. Taken together, our findings indicate that VP GABAergic neurons are essential for arousal related to motivation.

Movement signaling in ventral pallidum and dopaminergic midbrain is gated by behavioral state in singing birds

Movement-related neuronal discharge in ventral tegmental area (VTA) and ventral pallidum (VP) is inconsistently observed across studies. One possibility is that some neurons are movement related and others are not. Another possibility is that the precise behavioral conditions matter-that a single neuron can be movement related under certain behavioral states but not others. We recorded single VTA and VP neurons in birds transitioning between singing and nonsinging states while monitoring body movement with microdrive-mounted accelerometers. Many VP and VTA neurons exhibited body movement-locked activity exclusively when the bird was not singing. During singing, VP and VTA neurons could switch off their tuning to body movement and become instead precisely time-locked to specific song syllables. These changes in neuronal tuning occurred rapidly at state boundaries. Our findings show that movement-related activity in limbic circuits can be gated by behavioral context.NEW & NOTEWORTHY Neural signals in the limbic system have long been known to represent body movements as well as reward. Here, we show that single neurons dramatically change their tuning from movement to song timing when a bird starts to sing.

Differential recruitment of ventral pallidal e-types by behaviorally salient stimuli during Pavlovian conditioning

The ventral pallidum (VP) is interfacing striatopallidal and limbic circuits, conveying information about salience and valence crucial to adjusting behavior. However, how VP neuron populations with distinct electrophysiological properties (e-types) represent these variables is not fully understood. Therefore, we trained mice on probabilistic Pavlovian conditioning while recording the activity of VP neurons. Many VP neurons responded to punishment (54%), reward (48%), and outcome-predicting auditory stimuli (32%), increasingly differentiating distinct outcome probabilities through learning. We identified e-types based on the presence of bursts or fast rhythmic discharges and found that non-bursting, non-rhythmic neurons were the most sensitive to reward and punishment. Some neurons exhibited distinct responses of their bursts and single spikes, suggesting a multiplexed coding scheme in the VP. Finally, we demonstrate synchronously firing neuron assemblies, particularly responsive to reinforcing stimuli. These results suggest that electrophysiologically defined e-types of the VP differentially participate in transmitting reinforcement signals during learning.

Central Thalamic-Medial Prefrontal Control of Adaptive Responding in the Rat: Many Players in the Chamber

The medial prefrontal cortex (mPFC) has robust afferent and efferent connections with multiple nuclei clustered in the central thalamus. These nuclei are elements in large-scale networks linking mPFC with the hippocampus, basal ganglia, amygdala, other cortical areas, and visceral and arousal systems in the brainstem that give rise to adaptive goal-directed behavior. Lesions of the mediodorsal nucleus (MD), the main source of thalamic input to middle layers of PFC, have limited effects on delayed conditional discriminations, like DMTP and DNMTP, that depend on mPFC. Recent evidence suggests that MD sustains and amplifies neuronal responses in mPFC that represent salient task-related information and is important for detecting and encoding contingencies between actions and their consequences. Lesions of rostral intralaminar (rIL) and ventromedial (VM) nuclei produce delay-independent impairments of egocentric DMTP and DNMTP that resemble effects of mPFC lesions on response speed and accuracy: results consistent with projections of rIL to striatum and VM to motor cortices. The ventral midline and anterior thalamic nuclei affect allocentric spatial cognition and memory consistent with their connections to mPFC and hippocampus. The dorsal midline nuclei spare DMTP and DNMTP. They have been implicated in behavioral-state control and response to salient stimuli in associative learning. mPFC functions are served during DNMTP by discrete populations of neurons with responses related to motor preparation, movements, lever press responses, reinforcement anticipation, reinforcement delivery, and memory delay. Population analyses show that different responses are timed so that they effectively tile the temporal interval from when DNMTP trials are initiated until the end. Event-related responses of MD neurons during DNMTP are predominantly related to movement and reinforcement, information important for DNMTP choice. These responses closely mirror the activity of mPFC neurons with similar responses. Pharmacological inactivation of MD and adjacent rIL affects the expression of diverse action- and outcome-related responses of mPFC neurons. Lesions of MD before training are associated with a shift away from movement-related responses in mPFC important for DNMTP choice. These results suggest that MD has short-term effects on the expression of event-related activity in mPFC and long-term effects that tune mPFC neurons to respond to task-specific information.

A quantitative reward prediction error signal in the ventral pallidum

The nervous system is hypothesized to compute reward prediction errors (RPEs) to promote adaptive behavior. Correlates of RPEs have been observed in the midbrain dopamine system, but the extent to which RPE signals exist in other reward-processing regions is less well understood. In the present study, we quantified outcome history-based RPE signals in the ventral pallidum (VP), a basal ganglia region functionally linked to reward-seeking behavior. We trained rats to respond to reward-predicting cues, and we fit computational models to predict the firing rates of individual neurons at the time of reward delivery. We found that a subset of VP neurons encoded RPEs and did so more robustly than the nucleus accumbens, an input to the VP. VP RPEs predicted changes in task engagement, and optogenetic manipulation of the VP during reward delivery bidirectionally altered rats' subsequent reward-seeking behavior. Our data suggest a pivotal role for the VP in computing teaching signals that influence adaptive reward seeking.

Learning from Action: Reconsidering Movement Signaling in Midbrain Dopamine Neuron Activity

Animals infer when and where a reward is available from experience with informative sensory stimuli and their own actions. In vertebrates, this is thought to depend upon the release of dopamine from midbrain dopaminergic neurons. Studies of the role of dopamine have focused almost exclusively on their encoding of informative sensory stimuli; however, many dopaminergic neurons are active just prior to movement initiation, even in the absence of sensory stimuli. How should current frameworks for understanding the role of dopamine incorporate these observations? To address this question, we review recent anatomical and functional evidence for action-related dopamine signaling. We conclude by proposing a framework in which dopaminergic neurons encode subjective signals of action initiation to solve an internal credit assignment problem.

Cocaine Dysregulates Dynorphin Modulation of Inhibitory Neurotransmission in the Ventral Pallidum in a Cell-Type-Specific Manner

Cocaine-driven changes in the modulation of neurotransmission by neuromodulators are poorly understood. The ventral pallidum (VP) is a key structure in the reward system, in which GABA neurotransmission is regulated by opioid neuropeptides, including dynorphin. However, it is not known whether dynorphin acts differently on different cell types in the VP and whether its effects are altered by withdrawal from cocaine. Here, we trained wild-type, D1-Cre, A2A-Cre, or vGluT2-Cre:Ai9 male and female mice in a cocaine conditioned place preference protocol followed by 2 weeks of abstinence, and then recorded GABAergic synaptic input evoked either electrically or optogenetically onto identified VP neurons before and after applying dynorphin. We found that after cocaine CPP and abstinence dynorphin attenuated inhibitory input to VPGABA neurons through a postsynaptic mechanism. This effect was absent in saline mice. Furthermore, this effect was seen specifically on the inputs from nucleus accumbens medium spiny neurons expressing either the D1 or the D2 dopamine receptor. Unlike its effect on VPGABA neurons, dynorphin surprisingly potentiated the inhibitory input on VPvGluT2 neurons, but this effect was abolished after cocaine CPP and abstinence. Thus, dynorphin has contrasting influences on GABA input to VPGABA and VPvGluT2 neurons and these influences are affected differentially by cocaine CPP and abstinence. Collectively, our data suggest a role for dynorphin in withdrawal through its actions in the VP. As VPGABA and VPvGluT2 neurons have contrasting effects on drug-seeking behavior, our data may indicate a complex role for dynorphin in withdrawal from cocaine.SIGNIFICANCE STATEMENT The ventral pallidum consists mainly of GABAergic reward-promoting neurons, but it also encloses a subgroup of aversion-promoting glutamatergic neurons. Dynorphin, an opioid neuropeptide abundant in the ventral pallidum, shows differential modulation of GABA input to GABAergic and glutamatergic pallidal neurons and may therefore affect both the rewarding and aversive aspects of withdrawal. Indeed, abstinence after repeated exposure to cocaine alters dynorphin actions in a cell-type-specific manner; after abstinence dynorphin suppresses the inhibitory drive on the "rewarding" GABAergic neurons but ceases to modulate the inhibitory drive on the "aversive" glutamatergic neurons. This reflects a complex role for dynorphin in cocaine reward and abstinence.

Opposing Contributions of GABAergic and Glutamatergic Ventral Pallidal Neurons to Motivational Behaviors

The ventral pallidum (VP) is critical for invigorating reward seeking and is also involved in punishment avoidance, but how it contributes to such opposing behavioral actions remains unclear. Here, we show that GABAergic and glutamatergic VP neurons selectively control behavior in opposing motivational contexts. In vivo recording combined with optogenetics in mice revealed that these two populations oppositely encode positive and negative motivational value, are differentially modulated by animal's internal state, and determine the behavioral response during motivational conflict. Furthermore, GABAergic VP neurons are essential for movements toward reward in a positive motivational context but suppress movements in an aversive context. In contrast, glutamatergic VP neurons are essential for movements to avoid a threat but suppress movements in an appetitive context. Our results indicate that GABAergic and glutamatergic VP neurons encode the drive for approach and avoidance, respectively, with the balance between their activities determining the type of motivational behavior.

Projection-Specific Potentiation of Ventral Pallidal Glutamatergic Outputs after Abstinence from Cocaine

The ventral pallidum (VP) is a central node in the reward system that is strongly implicated in reward and addiction. Although the majority of VP neurons are GABAergic and encode reward, recent studies revealed a novel glutamatergic neuronal population in the VP [VP neurons expressing the vesicular glutamate transporter 2 (VP_VGluT2)], whose activation generates aversion. Withdrawal from drugs has been shown to induce drastic synaptic changes in neuronal populations associated with reward, such as the ventral tegmental area (VTA) or nucleus accumbens neurons, but less is known about cocaine-induced synaptic changes in neurons classically linked with aversion. Here, we demonstrate that VP_VGluT2 neurons contact different targets with different intensities, and that cocaine conditioned place preference (CPP) training followed by abstinence selectively potentiates their synapses on targets that encode aversion. Using whole-cell patch-clamp recordings combined with optogenetics in male and female transgenic mice, we show that VP_VGluT2 neurons preferentially contact aversion-related neurons, such as lateral habenula neurons and VTA GABAergic neurons, with minor input to reward-related neurons, such as VTA dopamine and VP GABA neurons. Moreover, after cocaine CPP and abstinence, the VP_VGluT2 input to the aversion-related structures is potentiated, whereas the input to the reward-related structures is depressed. Thus, cocaine CPP followed by abstinence may allow VP_VGluT2 neurons to recruit aversion-related targets more readily and therefore be part of the mechanism underlying the aversive symptoms seen after withdrawal.SIGNIFICANCE STATEMENT The biggest problem in drug addiction is the high propensity to relapse. One central driver for relapse events is the negative aversive symptoms experienced by addicts during withdrawal. In this work, we propose a possible mechanism for the intensification of aversive feelings after withdrawal that involves the glutamatergic neurons of the ventral pallidum. We show not only that these neurons are most strongly connected to aversive targets, such as the lateral habenula, but also that, after abstinence, their synapses on aversive targets are strengthened, whereas the synapses on other rewarding targets are weakened. These data illustrate how after abstinence from cocaine, aversive pathways change in a manner that may contribute to relapse.

Distinct recruitment of dorsomedial and dorsolateral striatum erodes with extended training

Hypotheses of striatal orchestration of behavior ascribe distinct functions to striatal subregions, with the dorsolateral striatum (DLS) especially implicated in habitual and skilled performance. Thus neural activity patterns recorded from the DLS, but not the dorsomedial striatum (DMS), should be correlated with habitual and automatized performance. Here, we recorded DMS and DLS neural activity in rats during training in a task promoting habitual lever pressing. Despite improving performance across sessions, clear changes in corresponding neural activity patterns were not evident in DMS or DLS during early training. Although DMS and DLS activity patterns were distinct during early training, their activity was similar following extended training. Finally, performance after extended training was not associated with DMS disengagement, as would be predicted from prior work. These results suggest that behavioral sequences may continue to engage both striatal regions long after initial acquisition, when skilled performance is consolidated.

Recruitment and disruption of ventral pallidal cue encoding during alcohol seeking

A critical area of inquiry in the neurobiology of alcohol abuse is the mechanism by which cues gain the ability to elicit alcohol use. Previously, we found that cue-evoked activity in rat ventral pallidum robustly encodes the value of sucrose cues trained under both Pavlovian and instrumental contingencies, despite a stronger relationship between cue-evoked activity and behavioral latency after instrumental training (Richard et al., 2018, Elife, 7, e33107). Here, we assessed: (a) ventral pallidal representations of Pavlovian versus instrumental cues trained with alcohol reward, and (b) the impact of non-associative alcohol exposure on ventral pallidal representations of sucrose cues. Decoding of cue identity based on ventral pallidum firing was blunted for the Pavlovian alcohol cue in comparison to both the instrumental cue trained with alcohol and either cue type trained with sucrose. Further, non-associative alcohol exposure had opposing effects on ventral pallidal encoding of sucrose cues trained on instrumental versus Pavlovian associations, enhancing decoding accuracy for an instrumental discriminative stimulus and reducing decoding accuracy for a Pavlovian conditioned stimulus. These findings suggest that alcohol exposure can drive biased engagement of specific reward-related signals in the ventral pallidum.

Songbird Ventral Pallidum Sends Diverse Performance Error Signals to Dopaminergic Midbrain

Motor skills improve with practice, requiring outcomes to be evaluated against ever-changing performance benchmarks, yet it remains unclear how performance error signals are computed. Here, we show that the songbird ventral pallidum (VP) is required for song learning and sends diverse song timing and performance error signals to the ventral tegmental area (VTA). Viral tracing revealed inputs to VP from auditory and vocal motor thalamus, auditory and vocal motor cortex, and VTA. Our findings show that VP circuits, commonly associated with hedonic functions, signal performance error during motor sequence learning.

Ventral pallidum encodes relative reward value earlier and more robustly than nucleus accumbens

The ventral striatopallidal system, a basal ganglia network thought to convert limbic information into behavioral action, includes the nucleus accumbens (NAc) and the ventral pallidum (VP), typically described as a major output of NAc. Here, to investigate how reward-related information is transformed across this circuit, we measure the activity of neurons in NAc and VP when rats receive two highly palatable but differentially preferred rewards, allowing us to track the reward-specific information contained within the neural activity of each region. In VP, we find a prominent preference-related signal that flexibly reports the relative value of reward outcomes across multiple conditions. This reward-specific firing in VP is present in a greater proportion of the population and arises sooner following reward delivery than in NAc. Our findings establish VP as a preeminent value signaler and challenge the existing model of information flow in the ventral basal ganglia.

Ventral pallidal modulation of aversion processing

Responding to aversive and rewarding stimuli is essential to survival. The ventral pallidum (VP) is a critical node in the mesolimbic network, being the primary output of the nucleus accumbens and projecting to the lateral habenula (LHb) and ventral tegmental area (VTA). The VP is thus poised to modulate the habenula-tegmental circuitry and contribute to processing both rewarding and aversive stimuli. Here, we integrate human functional imaging, behavioral pharmacology in rodents, and recent optogenetic circuit dissection studies of the VP with a focus on the role of the neurochemically-distinct subpopulations in aversion processing. These recent results support a model in which glutamatergic VP neurons play a unique role in aversion processing, while canonical GABAergic VP neurons promote reinforcement and encode the hedonic value of reward. Genetic ablation of glutamatergic, but not GABAergic VP neurons abolishes devaluation of natural reward (sucrose) by pairing with an aversive stimulus (lithium chloride injection). Both of these populations modulate activity throughout the LHb and VTA, which is necessary for expression of adaptive behavior in response to rewarding or aversive stimuli. Future work will address how neuromodulators such as endogenous opioids or dopamine shape function and plasticity within these distinct populations of VP neurons, when these subpopulations are engaged during learning responses to rewarding and aversive stimuli, and how their activity is altered in models of reward-related disorders. Answering these questions will be necessary to understand the basis and ultimately develop targeted therapies for disorders of reward/aversion processing, such as affective, chronic pain and substance use disorders.