Paradoxical accentuation of motivation following accumbens-pallidum disconnection

Distinct role of nucleus accumbens D2-MSN projections to ventral pallidum in different phases of motivated behavior

The nucleus accumbens (NAc) is a key region in motivated behaviors. NAc medium spiny neurons (MSNs) are divided into those expressing dopamine receptor D1 or D2. Classically, D1- and D2-MSNs have been described as having opposing roles in reinforcement, but recent evidence suggests a more complex role for D2-MSNs. Here, we show that optogenetic modulation of D2-MSN to ventral pallidum (VP) projections during different stages of motivated behavior has contrasting effects in motivation. Activation of D2-MSN-VP projections during a reward-predicting cue results in increased motivational drive, whereas activation at reward delivery decreases motivation; optical inhibition triggers the opposite behavioral effect. In addition, in a free-choice instrumental task, animals prefer the lever that originates one pellet in opposition to pellet plus D2-MSN-VP optogenetic activation and vice versa for optogenetic inhibition. In summary, D2-MSN-VP projections play different, and even opposing, roles in distinct phases of motivated behavior.

Ventral arkypallidal neurons inhibit accumbal firing to promote reward consumption

The nucleus accumbens shell (NAcSh) and the ventral pallidum (VP) are critical for reward processing, although the question of how coordinated activity within these nuclei orchestrates reward valuation and consumption remains unclear. Inhibition of NAcSh firing is necessary for reward consumption, but the source of this inhibition remains unknown. Here, we report that a subpopulation of VP neurons, the ventral arkypallidal (vArky) neurons, project back to the NAcSh, where they inhibit NAcSh neurons in vivo in mice. Consistent with this pathway driving reward consumption via inhibition of the NAcSh, calcium activity of vArky neurons scaled with reward palatability (which was dissociable from reward seeking) and predicted the subsequent drinking behavior during a free-access paradigm. Activation of the VP-NAcSh pathway increased ongoing reward consumption while amplifying hedonic reactions to reward. These results establish a pivotal role for vArky neurons in the promotion of reward consumption through modulation of NAcSh firing in a value-dependent manner.

'Liking' and 'wanting' in eating and food reward: Brain mechanisms and clinical implications

It is becoming clearer how neurobiological mechanisms generate 'liking' and 'wanting' components of food reward. Mesocorticolimbic mechanisms that enhance 'liking' include brain hedonic hotspots, which are specialized subregions that are uniquely able to causally amplify the hedonic impact of palatable tastes. Hedonic hotspots are found in nucleus accumbens medial shell, ventral pallidum, orbitofrontal cortex, insula cortex, and brainstem. In turn, a much larger mesocorticolimbic circuitry generates 'wanting' or incentive motivation to obtain and consume food rewards. Hedonic and motivational circuitry interact together and with hypothalamic homeostatic circuitry, allowing relevant physiological hunger and satiety states to modulate 'liking' and 'wanting' for food rewards. In some conditions such as drug addiction, 'wanting' is known to dramatically detach from 'liking' for the same reward, and this may also occur in over-eating disorders. Via incentive sensitization, 'wanting' selectively becomes higher, especially when triggered by reward cues when encountered in vulnerable states of stress, etc. Emerging evidence suggests that some cases of obesity and binge eating disorders may reflect an incentive-sensitization brain signature of cue hyper-reactivity, causing excessive 'wanting' to eat. Future findings on the neurobiological bases of 'liking' and 'wanting' can continue to improve understanding of both normal food reward and causes of clinical eating disorders.

Sign-tracking behavior is sensitive to outcome devaluation in a devaluation context-dependent manner: implications for analyzing habitual behavior

Motivationally attractive cues can draw in behavior in a phenomenon termed incentive salience. Incentive cue attraction is an important model for animal models of drug seeking and relapse. One question of interest is the extent to which the pursuit of motivationally attractive cues is related to the value of the paired outcome or can become unrelated and habitual. We studied this question using a sign-tracking (ST) paradigm in rats, in which a lever stimulus preceding food reward comes to elicit conditioned lever-interaction behavior. We asked whether reinforcer devaluation by means of conditioned taste aversion, a classic test of habitual behavior, can modify ST to incentive cues, and whether this depends upon the manner in which reinforcer devaluation takes place. In contrast to several recent reports, we conclude that ST is indeed sensitive to reinforcer devaluation. However, this effect depends critically upon the congruence between the context in which taste aversion is learned and the context in which it is tested. When the taste aversion successfully transfers to the testing context, outcome value strongly influences ST behavior, both when the outcome is withheld (in extinction) and when animals can learn from outcome feedback (reacquisition). When taste aversion does not transfer to the testing context, ST remains high. In total, the extent to which ST persists after outcome devaluation is closely related to the extent to which that outcome is truly devalued in the task context. We believe this effect of context on devaluation can reconcile contradictory findings about the flexibility/inflexibility of ST. We discuss this literature and relate our findings to the study of habits generally.

Ventral pallidum is essential for cocaine relapse after voluntary abstinence in rats

Addiction is a chronic relapsing disorder, and during recovery many people experience several relapse events as they attempt to voluntarily abstain from drug. New preclinical relapse models have emerged that capture this common human experience, and mounting evidence indicates that resumption of drug seeking after voluntary abstinence recruits neural circuits distinct from those recruited during reinstatement after experimenter-imposed abstinence, or abstinence due to extinction training. Ventral pallidum (VP), a key limbic node involved in drug seeking, has well-established roles in conventional reinstatement models tested following extinction training, but it is unclear whether this region also participates in more translationally relevant models of relapse. Here we show that chemogenetic inhibition of VP neurons decreased cocaine-, context-, and cue-induced relapse tested after voluntary, punishment-induced abstinence. This effect was strongest in the most compulsive, punishment-resistant rats, and reinstatement was associated with neural activity in anatomically defined VP subregions. VP inhibition also attenuated the propensity of rats to display "abortive lever pressing," a species-typical risk assessment behavior seen here during punished drug taking, likely resulting from concurrent approach and avoidance motivations. These results indicate that VP, unlike other connected limbic brain regions, is essential for resumption of drug seeking after voluntary abstinence. Since VP inhibition effects were strongest in the most compulsively cocaine-seeking individuals, this may also indicate that VP plays a particularly important role in the most pathological, addiction-like behavior, making it an attractive target for future therapeutic interventions.

Neural circuits linking sleep and addiction: Animal models to understand why select individuals are more vulnerable to substance use disorders after sleep deprivation

Individuals differ widely in their drug-craving behaviors. One reason for these differences involves sleep. Sleep disturbances lead to an increased risk of substance use disorders and relapse in only some individuals. While animal studies have examined the impact of sleep on reward circuitry, few have addressed the role of individual differences in the effects of altered sleep. There does, however, exist a rodent model of individual differences in reward-seeking behavior: the sign/goal-tracker model of Pavlovian conditioned approach. In this model, only some rats show the key behavioral traits associated with addiction, including impulsivity and poor attentional control, making this an ideal model system to examine individually distinct sleep-reward interactions. Here, we describe how the limbic neural circuits responsible for individual differences in incentive motivation overlap with those involved in sleep-wake regulation, and how this model can elucidate the common underlying mechanisms. Consideration of individual differences in preclinical models would improve our understanding of how sleep interacts with motivational systems, and why sleep deprivation contributes to addiction in only select individuals.

Circuit directionality for motivation: Lateral accumbens-pallidum, but not pallidum-accumbens, connections regulate motivational attraction to reward cues

Sign-tracking behavior, in which animals interact with a cue that predicts reward, provides an example of how incentive salience can be attributed to cues and elicit motivation. The nucleus accumbens (NAc) and ventral pallidum (VP) are two regions involved in cue-driven motivation. The VP, and NAc subregions including the medial shell and core, are critical for sign-tracking. Further, connections between the medial shell and VP are known to participate in sign-tracking and other motivated behaviors. The NAc lateral shell (NAcLSh) is a distinct and understudied subdivision of the NAc, and its contribution to the process by which reward cues acquire value remains unclear. The NAcLSh has been implicated in reward-directed behavior, and has reciprocal connections with the VP, suggesting that NAcLSh and VP interactions could be important mechanisms for incentive salience. Here, we use DREADDs (Designer Receptors Exclusively Activated by Designer Drugs) and an intersectional viral delivery strategy to produce a biased inhibition of NAcLSh neurons projecting to the VP, and vice versa. We find that disruption of connections from NAcLSh to VP reduces sign-tracking behavior while not affecting consumption of food rewards. In contrast, VP to NAcLSh disruption affected neither sign-tracking nor reward consumption, but did produce a greater shift in animals' behavior more towards the reward source when it was available. These findings indicate that the NAcLSh → VP pathway plays an important role in guiding animals towards reward cues, while VP → NAcLSh back-projections may not and may instead bias motivated behavior towards rewards.

Chemogenetic Manipulations of Ventral Tegmental Area Dopamine Neurons Reveal Multifaceted Roles in Cocaine Abuse

Ventral tegmental area (VTA) dopamine (DA) neurons perform diverse functions in motivation and cognition, but their precise roles in addiction-related behaviors are still debated. Here, we targeted VTA DA neurons for bidirectional chemogenetic modulation during specific tests of cocaine reinforcement, demand, and relapse-related behaviors in male rats, querying the roles of DA neuron inhibitory and excitatory G-protein signaling in these processes. Designer receptor stimulation of G_q signaling, but not G_s signaling, in DA neurons enhanced cocaine seeking via functionally distinct projections to forebrain limbic regions. In contrast, engaging inhibitory G_i/o signaling in DA neurons blunted the reinforcing and priming effects of cocaine, reduced stress-potentiated reinstatement, and altered behavioral strategies for cocaine seeking and taking. Results demonstrate that DA neurons play several distinct roles in cocaine seeking, depending on behavioral context, G-protein-signaling cascades, and DA neuron efferent targets, highlighting their multifaceted roles in addiction.SIGNIFICANCE STATEMENT G-protein-coupled receptors are crucial modulators of ventral tegmental area (VTA) dopamine neuron activity, but how this metabotropic signaling impacts the complex roles of dopamine in reward and addiction is poorly understood. Here, we bidirectionally modulate dopamine neuron G-protein signaling with DREADDs (designer receptors exclusively activated by designer drugs) during a variety of cocaine-seeking behaviors, revealing nuanced, pathway-specific roles in cocaine reward, effortful seeking, and relapse-like behaviors. G_q and G_s stimulation activated dopamine neurons, but only G_q stimulation robustly enhanced cocaine seeking. G_i/o inhibitory signaling reduced some, but not all, types of cocaine seeking. Results show that VTA dopamine neurons modulate numerous distinct aspects of cocaine addiction- and relapse-related behaviors, and point to potential new approaches for intervening in these processes to treat addiction.

Ventral pallidum encodes relative reward value earlier and more robustly than nucleus accumbens

The ventral striatopallidal system, a basal ganglia network thought to convert limbic information into behavioral action, includes the nucleus accumbens (NAc) and the ventral pallidum (VP), typically described as a major output of NAc. Here, to investigate how reward-related information is transformed across this circuit, we measure the activity of neurons in NAc and VP when rats receive two highly palatable but differentially preferred rewards, allowing us to track the reward-specific information contained within the neural activity of each region. In VP, we find a prominent preference-related signal that flexibly reports the relative value of reward outcomes across multiple conditions. This reward-specific firing in VP is present in a greater proportion of the population and arises sooner following reward delivery than in NAc. Our findings establish VP as a preeminent value signaler and challenge the existing model of information flow in the ventral basal ganglia.

Ventral pallidal encoding of reward-seeking behavior depends on the underlying associative structure

Despite its being historically conceptualized as a motor expression site, emerging evidence suggests the ventral pallidum (VP) plays a more active role in integrating information to generate motivation. Here, we investigated whether rat VP cue responses would encode and contribute similarly to the vigor of reward-seeking behaviors trained under Pavlovian versus instrumental contingencies, when these behavioral responses consist of superficially similar locomotor response patterns but may reflect distinct underlying decision-making processes. We find that cue-elicited activity in many VP neurons predicts the latency of instrumental reward seeking, but not of Pavlovian response latency. Further, disruption of VP signaling increases the latency of instrumental but not Pavlovian reward seeking. This suggests that VP encoding of and contributions to response vigor are specific to the ability of incentive cues to invigorate reward-seeking behaviors upon which reward delivery is contingent.

Sounds or other cues associated with receiving a reward can have a powerful effect on an individual’s behavior or emotions. For example, the sound of an ice cream truck might cause salivation and motivate an individual to stand in a long line. Cues may prompt specific actions necessary to receive a reward, for example, approaching the ice cream truck and paying to get an ice cream. This is called instrumental conditioning. Some cues predict reward delivery, without requiring a specific action. This is called Pavlovian conditioning. Pavlovian cues can still prompt actions, such as approaching the truck, even though the action is not required. But exactly what happens in the brain to generate these actions during the two types of learning, is unclear.

Learning more about these reward-driven brain mechanisms might help scientists to develop better treatments for people with addiction or other conditions that involve compulsive reward-seeking behavior. Currently, scientists do not know enough about how the brain triggers this kind of behavior or how these processes lead to relapse in individuals who have been abstinent. Basic studies on the brain mechanisms that trigger reward-seeking behavior are needed.

Now, Richard et al. show that a greater activity in neurons, or brain cells, in a part of the brain called the ventral pallidum predicts a faster response to a reward cue. In the experiments, some rats were trained to approach a certain location when they heard a particular sound in order to receive sugar water, a form of instrumental conditioning. Another group of rats underwent Pavlovian training and learned to expect sugar water every time they heard sound even if they did nothing. Both groups learned to approach the sugar water location when they heard the cue, despite the different training requirements.

Richard et al. measured the activity of neurons in the ventral pallidum when the rats in the two groups heard the reward-associated sound. The experiments showed that the amount of activity in the brain cells in this area predicted whether a rat would approach the sugar-water delivery area and how quickly they would approach the reward after hearing the cue. The predictions were most reliable for rats that had to do something to get the sugar water. When Richard et al. reduced the activity in these cells they found the rats took longer to approach the reward source, but only when this action was required to receive sugar water. The experiments show that the ventral pallidum may provide the motivation to undertake reward-seeking behavior.