δ-opioid and dopaminergic processes in accumbens shell modulate the cholinergic control of predictive learning and choice

Dopamine-mediated formation of a memory module in the nucleus accumbens for goal-directed navigation

Spatial memories guide navigation efficiently toward desired destinations. However, the neuronal and circuit mechanisms underlying the encoding of goal locations and its translation into goal-directed navigation remain unclear. Here we demonstrate that mice rapidly form a spatial memory of a shelter during shelter experiences, guiding escape behavior toward the goal location-a shelter-when under threat. Dopaminergic neurons in the ventral tegmental area and their projection to the nucleus accumbens (NAc) encode safety signals associated with the shelter. Optogenetically induced phasic dopamine signals are sufficient to create a place memory that directs escape navigation. Converging dopaminergic and hippocampal glutamatergic inputs to the NAc mediate the formation of a goal-related memory within a subpopulation of NAc neurons during shelter experiences. Artificial co-activation of this goal-related NAc ensemble with neurons in the dorsal periaqueductal gray was sufficient to trigger memory-guided, rather than random, escape behavior. These findings provide causal evidence of cognitive circuit modules linking memory with goal-directed action.

Distinct cholinergic circuits underlie discrete effects of reward on attention

Attention and reward are functions that are critical for the control of behavior, and massive multi-region neural systems have evolved to support the discrete computations associated with each. Previous research has also identified that attention and reward interact, though our understanding of the neural mechanisms that mediate this interplay is incomplete. Here, we review the basic neuroanatomy of attention, reward, and cholinergic systems. We then examine specific contexts in which attention and reward computations interact. Building on this work, we propose two discrete neural circuits whereby acetylcholine, released from cell groups located in different parts of the brain, mediates the impact of stimulus-reward associations as well as motivation on attentional control. We conclude by examining these circuits as a potential shared loci of dysfunction across diseases states associated with deficits in attention and reward.

A ventral pallidal-thalamocortical circuit mediates the cognitive control of instrumental action

Predictive learning can engage a selective form of cognitive control that biases choice between actions based on information about future outcomes that the learning provides. This influence has been hypothesized to depend on a feedback circuit in the brain through which the basal ganglia modulate activity in the prefrontal cortex; however, direct evidence for this functional circuit has proven elusive. Here, using an animal model of cognitive control, we found that the influence of predictive learning on decision making is mediated by an inhibitory feedback circuit linking the medial ventral pallidum and the mediodorsal thalamus, the activation of which causes disinhibition of the orbitofrontal cortex via reduced activation of inhibitory parvalbumin interneurons during choice. Thus, we found that, for this function, the mediodorsal thalamus serves as a pallidal-cortical relay through which predictive learning controls action selection, which has important implications for understanding cognitive control and its vicissitudes in various psychiatric disorders and addiction.

Neuroscience: A bottom-up mechanism for cognitive control?

Cognitive control is often conceived of as occurring top-down, with prefrontal cortical areas exerting control over other parts of the brain. A new study demonstrates what might be considered a 'bottom-up' mechanism for cognitive control, involving the disinhibition of orbitofrontal cortex by subcortical regions.

High fat diet allows food-predictive stimuli to energize action performance in the absence of hunger, without distorting insulin signaling on accumbal cholinergic interneurons

Obesity can disrupt how food-predictive stimuli control action performance and selection. These two forms of control recruit cholinergic interneurons (CIN) located in the nucleus accumbens core (NAcC) and shell (NAcS), respectively. Given that obesity is associated with insulin resistance in this region, we examined whether interfering with CIN insulin signaling disrupts how food-predictive stimuli control actions. To interfere with insulin signaling we used a high-fat diet (HFD) or genetic excision of insulin receptor (InsR) from cholinergic cells. HFD left intact the capacity of food-predictive stimuli to energize performance of an action earning food when mice were tested hungry. However, it allowed this energizing effect to persist when the mice were tested sated. This persistence was linked to NAcC CIN activity but was not associated with distorted CIN insulin signaling. Accordingly, InsR excision had no effect on how food-predicting stimuli control action performance. Next, we found that neither HFD nor InsR excision altered the capacity of food-predictive stimuli to guide action selection. Yet, this capacity was associated with changes in NAcS CIN activity. These results indicate that insulin signaling on accumbal CIN does not modulate how food-predictive stimuli control action performance and selection. However, they show that HFD allows food-predictive stimuli to energize performance of an action earning food in the absence of hunger.

Diet and obesity effects on cue-driven food-seeking: insights from studies of Pavlovian-instrumental transfer in rodents and humans

Our modern environment is said to be obesogenic, promoting the consumption of calorically dense foods and reducing energy expenditure. One factor thought to drive excess energy intake is the abundance of cues signaling the availability of highly palatable foods. Indeed, these cues exert powerful influences over food-related decision-making. Although obesity is associated with changes to several cognitive domains, the specific role of cues in producing this shift and on decision-making more generally, remains poorly understood. Here we review the literature examining how obesity and palatable diets affect the ability of Pavlovian cues to influence instrumental food-seeking behaviors by examining rodent and human studies incorporating Pavlovian-instrumental transfer (PIT) protocols. There are two types of PIT: (a) general PIT that tests whether cues can energize actions elicited in the pursuit of food generally, and (b) specific PIT which tests whether cues can elicit an action that earns a specific food outcome when faced with a choice. Both types of PIT have been shown to be vulnerable to alterations as a result of changes to diet and obesity. However, effects appear to be driven less by increases in body fat and more by palatable diet exposure per se. We discuss the limitations and implications of the current findings. The challenges for future research are to uncover the mechanisms underlying these alterations to PIT, which appear unrelated to excess weight itself, and to better model the complex determinants of food choice in humans.

The Dopamine System in Mediating Alcohol Effects in Humans

Brain-imaging studies show that the development and maintenance of alcohol use disorder (AUD) is determined by a complex interaction of different neurotransmitter systems and multiple psychological factors. In this context, the dopaminergic reinforcement system appears to be of fundamental importance. We focus on the excitatory and depressant effects of acute versus chronic alcohol intake and its impact on dopaminergic neurotransmission. Furthermore, we describe alterations in dopaminergic neurotransmission as associated with symptoms of alcohol dependence. We specifically focus on neuroadaptations to chronic alcohol consumption and their effect on central processing of alcohol-associated and reward-related stimuli. Altered reward processing, complex conditioning processes, impaired reinforcement learning, and increased salience attribution to alcohol-associated stimuli enable alcohol cues to drive alcohol seeking and consumption. Finally, we will discuss how the neurobiological and neurochemical mechanisms of alcohol-associated alterations in reward processing and learning can interact with stress, cognition, and emotion processing.

Potential therapeutic mechanism of deep brain stimulation of the nucleus accumbens in obsessive-compulsive disorder

Deep brain stimulation (DBS) of the nucleus accumbens (NAc) (NAc-DBS) is an effective solution to refractory obsessive-compulsive disorder (OCD). However, evidence for the neurobiological mechanisms of OCD and the effect of NAc-DBS is still lacking. One hypothesis is that the electrophysiological activities in the NAc are modulated by DBS, and another hypothesis is that the activities of neurotransmitters in the NAc are influenced by DBS. To investigate these potential alterations, rats with quinpirole (QNP)- induced OCD were treated with DBS of the core part of NAc. Then, extracellular spikes (SPK) and local field potentials (LFP) in the NAc were recorded, and the levels of relevant neurotransmitters and related proteins were measured. Analysis of SPK revealed that the firing rate was decreased and the firing pattern was changed after NAc-DBS, and analysis of LFP showed that overall power spectral density (PSD) levels were reduced after NAc-DBS. Additionally, we found that the relative powers of the theta band, alpha band and beta band were increased in OCD status, while the relative powers of the delta band and gamma band were decreased. This pathological pattern of power distribution was reformed by NAc-DBS. Furthermore, we found that the local levels of monoamines [dopamine (DA) and serotonin (5-HT)] and amino acids [glutamate (Glu) and gamma-aminobutyric acid (GABA)] in the NAc were increased in OCD status, and that the expression of the two types of DA receptors in the NAc exhibited an opposite change. These abnormalities could be reversed by NAc-DBS. These findings provide a more comprehensive understanding about the function of the NAc in the pathophysiology of OCD and provide more detailed evidence for the potential effect of NAc-DBS.

Outcome devaluation by specific satiety disrupts sensory-specific Pavlovian-to-instrumental transfer

Reward predictive cues can selectively motivate instrumental behaviors that predict the same rewarding outcomes, an effect known as specific Pavlovian-to-instrumental transfer (PIT). This selective effect is thought to be mediated by a representation of the sensory specific properties of an outcome, that has become associated with both the Pavlovian cue and the instrumental response during initial learning. Specific satiety is a common method of outcome devaluation that reduces an outcome's value but might also lead to the habituation of the outcome's sensory properties. Previous research has demonstrated that specific PIT is insensitive to changes in specific outcome value following taste aversion devaluation, as well as general satiety manipulations, and therefore specific satiety should not disrupt specific PIT by reducing outcome value. The present rodent experiments used a specific satiety devaluation procedure immediately prior to a specific PIT test to show that habituation of these outcome specific sensory representations can disrupt its efficacy as a stimulus and abolish the specific PIT effect. Experiment 1 employed a two-lever choice test to show that a non-devalued stimulus supports specific PIT, whereas a devalued stimulus abolished the specific PIT effect. Experiment 2 replicated this procedure while controlling for response competition by using a single-lever test to confirm that a devalued stimulus abolishes the specific PIT effect. These findings demonstrate that specific satiety can disrupt the ability of an outcome specific representation to support specific PIT. Given previous findings that specific PIT is insensitive to changes in outcome value by general satiety and taste aversion devaluation, this suggests that specific satiety devaluation might disrupt the use of sensory specific outcome representations to guide behavior via a mechanism that is independent of the outcome's current value.

Endogenous opioid systems alterations in pain and opioid use disorder

Decades of research advances have established a central role for endogenous opioid systems in regulating reward processing, mood, motivation, learning and memory, gastrointestinal function, and pain relief. Endogenous opioid systems are present ubiquitously throughout the central and peripheral nervous system. They are composed of four families, namely the μ (MOPR), κ (KOPR), δ (DOPR), and nociceptin/orphanin FQ (NOPR) opioid receptors systems. These receptors signal through the action of their endogenous opioid peptides β-endorphins, dynorphins, enkephalins, and nociceptins, respectfully, to maintain homeostasis under normal physiological states. Due to their prominent role in pain regulation, exogenous opioids-primarily targeting the MOPR, have been historically used in medicine as analgesics, but their ability to produce euphoric effects also present high risks for abuse. The ability of pain and opioid use to perturb endogenous opioid system function, particularly within the central nervous system, may increase the likelihood of developing opioid use disorder (OUD). Today, the opioid crisis represents a major social, economic, and public health concern. In this review, we summarize the current state of the literature on the function, expression, pharmacology, and regulation of endogenous opioid systems in pain. Additionally, we discuss the adaptations in the endogenous opioid systems upon use of exogenous opioids which contribute to the development of OUD. Finally, we describe the intricate relationship between pain, endogenous opioid systems, and the proclivity for opioid misuse, as well as potential advances in generating safer and more efficient pain therapies.

The role of enkephalinergic systems in substance use disorders

Enkephalin, an endogenous opioid peptide, is highly expressed in the reward pathway and may modulate neurotransmission to regulate reward-related behaviors, such as drug-taking and drug-seeking behaviors. Drugs of abuse also directly increase enkephalin in this pathway, yet it is unknown whether or not changes in the enkephalinergic system after drug administration mediate any specific behaviors. The use of animal models of substance use disorders (SUDs) concurrently with pharmacological, genetic, and molecular tools has allowed researchers to directly investigate the role of enkephalin in promoting these behaviors. In this review, we explore neurochemical mechanisms by which enkephalin levels and enkephalin-mediated signaling are altered by drug administration and interrogate the contribution of enkephalin systems to SUDs. Studies manipulating the receptors that enkephalin targets (e.g., mu and delta opioid receptors mainly) implicate the endogenous opioid peptide in drug-induced neuroadaptations and reward-related behaviors; however, further studies will need to confirm the role of enkephalin directly. Overall, these findings suggest that the enkephalinergic system is involved in multiple aspects of SUDs, such as the primary reinforcing properties of drugs, conditioned reinforcing effects, and sensitization. The idea of dopaminergic-opioidergic interactions in these behaviors remains relatively novel and warrants further research. Continuing work to elucidate the role of enkephalin in mediating neurotransmission in reward circuitry driving behaviors related to SUDs remains crucial.

Food cue reactivity: Neurobiological and behavioral underpinnings

The modern obesogenic environment contains an abundance of food cues (e.g., sight, smell of food) as well cues that are associated with food through learning and memory processes. Food cue exposure can lead to food seeking and excessive consumption in otherwise food-sated individuals, and a high level of food cue responsivity is a risk factor for overweight and obesity. Similar food cue responses are observed in experimental rodent models, and these models are therefore useful for mechanistically identifying the neural circuits mediating food cue responsivity. This review draws from both experimental rodent models and human data to characterize the behavioral and biological processes through which food-associated stimuli contribute to overeating and weight gain. Two rodent models are emphasized - cue-potentiated feeding and Pavlovian-instrumental transfer - that provide insight in the neural circuits and peptide systems underlying food cue responsivity. Data from humans are highlighted that reveal physiological, psychological, and neural mechanisms that connect food cue responsivity with overeating and weight gain. The collective literature identifies connections between heightened food cue responsivity and obesity in both rodents and humans, and identifies underlying brain regions (nucleus accumbens, amygdala, orbitofrontal cortex, hippocampus) and endocrine systems (ghrelin) that regulate food cue responsivity in both species. These species similarities are encouraging for the possibility of mechanistic rodent model research and further human research leading to novel treatments for excessive food cue responsivity in humans.

Opioid Receptor-Mediated Regulation of Neurotransmission in the Brain

Opioids mediate their effects via opioid receptors: mu, delta, and kappa. At the neuronal level, opioid receptors are generally inhibitory, presynaptically reducing neurotransmitter release and postsynaptically hyperpolarizing neurons. However, opioid receptor-mediated regulation of neuronal function and synaptic transmission is not uniform in expression pattern and mechanism across the brain. The localization of receptors within specific cell types and neurocircuits determine the effects that endogenous and exogenous opioids have on brain function. In this review we will explore the similarities and differences in opioid receptor-mediated regulation of neurotransmission across different brain regions. We discuss how future studies can consider potential cell-type, regional, and neural pathway-specific effects of opioid receptors in order to better understand how opioid receptors modulate brain function.

Role of the striatal dopamine, GABA and opioid systems in mediating feeding and fat intake

Food intake, which is a highly reinforcing behavior, provides nutrients required for survival in all animals. However, when fat and sugar consumption goes beyond the daily needs, it can favor obesity. The prevalence and severity of this health problem has been increasing with time. Besides covering nutrient and energy needs, food and in particular its highly palatable components, such as fats, also induce feelings of joy and pleasure. Experimental evidence supports a role of the striatal complex and of the mesolimbic dopamine system in both feeding and food-related reward processing, with the nucleus accumbens as a key target for reward or reinforcing-associated signaling during food intake behavior. In this review, we provide insights concerning the impact of feeding, including fat intake, on different types of receptors and neurotransmitters present in the striatal complex. Reciprocally, we also cover the evidence for a modulation of palatable food intake by different neurochemical systems in the striatal complex and in particular the nucleus accumbens, with a focus on dopamine, GABA and the opioid system.

Effort-motivated behavior resolves paradoxes in appetitive conditioning

Motivated behavior has long been studied by psychologists, ethologists, and neuroscientists. To date, many scientists agree with the view that cue and reward attraction is the product of a dopamine-dependent unconscious process called incentive salience or "wanting". This process allows the influence of multiple factors such as hunger and odors on motivational attraction. In some cases, however, the resulting motivated behavior differs from what the incentive salience hypothesis would predict. I argue that seeking behavior under reward uncertainty illustrates this situation: Organisms do not just "want" (appetite-based attraction) cues that are inconsistent or associated with reward occasionally, they "hope" that those cues will consistently predict reward procurement in the ongoing trial. Said otherwise, they become motivated to invest time and energy to find consistent cue-reward associations despite no guarantee of success (effort-based attraction). A multi-test comparison of performance between individuals trained under uncertainty and certainty reveals behavioral paradoxes suggesting that the concept of incentive salience cannot fully account for responding to inconsistent cues. A mathematical model explains how appetite-based and effort-based attractions might combine their effects.

The expression of delta opioid receptor mRNA in adult male zebra finches (Taenopygia guttata)

The endogenous opioid system is evolutionarily conserved across reptiles, birds and mammals and is known to modulate varied brain functions such as learning, memory, cognition and reward. To date, most of the behavioral and anatomical studies in songbirds have mainly focused on μ-opioid receptors (ORs). Expression patterns of δ-ORs in zebra finches, a well-studied species of songbird have not yet been reported, possibly due to the high sequence similarity amongst different opioid receptors. In the present study, a specific riboprobe against the δ-OR mRNA was used to perform fluorescence in situ hybridization (FISH) on sections from the male zebra finch brain. We found that δ-OR mRNA was expressed in different parts of the pallium, basal ganglia, cerebellum and the hippocampus. Amongst the song control and auditory nuclei, HVC (abbreviation used as a formal name) and NIf (nucleus interfacialis nidopallii) strongly express δ-OR mRNA and stand out from the surrounding nidopallium. Whereas the expression of δ-OR mRNA is moderate in LMAN (lateral magnocellular nucleus of the anterior nidopallium), it is low in the MSt (medial striatum), Area X, DLM (dorsolateral nucleus of the medial thalamus), RA (robust nucleus of the arcopallium) of the song control circuit and Field L, Ov (nucleus ovoidalis) and MLd (nucleus mesencephalicus lateralis, pars dorsalis) of the auditory pathway. Our results suggest that δ-ORs may be involved in modulating singing, song learning as well as spatial learning in zebra finches.

How predictive learning influences choice: Evidence for a GPCR-based memory process necessary for Pavlovian-instrumental transfer

Predictive learning endows stimuli with the capacity to signal both the sensory-specific and general motivational properties of their associated rewards or outcomes. These two signals can be distinguished behaviorally by their influence on the selection and performance of instrumental actions, respectively. This review focuses on how sensory-specific predictive learning guides choice between actions that earn otherwise equally desirable outcomes. We describe evidence that outcome-specific predictive learning is encoded in the basolateral amygdala and drives the accumulation of delta-opioid receptors on the surface of cholinergic interneurons located in the nucleus accumbens shell. This accumulation constitutes a novel form of cellular memory, not for outcome-specific predictive learning per se but for the selection of, and choice between, future instrumental actions. We describe recent evidence regarding the cascade of events necessary for the formation and expression of this cellular memory and point to open questions for future research into this process. Beyond these mechanistic considerations, the discovery of this new form of memory is consistent with recent evidence suggesting that intracellular rather than synaptic changes can mediate learning-related plasticity to modify brain circuitry to prepare for future significant events.

The Meaning of Behavior: Discriminating Reflex and Volition in the Brain

The ability to establish behaviorally what psychological capacity an animal is deploying-to discern accurately what an animal is doing-is key to functional analyses of the brain. Our current understanding of these capacities suggests, however, that this task is complex; there is evidence that multiple capacities are engaged simultaneously and contribute independently to the control of behavior. As such, establishing the contribution of a cell, circuit, or neural system to any one function requires careful dissection of that role from its influence on other functions and, therefore, the careful selection and design of behavioral tasks fit for that purpose. Here I describe recent research that has sought to utilize behavioral tools to investigate the neural bases of instrumental conditioning, particularly the circuits and systems supporting the capacity for goal-directed action, as opposed to conditioned reflexes and habits, and how these sources of action control interact to generate adaptive behavior.

Mechanical stimulation of cervical vertebrae modulates the discharge activity of ventral tegmental area neurons and dopamine release in the nucleus accumbens

Background:

Growing evidence suggests that mechanical stimulation modulates substrates in the supraspinal central nervous system (CNS) outside the canonical somatosensory circuits.

Objective/Methods:

We evaluate mechanical stimulation applied to the cervical spine at the C7-T1 level (termed “MStim”) on neurons and neurotransmitter release in the mesolimbic dopamine (DA) system, an area implicated in reward and motivation, utilizing electrophysiological, pharmacological, neurochemical and immunohistochemical techniques in Wistar rats.

Results:

Low frequency (45–80 Hz), but not higher frequency (115 Hz), MStim inhibited the firing rate of ventral tegmental area (VTA) GABA neurons (52.8% baseline; 450 s) while increasing the firing rate of VTA DA neurons (248% baseline; 500 s). Inactivation of the nucleus accumbens (NAc), or systemic or in situ antagonism of delta opioid receptors (DORs), blocked MStim inhibition of VTA GABA neuron firing rate. MStim enhanced both basal (178.4% peak increase at 60 min) and evoked DA release in NAc (135.0% peak increase at 40 min), which was blocked by antagonism of DORs or acetylcholine release in the NAc. MStim enhanced c-FOS expression in the NAc, but inhibited total expression in the VTA, and induced translocation of DORs to neuronal membranes in the NAc.

Conclusion:

These findings demonstrate that MStim modulates neuron firing and DA release in the mesolimbic DA system through endogenous opioids and acetylcholine in the NAc. These findings demonstrate the need to explore more broadly the extra-somatosensory effects of peripheral mechanoreceptor activation and the specific role for mechanoreceptor-based therapies in the treatment of substance abuse.

A Motivational and Neuropeptidergic Hub: Anatomical and Functional Diversity within the Nucleus Accumbens Shell

The mesocorticolimbic pathway is canonically known as the "reward pathway." Embedded within the center of this circuit is the striatum, a massive and complex network hub that synthesizes motivation, affect, learning, cognition, stress, and sensorimotor information. Although striatal subregions collectively share many anatomical and functional similarities, it has become increasingly clear that it is an extraordinarily heterogeneous region. In particular, the nucleus accumbens (NAc) medial shell has repeatedly demonstrated that the rules dictated by more dorsal aspects of the striatum do not apply or are even reversed in functional logic. These discrepancies are perhaps most easily captured when isolating the functions of various neuromodulatory peptide systems within the striatum. Endogenous peptides are thought to play a critical role in modulating striatal signals to either amplify or dampen evoked behaviors. Here we describe the anatomical-functional backdrop upon which several neuropeptides act within the NAc to modulate behavior, with a specific emphasis on nucleus accumbens medial shell and stress responsivity. Additionally, we propose that, as the field continues to dissect fast neurotransmitter systems within the NAc, we must also provide considerable contextual weight to the roles local peptides play in modulating these circuits to more comprehensively understand how this important subregion gates motivated behaviors.

Delta opioid receptor agonists are effective for multiple types of headache disorders

Headaches are highly disabling and are among the most common neurological disorders worldwide. Despite the high prevalence of headache, therapeutic options are limited. We recently identified the delta opioid receptor (DOR) as an emerging therapeutic target for migraine. In this study, we examined the effectiveness of a hallmark DOR agonist, SNC80, in disease models reflecting diverse headache disorders including: chronic migraine, post-traumatic headache (PTH), medication overuse headache by triptans (MOH), and opioid-induced hyperalgesia (OIH). To model chronic migraine C57BL/6J mice received chronic intermittent treatment with the known human migraine trigger, nitroglycerin. PTH was modeled by combining the closed head weight drop model with the nitroglycerin model of chronic migraine. For MOH and OIH, mice were chronically treated with sumatriptan or morphine, respectively. The development of periorbital and peripheral allodynia was observed in all four models; and SNC80 significantly inhibited allodynia in all cases. In addition, we also determined if chronic daily treatment with SNC80 would induce MOH/OIH, and we observed limited hyperalgesia relative to sumatriptan or morphine. Together, our results indicate that DOR agonists could be effective in multiple headache disorders, despite their distinct etiology, thus presenting a novel therapeutic target for headache.

Contributions of Pavlovian incentive motivation to cue-potentiated feeding

Cues signaling the availability of palatable food acquire the ability to potentiate food seeking and consumption. The current study employed a combination of behavioral, pharmacological, and analytical techniques to probe the role of Pavlovian incentive motivation in cue-potentiated feeding. We show that a cue paired with sucrose solution (CS+) can transfer its control over feeding to stimulate sucrose consumption at a new receptacle, and that this effect depends on activation of D1 dopamine receptors, which is known to modulate other forms of cue-motivated behavior but not taste palatability. Microstructural analyses of sucrose-licking behavior revealed that the CS+ tended to increase the frequency with which rats engaged in active bouts of licking behavior without having a reliable effect on the duration of those licking bouts, a measure that was instead associated with sucrose palatability. Furthermore, we found that individual differences in CS+ elicited increases in bout frequency were associated with total sucrose intake at test, supporting the view that this process was related to meaningful dysregulation of eating behavior. The current study, therefore, (1) demonstrates that a dopamine-dependent Pavlovian incentive motivational process can mediate cue-potentiated feeding, and (2) lays out an experimental and analytical approach for parsing this aspect of behavior.

Food Addiction and Binge Eating: Lessons Learned from Animal Models

The feeding process is required for basic life, influenced by environment cues and tightly regulated according to demands of the internal milieu by regulatory brain circuits. Although eating behaviour cannot be considered "addictive" under normal circumstances, people can become "addicted" to this behaviour, similarly to how some people are addicted to drugs. The symptoms, cravings and causes of "eating addiction" are remarkably similar to those experienced by drug addicts, and both drug-seeking behaviour as eating addiction share the same neural pathways. However, while the drug addiction process has been highly characterised, eating addiction is a nascent field. In fact, there is still a great controversy over the concept of "food addiction". This review aims to summarize the most relevant animal models of "eating addictive behaviour", emphasising binge eating disorder, that could help us to understand the neurobiological mechanisms hidden under this behaviour, and to improve the psychotherapy and pharmacological treatment in patients suffering from these pathologies.

Sex-dependent impact of early-life stress and adult immobilization in the attribution of incentive salience in rats

Early life stress (ELS) induces long-term effects in later functioning and interacts with further exposure to other stressors in adulthood to shape our responsiveness to reward-related cues. The attribution of incentive salience to food-related cues may be modulated by previous and current exposures to stressors in a sex-dependent manner. We hypothesized from human data that exposure to a traumatic (severe) adult stressor will decrease the attribution of incentive salience to reward-associated cues, especially in females, because these effects are modulated by previous ELS. To study these factors in Long-Evans rats, we used as an ELS model of restriction of nesting material and concurrently evaluated maternal care. In adulthood, the offspring of both sexes were exposed to acute immobilization (IMO), and several days after, a Pavlovian conditioning procedure was used to assess the incentive salience of food-related cues. Some rats developed more attraction to the cue predictive of reward (sign-tracking) and others were attracted to the location of the reward itself, the food-magazine (goal-tracking). Several dopaminergic markers were evaluated by in situ hybridization. The results showed that ELS increased maternal care and decreased body weight gain (only in females). Regarding incentive salience, in absolute control animals, females presented slightly greater sign-tracking behavior than males. Non-ELS male rats exposed to IMO showed a bias towards goal-tracking, whereas in females, IMO produced a bias towards sign-tracking. Animals of both sexes not exposed to IMO displayed an intermediate phenotype. ELS in IMO-treated females was able to reduce sign-tracking and decrease tyrosine hydroxylase expression in the ventral tegmental area and dopamine D1 receptor expression in the accumbens shell. Although the predicted greater decrease in females in sign-tracking after IMO exposure was not corroborated by the data, the results highlight the idea that sex is an important factor in the study of the long-term impact of early and adult stressors.

The Lateral Habenula and Its Input to the Rostromedial Tegmental Nucleus Mediates Outcome-Specific Conditioned Inhibition

Animals can readily learn that stimuli predict the absence of specific appetitive outcomes; however, the neural substrates underlying such outcome-specific conditioned inhibition remain largely unexplored. Here, using female and male rats as subjects, we examined the involvement of the lateral habenula (LHb) and of its inputs onto the rostromedial tegmental nucleus (RMTg) in inhibitory learning. In these experiments, we used backward conditioning and contingency reversal to establish outcome-specific conditioned inhibitors for two distinct appetitive outcomes. Then, using the Pavlovian-instrumental transfer paradigm, we assessed the effects of manipulations of the LHb and the LHb-RMTg pathway on that inhibitory encoding. In control animals, we found that an outcome-specific conditioned inhibitor biased choice away from actions delivering that outcome and toward actions earning other outcomes. Importantly, this bias was abolished by both electrolytic lesions of the LHb and selective ablation of LHb neurons using Cre-dependent Caspase3 expression in Cre-expressing neurons projecting to the RMTg. This deficit was specific to conditioned inhibition; an excitatory predictor of a specific outcome-biased choice toward actions delivering the same outcome to a similar degree whether the LHb or the LHb-RMTg network was intact or not. LHb lesions also disrupted the ability of animals to inhibit previously encoded stimulus-outcome contingencies after their reversal, pointing to a critical role of the LHb and of its inputs onto the RMTg in outcome-specific conditioned inhibition in appetitive settings. These findings are consistent with the developing view that the LHb promotes a negative reward prediction error in Pavlovian conditioning.SIGNIFICANCE STATEMENT Stimuli that positively or negatively predict rewarding outcomes influence choice between actions that deliver those outcomes. Previous studies have found that a positive predictor of a specific outcome biases choice toward actions delivering that outcome. In contrast, a negative predictor of an outcome biases choice away from actions earning that outcome and toward other actions. Here we reveal that the lateral habenula is critical for negative predictors, but not positive predictors, to affect choice. Furthermore, these effects were found to require activation of lateral habenula inputs to the rostromedial tegmental nucleus. These results are consistent with the view that the lateral habenula establishes inhibitory relationships between stimuli and food outcomes and computes a negative prediction error in Pavlovian conditioning.

Beta-arrestin 1 regulation of reward-motivated behaviors and glutamatergic function

The two highly homologous non-visual arrestins, beta-arrestin 1 and 2, are ubiquitously expressed in the central nervous system, yet knowledge of their disparate roles is limited. While beta-arrestin 2 (βarr2) has been implicated in several aspects of reward-related learning and behavior, very little is known about the behavioral function of beta-arrestin 1 (βarr1). Using mice lacking βarr1, we focused on the role of this scaffolding and signal transduction protein in reward-motivated behaviors and in striatal glutamatergic function. We found that βarr1 KO mice were both slower in acquiring cocaine self-administration and in extinguishing this behavior. They also showed deficits in learning tasks supported by a natural food reward, suggesting a general alteration in reward processing. We then examined glutamatergic synaptic strength in WT and KO medium spiny neurons (MSNs) of the Nucleus Accumbens (NAc) shell in naïve animals, and from those that underwent cocaine self-administration. An increase in the AMPA/NMDA (A/N) ratio and a relative lack of GluN2B-enriched NMDARs was found in naïve KO vs WT MSNs. Applying Lim Domain Kinase (LIMK1), the kinase that phosphorylates and inactivates cofilin, to these cells, showed that both βarr1 and LIMK regulate the A/N ratio and GluN2B-NMDARs. Cocaine self-administration increased the A/N ratio and GluN2B-NMDARs in WT MSNs and, although the A/N ratio also increased in KO MSNs, this was accompanied by fewer GluN2B-NMDARs and an appearance of calcium-permeable AMPARs. Finally, to examine the consequences of reduced basal GluN2B-NMDARs in reward-processing seen in KO mice, we chronically infused ifenprodil, a GluN2B antagonist, into the NAc shell of WT mice. This intervention substantially reduced food-motivated behavior. Together these findings identify a previously unknown role of βarr1 in regulating specific reward-motivated behaviors and glutamatergic function.

Noradrenergic Regulation of Central Amygdala in Aversive Pavlovian-to-Instrumental Transfer

The neural mechanisms through which a Pavlovian conditioned stimulus (CS) elicits innate defense responses are well understood. But a Pavlovian CS can also invigorate ongoing instrumental responding, as shown by studies of aversive Pavlovian-to-instrumental transfer (PIT). While the neural circuitry of appetitive PIT has been studied extensively, little is known about the brain mechanisms of aversive PIT. We recently showed the central amygdala (CeA) is essential for aversive PIT. In the current studies, using pharmacology and designer receptors in rodents, we demonstrate that noradrenergic (NE) activity negatively regulates PIT via brainstem locus coeruleus (LC) activity and LC projections to CeA. Our results provide evidence for a novel pathway through which response modulation occurs between brainstem neuromodulatory systems and CeA to invigorate adaptive behavior in the face of threat.

Reassessing wanting and liking in the study of mesolimbic influence on food intake

Humans and animals such as rats and mice tend to overconsume calorie-dense foods, a phenomenon that likely contributes to obesity. One often-advanced explanation for why we preferentially consume sweet and fatty foods is that they are more "rewarding" than low-calorie foods. "Reward" has been subdivided into three interdependent psychological processes: hedonia (liking a food), reinforcement (formation of associations among stimuli, actions, and/or the food), and motivation (wanting the food). Research into these processes has focused on the mesolimbic system, which comprises both dopamine neurons in the ventral tegmental area and neurons in their major projection target, the nucleus accumbens. The mesolimbic system and closely connected structures are commonly referred to as the brain's "reward circuit." Implicit in this title is the assumption that "rewarding" experiences are generally the result of activity in this circuit. In this review, I argue that food intake and the preference for calorie-dense foods can be explained without reference to subjective emotions. Furthermore, the contribution of mesolimbic dopamine to food intake and preference may not be a general one of promoting or coordinating behaviors that result in the most reward or caloric intake but may instead be limited to the facilitation of a specific form of neural computation that results in conditioned approach behavior. Studies on the neural mechanisms of caloric intake regulation must address how sensory information about calorie intake affects not just the mesolimbic system but also many other forms of computation that govern other types of food-seeking and food-oriented behaviors.

Quantitative Imaging of Cholinergic Interneurons Reveals a Distinctive Spatial Organization and a Functional Gradient across the Mouse Striatum

Information processing in the striatum requires the postsynaptic integration of glutamatergic and dopaminergic signals, which are then relayed to the output nuclei of the basal ganglia to influence behavior. Although cellularly homogeneous in appearance, the striatum contains several rare interneuron populations which tightly modulate striatal function. Of these, cholinergic interneurons (CINs) have been recently shown to play a critical role in the control of reward-related learning; however how the striatal cholinergic network is functionally organized at the mesoscopic level and the way this organization influences striatal function remains poorly understood. Here, we systematically mapped and digitally reconstructed the entire ensemble of CINs in the mouse striatum and quantitatively assessed differences in densities, spatial arrangement and neuropil content across striatal functional territories. This approach demonstrated that the rostral portion of the striatum contained a higher concentration of CINs than the caudal striatum and that the cholinergic content in the core of the ventral striatum was significantly lower than in the rest of the regions. Additionally, statistical comparison of spatial point patterns in the striatal cholinergic ensemble revealed that only a minor portion of CINs (17%) aggregated into cluster and that they were predominantly organized in a random fashion. Furthermore, we used a fluorescence reporter to estimate the activity of over two thousand CINs in naïve mice and found that there was a decreasing gradient of CIN overall function along the dorsomedial-to-ventrolateral axis, which appeared to be independent of their propensity to aggregate within the striatum. Altogether this work suggests that the regulation of striatal function by acetylcholine across the striatum is highly heterogeneous, and that signals originating in external afferent systems may be principally determining the function of CINs in the striatum.

Neural and neurochemical basis of reinforcement-guided decision making

Decision making is an adaptive behavior that takes into account several internal and external input variables and leads to the choice of a course of action over other available and often competing alternatives. While it has been studied in diverse fields ranging from mathematics, economics, ecology, and ethology to psychology and neuroscience, recent cross talk among perspectives from different fields has yielded novel descriptions of decision processes. Reinforcement-guided decision making models are based on economic and reinforcement learning theories, and their focus is on the maximization of acquired benefit over a defined period of time. Studies based on reinforcement-guided decision making have implicated a large network of neural circuits across the brain. This network includes a wide range of cortical (e.g., orbitofrontal cortex and anterior cingulate cortex) and subcortical (e.g., nucleus accumbens and subthalamic nucleus) brain areas and uses several neurotransmitter systems (e.g., dopaminergic and serotonergic systems) to communicate and process decision-related information. This review discusses distinct as well as overlapping contributions of these networks and neurotransmitter systems to the processing of decision making. We end the review by touching on neural circuitry and neuromodulatory regulation of exploratory decision making.

Mesolimbic Dopamine Encodes Prediction Errors in a State-Dependent Manner

Mesolimbic dopamine encodes the benefits of a course of action. However, the value of an appetitive reward depends strongly on an animal’s current state. To investigate the relationship between dopamine, value, and physiological state, we monitored sub-second dopamine release in the nucleus accumbens core while rats made choices between food and sucrose solution following selective satiation on one of these reinforcers. Dopamine signals reflected preference for the reinforcers in the new state, decreasing to the devalued reward and, after satiation on food, increasing for the valued sucrose solution. These changes were rapid and selective, with dopamine release returning to pre-satiation patterns when the animals were re-tested in a standard food-restricted state. Such rapid and selective adaptation of dopamine-associated value signals could provide an important signal to promote efficient foraging for a varied diet.

•

Dopamine reward prediction errors are shaped by physiological state

•

Both choices and dopamine signals rapidly update after selective satiation

•

In a new state, dopamine signals mainly only update with experience

•

When returning to a familiar state, dopamine immediately signals stored values

Endogenous opiates and behavior: 2014

This paper is the thirty-seventh consecutive installment of the annual review of research concerning the endogenous opioid system. It summarizes papers published during 2014 that studied the behavioral effects of molecular, pharmacological and genetic manipulation of opioid peptides, opioid receptors, opioid agonists and opioid antagonists. The particular topics that continue to be covered include the molecular-biochemical effects and neurochemical localization studies of endogenous opioids and their receptors related to behavior (endogenous opioids and receptors), and the roles of these opioid peptides and receptors in pain and analgesia (pain and analgesia); stress and social status (human studies); tolerance and dependence (opioid mediation of other analgesic responses); learning and memory (stress and social status); eating and drinking (stress-induced analgesia); alcohol and drugs of abuse (emotional responses in opioid-mediated behaviors); sexual activity and hormones, pregnancy, development and endocrinology (opioid involvement in stress response regulation); mental illness and mood (tolerance and dependence); seizures and neurologic disorders (learning and memory); electrical-related activity and neurophysiology (opiates and conditioned place preferences (CPP)); general activity and locomotion (eating and drinking); gastrointestinal, renal and hepatic functions (alcohol and drugs of abuse); cardiovascular responses (opiates and ethanol); respiration and thermoregulation (opiates and THC); and immunological responses (opiates and stimulants). This paper is the thirty-seventh consecutive installment of the annual review of research concerning the endogenous opioid system. It summarizes papers published during 2014 that studied the behavioral effects of molecular, pharmacological and genetic manipulation of opioid peptides, opioid receptors, opioid agonists and opioid antagonists. The particular topics that continue to be covered include the molecular-biochemical effects and neurochemical localization studies of endogenous opioids and their receptors related to behavior (endogenous opioids and receptors), and the roles of these opioid peptides and receptors in pain and analgesia (pain and analgesia); stress and social status (human studies); tolerance and dependence (opioid mediation of other analgesic responses); learning and memory (stress and social status); eating and drinking (stress-induced analgesia); alcohol and drugs of abuse (emotional responses in opioid-mediated behaviors); sexual activity and hormones, pregnancy, development and endocrinology (opioid involvement in stress response regulation); mental illness and mood (tolerance and dependence); seizures and neurologic disorders (learning and memory); electrical-related activity and neurophysiology (opiates and conditioned place preferences (CPP)); general activity and locomotion (eating and drinking); gastrointestinal, renal and hepatic functions (alcohol and drugs of abuse); cardiovascular responses (opiates and ethanol); respiration and thermoregulation (opiates and THC); and immunological responses (opiates and stimulants).

Delta Opioid Receptors: Learning and Motivation

Delta opioid receptor (DOR) displays a unique, highly conserved, structure and an original pattern of distribution in the central nervous system, pointing to a distinct and specific functional role among opioid peptide receptors. Over the last 15 years, in vivo pharmacology and genetic models have allowed significant advances in the understanding of this role. In this review, we will focus on the involvement of DOR in modulating different types of hippocampal- and striatal-dependent learning processes as well as motor function, motivation, and reward. Remarkably, DOR seems to play a key role in balancing hippocampal and striatal functions, with major implications for the control of cognitive performance and motor function under healthy and pathological conditions.

A cholinergic feedback circuit to regulate striatal population uncertainty and optimize reinforcement learning

Convergent evidence suggests that the basal ganglia support reinforcement learning by adjusting action values according to reward prediction errors. However, adaptive behavior in stochastic environments requires the consideration of uncertainty to dynamically adjust the learning rate. We consider how cholinergic tonically active interneurons (TANs) may endow the striatum with such a mechanism in computational models spanning three Marr's levels of analysis. In the neural model, TANs modulate the excitability of spiny neurons, their population response to reinforcement, and hence the effective learning rate. Long TAN pauses facilitated robustness to spurious outcomes by increasing divergence in synaptic weights between neurons coding for alternative action values, whereas short TAN pauses facilitated stochastic behavior but increased responsiveness to change-points in outcome contingencies. A feedback control system allowed TAN pauses to be dynamically modulated by uncertainty across the spiny neuron population, allowing the system to self-tune and optimize performance across stochastic environments.

The Relationship Between Specific Pavlovian Instrumental Transfer and Instrumental Reward Probability

Goal-directed behavior is influenced by environmental cues: in particular, cues associated with a reward can bias action choice toward actions directed to that same reward. This effect is studied experimentally as specific Pavlovian-instrumental transfer (specific PIT). We have investigated the hypothesis that cues associated to an outcome elicit specific PIT by rising the estimates of reward probability of actions associated to that same outcome. In other words, cues reduce the uncertainty on the efficacy of instrumental actions. We used a human PIT experimental paradigm to test the effects of two different instrumental contingencies: one group of participants had a 33% chance of being rewarded for each button press, while another had a 100% chance. The group trained with 33% reward probability showed a stronger PIT effect than the 100% group, in line with the hypothesis that Pavlovian cues linked to an outcome work by reducing the uncertainty of receiving it. The 100% group also showed a significant specific PIT effect, highlighting additional factors that could contribute to specific PIT beyond the instrumental training contingency. We hypothesize that the uncertainty about reward delivery due to testing in extinction might be one of these factors. These results add knowledge on how goal-directed behavior is influenced by the presence of environmental cues associated with a reward: such influence depends on the probability that we have to reach a reward, namely when there is less chance of getting a reward we are more influenced by cues associated with it, and vice versa.

The role of opioid processes in reward and decision-making

Contemporary theories emphasize the involvement of the endogenous opioid system in assigning hedonic values to rewards. Although earlier research supports this view, recent findings suggest that opioids play a larger and more complex role in reward processes than these theories suggest. For example, opioid activity in the basolateral amygdala is required for encoding incentive learning, a process by which the value of goal-directed actions is updated. Outside the amygdala, opioid receptors in the ventral striatum have been found to promote choice between different courses of action. Specifically, μ opioid receptors in the nucleus accumbens core and δ opioid receptors in the nucleus accumbens shell have been reported to mediate distinct aspects of incentive motivation; the core regulating the effect of experienced reward and the shell of predicted reward on choice. In both cases, the involvement of opioid receptors was restricted to the time of choice, although changes in their expression pattern could be observed prior to that point. This time-restricted involvement of opioid receptor-related processes is consistent with the view that opioids in the nucleus accumbens are central components of the limbic-motor interface, integrating reward-related information with instrumental learning to guide decision-making, particularly the selection and execution of goal-directed actions.

LINKED ARTICLES

This article is part of a themed section on Opioids: New Pathways to Functional Selectivity. To view the other articles in this section visit http://dx.doi.org/10.1111/bph.2015.172.issue-2.

Involvement of Endogenous Enkephalins and β-Endorphin in Feeding and Diet-Induced Obesity

Studies implicate opioid transmission in hedonic and metabolic control of feeding, although roles for specific endogenous opioid peptides have barely been addressed. Here, we studied palatable liquid consumption in proenkephalin knockout (PENK KO) and β-endorphin-deficient (BEND KO) mice, and how the body weight of these mice changed during consumption of an energy-dense highly palatable 'cafeteria diet'. When given access to sucrose solution, PENK KOs exhibited fewer bouts of licking than wild types, even though the length of bouts was similar to that of wild types, a pattern that suggests diminished food motivation. Conversely, BEND KOs did not differ from wild types in the number of licking bouts, even though these bouts were shorter in length, suggesting that they experienced the sucrose as being less palatable. In addition, licking responses in BEND, but not PENK, KO mice were insensitive to shifts in sucrose concentration or hunger. PENK, but not BEND, KOs exhibited lower baseline body weights compared with wild types on chow diet and attenuated weight gain when fed cafeteria diet. Based on this and related findings, we suggest endogenous enkephalins primarily set a background motivational tone regulating feeding behavior, whereas β-endorphin underlies orosensory reward in high need states or when the stimulus is especially valuable. Overall, these studies emphasize complex interplays between endogenous opioid peptides targeting μ-receptors, such as enkephalins and endorphins, underlying the regulation of feeding and body weight that might explain the poor efficacy of drugs that generally target μ-opioid receptors in the long-term control of appetite and body weight.

Cholinergic interneurons in the dorsal and ventral striatum: anatomical and functional considerations in normal and diseased conditions

Striatal cholinergic interneurons (ChIs) are central for the processing and reinforcement of reward-related behaviors that are negatively affected in states of altered dopamine transmission, such as in Parkinson's disease or drug addiction. Nevertheless, the development of therapeutic interventions directed at ChIs has been hampered by our limited knowledge of the diverse anatomical and functional characteristics of these neurons in the dorsal and ventral striatum, combined with the lack of pharmacological tools to modulate specific cholinergic receptor subtypes. This review highlights some of the key morphological, synaptic, and functional differences between ChIs of different striatal regions and across species. It also provides an overview of our current knowledge of the cellular localization and function of cholinergic receptor subtypes. The future use of high-resolution anatomical and functional tools to study the synaptic microcircuitry of brain networks, along with the development of specific cholinergic receptor drugs, should help further elucidate the role of striatal ChIs and permit efficient targeting of cholinergic systems in various brain disorders, including Parkinson's disease and addiction.

Ventral pallidal projections to mediodorsal thalamus and ventral tegmental area play distinct roles in outcome-specific Pavlovian-instrumental transfer

Outcome-specific Pavlovian-instrumental transfer (PIT) demonstrates the way that reward-related cues influence choice between instrumental actions. The nucleus accumbens shell (NAc-S) contributes critically to this effect, particularly through its output to the rostral medial ventral pallidum (VP-m). Using rats, we investigated in two experiments the role in the PIT effect of the two major outputs of this VP-m region innervated by the NAc-S, the mediodorsal thalamus (MD) and the ventral tegmental area (VTA). First, two retrograde tracers were injected into the MD and VTA to compare the neuronal activity of the two populations of projection neurons in the VP-m during PIT relative to controls. Second, the functional role of the connection between the VP-m and the MD or VTA was assessed using asymmetrical pharmacological manipulations before a PIT test. It was found that, whereas neurons in the VP-m projecting to the MD showed significantly more neuronal activation during PIT than those projecting to the VTA, neuronal activation of these latter neurons correlated with the size of the PIT effect. Disconnection of the two pathways during PIT also revealed different deficits in performance: disrupting the VP-m to MD pathway removed the response biasing effects of reward-related cues, whereas disrupting the VP-m to VTA pathway preserved the response bias but altered the overall rate of responding. The current results therefore suggest that the VP-m exerts distinct effects on the VTA and MD and that these latter structures mediate the motivational and cognitive components of specific PIT, respectively.

Learning and Motivational Processes Contributing to Pavlovian-Instrumental Transfer and Their Neural Bases: Dopamine and Beyond

Pavlovian stimuli exert a range of effects on behavior from simple conditioned reflexes, such as salivation, to altering the vigor and direction of instrumental actions. It is currently accepted that these distinct behavioral effects stem from two sources (i) the various associative connections between predictive stimuli and the component features of the events that these stimuli predict and (ii) the distinct motivational and cognitive functions served by cues, particularly their arousing and informational effects on the selection and performance of specific actions. Here, we describe studies that have assessed these latter phenomena using a paradigm that has come to be called Pavlovian-instrumental transfer. We focus first on behavioral experiments that have described distinct sources of stimulus control derived from the general affective and outcome-specific predictions of conditioned stimuli, referred to as general transfer and specific transfer, respectively. Subsequently, we describe research efforts attempting to establish the neural bases of these transfer effects, largely in the afferent and efferent connections of the nucleus accumbens (NAc) core and shell. Finally, we examine the role of predictive cues in examples of aberrant stimulus control associated with psychiatric disorders and addiction.

δ-Opioid receptors in the accumbens shell mediate the influence of both excitatory and inhibitory predictions on choice

BACKGROUND AND PURPOSE

Stimuli that predict rewarding events can control choice between future actions, and this control could be mediated by δ-opioid receptors in the nucleus accumbens shell (NAc-S). Stimuli predicting the absence of important events can also guide choice, although it remains unknown whether they do so via changes in an accumbal δ-opioid receptor-related process.

EXPERIMENTAL APPROACH

δ-opioid receptor-eGFP mice were trained to perform two instrumental actions that delivered different food outcomes. Choice between the two actions was then tested in the presence of stimuli paired with either the delivery or the non-delivery of each of the two outcomes. Bilateral infusions of the δ-opioid receptor antagonist naltrindole into the NAc-S were used to determine the role of these receptors at the time of choice and δ-opioid receptor expression in the NAc-S used to assess functional activity.

KEY RESULTS

A stimulus predicting a specific outcome biased choice performance towards the action previously earning that same outcome. In contrast, a stimulus signalling the absence of that outcome biased performance away from the action that delivered that outcome towards actions associated with the absence of that outcome. Both effects were associated with increased δ-opioid receptor expression on the membrane of cholinergic interneurons within the NAc-S. Furthermore, both effects were blocked by naltrindole infused into the NAc-S.

CONCLUSIONS AND IMPLICATIONS

These findings suggest that δ-opioid receptors in the NAc-S were involved in the effects of predictive learning on choice between actions, whether those predictions involve the presence or absence of specific rewarding events.

LINKED ARTICLES

This article is part of a themed section on Opioids: New Pathways to Functional Selectivity. To view the other articles in this section visit http://dx.doi.org/10.1111/bph.2015.172.issue-2.