Forebrain circuitry involved in effort-related choice: Injections of the GABAA agonist muscimol into ventral pallidum alter response allocation in food-seeking behavior

Ventral Pallidum and Amygdala Cooperate to Restrain Reward Approach under Threat

Foraging decisions involve assessing potential risks and prioritizing food sources, which can be challenging when confronted with changing and conflicting circumstances. A crucial aspect of this decision-making process is the ability to actively overcome defensive reactions to threats and focus on achieving specific goals. The ventral pallidum (VP) and basolateral amygdala (BLA) are two brain regions that play key roles in regulating behavior motivated by either rewards or threats. However, it is unclear whether these regions are necessary in decision-making processes involving competing motivational drives during conflict. Our aim was to investigate the requirements of the VP and BLA for foraging choices in conflicts involving overcoming defensive responses. Here, we used a novel foraging task and pharmacological techniques to inactivate either the VP or BLA or to disconnect these brain regions before conducting a conflict test in male rats. Our findings showed that BLA is necessary for making risky choices during conflicts, whereas VP is necessary for invigorating the drive to obtain food, regardless of the presence of conflict. Importantly, our research revealed that the connection between VP and BLA is critical in controlling risky food-seeking choices during conflict situations. This study provides a new perspective on the collaborative function of VP and BLA in driving behavior, aimed at achieving goals in the face of dangers.

Neonatal Isolation Increases the Susceptibility to Learned Helplessness through the Aberrant Neuronal Activity in the Ventral Pallidum of Rats

Objective

: Environmental deprivation, a type of childhood maltreatment, has been reported to constrain the cognitive developmental processes such as associative learning and implicit learning, which may lead to functional and morphological changes in the ventral pallidum (VP) and pessimism, a well-known cognitive feature of major depression. We examined whether neonatal isolation (NI) could influence the incidence of learned helplessness (LH) in a rat model mimicking the pessimism, and the number of vesicular glutamate transporter 2 (VGLUT2)-expressing VP cells and Penk-expressing VP cells.

Methods

: The number of escape failures from foot-shocks in the LH test was measured to examine stress-induced depression-like behavior in rats. The number of VGLUT2-expressing VP cells and Penk-expressing VP cells was measured by immunohistochemistry.

Results

: In NI rats compared with Sham rats, the incidence of LH in adulthood was increased and VGLUT2-expressing VP cells but not Penk-expressing VP cells in adulthood were decreased. VGLUT2-expressing VP cells were decreased only in the LH group of NI rats and significantly correlated with the escape latency in the LH test.

Conclusion

: These findings suggest that the aberrant VP neuronal activity due to environmental deprivation early in life leads to pessimistic associative and implicit learning. Modulating VP neuronal activity could be a novel therapeutic and preventive strategy for the patients with this specific pathophysiology.

Apathy and Motivation: Biological Basis and Drug Treatment

Apathy is a disabling syndrome associated with poor functional outcomes that is common across a broad range of neurological and psychiatric conditions. Currently, there are no established therapies specifically for the condition, and safe and effective treatments are urgently needed. Advances in the understanding of motivation and goal-directed behavior in humans and animals have shed light on the cognitive and neurobiological mechanisms contributing to apathy, providing an important foundation for the development of new treatments. Here, we review the cognitive components, neural circuitry, and pharmacology of apathy and motivation, highlighting converging evidence of shared transdiagnostic mechanisms. Though no pharmacological treatments have yet been licensed, we summarize trials of existing and novel compounds to date, identifying several promising candidates for clinical use and avenues of future drug development.

Not all discounts are created equal: Regional activity and brain networks in temporal and effort discounting

Reward outcomes associated with costs like time delay and effort investment are generally discounted in decision-making. Standard economic models predict rewards associated with different types of costs are devalued in a similar manner. However, our review of rodent lesion studies indicated partial dissociations between brain regions supporting temporal- and effort-based decision-making. Another debate is whether options involving low and high costs are processed in different brain substrates (dual-system) or in the same regions (single-system). This research addressed these issues using coordinate-based, connectivity-based, and activation network-based meta-analyses to identify overlapping and separable neural systems supporting temporal (39 studies) and effort (20 studies) discounting. Coordinate-based activation likelihood estimation and resting-state connectivity analyses showed immediate-small reward and delayed-large reward choices engaged distinct regions with unique connectivity profiles, but their activation network mapping was found to engage the default mode network. For effort discounting, salience and sensorimotor networks supported low-effort choices, while the frontoparietal network supported high-effort choices. There was little overlap between the temporal and effort networks. Our findings underscore the importance of differentiating different types of costs in decision-making and understanding discounting at both regional and network levels.

Activation of Ventral Pallidum CaMKIIa-Expressing Neurons Promotes Wakefulness

The ventral pallidum (VP) is involved in the regulation of a variety of behaviors such as motor, reward, and behavioral motivation, and the ability to perform these functions properly is dependent on a high degree of wakefulness. It is unknown whether VP CaMKIIa-expression (VP^CaMKIIa) neurons also have a role in sleep-wake regulation and related neuronal circuit mechanisms. In the present experiment, we first used in vivo fiber photometry to find the population activity of VP^CaMKIIa neurons which increased during the transitions from non-rapid-eye movement (NREM) sleep to wakefulness and NREM sleep to rapid-eye-movement (REM) sleep, with decreased during the transitions from wakefulness to NREM sleep. Then chemogenetic activation of VP^CaMKIIa neurons induced an increase in wakefulness that lasted for 2 h. Mice that were exposed to short-term optogenetic stimulation woke up quickly from stable NREM sleep, and long-term optogenetic stimulation maintained wakefulness. In addition, optogenetic activation of the axons of VP^CaMKIIa neurons in the lateral habenula (LHb) also facilitated the initiation and maintenance of wakefulness and mediated anxiety-like behavior. Finally, the method of chemogenetic inhibition was employed to suppress VP^CaMKIIa neurons, and yet, inhibition of VP^CaMKIIa neuronal activity did not result in an increase in NREM sleep and a decrease in wakefulness. Overall, our data illustrate that the activation of VP^CaMKIIa neurons is of great importance for promoting wakefulness.

Critical review of RDoC approaches to the study of motivation with animal models: effort valuation/willingness to work

The NIMH research domain criteria (RDoC) approach was instigated to refocus mental health research on the neural circuits that mediate psychological functions, with the idea that this would foster an understanding of the neural basis of specific psychiatric dysfunctions (i.e. 'symptoms and circuits') and ultimately facilitate treatment. As a general idea, this attempt to go beyond traditional diagnostic categories and focus on neural circuit dysfunctions related to specific symptoms spanning multiple disorders has many advantages. For example, motivational dysfunctions are present in multiple disorders, including depression, schizophrenia, Parkinson's disease, and other conditions. A critical aspect of motivation is effort valuation/willingness to work, and several clinical studies have identified alterations in effort-based decision making in various patient groups. In parallel, formal animal models focusing on the exertion of effort and effort-based decision making have been developed. This paper reviews the literature on models of effort-based motivational function in the context of a discussion of the RDoC approach, with an emphasis on the dissociable nature of distinct aspects of motivation. For example, conditions associated with depression and schizophrenia blunt the selection of high-effort activities as measured by several tasks in animal models (e.g. lever pressing, barrier climbing, wheel running). Nevertheless, these manipulations also leave fundamental aspects of hedonic reactivity, food motivation, and reinforcement intact. This pattern of effects demonstrates that the general emphasis of the RDoC on the specificity of the neural circuits mediating behavioral pathologies, and the dissociative nature of these dysfunctions, is a valid concept. Nevertheless, the specific placement of effort-related processes as simply a 'sub-construct' of 'reward processing' is empirically and conceptually problematic. Thus, while the RDoC is an excellent general framework for new ways to approach research and therapeutics, it still needs further refinement.

Neural circuits provide insights into reward and aversion

Maladaptive changes in the neural circuits associated with reward and aversion result in some common symptoms, such as drug addiction, anxiety, and depression. Historically, the study of these circuits has been hampered by technical limitations. In recent years, however, much progress has been made in understanding the neural mechanisms of reward and aversion owing to the development of technologies such as cell type-specific electrophysiology, neuronal tracing, and behavioral manipulation based on optogenetics. The aim of this paper is to summarize the latest findings on the mechanisms of the neural circuits associated with reward and aversion in a review of previous studies with a focus on the ventral tegmental area (VTA), nucleus accumbens (NAc), and basal forebrain (BF). These findings may inform efforts to prevent and treat mental illnesses associated with dysfunctions of the brain's reward and aversion system.

Neural correlates and potential targets for the contribution of orexin to addiction in cortical and subcortical areas

The orexin (hypocretin) is one of the hypothalamic neuropeptides that plays a critical role in some behaviors including feeding, sleep, arousal, reward processing, and drug addiction. This variety of functions can be described by a united function for orexins in translating states of heightened motivation, for example during physiological requirement states or following exposure to reward opportunities, into planned goal-directed behaviors. An addicted state is characterized by robust activation of orexin neurons from the environment, which triggers downstream circuits to facilitate behavior directed towards obtaining the drug. Two orexin receptors 1 (OX1R) and 2 (OX2R) are widely distributed in the brain. Here, we will introduce and describe the cortical and subcortical brain areas involved in addictive-like behaviors and the impact of orexin on addiction.

Role of the striatal dopamine, GABA and opioid systems in mediating feeding and fat intake

Food intake, which is a highly reinforcing behavior, provides nutrients required for survival in all animals. However, when fat and sugar consumption goes beyond the daily needs, it can favor obesity. The prevalence and severity of this health problem has been increasing with time. Besides covering nutrient and energy needs, food and in particular its highly palatable components, such as fats, also induce feelings of joy and pleasure. Experimental evidence supports a role of the striatal complex and of the mesolimbic dopamine system in both feeding and food-related reward processing, with the nucleus accumbens as a key target for reward or reinforcing-associated signaling during food intake behavior. In this review, we provide insights concerning the impact of feeding, including fat intake, on different types of receptors and neurotransmitters present in the striatal complex. Reciprocally, we also cover the evidence for a modulation of palatable food intake by different neurochemical systems in the striatal complex and in particular the nucleus accumbens, with a focus on dopamine, GABA and the opioid system.

How changes in dopamine D2 receptor levels alter striatal circuit function and motivation

It was first posited, more than five decades ago, that the etiology of schizophrenia involves overstimulation of dopamine receptors. Since then, advanced clinical research methods, including brain imaging, have refined our understanding of the relationship between striatal dopamine and clinical phenotypes as well as disease trajectory. These studies point to striatal dopamine D2 receptors, the main target for all current antipsychotic medications, as being involved in both positive and negative symptoms. Simultaneously, animal models have been central to investigating causal relationships between striatal dopamine D2 receptors and behavioral phenotypes relevant to schizophrenia. We begin this article by reviewing the circuit, cell-type and subcellular locations of dopamine D2 receptors and their downstream signaling pathways. We then summarize results from several mouse models in which D2 receptor levels were altered in various brain regions, cell-types and developmental periods. Behavioral, electrophysiological and anatomical consequences of these D2 receptor perturbations are reviewed with a selective focus on striatal circuit function and alterations in motivated behavior, a core negative symptom of schizophrenia. These studies show that D2 receptors serve distinct physiological roles in different cell types and at different developmental time points, regulating motivated behaviors in sometimes opposing ways. We conclude by considering the clinical implications of this complex regulation of striatal circuit function by D2 receptors.

Ventral pallidum regulates the default mode network, controlling transitions between internally and externally guided behavior

Daily life requires transitions between performance of well-practiced, automatized behaviors reliant upon internalized representations and behaviors requiring external focus. Such transitions involve differential activation of the default mode network (DMN), a group of brain areas associated with inward focus. We asked how optogenetic modulation of the ventral pallidum (VP), a subcortical DMN node, impacts task switching between internally to externally guided lever-pressing behavior in the rat. Excitation of the VP dramatically compromised acquisition of an auditory discrimination task, trapping animals in a DMN state of automatized internally focused behavior and impairing their ability to direct attention to external sensory stimuli. VP inhibition, on the other hand, facilitated task acquisition, expediting escape from the DMN brain state, thereby allowing rats to incorporate the contingency changes associated with the auditory stimuli. We suggest that VP, instant by instant, regulates the DMN and plays a deterministic role in transitions between internally and externally guided behaviors.

Decoding the Role of Gut-Microbiome in the Food Addiction Paradigm

Eating behaviour is characterised by a solid balance between homeostatic and hedonic regulatory mechanisms at the central level and highly influenced by peripheral signals. Among these signals, those generated by the gut microbiota have achieved relevance in recent years. Despite this complex regulation, under certain circumstances eating behaviour can be deregulated becoming addictive. Although there is still an ongoing debate about the food addiction concept, studies agree that patients with eating addictive behaviour present similar symptoms to those experienced by drug addicts, by affecting central areas involved in the control of motivated behaviour. In this context, this review tries to summarise the main data regarding the role of the gut microbiome in eating behaviour and how a gut dysbiosis can be responsible for a maladaptive behaviour such as “food addiction”.

Not Just a Bystander: The Emerging Role of Astrocytes and Research Tools in Studying Cognitive Dysfunctions in Schizophrenia

Cognitive dysfunction is one of the core symptoms in schizophrenia, and it is predictive of functional outcomes and therefore useful for treatment targets. Rather than improving cognitive deficits, currently available antipsychotics mainly focus on positive symptoms, targeting dopaminergic/serotoninergic neurons and receptors in the brain. Apart from investigating the neural mechanisms underlying schizophrenia, emerging evidence indicates the importance of glial cells in brain structure development and their involvement in cognitive functions. Although the etiopathology of astrocytes in schizophrenia remains unclear, accumulated evidence reveals that alterations in gene expression and astrocyte products have been reported in schizophrenic patients. To further investigate the role of astrocytes in schizophrenia, we highlighted recent progress in the investigation of the effect of astrocytes on abnormalities in glutamate transmission and impairments in the blood–brain barrier. Recent advances in animal models and behavioral methods were introduced to examine schizophrenia-related cognitive deficits and negative symptoms. We also highlighted several experimental tools that further elucidate the role of astrocytes. Instead of focusing on schizophrenia as a neuron-specific disorder, an additional astrocytic perspective provides novel and promising insight into its causal mechanisms and treatment. The involvement of astrocytes in the pathogenesis of schizophrenia and other brain disorders is worth further investigation.

Ventral Pallidum GABA Neurons Mediate Motivation Underlying Risky Choice

Pursuing rewards while avoiding danger is an essential function of any nervous system. Here, we examine a new mechanism helping rats negotiate the balance between risk and reward when making high-stakes decisions. Specifically, we focus on GABA neurons within an emerging mesolimbic circuit nexus: the ventral pallidum (VP). These neurons play a distinct role from other VP neurons in simple motivated behaviors in mice, but their role in more complex motivated behaviors is unknown. Here, we interrogate the behavioral functions of VPGABA neurons in male and female transgenic GAD1:Cre rats (and WT littermates), using a reversible chemogenetic inhibition approach. Using a behavioral assay of risky decision-making, and of the food-seeking and shock-avoidance components of this task, we show that engaging inhibitory Gi/o signaling specifically in VPGABA neurons suppresses motivation to pursue highly salient palatable foods, and possibly also motivation to avoid being shocked. In contrast, inhibiting these neurons did not affect seeking of low-value food, free consumption of palatable food, or unconditioned affective responses to shock. Accordingly, when rats considered whether to pursue food despite potential for shock in a risky decision-making task, inhibiting VPGABA neurons caused them to more readily select a small but safe reward over a large but dangerous one, an effect not seen in the absence of shock threat. Together, results indicate that VPGABA neurons are critical for high-stakes adaptive responding that is necessary for survival, but which may also malfunction in psychiatric disorders.SIGNIFICANCE STATEMENT In a dynamic world, it is essential to implement appropriate behaviors under circumstances involving rewards, threats, or both. Here, we demonstrate a crucial role for VPGABA neurons in high-stakes motivated behavior of several types. We show that this VPGABA role in motivation impacts decision-making, as inhibiting these neurons yields a conservative, risk-averse strategy not seen when the task is performed without threat of shock. These new roles for VPGABA neurons in behavior may inform future strategies for treating addiction, and other disorders of maladaptive decision-making.

Interplay between Peripheral and Central Inflammation in Obesity-Promoted Disorders: The Impact on Synaptic Mitochondrial Functions

The metabolic dysfunctions induced by high fat diet (HFD) consumption are not limited to organs involved in energy metabolism but cause also a chronic low-grade systemic inflammation that affects the whole body including the central nervous system. The brain has been considered for a long time to be protected from systemic inflammation by the blood–brain barrier, but more recent data indicated an association between obesity and neurodegeneration. Moreover, obesity-related consequences, such as insulin and leptin resistance, mitochondrial dysfunction and reactive oxygen species (ROS) production, may anticipate and accelerate the physiological aging processes characterized by systemic inflammation and higher susceptibility to neurological disorders. Here, we discussed the link between obesity-related metabolic dysfunctions and neuroinflammation, with particular attention to molecules regulating the interplay between energetic impairment and altered synaptic plasticity, for instance AMP-activated protein kinase (AMPK) and Brain-derived neurotrophic factor (BDNF). The effects of HFD-induced neuroinflammation on neuronal plasticity may be mediated by altered brain mitochondrial functions. Since mitochondria play a key role in synaptic areas, providing energy to support synaptic plasticity and controlling ROS production, the negative effects of HFD may be more pronounced in synapses. In conclusion, it will be emphasized how HFD-induced metabolic alterations, systemic inflammation, oxidative stress, neuroinflammation and impaired brain plasticity are tightly interconnected processes, implicated in the pathogenesis of neurological diseases.

Roux-en-Y gastric bypass increases GABA-A receptor levels in regions of the rat brain involved in object recognition memory and perceptual acuity

Roux-en-Y gastric bypass surgery (RYGB), one of the most common and successful procedures for combatting obesity, is associated with post-surgery substance use disorder (SUD) and other addictive behaviors in a subset of patients. We investigated the effects of RYGB on GABA-A receptor levels in the rat brain to identify potential mechanisms of this behavior. The GABAergic system is affected in addiction and has been implicated in the pathology of obesity. We assigned male Sprague-Dawley rats to four groups: standard, low fat diet with sham surgery (control), ad libitum HFD with sham surgery (Sham), calorie restricted HFD with sham surgery (Sham-FR), or HFD with RYGB surgery. Surgery was performed after 8 weeks on the control or HFD diet. Rats maintained their respective diets for 9 weeks post-surgery, then were sacrificed for GABA-A receptor autoradiography using the [³H] Flunitrazepam ligand. We identified increased GABA-A binding in the perirhinal cortex of ad-libitum HFD fed rats compared to normal diet controls. RYGB surgery increased GABA-A in the ectorhinal cortex compared to normal diet controls, and increased binding in the jaw region of the primary somatosensory cortex compared to food-restricted rats that received sham surgery. Hypothalamus GABA-A was also negatively correlated with body weight in the RYGB group, where GABA signaling may play a role in obesity regulation. These results suggest that HFD and RYGB modulate GABA signaling in regions important for object recognition memory, and that increased GABA-A levels in the jaw's perceptual field cortex arise from the surgery itself, independent of caloric restriction.

Opposing Contributions of GABAergic and Glutamatergic Ventral Pallidal Neurons to Motivational Behaviors

The ventral pallidum (VP) is critical for invigorating reward seeking and is also involved in punishment avoidance, but how it contributes to such opposing behavioral actions remains unclear. Here, we show that GABAergic and glutamatergic VP neurons selectively control behavior in opposing motivational contexts. In vivo recording combined with optogenetics in mice revealed that these two populations oppositely encode positive and negative motivational value, are differentially modulated by animal's internal state, and determine the behavioral response during motivational conflict. Furthermore, GABAergic VP neurons are essential for movements toward reward in a positive motivational context but suppress movements in an aversive context. In contrast, glutamatergic VP neurons are essential for movements to avoid a threat but suppress movements in an appetitive context. Our results indicate that GABAergic and glutamatergic VP neurons encode the drive for approach and avoidance, respectively, with the balance between their activities determining the type of motivational behavior.

Orexin-1 Receptor Signaling in Ventral Pallidum Regulates Motivation for the Opioid Remifentanil

Signaling at the orexin-1 receptor (OxR1) is important for motivated drug taking. Using a within-session behavioral economics (BE) procedure, we previously found that pharmacologic blockade of the OxR1 decreased motivation (increased demand elasticity) for the potent and short-acting opioid remifentanil and reduced low-effort remifentanil consumption. However, the mechanism through which orexin regulates remifentanil demand is currently unknown. Previous work implicated OxR1 signaling within ventral pallidum (VP) as a potential target. VP is densely innervated by orexin fibers and is known to regulate opioid reward. Accordingly, this study sought to determine the role of VP OxR1 signaling in remifentanil demand and cue-induced reinstatement of remifentanil seeking in male rats. Intra-VP microinjections of the OxR1 antagonist SB-334867 (SB) decreased motivation (increased demand elasticity; α) for remifentanil without affecting remifentanil consumption at low effort. Baseline α values predicted the degree of cue-induced remifentanil seeking, and microinjection of SB into VP attenuated this behavior without affecting extinction responding. Baseline α values also predicted SB efficacy, such that SB was most effective in attenuating reinstatement behavior in highly motivated rats. Together, these findings support a selective role for VP OxR1 signaling in motivation for the opioid remifentanil. Our findings also highlight the utility of BE in predicting relapse propensity and efficacy of treatment with OxR1 antagonists.SIGNIFICANCE STATEMENT Abuse of opioids has risen rapidly and continues to be a major health crisis. Thus, there is an urgent need to better understand the neurobiological and behavioral mechanisms underlying opioid addiction. Here, we investigate the role of orexin-1 receptor signaling (OxR1) within ventral pallidum (VP) in remifentanil demand and cue-induced reinstatement of remifentanil seeking. Using a within-session behavioral economics procedure, we show that intra-VP microinjections of the OxR1 antagonist SB-334867 decreased motivation (increased demand elasticity) without affecting remifentanil consumption at low effort. We also found that SB microinjected intra-VP attenuated cue-induced reinstatement of remifentanil seeking. Together, our results support a role for VP OxR1 signaling in opioid reward.

Affective biases and their interaction with other reward-related deficits in rodent models of psychiatric disorders

Major depressive disorder (MDD) is one of the leading global causes of disability. Symptoms of MDD can vary person to person, and current treatments often fail to alleviate the poor quality of life that patients experience. One of the two core diagnostic criteria for MDD is the loss of interest in previously pleasurable activities, which suggests a link between the disease aetiology and reward processing. Cognitive impairments are also common in patients with MDD, and more recently, emotional processing deficits known as affective biases have been recognised as a key feature of the disorder. Studies in animals have found similar affective biases related to reward. In this review we consider these affective biases in the context of other reward-related deficits and examine how affective biases associated with learning and memory may interact with the wider behavioural symptoms seen in MDD. We discuss recent developments in how analogues of affective biases and other aspects of reward processing can be assessed in rodents, as well as how these behaviours are influenced in models of MDD. We subsequently discuss evidence for the neurobiological mechanisms contributing to one or more reward-related deficits in preclinical models of MDD, identified using these behavioural assays. We consider how the relationships between these selective behavioural assays and the neurobiological mechanisms for affective bias and reward processing could be used to identify potential treatment strategies.

The Psychopharmacology of Effort-Related Decision Making: Dopamine, Adenosine, and Insights into the Neurochemistry of Motivation

Effort-based decision making is studied using tasks that offer choices between high-effort options leading to more highly valued reinforcers versus low-effort/low-reward options. These tasks have been used to study the involvement of neural systems, including mesolimbic dopamine and related circuits, in effort-related aspects of motivation. Moreover, such tasks are useful as animal models of some of the motivational symptoms that are seen in people with depression, schizophrenia, Parkinson's disease, and other disorders. The present review will discuss the pharmacology of effort-related decision making and will focus on the use of these tasks for the development of drug treatments for motivational dysfunction. Research has identified pharmacological conditions that can alter effort-based choice and serve as models for depression-related symptoms (e.g., the vesicular monoamine transport-2 inhibitor tetrabenazine and proinflammatory cytokines). Furthermore, tests of effort-based choice have identified compounds that are particularly useful for stimulating high-effort work output and reversing the deficits induced by tetrabenazine and cytokines. These studies indicate that drugs that act by facilitating dopamine transmission, as well as adenosine A_2A antagonists, are relatively effective at reversing effort-related impairments. Studies of effort-based choice may lead to the identification of drug targets that could be useful for treating motivational treatments that are resistant to commonly used antidepressants such as serotonin transport inhibitors.

Wheat bran with enriched gamma-aminobutyric acid attenuates glucose intolerance and hyperinsulinemia induced by a high-fat diet

In this study, the level of gamma-aminobutyric acid (GABA) in wheat bran was increased to be six times higher through the action of endogenous glutamate decarboxylase compared with untreated bran. The process of GABA formation in wheat bran also led to an increased level of phenolic compounds with enhanced antioxidant capacity 2 times higher than the untreated status. The interventional effect of a diet containing GABA-enriched bran on hyperinsulinemia induced by a high-fat diet (HFD) was investigated in a rat model. The results showed that, when compared with animals fed with HFD-containing untreated bran (NB group), the consumption of HFD-containing GABA-enriched bran (GB group) demonstrated a greater improvement of insulin resistance/sensitivity as revealed by the changes in the homeostatic model assessment for insulin resistance index (HOMA-IR) and the quantitative insulin sensitivity check index (QUICKI). The expression of hepatic genes, cytochrome P450 family 7 subfamily A member 1 (Cyp7a1) and ubiquitin C (Ubc), which are involved in the adipogenesis-associated PPAR signalling pathway, was found to be significantly down-regulated in the GB group compared with the HFD group (P = 0.0055). Meanwhile, changes in the expression of a number of genes associated with lipid metabolism and gluconeogenesis were also noted in the GB group versus the HFD group, but not in the NB group, indicating different regulatory patterns between the two brans in a high-fat diet. More importantly, the analysis of key genes related to glucose metabolism further revealed that the expression of insulin-induced gene 1/2 (Insig-1/2) was increased following GB intervention with a corresponding reduction in phosphoenolpyruvate carboxykinase 1 (Pepck) and glucose-6-phosphatase, catalytic subunit (G6pc) expression, suggesting that glucose homeostasis is greatly improved through the intervention of GABA-enriched bran in the context of a high-fat diet.

Glutamatergic Ventral Pallidal Neurons Modulate Activity of the Habenula-Tegmental Circuitry and Constrain Reward Seeking

BACKGROUND

The ability to appropriately integrate and respond to rewarding and aversive stimuli is essential for survival. The ventral pallidum (VP) plays a critical role in processing both rewarding and aversive stimuli. However, the VP is a heterogeneous structure, and how VP subpopulations integrate into larger reward networks to ultimately modulate these behaviors is not known. We identify a noncanonical population of glutamatergic VP neurons that play a unique role in responding to aversive stimuli and constraining inappropriate reward seeking.

METHODS

Using neurochemical, genetic, and electrophysiological approaches, we characterized glutamatergic VP neurons (n = 4-8 mice/group). We performed patch clamp and in vivo electrophysiology recordings in the lateral habenula, rostromedial tegmental nucleus, and ventral tegmental area to determine the effect of glutamatergic VP neuron activation in these target regions (n = 6-10 mice/group). Finally, we selectively optogenetically stimulated glutamatergic VP neurons in a real-time place preference task and ablated these neurons using a virally expressed caspase to determine their necessity for reward seeking.

RESULTS

Glutamatergic VP neurons exhibit little overlap with cholinergic or gamma-aminobutyric acidergic markers, the canonical VP subtypes, and exhibit distinct membrane properties. Glutamatergic VP neurons innervate and increase firing activity of the lateral habenula, rostromedial tegmental nucleus, and gamma-aminobutyric acidergic ventral tegmental area neurons. While nonselective optogenetic stimulation of the VP induced a robust place preference, selective activation of glutamatergic VP neurons induced a place avoidance. Viral ablation of glutamatergic VP neurons increased reward responding and abolished taste aversion to sucrose.

CONCLUSIONS

Glutamatergic VP neurons constitute a noncanonical subpopulation of VP neurons. These glutamatergic VP neurons increase activity of the lateral habenula, rostromedial tegmental nucleus, and gamma-aminobutyric acidergic ventral tegmental area neurons and adaptively constrain reward seeking.

Dopamine, Effort-Based Choice, and Behavioral Economics: Basic and Translational Research

Operant behavior is not only regulated by factors related to the quality or quantity of reinforcement, but also by the work requirements inherent in performing instrumental actions. Moreover, organisms often make effort-related decisions involving economic choices such as cost/benefit analyses. Effort-based decision making is studied using behavioral procedures that offer choices between high-effort options leading to relatively preferred reinforcers vs. low effort/low reward choices. Several neural systems, including the mesolimbic dopamine (DA) system and other brain circuits, are involved in regulating effort-related aspects of motivation. Considerable evidence indicates that mesolimbic DA transmission exerts a bi-directional control over exertion of effort on instrumental behavior tasks. Interference with DA transmission produces a low-effort bias in animals tested on effort-based choice tasks, while increasing DA transmission with drugs such as DA transport blockers tends to enhance selection of high-effort options. The results from these pharmacology studies are corroborated by the findings from recent articles using optogenetic, chemogenetic and physiological techniques. In addition to providing important information about the neural regulation of motivated behavior, effort-based choice tasks are useful for developing animal models of some of the motivational symptoms that are seen in people with various psychiatric and neurological disorders (e.g., depression, schizophrenia, Parkinson’s disease). Studies of effort-based decision making may ultimately contribute to the development of novel drug treatments for motivational dysfunction.

Accumbens dopamine D2 receptors increase motivation by decreasing inhibitory transmission to the ventral pallidum

Dopamine D2 receptors (D2Rs) in the nucleus accumbens (NAc) regulate motivated behavior, but the underlying neurobiological mechanisms remain unresolved. Here, we show that selective upregulation of D2Rs in the indirect pathway of the adult NAc enhances the willingness to work for food. Mechanistic studies in brain slices reveal that D2R upregulation attenuates inhibitory transmission at two main output projections of the indirect pathway, the classical long-range projections to the ventral pallidum (VP), as well as local collaterals to direct pathway medium spiny neurons. In vivo physiology confirms the reduction in indirect pathway inhibitory transmission to the VP, and inhibition of indirect pathway terminals to VP is sufficient to enhance motivation. In contrast, D2R upregulation in the indirect pathway does not disinhibit neuronal activity of the direct pathway in vivo. These data suggest that D2Rs in ventral striatal projection neurons promote motivation by weakening the canonical output to the ventral pallidum.

Assessment of a glycine uptake inhibitor in animal models of effort-related choice behavior: implications for motivational dysfunctions

RATIONALE

Motivated behavior can be characterized by a substantial exertion of effort, and organisms often make effort-related decisions based upon analyses of work-related response costs and reinforcement preference. Moreover, alterations in effort-based choice can be seen in people with major depression and schizophrenia. Effort-related decision making is studied using tasks offering choices between high effort options leading to highly valued reinforces vs low effort/low reward options. Interference with dopamine (DA) transmission by administration of the DA D2 family antagonist haloperidol biases behavior towards the lower effort option that can be obtained with minimal work, and previous research has shown that DA interacts with other transmitters, including adenosine and GABA, to regulate effort-based choice.

OBJECTIVES

The present studies focused upon the ability of the glycine transport inhibitor bitopertin to attenuate haloperidol-induced shifts in effort-related choice behavior.

METHODS

Effort-based choice in rats was assessed using the concurrent fixed ratio (FR) 5/chow feeding choice task and the T-maze barrier choice procedure.

RESULTS

Haloperidol shifted effort-based choice, biasing animals towards the low effort option in each task. Co-administration of bitopertin (1.0-10.0 mg/kg) significantly attenuated haloperidol-induced shifts in choice behavior, but the same doses of bitopertin had no effect when administered alone.

CONCLUSIONS

These results indicated that elevation of extracellular glycine via inhibition of glycine uptake was able to reverse the effects of D2 antagonism. Increases in extracellular glycine, possibly through actions on the glycine allosteric site on the NMDA receptor, may be a useful strategy for treating motivational dysfunctions in humans.

Vasopressinergic Neurocircuitry Regulating Social Attachment in a Monogamous Species

The prairie vole (Microtus ochrogaster) is a socially monogamous rodent species that forms a lasting connection between mates, known as a pair bond. The pair bond is primarily characterized by three distinct behaviors: partner preference, selective aggression, and biparental care of the young. The presence of these behaviors in the prairie vole and their absence in closely related non-monogamous species makes the prairie vole an important model of social relationships and facilitates the study of the neurobiological mechanisms of social affiliation and attachment. The nona-peptide arginine-vasopressin (AVP) is an important neuromodulator of social behavior and has been implicated in the regulation of the pair bond-related behaviors of the prairie vole, through activation of the AVP receptor subtype 1a (AVPR1a). Modulation of AVPR1a activity in different regions of the prairie vole brain impacts pair bond behavior, suggesting a role of AVP in neurocircuitry responsible for the regulation of social attachment. This review will discuss findings that have suggested the role of AVP in regulation of the pair bond-related behaviors of the prairie vole and the specific brain regions through which AVP acts to impact these unique behaviors.

Neural substrates underlying effort, time, and risk-based decision making in motivated behavior

All mobile organisms rely on adaptive motivated behavior to overcome the challenges of living in an environment in which essential resources may be limited. A variety of influences ranging from an organism's environment, experiential history, and physiological state all influence a cost-benefit analysis which allows motivation to energize behavior and direct it toward specific goals. Here we review the substantial amount of research aimed at discovering the interconnected neural circuits which allow organisms to carry-out the cost-benefit computations which allow them to behave in adaptive ways. We specifically focus on how the brain deals with different types of costs, including effort requirements, delays to reward and payoff riskiness. An examination of this broad literature highlights the importance of the extended neural circuits which enable organisms to make decisions about these different types of costs. This involves Cortical Structures, including the Anterior Cingulate Cortex (ACC), the Orbital Frontal Cortex (OFC), the Infralimbic Cortex (IL), and prelimbic Cortex (PL), as well as the Baso-Lateral Amygdala (BLA), the Nucleus Accumbens (NAcc), the Ventral Pallidal (VP), the Sub Thalamic Nucleus (STN) among others. Some regions are involved in multiple aspects of cost-benefit computations while the involvement of other regions is restricted to information relating to specific types of costs.

To work or not to work: Neural representation of cost and benefit of instrumental action

By definition, instrumental actions are performed in order to obtain certain goals. Nevertheless, the attainment of goals typically implies obstacles, and response vigor is known to reflect an integration of subjective benefit and cost. Whereas several brain regions have been associated with cost/benefit ratio decision-making, trial-by-trial fluctuations in motivation are not well understood. We review recent evidence supporting the motivational implications of signal fluctuations in the mesocorticolimbic system. As an extension of "set-point" theories of instrumental action, we propose that response vigor is determined by a rapid integration of brain signals that reflect value and cost on a trial-by-trial basis giving rise to an online estimate of utility. Critically, we posit that fluctuations in key nodes of the network can predict deviations in response vigor and that variability in instrumental behavior can be accounted for by models devised from optimal control theory, which incorporate the effortful control of noise. Notwithstanding, the post hoc analysis of signaling dynamics has caveats that can effectively be addressed in future research with the help of two novel fMRI imaging techniques. First, adaptive fMRI paradigms can be used to establish a time-order relationship, which is a prerequisite for causality, by using observed signal fluctuations as triggers for stimulus presentation. Second, real-time fMRI neurofeedback can be employed to induce predefined brain states that may facilitate benefit or cost aspects of instrumental actions. Ultimately, understanding temporal dynamics in brain networks subserving response vigor holds the promise for targeted interventions that could help to readjust the motivational balance of behavior.

Activational and effort-related aspects of motivation: neural mechanisms and implications for psychopathology

Motivation has been defined as the process that allows organisms to regulate their internal and external environment, and control the probability, proximity and availability of stimuli. As such, motivation is a complex process that is critical for survival, which involves multiple behavioural functions mediated by a number of interacting neural circuits. Classical theories of motivation suggest that there are both directional and activational aspects of motivation, and activational aspects (i.e. speed and vigour of both the instigation and persistence of behaviour) are critical for enabling organisms to overcome work-related obstacles or constraints that separate them from significant stimuli. The present review discusses the role of brain dopamine and related circuits in behavioural activation, exertion of effort in instrumental behaviour, and effort-related decision-making, based upon both animal and human studies. Impairments in behavioural activation and effort-related aspects of motivation are associated with psychiatric symptoms such as anergia, fatigue, lassitude and psychomotor retardation, which cross multiple pathologies, including depression, schizophrenia, and Parkinson's disease. Therefore, this review also attempts to provide an interdisciplinary approach that integrates findings from basic behavioural neuroscience, behavioural economics, clinical neuropsychology, psychiatry, and neurology, to provide a coherent framework for future research and theory in this critical field. Although dopamine systems are a critical part of the brain circuitry regulating behavioural activation, exertion of effort, and effort-related decision-making, mesolimbic dopamine is only one part of a distributed circuitry that includes multiple neurotransmitters and brain areas. Overall, there is a striking similarity between the brain areas involved in behavioural activation and effort-related processes in rodents and in humans. Animal models of effort-related decision-making are highly translatable to humans, and an emerging body of evidence indicates that alterations in effort-based decision-making are evident in several psychiatric and neurological disorders. People with major depression, schizophrenia, and Parkinson's disease show evidence of decision-making biases towards a lower exertion of effort. Translational studies linking research with animal models, human volunteers, and clinical populations are greatly expanding our knowledge about the neural basis of effort-related motivational dysfunction, and it is hoped that this research will ultimately lead to improved treatment for motivational and psychomotor symptoms in psychiatry and neurology.

A high-fat diet decreases GABA concentration in the frontal cortex and hippocampus of rats

BACKGROUND

It has been proposed that the γ-aminobutyric acid (GABA) plays a key role in the regulation of food intake and body weight by controlling the excitability, plasticity and the synchronization of neuronal activity in the frontal cortex (FC). It has been also proposed that the high-fat diet (HFD) could disturb the metabolism of glutamate and consequently the GABA levels, but the mechanism is not yet clearly understood. Therefore, the aim of this study was to investigate the effect of a HFD on the GABA levels in the FC and hippocampus of rats.

RESULTS

The HFD significantly increased weight gain and blood glucose levels, whereas decreased the GABA levels in the FC and hippocampus compared with standard diet-fed rats.

CONCLUSIONS

HFD decreases GABA levels in the FC and hippocampus of rat, which likely disrupts the GABAergic inhibitory processes, underlying feeding behavior.

The pharmacology of effort-related choice behavior: Dopamine, depression, and individual differences

This review paper is focused upon the involvement of mesolimbic dopamine (DA) and related brain systems in effort-based processes. Interference with DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task, such that rats with impaired DA transmission show a heightened sensitivity to ratio requirements. Impaired DA transmission also affects effort-related choice behavior, which is assessed by tasks that offer a choice between a preferred reinforcer that has a high work requirement vs. less preferred reinforcer that can be obtained with minimal effort. Rats and mice with impaired DA transmission reallocate instrumental behavior away from food-reinforced tasks with high response costs, and show increased selection of low reinforcement/low cost options. Tests of effort-related choice have been developed into models of pathological symptoms of motivation that are seen in disorders such as depression and schizophrenia. These models are being employed to explore the effects of conditions associated with various psychopathologies, and to assess drugs for their potential utility as treatments for effort-related symptoms. Studies of the pharmacology of effort-based choice may contribute to the development of treatments for symptoms such as psychomotor slowing, fatigue or anergia, which are seen in depression and other disorders.

Neurobiological basis of motivational deficits in psychopathology

In recent years, there has been increasing emphasis on the importance of motivational symptoms in depression, schizophrenia and other disorders. The present review discusses the conceptual background related to the construct of motivation, and provides a framework that for research on both physiological and pathological aspects of motivation. Particular emphasis is placed on what is known about the neurobiological basis of activational aspects of motivation, including studies from animal models. The role of limbic/prefrontal/striatal circuitry in behavioral activation and effort-related functions is examined, and the utility of behavioral tasks of effort-based decision making as models of motivational symptoms is discussed. We also review the neurobiology of motivational symptoms in relation to psychopathology, and issues related to the language used to characterize motivational dysfunctions are considered. The literature suggests that research on the neurobiology of motivational dysfunction in psychopathology, at both clinical and preclinical levels, could inform the development of novel and more effective treatments for a range of CNS disorders.

The ventral pallidum: Subregion-specific functional anatomy and roles in motivated behaviors

The ventral pallidum (VP) plays a critical role in the processing and execution of motivated behaviors. Yet this brain region is often overlooked in published discussions of the neurobiology of mental health (e.g., addiction, depression). This contributes to a gap in understanding the neurobiological mechanisms of psychiatric disorders. This review is presented to help bridge the gap by providing a resource for current knowledge of VP anatomy, projection patterns and subregional circuits, and how this organization relates to the function of VP neurons and ultimately behavior. For example, ventromedial (VPvm) and dorsolateral (VPdl) VP subregions receive projections from nucleus accumbens shell and core, respectively. Inhibitory GABAergic neurons of the VPvm project to mediodorsal thalamus, lateral hypothalamus, and ventral tegmental area, and this VP subregion helps discriminate the appropriate conditions to acquire natural rewards or drugs of abuse, consume preferred foods, and perform working memory tasks. GABAergic neurons of the VPdl project to subthalamic nucleus and substantia nigra pars reticulata, and this VP subregion is modulated by, and is necessary for, drug-seeking behavior. Additional circuits arise from nonGABAergic neuronal phenotypes that are likely to excite rather than inhibit their targets. These subregional and neuronal phenotypic circuits place the VP in a unique position to process motivationally relevant stimuli and coherent adaptive behaviors.

The VMAT-2 inhibitor tetrabenazine alters effort-related decision making as measured by the T-maze barrier choice task: reversal with the adenosine A2A antagonist MSX-3 and the catecholamine uptake blocker bupropion

RATIONALE

Depressed people show effort-related motivational symptoms, such as anergia, retardation, lassitude, and fatigue. Animal tests can model these motivational symptoms, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine. Tetrabenazine produces depressive symptoms in humans and, at low doses, preferentially depletes dopamine.

OBJECTIVES

The current studies investigated the effects of tetrabenazine on effort-based decision making using the T-maze barrier task.

METHODS

Rats were tested in a T-maze in which the choice arms of the maze contain different reinforcement densities, and under some conditions, a vertical barrier was placed in the high-density arm to provide an effort-related challenge. The first experiment assessed the effects of tetrabenazine under different maze conditions: a barrier in the arm with 4 food pellets and 2 pellets in the no barrier arm (4-2 barrier), 4 pellets in one arm and 2 pellets in the other with no barrier in either arm (no barrier), and 4 pellets in the barrier arm with no pellets in the other (4-0 barrier).

RESULTS

Tetrabenazine (0.25-0.75 mg/kg IP) decreased selection of the high cost/high reward arm when the barrier was present, but had no effect on choice under the no barrier and 4-0 barrier conditions. The effects of tetrabenazine on barrier climbing in the 4-2 condition were reversed by the adenosine A2A antagonist MSX-3 and the catecholamine uptake inhibitor and antidepressant bupropion.

CONCLUSIONS

These studies have implications for the development of animal models of the motivational symptoms of depression and other disorders.

Direct hypothalamic and indirect trans-pallidal, trans-thalamic, or trans-septal control of accumbens signaling and their roles in food intake

Due in part to the increasing incidence of obesity in developed nations, recent research aims to elucidate neural circuits that motivate humans to overeat. Earlier research has described how the nucleus accumbens shell (AcbSh) motivates organisms to feed by activating neuronal populations in the lateral hypothalamus (LH). However, more recent research suggests that the LH may in turn communicate with the AcbSh, both directly and indirectly, to re-tune the motivation to consume foods with homeostatic and food-related sensory signals. Here, we discuss the functional and anatomical evidence for an LH to AcbSh connection and its role in eating behaviors. The LH appears to modulate Acb activity directly, using neurotransmitters such as hypocretin/orexin or melanin concentrating hormone (MCH). The LH also indirectly regulates AcbSh activity through certain subcortical "relay" regions, such as the lateral septum (LS), ventral pallidum (VP), and paraventricular thalamus, using a variety of neurotransmitters. This review aims to summarize studies on these topics and outline a model by which LH circuits processing energy balance can modulate AcbSh neural activity to regulate feeding behavior.

Mesolimbic Dopamine and the Regulation of Motivated Behavior

It has been known for some time that nucleus accumbens dopamine (DA) is involved in aspects of motivation , but theoretical approaches to understanding the functions of DA have continued to evolve based upon emerging data and novel concepts. Although it has become traditional to label DA neurons as "reward" neurons, the actual findings are more complicated than that, because they indicate that DA neurons can respond to a variety of motivationally significant stimuli. Moreover, it is important to distinguish between aspects of motivation that are differentially affected by dopaminergic manipulations. Studies that involve nucleus accumbens DA antagonism or depletion indicate that accumbens DA does not mediate primary food motivation or appetite. Nevertheless, DA is involved in appetitive and aversive motivational processes including behavioral activation , exertion of effort, sustained task engagement, and Pavlovian-to-instrumental transfer. Interference with accumbens DA transmission affects instrumental behavior in a manner that interacts with the response requirements of the task and also shifts effort-related choice behavior, biasing animals toward low-effort alternatives. Dysfunctions of mesolimbic DA may contribute to motivational symptoms seen in various psychopathologies, including depression , schizophrenia, parkinsonism, and other disorders.

The VMAT-2 inhibitor tetrabenazine affects effort-related decision making in a progressive ratio/chow feeding choice task: reversal with antidepressant drugs

Behavioral activation is a fundamental feature of motivation, and organisms frequently make effort-related decisions based upon evaluations of reinforcement value and response costs. Furthermore, people with major depression and other disorders often show anergia, psychomotor retardation, fatigue, and alterations in effort-related decision making. Tasks measuring effort-based decision making can be used as animal models of the motivational symptoms of depression, and the present studies characterized the effort-related effects of the vesicular monoamine transport (VMAT-2) inhibitor tetrabenazine. Tetrabenazine induces depressive symptoms in humans, and also preferentially depletes dopamine (DA). Rats were assessed using a concurrent progressive ratio (PROG)/chow feeding task, in which they can either lever press on a PROG schedule for preferred high-carbohydrate food, or approach and consume a less-preferred lab chow that is freely available in the chamber. Previous work has shown that the DA antagonist haloperidol reduced PROG work output on this task, but did not reduce chow intake, effects that differed substantially from those of reinforcer devaluation or appetite suppressant drugs. The present work demonstrated that tetrabenazine produced an effort-related shift in responding on the PROG/chow procedure, reducing lever presses, highest ratio achieved and time spent responding, but not reducing chow intake. Similar effects were produced by administration of the subtype selective DA antagonists ecopipam (D1) and eticlopride (D2), but not by the cannabinoid CB1 receptor neutral antagonist and putative appetite suppressant AM 4413, which suppressed both lever pressing and chow intake. The adenosine A_2A antagonist MSX-3, the antidepressant and catecholamine uptake inhibitor bupropion, and the MAO-B inhibitor deprenyl, all reversed the impairments induced by tetrabenazine. This work demonstrates the potential utility of the PROG/chow procedure as a rodent model of the effort-related deficits observed in depressed patients.

Decreased basal ganglia activation in subjects with chronic fatigue syndrome: association with symptoms of fatigue

Reduced basal ganglia function has been associated with fatigue in neurologic disorders, as well as in patients exposed to chronic immune stimulation. Patients with chronic fatigue syndrome (CFS) have been shown to exhibit symptoms suggestive of decreased basal ganglia function including psychomotor slowing, which in turn was correlated with fatigue. In addition, CFS patients have been found to exhibit increased markers of immune activation. In order to directly test the hypothesis of decreased basal ganglia function in CFS, we used functional magnetic resonance imaging to examine neural activation in the basal ganglia to a reward-processing (monetary gambling) task in a community sample of 59 male and female subjects, including 18 patients diagnosed with CFS according to 1994 CDC criteria and 41 non-fatigued healthy controls. For each subject, the average effect of winning vs. losing during the gambling task in regions of interest (ROI) corresponding to the caudate nucleus, putamen, and globus pallidus was extracted for group comparisons and correlational analyses. Compared to non-fatigued controls, patients with CFS exhibited significantly decreased activation in the right caudate (p = 0.01) and right globus pallidus (p = 0.02). Decreased activation in the right globus pallidus was significantly correlated with increased mental fatigue (r² = 0.49, p = 0.001), general fatigue (r² = 0.34, p = 0.01) and reduced activity (r² = 0.29, p = 0.02) as measured by the Multidimensional Fatigue Inventory. No such relationships were found in control subjects. These data suggest that symptoms of fatigue in CFS subjects were associated with reduced responsivity of the basal ganglia, possibly involving the disruption of projections from the globus pallidus to thalamic and cortical networks.

Designer receptors show role for ventral pallidum input to ventral tegmental area in cocaine seeking

Ventral pallidum (VP) is centrally positioned within mesocorticolimbic reward circuits, and its dense projection to ventral tegmental area (VTA) regulates neuronal activity there. However, VP is a heterogeneous structure, and how this complexity affects its role within wider reward circuits is unclear. Here we demonstrate that projections to VTA from rostral (RVP), but not caudal VP (CVP) are robustly Fos-activated during cue-induced reinstatement of cocaine seeking—a rat model of relapse in addiction. Moreover, designer receptor-mediated transient inactivation of RVP neurons, their terminals in VTA, or functional connectivity between RVP and VTA dopamine neurons blocks the ability of drug-associated cues (but not a cocaine prime) to reinstate cocaine seeking. In contrast, CVP neuronal inhibition instead blocked cocaine-primed, but not cue-induced reinstatement. This novel double dissociation in VP sub-regional roles in drug seeking is likely important for understanding mesocorticolimbic circuits underlying reward seeking and addiction.

Effort-related motivational effects of the pro-inflammatory cytokine interleukin 1-beta: studies with the concurrent fixed ratio 5/ chow feeding choice task

RATIONALE

Effort-related motivational symptoms such as anergia and fatigue are common in patients with depression and other disorders. Research implicates pro-inflammatory cytokines in depression, and administration of cytokines can induce effort-related motivational symptoms in humans.

OBJECTIVES

The present experiments focused on the effects of the pro-inflammatory cytokine interleukin 1-beta (IL-1β) on effort-related choice behavior.

METHODS

Rats were tested on a concurrent fixed ratio 5 lever pressing/chow feeding choice procedure, which assesses the tendency of rats to work for a preferred food (high carbohydrate pellets) in the presence of a concurrently available but less preferred substitute (laboratory chow).

RESULTS

IL-1β (1.0-4.0 μg/kg IP) shifted choice behavior, significantly decreasing lever pressing and increasing intake of the freely available chow. The second experiment assessed the ability of the adenosine A2A antagonist (E)-phosphoric acid mono-[3-[8-[2-(3-methoxyphenyl)vinyl]-7-methyl-2,6-dioxo-1-prop-2-ynyl-1,2,6,7-tetrahydropurin-3-yl] propyl] ester disodium salt (MSX-3) to reverse the behavioral effects of IL-1β. MSX-3 attenuated the effort-related impairments produced by IL-1β, increasing lever pressing and also decreasing chow intake. In the same dose range that shifted effort-related choice behavior, IL-1β did not alter food intake or preference in parallel free-feeding choice studies, indicating that these low doses were not generally suppressing appetite or altering preference for the high carbohydrate pellets. In addition, IL-1β did not affect core body temperature.

CONCLUSIONS

These results indicate that IL-1β can reduce the tendency to work for food, even at low doses that do not produce a general sickness, malaise, or loss of appetite. This research has implications for the involvement of cytokines in motivational symptoms such as anergia and fatigue.

Diverse sources of reward value signals in the basal ganglia nuclei transmitted to the lateral habenula in the monkey

The lateral habenula (LHb) plays an important role in motivational decision making. Neurons in the primate LHb signal negative ‘reward prediction errors’ and inhibit midbrain dopamine (DA) neurons. These negative reward prediction error signals in the LHb are, at least partly, provided by a distinct group of neurons in the border region of the globus pallidus internal segment (GPb). However, it is still unclear whether other basal ganglia nuclei provide the LHb with reward signals, either through the GPb or through different circuits. As a first step to answer this question, we electrically stimulated various parts of the basal ganglia and monitored the neural activity in the LHb in the awake monkey. First, we found that low intensity stimulations in the GPb and the internal segment of the globus pallidus (GPi) evoked a short latency (5 ms) excitatory response in LHb neurons. Second, LHb neurons were inhibited by stimulations in the ventral pallidum (VP). These results suggest that reward-related signals are transmitted to the LHb mainly through excitatory connections from the GPb and inhibitory connections from the VP. Finally, excitations or inhibitions are induced in LHb neurons from diverse but patchy regions in the striatum. These effects have considerably longer latencies, suggesting that they may be mediated by the GPb or the VP. The patchy nature of the stimulation effect raises the possibility that the striosomes are the source of reward-related signals transmitted to the LHb.

The ventral striato-pallidal pathway mediates the effect of predictive learning on choice between goal-directed actions

The nucleus accumbens shell (NAc-S) plays an important role in the way stimuli that predict reward affect the performance of, and choice between, goal-directed actions in tests of outcome-specific Pavlovian-instrumental transfer (PIT). The neural processes involved in PIT downstream of the ventral striatum are, however, unknown. The NAc-S projects prominently to the ventral pallidum (VP), and in the current experiments, we assessed the involvement of the NAc-S to VP projection in specific PIT in rats. We first compared expression of the immediate-early gene c-Fos in the medial (VP-m) and lateral (VP-l) regions of the VP and in addition, used the retrograde tracer Fluoro-gold combined with c-Fos to assess the involvement of these pathways during PIT. Although there was no evidence of differential activation in neurons in the VP-l, the VP-m showed a selective increase in activity in rats tested for PIT compared with appropriate controls, as did NAc-S neurons projecting to the VP-m. To confirm that VP-m activity is important for PIT, we inactivated this region before test and found this inactivation blocked the influence of predictive learning on choice. Finally, to confirm the functional importance of the NAc-S to VP-m pathway we used a disconnection procedure, using asymmetrical inactivation of the NAc-S and either the ipsilateral or contralateral VP-m. Specific PIT was blocked but only by inactivation of the NAc-S and VP-m in contralateral hemispheres. These results suggest that the NAc-S and VP-m form part of a circuit mediating the effects of predictive learning on choice.

Neural substrates underlying effort computation in schizophrenia

The lack of initiative, drive or effort in patients with schizophrenia is linked to marked functional impairments. However, our assessment of effort and motivation is crude, relying on clinical rating scales based largely on patient recall. In order to better understand the neurobiology of effort in schizophrenia, we need more rigorous measurements of this construct. In the behavioural neuroscience literature, decades of work has been carried out developing various paradigms to examine the neural underpinnings of an animal's willingness to expend effort for a reward. Here, we shall review this literature on the nature of paradigms used in rodents to assess effort, as well as those used in humans. Next, the neurobiology of these effort-based decisions will be discussed. We shall then review what is known about effort in schizophrenia, and what might be inferred from experiments done in other human populations. Lastly, we shall discuss future directions of research that may assist in shedding light on the neurobiology of effort cost computations in schizophrenia.