Dynamic processing of hunger and thirst by common mesolimbic neural ensembles

From valence encoding to motivated behavior: A focus on the nucleus accumbens circuitry

How do our brains determine whether something is good or bad? The brain's ability to evaluate stimuli as positive or negative - by attributing valence - is fundamental to survival and decision-making. Different brain regions have been associated with valence encoding, including the nucleus accumbens (NAc). The NAc is predominantly composed of GABAergic medium spiny neurons (MSNs), which segregate into two distinct populations based on their dopamine receptor expression: D1-receptor-expressing (D1-MSNs) and D2-receptor-expressing neurons (D2-MSNs). Classical models propose a binary functional role, where D1-MSNs exclusively mediated reward and positive valence, while D2-MSNs processed aversion and negative valence. However, we now recognize that NAc MSN subpopulations operate in a more complex manner than previously thought, often working cooperatively rather than antagonistically in valence-related behaviors. This review synthesizes our current knowledge of valence-encoding neurocircuitry, with emphasis on the NAc. We examine electrophysiological, calcium imaging, optogenetic, chemogenetic and pharmacological studies detailing the contribution of NAc medium spiny neurons for rewarding and aversive responses. Finally, we explore emerging technical innovations that promise to advance our understanding of how the mammalian brain encodes valence and translates it into behavior.

Reward expectation and receipt differentially modulate the spiking of accumbens D1+ and D2+ neurons

The nucleus accumbens (NAc) helps govern motivation to pursue reward. Two distinct sets of NAc projection neurons-expressing dopamine D1 vs. D2 receptors-are thought to promote and suppress motivated behaviors, respectively. However, support for this conceptual framework is limited: in particular, the spiking patterns of these distinct cell types during motivated behavior have been largely unknown. Using optogenetic tagging, we recorded the spiking of identified D1+ and D2+ neurons in the NAc core as unrestrained rats performed an operant task in which motivation to initiate work tracks recent reward rate. D1+ neurons preferentially increased firing as rats initiated trials and fired more when reward expectation was higher. By contrast, D2+ cells preferentially increased firing later in the trial, especially in response to reward delivery-a finding not anticipated from current theoretical models. Our results provide new evidence for the specific contribution of NAc D1+ cells to self-initiated approach behavior and will spur updated models of how D2+ cells contribute to learning.

A cellular and molecular basis of leptin resistance

Similar to most humans with obesity, diet-induced obese (DIO) mice have high leptin levels and fail to respond to the exogenous hormone, suggesting that their obesity is caused by leptin resistance, the pathogenesis of which is unknown. We found that leptin treatment reduced plasma levels of leucine and methionine, mTOR-activating ligands, leading us to hypothesize that chronic mTOR activation might reduce leptin signaling. Rapamycin, an mTOR inhibitor, reduced fat mass and increased leptin sensitivity in DIO mice but not in mice with defects in leptin signaling. Rapamycin restored leptin's actions on POMC neurons and failed to reduce the weight of mice with defects in melanocortin signaling. mTOR activation in POMC neurons caused leptin resistance, whereas POMC-specific mutations in mTOR activators decreased weight gain of DIO mice. Thus, increased mTOR activity in POMC neurons is necessary and sufficient for the development of leptin resistance in DIO mice, establishing a key pathogenic mechanism leading to obesity.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards-an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2, but little is known about whether, where and how neurons in this circuit encode information about higher-order moments of reward distributions3. Here, to fill this gap, we used high-density probes (Neuropixels) to record striatal activity from mice performing a classical conditioning task in which reward mean, reward variance and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons-D1 and D2-contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 medium spiny neurons4-9 to reap the computational benefits of distributional RL.

A unified theoretical framework underlying the regulation of motivated behavior

To orchestrate behaviors for survival, multiple psychological components have evolved. The current theories do not clearly distinguish the distinct components. In this article, we provide a unified theoretical framework. To optimize survival, there should be four components; (1) "need", an alarm based on a predicted deficiency. (2) "motivation", a direct behavior driver. (3) "pleasure", a teacher based on immediate outcomes. (4) "utility", a teacher based on final delayed outcomes. For behavior stability, need should be accumulated into motivation to drive behavior. Based on the immediate outcome of the behavior, the pleasure should teach whether to continue the current behavior. Based on the final delay outcome, the utility should teach whether to increase future behavior by reshaping the other three components. We provide several neural substrate candidates in the food context. The proposed theoretical framework, in combination with appropriate experiments, will unravel the neural components responsible for each theoretical component.

Temporal dynamics of nucleus accumbens neurons in male mice during reward seeking

The nucleus accumbens (NAc) regulates reward-motivated behavior, but the temporal dynamics of NAc neurons that enable "free-willed" animals to obtain rewards remain elusive. Here, we recorded Ca2+ activity from individual NAc neurons when mice performed self-paced lever-presses for sucrose. NAc neurons exhibited three temporally-sequenced clusters, defined by times at which they exhibited increased Ca2+ activity: approximately 0, -2.5 or -5 sec relative to the lever-pressing. Dopamine D1 receptor (D1)-expressing neurons and D2-neurons formed the majority of the -5-sec versus -2.5-sec clusters, respectively, while both neuronal subtypes were represented in the 0-sec cluster. We found that pre-press activity patterns of D1- or D2-neurons could predict subsequent lever-presses. Inhibiting D1-neurons at -5 sec or D2-neurons at -2.5 sec, but not at other timepoints, reduced sucrose-motivated lever-pressing. We propose that the time-specific activity of D1- and D2-neurons mediate key temporal features of the NAc through which reward motivation initiates reward-seeking behavior.

Appetite Loss in Patients with Advanced Cancer Treated at an Acute Palliative Care Unit

Appetite loss is prevalent in patients with advanced cancer and negatively affects their quality of life. However, understanding of the factors associated with appetite loss is limited. The current study aims to explore characteristics and therapeutic interventions used for patients with and without appetite loss admitted to an acute palliative care unit. Patient characteristics and patient-reported outcome measures (PROMs), using the 11-point numeric rating scale (NRS 0-10), were registered. Descriptive statistics, independent samples T-tests and chi-square tests were utilized for data analysis. Of the 167 patients included in the analysis, 62% (104) had moderate to severe appetite loss at admission, whereof 63% (66) improved their appetite during their hospital stay. At admission, there was a significant association between appetite loss and having gastrointestinal cancer, living alone, poor performance status and withdrawn anticancer treatment. Patients with appetite loss also experienced more nausea, depression, fatigue, dyspnea and anxiety. In patients with improved appetite during hospitalization, mean decrease in NRS was 3.4 (standard error (SE) 0.27). Additionally, patients living alone were more likely to improve their appetite. Appetite improvement frequently coincided with alleviation of fatigue. Understanding these associations may help in developing better interventions for managing appetite loss in patients with advanced cancer.

A subset of dopamine receptor-expressing neurons in the nucleus accumbens controls feeding and energy homeostasis

Orchestrating complex behaviors, such as approaching and consuming food, is critical for survival. In addition to hypothalamus neuronal circuits, the nucleus accumbens (NAc) also controls appetite and satiety. However, specific neuronal subtypes of the NAc that are involved and how the humoral and neuronal signals coordinate to regulate feeding remain incompletely understood. Here we decipher the spatial diversity of neuron subtypes of the NAc shell (NAcSh) and define a dopamine receptor D1-expressing and Serpinb2-expressing subtype controlling food consumption in male mice. Chemogenetics and optogenetics-mediated regulation of Serpinb2+ neurons bidirectionally regulate food seeking and consumption specifically. Circuitry stimulation reveals that the NAcShSerpinb2→LHLepR projection controls refeeding and can overcome leptin-mediated feeding suppression. Furthermore, NAcSh Serpinb2+ neuron ablation reduces food intake and upregulates energy expenditure, resulting in reduced bodyweight gain. Our study reveals a neural circuit consisting of a molecularly distinct neuronal subtype that bidirectionally regulates energy homeostasis, providing a potential therapeutic target for eating disorders.

A Method for Evaluating Hunger and Thirst in Monkeys by Measuring Blood Ghrelin and Osmolality Levels

Hunger and thirst drive animals' consumption behavior and regulate their decision-making concerning rewards. We previously assessed the thirst states of monkeys by measuring blood osmolality under controlled water access and examined how these thirst states influenced their risk-taking behavior in decisions involving fluid rewards. However, hunger assessment in monkeys remains poorly performed. Moreover, the lack of precise measures for hunger states leads to another issue regarding how hunger and thirst states interact with each other in each individual. Thus, when controlling food access to motivate performance, it remains unclear how these two physiological needs are satisfied in captive monkeys. Here, we measured blood ghrelin and osmolality levels to respectively assess hunger and thirst in four captive macaques. Using an enzyme-linked immunosorbent assay, we identified that the levels of blood ghrelin, a widely measured hunger-related peptide hormone in humans, were high after 20 h of no food access (with ad libitum water). This reflects a typical controlled food access condition. One hour after consuming a regular dry meal, the blood ghrelin levels in three out of four monkeys decreased to within their baseline range. Additionally, blood osmolality measured from the same blood sample, the standard hematological index of hydration status, increased after consuming the regular dry meal with no water access. Thus, ghrelin and osmolality may reflect the physiological states of individual monkeys regarding hunger and thirst, suggesting that these indices can be used as tools for monitoring hunger and thirst levels that mediate an animal's decision to consume rewards.

Drugs of abuse hijack a mesolimbic pathway that processes homeostatic need

Drugs of abuse are thought to promote addiction in part by "hijacking" brain reward systems, but the underlying mechanisms remain undefined. Using whole-brain FOS mapping and in vivo single-neuron calcium imaging, we found that drugs of abuse augment dopaminoceptive ensemble activity in the nucleus accumbens (NAc) and disorganize overlapping ensemble responses to natural rewards in a cell type-specific manner. Combining FOS-Seq, CRISPR-perturbation, and single-nucleus RNA sequencing, we identified Rheb as a molecular substrate that regulates cell type-specific signal transduction in NAc while enabling drugs to suppress natural reward consumption. Mapping NAc-projecting regions activated by drugs of abuse revealed input-specific effects on natural reward consumption. These findings characterize the dynamic, molecular and circuit basis of a common reward pathway, wherein drugs of abuse interfere with the fulfillment of innate needs.

A molecularly defined NAcSh D1 subtype controls feeding and energy homeostasis

Orchestrating complex behavioral states, such as approach and consumption of food, is critical for survival. In addition to hypothalamus neuronal circuits, the nucleus accumbens (NAc) also plays an important role in controlling appetite and satiety in responses to changing external stimuli. However, the specific neuronal subtypes of NAc involved as well as how the humoral and neuronal signals coordinate to regulate feeding remain incompletely understood. Here, we deciphered the spatial diversity of neuron subtypes of the NAc shell (NAcSh) and defined a dopamine receptor D1(Drd1)- and Serpinb2-expressing subtype located in NAcSh encoding food consumption. Chemogenetics- and optogenetics-mediated regulation of Serpinb2 + neurons bidirectionally regulates food seeking and consumption specifically. Circuitry stimulation revealed the NAcSh Serpinb2 →LH LepR projection controls refeeding and can overcome leptin-mediated feeding suppression. Furthermore, NAcSh Serpinb2 + neuron ablation reduces food intake and upregulates energy expenditure resulting in body weight loss. Together, our study reveals a neural circuit consisted of molecularly distinct neuronal subtype that bidirectionally regulates energy homeostasis, which can serve as a potential therapeutic target for eating disorders.

An opponent striatal circuit for distributional reinforcement learning

Machine learning research has achieved large performance gains on a wide range of tasks by expanding the learning target from mean rewards to entire probability distributions of rewards - an approach known as distributional reinforcement learning (RL)1. The mesolimbic dopamine system is thought to underlie RL in the mammalian brain by updating a representation of mean value in the striatum2,3, but little is known about whether, where, and how neurons in this circuit encode information about higher-order moments of reward distributions4. To fill this gap, we used high-density probes (Neuropixels) to acutely record striatal activity from well-trained, water-restricted mice performing a classical conditioning task in which reward mean, reward variance, and stimulus identity were independently manipulated. In contrast to traditional RL accounts, we found robust evidence for abstract encoding of variance in the striatum. Remarkably, chronic ablation of dopamine inputs disorganized these distributional representations in the striatum without interfering with mean value coding. Two-photon calcium imaging and optogenetics revealed that the two major classes of striatal medium spiny neurons - D1 and D2 MSNs - contributed to this code by preferentially encoding the right and left tails of the reward distribution, respectively. We synthesize these findings into a new model of the striatum and mesolimbic dopamine that harnesses the opponency between D1 and D2 MSNs5-15 to reap the computational benefits of distributional RL.

Linking drug and food addiction: an overview of the shared neural circuits and behavioral phenotype

Despite a lack of agreement on its definition and inclusion as a specific diagnosable disturbance, the food addiction construct is supported by several neurobiological and behavioral clinical and preclinical findings. Recognizing food addiction is critical to understanding how and why it manifests. In this overview, we focused on those as follows: 1. the hyperpalatable food effects in food addiction development; 2. specific brain regions involved in both food and drug addiction; and 3. animal models highlighting commonalities between substance use disorders and food addiction. Although results collected through animal studies emerged from protocols differing in several ways, they clearly highlight commonalities in behavioral manifestations and neurobiological alterations between substance use disorders and food addiction characteristics. To develop improved food addiction models, this heterogeneity should be acknowledged and embraced so that research can systematically investigate the role of specific variables in the development of the different behavioral features of addiction-like behavior in preclinical models.

Drugs of abuse hijack a mesolimbic pathway that processes homeostatic need

Addiction prioritizes drug use over innate needs by "hijacking" brain circuits that direct motivation, but how this develops remains unclear. Using whole-brain FOS mapping and in vivo single-neuron calcium imaging, we find that drugs of abuse augment ensemble activity in the nucleus accumbens (NAc) and disorganize overlapping ensemble responses to natural rewards in a cell-type-specific manner. Combining "FOS-Seq", CRISPR-perturbations, and snRNA-seq, we identify Rheb as a shared molecular substrate that regulates cell-type-specific signal transductions in NAc while enabling drugs to suppress natural reward responses. Retrograde circuit mapping pinpoints orbitofrontal cortex which, upon activation, mirrors drug effects on innate needs. These findings deconstruct the dynamic, molecular, and circuit basis of a common reward circuit, wherein drug value is scaled to promote drug-seeking over other, normative goals.

Different antihypertensive and metabolic responses to rostafuroxin in undernourished and normonourished male rats: Outcomes on bodily Na+ handling

Hypertension is a pandemic nowadays. We aimed to investigate whether chronic undernutrition modifies the response to the antihypertensive drug rostafuroxin in juvenile hypertensive rats. Chronic undernutrition was induced in male rats using a multideficient diet known as the Regional Basic Diet (RBD), mimicking alimentary habits in impoverished regions worldwide. Animals were given RBD-or a control/CTRL normal diet for rodents-from weaning to 90 days, and rostafuroxin (1 mg/kg body mass) was orally administered from day 60 onwards. For the last 2 days, the rats were hosted in metabolic cages to measure food/energy, water, Na+ ingestion, and urinary volume. Rostafuroxin increased food/energy/Na+ intake in CTRL and RBD rats but had opposite effects on Na+ balance (intake minus urinary excretion). The drug normalized the decreased plasma Na+ concentration in RBD rats, increased urinary volume in RBD but not in CTRL, and decreased and increased urinary Na+ concentration in the RBD and CTRL groups, respectively. Rostafuroxin decreased the ouabain-sensitive (Na+ +K+ )ATPase and increased the ouabain-resistant Na+ -ATPase from proximal tubule cells in both groups and normalized the systolic blood pressure in RBD without effect in CTRL rats. We conclude that chronic undernutrition modifies the response of blood pressure and metabolic responses to rostafuroxin.