1
|
Lind EB, Sweis BM, Asp AJ, Esguerra M, Silvis KA, David Redish A, Thomas MJ. A quadruple dissociation of reward-related behaviour in mice across excitatory inputs to the nucleus accumbens shell. Commun Biol 2023; 6:119. [PMID: 36717646 PMCID: PMC9886947 DOI: 10.1038/s42003-023-04429-6] [Citation(s) in RCA: 4] [Impact Index Per Article: 4.0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Grants] [Track Full Text] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 03/25/2021] [Accepted: 01/05/2023] [Indexed: 02/01/2023] Open
Abstract
The nucleus accumbens shell (NAcSh) is critically important for reward valuations, yet it remains unclear how valuation information is integrated in this region to drive behaviour during reinforcement learning. Using an optogenetic spatial self-stimulation task in mice, here we show that contingent activation of different excitatory inputs to the NAcSh change expression of different reward-related behaviours. Our data indicate that medial prefrontal inputs support place preference via repeated actions, ventral hippocampal inputs consistently promote place preferences, basolateral amygdala inputs produce modest place preferences but as a byproduct of increased sensitivity to time investments, and paraventricular inputs reduce place preferences yet do not produce full avoidance behaviour. These findings suggest that each excitatory input provides distinct information to the NAcSh, and we propose that this reflects the reinforcement of different credit assignment functions. Our finding of a quadruple dissociation of NAcSh input-specific behaviours provides insights into how types of information carried by distinct inputs to the NAcSh could be integrated to help drive reinforcement learning and situationally appropriate behavioural responses.
Collapse
Affiliation(s)
- Erin B Lind
- Department of Neuroscience, University of Minnesota, 6-145 Jackson Hall, 321 Church St SE, Minneapolis, MN, 55455, USA
- Medical Discovery Team on Addiction, University of Minnesota, 3-432 McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN, 55455, USA
| | - Brian M Sweis
- Department of Neuroscience, University of Minnesota, 6-145 Jackson Hall, 321 Church St SE, Minneapolis, MN, 55455, USA
- Medical Discovery Team on Addiction, University of Minnesota, 3-432 McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN, 55455, USA
- Department of Psychiatry, Friedman Brain Institute, Icahn School of Medicine at Mount Sinai, 1 Gustave L. Levy Pl, New York, NY, 10029, USA
| | - Anders J Asp
- Department of Neuroscience, University of Minnesota, 6-145 Jackson Hall, 321 Church St SE, Minneapolis, MN, 55455, USA
- Rehabilitation Medicine Research Center, Department of Physical Medicine and Rehabilitation, Mayo Clinic, 200 First St SW, Rochester, MN, 55905, USA
| | - Manuel Esguerra
- Department of Neuroscience, University of Minnesota, 6-145 Jackson Hall, 321 Church St SE, Minneapolis, MN, 55455, USA
- Medical Discovery Team on Addiction, University of Minnesota, 3-432 McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN, 55455, USA
| | - Keelia A Silvis
- Department of Neuroscience, University of Minnesota, 6-145 Jackson Hall, 321 Church St SE, Minneapolis, MN, 55455, USA
- Medical Discovery Team on Addiction, University of Minnesota, 3-432 McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN, 55455, USA
| | - A David Redish
- Department of Neuroscience, University of Minnesota, 6-145 Jackson Hall, 321 Church St SE, Minneapolis, MN, 55455, USA
- Medical Discovery Team on Addiction, University of Minnesota, 3-432 McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN, 55455, USA
| | - Mark J Thomas
- Department of Neuroscience, University of Minnesota, 6-145 Jackson Hall, 321 Church St SE, Minneapolis, MN, 55455, USA.
- Medical Discovery Team on Addiction, University of Minnesota, 3-432 McGuire Translational Research Facility, 2001 6th St SE, Minneapolis, MN, 55455, USA.
| |
Collapse
|
2
|
Zheng Y, Chen Z. Targeting Histamine and Histamine Receptors for the Precise Regulation of Feeding. Curr Top Behav Neurosci 2021; 59:355-387. [PMID: 34622397 DOI: 10.1007/7854_2021_258] [Citation(s) in RCA: 2] [Impact Index Per Article: 0.7] [Reference Citation Analysis] [Abstract] [Key Words] [Journal Information] [Subscribe] [Scholar Register] [Indexed: 11/24/2022]
Abstract
Histamine has long been accepted as an anorexigenic agent. However, lines of evidence have suggested that the roles of histamine in feeding behaviors are much more complex than previously thought, being involved in satiety, satiation, feeding motivation, feeding circadian rhythm, and taste perception and memory. The functional diversity of histamine makes it a viable target for clinical management of obesity and other feeding-related disorders. Here, we update the current knowledge about the functions of histamine in feeding and summarize the underlying molecular and neural circuit mechanisms. Finally, we review the main clinical studies about the impacts of histamine-related compounds on weight control and discuss insights into future research on the roles of histamine in feeding. Despite the recent progress in histamine research, the histaminergic feeding circuits are poorly understood, and it is also worth verifying the functions of histamine receptors in a more spatiotemporally specific manner.
Collapse
Affiliation(s)
- Yanrong Zheng
- Key Laboratory of Neuropharmacology and Translational Medicine of Zhejiang Province, School of Pharmaceutical Sciences, Zhejiang Chinese Medical University, Hangzhou, China
| | - Zhong Chen
- Key Laboratory of Neuropharmacology and Translational Medicine of Zhejiang Province, School of Pharmaceutical Sciences, Zhejiang Chinese Medical University, Hangzhou, China.
| |
Collapse
|
3
|
Ksander J, Katz DB, Miller P. A model of naturalistic decision making in preference tests. PLoS Comput Biol 2021; 17:e1009012. [PMID: 34555012 PMCID: PMC8491944 DOI: 10.1371/journal.pcbi.1009012] [Citation(s) in RCA: 4] [Impact Index Per Article: 1.3] [Reference Citation Analysis] [Abstract] [MESH Headings] [Grants] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/19/2021] [Revised: 10/05/2021] [Accepted: 09/10/2021] [Indexed: 11/30/2022] Open
Abstract
Decisions as to whether to continue with an ongoing activity or to switch to an alternative are a constant in an animal’s natural world, and in particular underlie foraging behavior and performance in food preference tests. Stimuli experienced by the animal both impact the choice and are themselves impacted by the choice, in a dynamic back and forth. Here, we present model neural circuits, based on spiking neurons, in which the choice to switch away from ongoing behavior instantiates this back and forth, arising as a state transition in neural activity. We analyze two classes of circuit, which differ in whether state transitions result from a loss of hedonic input from the stimulus (an “entice to stay” model) or from aversive stimulus-input (a “repel to leave” model). In both classes of model, we find that the mean time spent sampling a stimulus decreases with increasing value of the alternative stimulus, a fact that we linked to the inclusion of depressing synapses in our model. The competitive interaction is much greater in “entice to stay” model networks, which has qualitative features of the marginal value theorem, and thereby provides a framework for optimal foraging behavior. We offer suggestions as to how our models could be discriminatively tested through the analysis of electrophysiological and behavioral data. Many decisions are of the ilk of whether to continue sampling a stimulus or to switch to an alternative, a key feature of foraging behavior. We produce two classes of model for such stay-switch decisions, which differ in how decisions to switch stimuli can arise. In an “entice-to-stay” model, a reduction in the necessary positive stimulus input causes switching decisions. In a “repel-to-leave” model, a rise in aversive stimulus input produces a switch decision. We find that in tasks where the sampling of one stimulus follows another, adaptive biological processes arising from a highly hedonic stimulus can reduce the time spent at the following stimulus, by up to ten-fold in the “entice-to-stay” models. Along with potentially observable behavioral differences that could distinguish the classes of networks, we also found signatures in neural activity, such as oscillation of neural firing rates and a rapid change in rates preceding the time of choice to leave a stimulus. In summary, our model findings lead to testable predictions and suggest a neural circuit-based framework for explaining foraging choices.
Collapse
Affiliation(s)
- John Ksander
- Volen National Center for Complex Systems, Brandeis University, Waltham, Massachusetts, United States of America
- Department of Psychology, Brandeis University, Waltham, Massachusetts, United States of America
| | - Donald B. Katz
- Volen National Center for Complex Systems, Brandeis University, Waltham, Massachusetts, United States of America
- Department of Psychology, Brandeis University, Waltham, Massachusetts, United States of America
| | - Paul Miller
- Volen National Center for Complex Systems, Brandeis University, Waltham, Massachusetts, United States of America
- Department of Biology, Brandeis University, Waltham, Massachusetts, United States of America
- * E-mail:
| |
Collapse
|
4
|
Secondary rewards acquire enhanced incentive motivation via increasing anticipatory activity of the lateral orbitofrontal cortex. Brain Struct Funct 2021; 226:2339-2355. [PMID: 34254166 DOI: 10.1007/s00429-021-02333-5] [Citation(s) in RCA: 1] [Impact Index Per Article: 0.3] [Reference Citation Analysis] [Abstract] [Key Words] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/14/2021] [Accepted: 06/28/2021] [Indexed: 10/20/2022]
Abstract
The motivation to strive for and consume primary rewards such as palatable food is bound by devaluation mechanisms, yet secondary rewards such as money may not be bound by these regulatory mechanisms. The present study therefore aimed at determining diverging devaluation trajectories for primary (chocolate milk) and secondary (money) reinforcers on the behavioral and neural level. Devaluation procedures with repeated exposure to reward combined with a choice (Experiment 1) and an incentive delay (Experiment 2) paradigm consistently revealed decreasing hedonic value for the primary reward as reflected by decreasing hedonic evaluation and choice preference with repeated receipt, while hedonic value and preferences for the secondary reward increased. Concomitantly acquired functional near-infrared spectroscopy (fNIRS) data during the incentive delay paradigm revealed that increasing value of the secondary reward was accompanied by increasing anticipatory activation in the lateral orbitofrontal cortex, while during the consummatory phase the secondary reinforcer associated with higher medial orbitofrontal activity irrespective of devaluation stage. Overall, the findings suggest that-in contrast to primary reinforcers-secondary reinforcers, i.e. money, can acquire progressively enhanced incentive motivation with repeated receipt, suggesting a mechanism which could promote escalating striving to obtain secondary rewards.
Collapse
|