1
|
Ma X, Wang Z, Lou S, Guo H, Yang Y. Prelimbic neuron assemblies with delayed activation encode the economic decision-making process in a bandit game. Behav Brain Res 2023; 447:114419. [PMID: 37023860 DOI: 10.1016/j.bbr.2023.114419] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 01/08/2023] [Revised: 03/05/2023] [Accepted: 04/03/2023] [Indexed: 04/08/2023]
Abstract
The medial prefrontal cortex (mPFC) is critical to an animal's value-based decision-making process. However, due to heterogeneity of local mPFC neurons, which neuron group and how it contributes to the alteration of the animal's decision is yet to be explored. And the effect of empty reward in this process is often neglected. Here, we adopted a two-port bandit game paradigm for mice and applied synchronized calcium imaging to the prelimbic area of the mPFC. The results showed that neurons recruited in the bandit game exhibit three distinct firing patterns. Specially, neurons with delayed activation (deA neurons1) carried exclusive information on reward type and changes of choice value. We demonstrated that these deA neurons were essential for the construction of choice-outcome correlation and the trial-to-trial modification of decision. Additionally, we found that in a long-term gambling game, members of the deA neuron assembly were dynamically shifting while maintaining the function, and the importance of empty reward feedbacks were gradually elevated to the same level as reward. Together, these results revealed a vital role for prelimbic deA neurons in the gambling tasks and a new perspective on the encoding of economic decision-making.
Collapse
|
2
|
Yagishita S. Cellular bases for reward-related dopamine actions. Neurosci Res 2023; 188:1-9. [PMID: 36496085 DOI: 10.1016/j.neures.2022.12.003] [Citation(s) in RCA: 0] [Impact Index Per Article: 0] [Reference Citation Analysis] [Abstract] [Key Words] [MESH Headings] [Track Full Text] [Journal Information] [Subscribe] [Scholar Register] [Received: 04/01/2022] [Revised: 11/09/2022] [Accepted: 12/06/2022] [Indexed: 12/12/2022]
Abstract
Dopamine neurons exhibit transient increases and decreases in their firing rate upon reward and punishment for learning. This bidirectional modulation of dopamine dynamics occurs on the order of hundreds of milliseconds, and it is sensitively detected to reinforce the preceding sensorimotor events. These observations indicate that the mechanisms of dopamine detection at the projection sites are of remarkable precision, both in time and concentration. A major target of dopamine projection is the striatum, including the ventral region of the nucleus accumbens, which mainly comprises dopamine D1 and D2 receptor (D1R and D2R)-expressing spiny projection neurons. Although the involvement of D1R and D2R in dopamine-dependent learning has been suggested, the exact cellular bases for detecting transient dopamine signaling remain unclear. This review discusses recent cellular studies on the novel synaptic mechanisms for detecting dopamine transient signals associated with learning. Analyses of behavior based on these mechanisms have further revealed new behavioral aspects that are closely associated with these synaptic mechanisms. Thus, it is gradually possible to mechanistically explain behavioral learning via synaptic and cellular bases in rodents.
Collapse
Affiliation(s)
- Sho Yagishita
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, The University of Tokyo, Bunkyo-ku, Tokyo, Japan; International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan.
| |
Collapse
|
3
|
Yamaguchi K, Maeda Y, Sawada T, Iino Y, Tajiri M, Nakazato R, Ishii S, Kasai H, Yagishita S. A behavioural correlate of the synaptic eligibility trace in the nucleus accumbens. Sci Rep 2022; 12:1921. [PMID: 35121769 PMCID: PMC8817024 DOI: 10.1038/s41598-022-05637-6] [Citation(s) in RCA: 3] [Impact Index Per Article: 1.5] [Reference Citation Analysis] [Abstract] [Track Full Text] [Download PDF] [Figures] [Journal Information] [Subscribe] [Scholar Register] [Received: 08/31/2021] [Accepted: 01/17/2022] [Indexed: 11/09/2022] Open
Abstract
Reward reinforces the association between a preceding sensorimotor event and its outcome. Reinforcement learning (RL) theory and recent brain slice studies explain the delayed reward action such that synaptic activities triggered by sensorimotor events leave a synaptic eligibility trace for 1 s. The trace produces a sensitive period for reward-related dopamine to induce synaptic plasticity in the nucleus accumbens (NAc). However, the contribution of the synaptic eligibility trace to behaviour remains unclear. Here we examined a reward-sensitive period to brief pure tones with an accurate measurement of an effective timing of water reward in head-fixed Pavlovian conditioning, which depended on the plasticity-related signaling in the NAc. We found that the reward-sensitive period was within 1 s after the pure tone presentation and optogenetically-induced presynaptic activities at the NAc, showing that the short reward-sensitive period was in conformity with the synaptic eligibility trace in the NAc. These findings support the application of the synaptic eligibility trace to construct biologically plausible RL models.
Collapse
Affiliation(s)
- Kenji Yamaguchi
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan.,Department of Psychology, Waseda University, Shinjuku-ku, Tokyo, Japan
| | - Yoshitomo Maeda
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Takeshi Sawada
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Yusuke Iino
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Mio Tajiri
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Ryosuke Nakazato
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Shin Ishii
- International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan.,Graduate School of Informatics, Kyoto University, Yoshida-Honmachi, Kyoto, Japan
| | - Haruo Kasai
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan.,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan
| | - Sho Yagishita
- Laboratory of Structural Physiology, Center for Disease Biology and Integrative Medicine, Faculty of Medicine, Faculty of Medicine Bldg, The University of Tokyo, 1 #NC207, 7-3-1 Hongo, Bunkyo-ku, Tokyo, 113-0033, Japan. .,International Research Center for Neurointelligence (WPI-IRCN), UTIAS, The University of Tokyo, Bunkyo-ku, Tokyo, Japan.
| |
Collapse
|