The neural basis of delayed gratification

Mesolimbic dopamine ramps reflect environmental timescales

Mesolimbic dopamine activity occasionally exhibits ramping dynamics, reigniting debate on theories of dopamine signaling. This debate is ongoing partly because the experimental conditions under which dopamine ramps emerge remain poorly understood. Here, we show that during Pavlovian and instrumental conditioning, mesolimbic dopamine ramps are only observed when the inter-trial interval is short relative to the trial period. These results constrain theories of dopamine signaling and identify a critical variable determining the emergence of dopamine ramps.

Oxytocin neurons mediate stress-induced social memory impairment

Oxytocin has long been thought to play a substantial role in social behaviors, such as social attachment and parenting behavior. However, how oxytocin neurons respond to social and non-social stimuli is largely unknown, especially in high temporal resolution. Here, we recorded the in vivo real-time responses of oxytocin neurons in the paraventricular nucleus of the hypothalamus (PVN) in freely behaving mice. Our results revealed that oxytocin neurons were activated more significantly by stressors than social stimuli. The activation of oxytocin neurons was precisely correlated with struggling behavior during stress. Furthermore, we found that oxytocin mediated stress-induced social memory impairment. Our results reveal an important role of PVN oxytocin neurons in stress-induced social amnesia.

Neural energy computations based on Hodgkin-Huxley models bridge abnormal neuronal activities and energy consumption patterns of major depressive disorder

Limited by the current experimental techniques and neurodynamical models, the dysregulation mechanisms of decision-making related neural circuits in major depressive disorder (MDD) are still not clear. In this paper, we proposed a neural coding methodology using energy to further investigate it, which has been proven to strongly complement the neurodynamical methodology. We augmented the previous neural energy calculation method, and applied it to our VTA-NAc-mPFC neurodynamical H-H models. We particularly focused on the peak power and energy consumption of abnormal ion channel (ionic) currents under different concentrations of dopamine input, and investigated the abnormal energy consumption patterns for the MDD group. The results revealed that the energy consumption of medium spiny neurons (MSNs) in the NAc region were lower in the MDD group than that of the normal control group despite having the same firing frequencies, peak action potentials, and average membrane potentials in both groups. Dopamine concentration was also positively correlated with the energy consumption of the pyramidal neurons, but the patterns of different interneuron types were distinct. Additionally, the ratio of mPFC's energy consumption to total energy consumption of the whole network in MDD group was lower than that in normal control group, revealing that the mPFC region in MDD group encoded less neural information, which matched the energy consumption patterns of BOLD-fMRI results. It was also in line with the behavioral characteristics that MDD patients demonstrated in the form of reward insensitivity during decision-making tasks. In conclusion, the model in this paper was the first neural network energy computational model for MDD, which showed success in explaining its dynamical mechanisms with an energy consumption perspective. To build on this, we demonstrated that energy consumption levels can be used as a potential indicator for MDD, which also showed a promising pipeline to use an energy methodology for studying other neuropsychiatric disorders.

Atypical antipsychotics antagonize GABAA receptors in the ventral tegmental area GABA neurons to relieve psychotic behaviors

Psychosis is an abnormal mental condition that can cause patients to lose contact with reality. It is a common symptom of schizophrenia, bipolar disorder, sleep deprivation, and other mental disorders. Clinically, antipsychotic medications, such as olanzapine and clozapine, are very effective in treatment for psychosis. To investigate the neural circuit mechanism that is affected by antipsychotics and identify more selective therapeutic targets, we employed a strategy by using these effective antipsychotics to identify antipsychotic neural substrates. We observed that local injection of antipsychotics into the ventral tegmental area (VTA) could reverse the sensorimotor gating defects induced by MK-801 injection in mice. Using in vivo fiber photometry, electrophysiological techniques, and chemogenetics, we found that antipsychotics could activate VTA gamma-aminobutyric acid (GABA) neurons by blocking GABAA receptors. Moreover, we found that the VTAGABA nucleus accumbens (NAc) projection was crucially involved in such antipsychotic effects. In summary, our study identifies a novel therapeutic target for the treatment of psychosis and underscores the utility of a 'bedside-to-bench' approach for identifying neural circuits that influence psychotic disorders.

Neural Correlates of Delay Discounting in the Light of Brain Imaging and Non-Invasive Brain Stimulation: What We Know and What Is Missed

In decision making, the subjective value of a reward declines with the delay to its receipt, describing a hyperbolic function. Although this phenomenon, referred to as delay discounting (DD), has been extensively characterized and reported in many animal species, still, little is known about the neuronal processes that support it. Here, after drawing a comprehensive portrait, we consider the latest neuroimaging and lesion studies, the outcomes of which often appear contradictory among comparable experimental settings. In the second part of the manuscript, we focus on a more recent and effective route of investigation: non-invasive brain stimulation (NIBS). We provide a comprehensive review of the available studies that applied transcranial magnetic stimulation (TMS) and transcranial direct current stimulation (tDCS) to affect subjects’ performance in DD tasks. The aim of our survey is not only to highlight the superiority of NIBS in investigating DD, but also to suggest targets for future experimental studies, since the regions considered in these studies represent only a fraction of the possible ones. In particular, we argue that, based on the available neurophysiological evidence from lesion and brain imaging studies, a very promising and underrepresented region for future neuromodulation studies investigating DD is the orbitofrontal cortex.

Learned industriousness as a translational mechanism in anorexia nervosa

It remains unexplained why some behaviours persist despite being non-hedonic and ostensibly aversive. This phenomenon is especially baffling when such behaviours are taken to excess in the form of psychopathology. Anorexia nervosa is one psychiatric disorder in which effortful behaviours that most people find unpleasant (suchas restrictive eating) are persistently performed. We propose thatthe social psychology theory of learned industriousness providesa novel mechanistic account for such phenomena. This theoryposits that high-effort behaviour can be conditioned to acquire secondary reinforcing properties through repeated pairing with reward. Accordingly, effort sensations become less aversive andmore appetitive, increasing willingness to engage in effortful behaviour. In this Perspective, we review pre-clinical behaviouraland biological data that support learned industriousness, contrast learned industriousness with other models of non-hedonic persistence (such as habit learning), highlight evidence that supports learned industriousness in individuals with anorexia nervosa and consider implications of the model, including translation to other psychiatric presentations.

Midbrain dopamine neurons signal phasic and ramping reward prediction error during goal-directed navigation

Goal-directed navigation requires learning to accurately estimate location and select optimal actions in each location. Midbrain dopamine neurons are involved in reward value learning and have been linked to reward location learning. They are therefore ideally placed to provide teaching signals for goal-directed navigation. By imaging dopamine neural activity as mice learned to actively navigate a closed-loop virtual reality corridor to obtain reward, we observe phasic and pre-reward ramping dopamine activity, which are modulated by learning stage and task engagement. A Q-learning model incorporating position inference recapitulates our results, displaying prediction errors resembling phasic and ramping dopamine neural activity. The model predicts that ramping is followed by improved task performance, which we confirm in our experimental data, indicating that the dopamine ramp may have a teaching effect. Our results suggest that midbrain dopamine neurons encode phasic and ramping reward prediction error signals to improve goal-directed navigation.