Hippocampus and Prefrontal Cortex Predict Distinct Timescales of Activation in the Human Ventral Tegmental Area

Blunt dopamine transmission due to decreased GDNF in the PFC evokes cognitive impairment in Parkinson's disease

Studies have found that the absence of glial cell line-derived neurotrophic factor may be the primary risk factor for Parkinson's disease. However, there have not been any studies conducted on the potential relationship between glial cell line-derived neurotrophic factor and cognitive performance in Parkinson's disease. We first performed a retrospective case-control study at the Affiliated Hospital of Xuzhou Medical University between September 2018 and January 2020 and found that a decreased serum level of glial cell line-derived neurotrophic factor was a risk factor for cognitive disorders in patients with Parkinson's disease. We then established a mouse model of Parkinson's disease induced by 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine and analyzed the potential relationships among glial cell line-derived neurotrophic factor in the prefrontal cortex, dopamine transmission, and cognitive function. Our results showed that decreased glial cell line-derived neurotrophic factor in the prefrontal cortex weakened dopamine release and transmission by upregulating the presynaptic membrane expression of the dopamine transporter, which led to the loss and primitivization of dendritic spines of pyramidal neurons and cognitive impairment. In addition, magnetic resonance imaging data showed that the long-term lack of glial cell line-derived neurotrophic factor reduced the connectivity between the prefrontal cortex and other brain regions, and exogenous glial cell line-derived neurotrophic factor significantly improved this connectivity. These findings suggested that decreased glial cell line-derived neurotrophic factor in the prefrontal cortex leads to neuroplastic degeneration at the level of synaptic connections and circuits, which results in cognitive impairment in patients with Parkinson's disease.

Prediction errors disrupt hippocampal representations and update episodic memories

The brain supports adaptive behavior by generating predictions, learning from errors, and updating memories to incorporate new information. Prediction error, or surprise, triggers learning when reality contradicts expectations. Prior studies have shown that the hippocampus signals prediction errors, but the hypothesized link to memory updating has not been demonstrated. In a human functional MRI study, we elicited mnemonic prediction errors by interrupting familiar narrative videos immediately before the expected endings. We found that prediction errors reversed the relationship between univariate hippocampal activation and memory: greater hippocampal activation predicted memory preservation after expected endings, but memory updating after surprising endings. In contrast to previous studies, we show that univariate activation was insufficient for understanding hippocampal prediction error signals. We explain this surprising finding by tracking both the evolution of hippocampal activation patterns and the connectivity between the hippocampus and neuromodulatory regions. We found that hippocampal activation patterns stabilized as each narrative episode unfolded, suggesting sustained episodic representations. Prediction errors disrupted these sustained representations and the degree of disruption predicted memory updating. The relationship between hippocampal activation and subsequent memory depended on concurrent basal forebrain activation, supporting the idea that cholinergic modulation regulates attention and memory. We conclude that prediction errors create conditions that favor memory updating, prompting the hippocampus to abandon ongoing predictions and make memories malleable.

VTA and Anterior Hippocampus Target Dissociable Neocortical Networks for Post-Novelty Enhancements

The detection of novelty indicates changes in the environment and the need to update existing representations. In response to novelty, interactions across the VTA-hippocampal circuit support experience-dependent plasticity in the hippocampus. While theories have broadly suggested plasticity-related changes are also instantiated in the cortex, research has also shown evidence for functional heterogeneity in cortical networks. It therefore remains unclear how the hippocampal-VTA circuit engages cortical networks, and whether novelty targets specific cortical regions or diffuse, large-scale cortical networks. To adjudicate the role of the VTA and hippocampus in cortical network plasticity, we used fMRI to compare resting-state functional coupling before and following exposure to novel scene images in human subjects of both sexes. Functional coupling between right anterior hippocampus and VTA was enhanced following novelty exposure. However, we also found evidence for a double dissociation, with anterior hippocampus and VTA showing distinct patterns of post-novelty functional coupling enhancements, targeting task-relevant regions versus large-scale networks, respectively. Further, significant correlations between these networks and the novelty-related plasticity in the anterior hippocampal-VTA functional network suggest that the central hippocampal-VTA network may facilitate the interactions with the cortex. These findings support an extended model of novelty-induced plasticity, in which novelty elicits plasticity-related changes in both local and global cortical networks.SIGNIFICANCE STATEMENT Novelty detection is critical for adaptive behavior, signaling the need to update existing representations. By engaging the bidirectional hippocampal-VTA circuit, novelty has been shown to induce plasticity-related changes in the hippocampus. However, it remains an open question how novelty targets such plasticity-related changes in cortical networks. We show that anterior hippocampus and VTA target cortical networks at different spatial scales, with respective enhancements in post-novelty functional coupling with a task-relevant cortical region and a large-scale memory network. The results presented here support an extended model of novelty-related plasticity, in which engaging the anterior hippocampal-VTA circuit through novelty exposure propagates cortical plasticity through hippocampal and VTA functional pathways at distinct scales, targeting specific or diffuse cortical networks.

Acute depletion of dopamine precursors in the human brain: effects on functional connectivity and alcohol attentional bias

Individuals who abuse alcohol often show exaggerated attentional bias (AB) towards alcohol-related cues, which is thought to reflect reward conditioning processes. Rodent studies indicate that dopaminergic pathways play a key role in conditioned responses to reward- and alcohol-associated cues. However, investigation of the dopaminergic circuitry mediating this process in humans remains limited. We hypothesized that depletion of central dopamine levels in adult alcohol drinkers would attenuate AB and that these effects would be mediated by altered function in frontolimbic circuitry. Thirty-four male participants (22-38 years, including both social and heavy drinkers) underwent a two-session, placebo-controlled, double-blind dopamine precursor depletion procedure. At each visit, participants consumed either a balanced amino acid (control) beverage or an amino acid beverage lacking dopamine precursors (order counterbalanced), underwent resting-state fMRI, and completed behavioral testing on three AB tasks: an alcohol dot-probe task, an alcohol attentional blink task, and a task measuring AB to a reward-conditioned cue. Dopamine depletion significantly diminished AB in each behavioral task, with larger effects among subjects reporting higher levels of binge drinking. The depletion procedure significantly decreased resting-state functional connectivity among ventral tegmental area, striatum, amygdala, and prefrontal regions. Beverage-related AB decreases were mediated by decreases in functional connectivity between the fronto-insular cortex and striatum and, for alcohol AB only, between anterior cingulate cortex and amygdala. The results support a substantial role for dopamine in AB, and suggest specific dopamine-modulated functional connections between frontal, limbic, striatal, and brainstem regions mediate general reward AB versus alcohol AB.

A predictive account of how novelty influences declarative memory

A rich body of studies in the human and non-human literature has examined the question how novelty influences memory. For a variety of different stimuli, ranging from simple objects and words to vastly complex scenarios, the literature reports that novelty improves memory in some cases, but impairs memory in other cases. In recent attempts to reconcile these conflicting findings, novelty has been divided into different subtypes, such as relative versus absolute novelty, or stimulus versus contextual novelty. Nevertheless, a single overarching theory of novelty and memory has been difficult to attain, probably due to the complexities in the interactions among stimuli, environmental factors (e.g., spatial and temporal context) and level of prior knowledge (but see Duszkiewicz et al., 2019; Kafkas & Montaldi, 2018b; Schomaker & Meeter, 2015). Here we describe how a predictive coding framework might be able to shed new light on different types of novelty and how they affect declarative memory in humans. More precisely, we consider how prior expectations modulate the influence of novelty on encoding episodes into memory, e.g., in terms of surprise, and how novelty/surprise affect memory for surrounding information. By reviewing a range of behavioural findings and their possible underlying neurobiological mechanisms, we highlight where a predictive coding framework succeeds and where it appears to struggle.

The value of what's to come: Neural mechanisms coupling prediction error and the utility of anticipation

Having something to look forward to is a keystone of well-being. Anticipation of future reward, such as an upcoming vacation, can often be more gratifying than the experience itself. Theories suggest the utility of anticipation underpins various behaviors, ranging from beneficial information-seeking to harmful addiction. However, how neural systems compute anticipatory utility remains unclear. We analyzed the brain activity of human participants as they performed a task involving choosing whether to receive information predictive of future pleasant outcomes. Using a computational model, we show three brain regions orchestrate anticipatory utility. Specifically, ventromedial prefrontal cortex tracks the value of anticipatory utility, dopaminergic midbrain correlates with information that enhances anticipation, while sustained hippocampal activity mediates a functional coupling between these regions. Our findings suggest a previously unidentified neural underpinning for anticipation's influence over decision-making and unify a range of phenomena associated with risk and time-delay preference.

Anterior Hippocampal-Cortical Functional Connectivity Distinguishes Antipsychotic Naïve First-Episode Psychosis Patients From Controls and May Predict Response to Second-Generation Antipsychotic Treatment

BACKGROUND

Converging evidence implicates the anterior hippocampus in the proximal pathophysiology of schizophrenia. Although resting state functional connectivity (FC) holds promise for characterizing anterior hippocampal circuit abnormalities and their relationship to treatment response, this technique has not yet been used in first-episode psychosis (FEP) patients in a manner that distinguishes the anterior from posterior hippocampus.

METHODS

We used masked-hippocampal-group-independent component analysis with dual regression to contrast subregional hippocampal-whole brain FC between healthy controls (HCs) and antipsychotic naïve FEP patients (N = 61, 36 female). In a subsample of FEP patients (N = 27, 15 female), we repeated this analysis following 8 weeks of second-generation antipsychotic treatment and explored whether baseline FC predicted treatment response using random forest.

RESULTS

Relative to HC, untreated FEP subjects displayed reproducibly lower FC between the left anteromedial hippocampus and cortical regions including the anterior cingulate and insular cortex (P < .05, corrected). Anteromedial hippocampal FC increased in FEP patients following treatment (P < .005), and no longer differed from HC. Random forest analysis showed baseline anteromedial hippocampal FC with four brain regions, namely the insular-opercular cortex, superior frontal gyrus, precentral gyrus, and postcentral gyrus predicted treatment response (area under the curve = 0.95).

CONCLUSIONS

Antipsychotic naïve FEP is associated with lower FC between the anterior hippocampus and cortical regions previously implicated in schizophrenia. Preliminary analysis suggests that random forest models based on hippocampal FC may predict treatment response in FEP patients, and hence could be a useful biomarker for treatment development.

Expected Reward Value and Reward Uncertainty Have Temporally Dissociable Effects on Memory Formation

Anticipating rewards has been shown to enhance memory formation. Although substantial evidence implicates dopamine in this behavioral effect, the precise mechanisms remain ambiguous. Because dopamine nuclei have been associated with two distinct physiological signatures of reward prediction, we hypothesized two dissociable effects on memory formation. These two signatures are a phasic dopamine response immediately following a reward cue that encodes its expected value and a sustained, ramping response that has been demonstrated during high reward uncertainty [Fiorillo, C. D., Tobler, P. N., & Schultz, W. Discrete coding of reward probability and uncertainty by dopamine neurons. Science, 299, 1898-1902, 2003]. Here, we show in humans that the impact of reward anticipation on memory for an event depends on its timing relative to these physiological signatures. By manipulating reward probability (100%, 50%, or 0%) and the timing of the event to be encoded (just after the reward cue versus just before expected reward outcome), we demonstrated the predicted double dissociation: Early during reward anticipation, memory formation was improved by increased expected reward value, whereas late during reward anticipation, memory formation was enhanced by reward uncertainty. Notably, although the memory benefits of high expected reward in the early interval were consolidation dependent, the memory benefits of high uncertainty in the later interval were not. These findings support the view that expected reward benefits memory consolidation via phasic dopamine release. The novel finding of a distinct memory enhancement, temporally consistent with sustained anticipatory dopamine release, points toward new mechanisms of memory modulation by reward now ripe for further investigation.

Divided Attention Selectively Impairs Value-Directed Encoding

In the present study, we examined the effect of value-directed encoding on recognition memory and how various divided attention tasks at encoding alter value-directed remembering. In the first experiment, participants encoded words that were assigned either high or low point values in multiple study-test phases. The points corresponded to the value the participants could earn by successfully recognizing the words in an upcoming recognition memory task. Importantly, participants were instructed that their goal was to maximize their score in this memory task. The second experiment was modified such that while studying the words participants simultaneously completed a divided attention task (either articulatory suppression or random number generation). The third experiment used a non-verbal tone detection divided attention task (easy or difficult versions). Subjective states of recollection (i.e., “Remember”) and familiarity (i.e., “Know”) were assessed at retrieval in all experiments. In Experiment 1, high value words were recognized more effectively than low value words, and this difference was primarily driven by increases in “Remember” responses with no difference in “Know” responses. In Experiment 2, the pattern of subjective judgment results from the articulatory suppression condition replicated Experiment 1. However, in the random number generation condition, the effect of value on recognition memory was lost. This same pattern of results was found in Experiment 3 which implemented a different variant of the divided attention task. Overall, these data suggest that executive processes are used when encoding valuable information and that value-directed improvements to memory are not merely the result of differential rehearsal.

Age-Related Trajectories of Functional Coupling between the VTA and Nucleus Accumbens Depend on Motivational State

Over-engagement of the mesolimbic dopamine system is thought to enhance motivation in adolescents. Whereas human neuroimaging has characterized event-evoked responses of the mesolimbic system in adolescents, research has yet to characterize state-dependent engagement (i.e., seconds to minutes) of this system in goal-relevant contexts. In the current longitudinal study, we characterized age-related changes in state-dependent coupling in male and female human participants ranging in age from adolescence to adulthood. Analyses focused on two key regions of the mesolimbic dopamine system, the ventral tegmental area (VTA) and nucleus accumbens (NAcc). Although there were no differences in VTA-NAcc functional coupling in a resting-state context, VTA-NAcc functional coupling was enhanced in preadolescence/early adolescence and decreased into adulthood in a motivational context, in which individuals had to translate goal-relevant cues into instrumental actions. Furthermore, we found that task-related activation in orbitofrontal cortex, middle temporal gyrus, and visual association cortex partially mediated age-related changes in state-dependent VTA-NAcc functional coupling. These results extend prior models of neurodevelopment by showing a relationship between cortical event-evoked activation and state-dependent increases in subcortical engagement of mesolimbic systems.SIGNIFICANCE STATEMENT Adolescence is characterized by increased motivated behavior, which is thought to result from an over-engagement of mesolimbic dopamine systems. Rodent models show increases in state-dependent engagement of mesolimbic systems in adolescence. However, human neuroimaging research has mainly focused on event-evoked responses (i.e., reward cues). We show that in motivational contexts, there is increased state-dependent coupling across mesolimbic systems in preadolescence/early adolescence that decreases into adulthood and is further predicted by event-evoked cortical responses. Critically, these developmental trajectories were specific to motivationally relevant contexts and were not apparent during resting state. These findings extend emerging models of human development and suggest that state-dependent increases in dopamine signaling may underlie heightened motivation.

Neuromodulatory Systems and Their Interactions: A Review of Models, Theories, and Experiments

Neuromodulatory systems, including the noradrenergic, serotonergic, dopaminergic, and cholinergic systems, track environmental signals, such as risks, rewards, novelty, effort, and social cooperation. These systems provide a foundation for cognitive function in higher organisms; attention, emotion, goal-directed behavior, and decision-making derive from the interaction between the neuromodulatory systems and brain areas, such as the amygdala, frontal cortex, hippocampus, and sensory cortices. Given their strong influence on behavior and cognition, these systems also play a key role in disease states and are the primary target of many current treatment strategies. The fact that these systems interact with each other either directly or indirectly, however, makes it difficult to understand how a failure in one or more systems can lead to a particular symptom or pathology. In this review, we explore experimental evidence, as well as focus on computational and theoretical models of neuromodulation. Better understanding of neuromodulatory systems may lead to the development of novel treatment strategies for a number of brain disorders.

Differential release of dopamine in the nucleus accumbens evoked by low-versus high-frequency medial prefrontal cortex stimulation

The medial prefrontal cortex (mPFC) coordinates goal-directed behaviors, which may be mediated through mPFC regulation of dopamine release in the nucleus accumbens (NAc). Furthermore, frequency-specific oscillatory activity between the frontal cortex and downstream structures may facilitate inter-region communication. Although high-frequency (e.g., 60 Hz) mPFC stimulation is known to increase basal dopamine levels in the NAc, little is known about how phasic dopamine release is affected by mPFC stimulation. Understanding the frequency-specific control of phasic dopamine release by mPFC stimulation could elucidate mechanisms by which the mPFC modulates other regions. It could also inform optimization of deep brain stimulation for treatment of neurological disorders.

OBJECTIVE

The goal of this work was to characterize the frequency response of NAc dopamine release resultant from mPFC stimulation. We hypothesized that the magnitude of dopamine release in the NAc would increase with increasing stimulation frequency.

METHODS

Electrical stimulation of the mPFC of anesthetized rats was delivered at 4-60 Hz and at varying durations while measuring NAc dopamine release with fast-scan cyclic voltammetry.

RESULTS

mPFC stimulation resulted in phasic dopamine release in the NAc. Furthermore, 20 Hz stimulation evoked the largest peak response for stimulation intervals >5 s when compared to higher or lower frequencies.

CONCLUSIONS

Activation of the mPFC drives dopamine release in the NAc in a complex frequency- and duration-dependent manner. This has implications for the use of deep brain stimulation treatment of disorders marked by dopaminergic dysregulation, and suggest that mPFC may exert more specialized control over neuromodulator release than previously understood.

Reward Anticipation Dynamics during Cognitive Control and Episodic Encoding: Implications for Dopamine

Dopamine (DA) modulatory activity critically supports motivated behavior. This modulation operates at multiple timescales, but the functional roles of these distinct dynamics on cognition are still being characterized. Reward processing has been robustly linked to DA activity; thus, examining behavioral effects of reward anticipation at different timing intervals, corresponding to different putative dopaminergic dynamics, may help in characterizing the functional role of these dynamics. Towards this end, we present two research studies investigating reward motivation effects on cognitive control and episodic memory, converging in their manipulation of rapid vs. multi-second reward anticipation (consistent with timing profiles of phasic vs. ramping DA, respectively) on performance. Under prolonged reward anticipation, both control and memory performances were enhanced, specifically when combined with other experimental factors: task-informative cues (control task) and reward uncertainty (memory task). Given observations of ramping DA under uncertainty (Fiorillo et al., 2003) and arguments that uncertainty may act as a control signal increasing environmental monitoring (Mushtaq et al., 2011), we suggest that task information and reward uncertainty can both serve as “need for control” signals that facilitate learning via enhanced monitoring, and that this activity may be supported by a ramping profile of dopaminergic activity. Observations of rapid (i.e., phasic) reward on control and memory performance can be interpreted in line with prior evidence, but review indicates that contributions of different dopaminergic timescales in these processes are not well-understood. Future experimental work to clarify these dynamics and characterize a cross-domain role for reward motivation and DA in goal-directed behavior is suggested.