Dopamine Neurons Encoding Long-Term Memory of Object Value for Habitual Behavior

Implication of regional selectivity of dopamine deficits in impaired suppressing of involuntary movements in Parkinson's disease

To improve the initiation and speed of intended action, one of the crucial mechanisms is suppressing unwanted movements that interfere with goal-directed behavior, which is observed relatively aberrant in Parkinson's disease patients. Recent research has highlighted that dopamine deficits in Parkinson's disease predominantly occur in the caudal lateral part of the substantia nigra pars compacta (SNc) in human patients. We previously found two parallel circuits within the basal ganglia, primarily divided into circuits mediated by the rostral medial part and caudal lateral part of the SNc dopamine neurons. We have further discovered that the indirect pathway in caudal basal ganglia circuits, facilitated by the caudal lateral part of the SNc dopamine neurons, plays a critical role in suppressing unnecessary involuntary movements when animals perform voluntary goal-directed actions. We thus explored recent research in humans and non-human primates focusing on the distinct functions and networks of the caudal lateral part of the SNc dopamine neurons to elucidate the mechanisms involved in the impairment of suppressing involuntary movements in Parkinson's disease patients.

Convergence of oxytocin and dopamine signalling in neuronal circuits: Insights into the neurobiology of social interactions across species

Social behaviour is essential for animal survival, and the hypothalamic neuropeptide oxytocin (OXT) critically impacts bonding, parenting, and decision-making. Dopamine (DA), is released by ventral tegmental area (VTA) dopaminergic neurons, regulating social cues in the mesolimbic system. Despite extensive exploration of OXT and DA roles in social behaviour independently, limited studies investigate their interplay. This narrative review integrates insights from human and animal studies, particularly rodents, emphasising recent research on pharmacological manipulations of OXT or DA systems in social behaviour. Additionally, we review studies correlating social behaviour with blood/cerebral OXT and DA levels. Behavioural facets include sociability, cooperation, pair bonding and parental care. In addition, we provide insights into OXT-DA interplay in animal models of social stress, autism, and schizophrenia. Emphasis is placed on the complex relationship between the OXT and DA systems and their collective influence on social behaviour across physiological and pathological conditions. Understanding OXT and DA imbalance is fundamental for unravelling the neurobiological underpinnings of social interaction and reward processing deficits observed in psychiatric conditions.

Robust memory of face moral values is encoded in the human caudate tail: a simultaneous EEG-fMRI study

Moral judgements about people based on their actions is a key component that guides social decision making. It is currently unknown how positive or negative moral judgments associated with a person's face are processed and stored in the brain for a long time. Here, we investigate the long-term memory of moral values associated with human faces using simultaneous EEG-fMRI data acquisition. Results show that only a few exposures to morally charged stories of people are enough to form long-term memories a day later for a relatively large number of new faces. Event related potentials (ERPs) showed a significant differentiation of remembered good vs bad faces over centerofrontal electrode sites (value ERP). EEG-informed fMRI analysis revealed a subcortical cluster centered on the left caudate tail (CDt) as a correlate of the face value ERP. Importantly neither this analysis nor a conventional whole-brain analysis revealed any significant coding of face values in cortical areas, in particular the fusiform face area (FFA). Conversely an fMRI-informed EEG source localization using accurate subject-specific EEG head models also revealed activation in the left caudate tail. Nevertheless, the detected caudate tail region was found to be functionally connected to the FFA, suggesting FFA to be the source of face-specific information to CDt. A further psycho-physiological interaction analysis also revealed task-dependent coupling between CDt and dorsomedial prefrontal cortex (dmPFC), a region previously identified as retaining emotional working memories. These results identify CDt as a main site for encoding the long-term value memories of faces in humans suggesting that moral value of faces activates the same subcortical basal ganglia circuitry involved in processing reward value memory for objects in primates.

Valence ambiguity dynamically shapes striatal dopamine heterogeneity

Adaptive decision making relies on dynamic updating of learned associations where environmental cues come to predict positive and negatively valenced stimuli, such as food or threat. Flexible cue-guided behaviors depend on a network of brain systems, including dopamine signaling in the striatum, which is critical for learning and maintenance of conditioned behaviors. Critically, it remains unclear how dopamine signaling encodes multi-valent, dynamic learning contexts, where positive and negative associations must be rapidly disambiguated. To understand this, we employed a Pavlovian discrimination paradigm, where cues predicting positive and negative outcomes were intermingled during conditioning sessions, and their meaning was serially reversed across training. We found that rats readily distinguished these cues, and updated their behavior rapidly upon valence reversal. Using fiber photometry, we recorded dopamine signaling in three major striatal subregions -,the dorsolateral striatum (DLS), the nucleus accumbens core, and the nucleus accumbens medial shell - and found heterogeneous responses to positive and negative conditioned cues and their predicted outcomes. Valence ambiguity introduced by cue reversal reshaped striatal dopamine on different timelines: nucleus accumbens core and shell signals updated more readily than those in the DLS. Together, these results suggest that striatal dopamine flexibly encodes multi-valent learning contexts, and these signals are dynamically modulated by changing contingencies to resolve ambiguity about the meaning of environmental cues.

Memory-specific encoding activities of the ventral tegmental area dopamine and GABA neurons

Although the midbrain dopamine (DA) system plays a crucial role in higher cognitive functions, including updating and maintaining short-term memory, the encoding properties of the somatic spiking activity of ventral tegmental area (VTA) DA neurons for short-term memory computations have not yet been identified. Here, we probed and analyzed the activity of optogenetically identified DA and GABA neurons while mice engaged in short-term memory-dependent behavior in a T-maze task. Single-neuron analysis revealed that significant subpopulations of DA and GABA neurons responded differently between left and right trials in the memory delay. With a series of control behavioral tasks and regression analysis tools, we show that firing rate differences are linked to short-term memory-dependent decisions and cannot be explained by reward-related processes, motivated behavior, or motor-related activities. This evidence provides novel insights into the mnemonic encoding activities of midbrain DA and GABA neurons.

Value-Based Search Efficiency Is Encoded in the Substantia Nigra Reticulata Firing Rate, Spiking Irregularity and Local Field Potential

Recent results show that valuable objects can pop out in visual search, yet its neural mechanisms remain unexplored. Given the role of substantia nigra reticulata (SNr) in object value memory and control of gaze, we recorded its single-unit activity while male macaque monkeys engaged in efficient or inefficient search for a valuable target object among low-value objects. The results showed that efficient search was concurrent with stronger inhibition and higher spiking irregularity in the target-present (TP) compared with the target-absent (TA) trials in SNr. Importantly, the firing rate differentiation of TP and TA trials happened within ∼100 ms of display onset, and its magnitude was significantly correlated with the search times and slopes (search efficiency). Time-frequency analyses of local field potential (LFP) after display onset revealed significant modulations of the gamma band power with search efficiency. The greater reduction of SNr firing in TP trials in efficient search can create a stronger disinhibition of downstream superior colliculus, which in turn can facilitate saccade to obtain valuable targets in competitive environments.

Prediction error in dopamine neurons during associative learning

Dopamine neurons have long been thought to facilitate learning by broadcasting reward prediction error (RPE), a teaching signal used in machine learning, but more recent work has advanced alternative models of dopamine's computational role. Here, I revisit this critical issue and review new experimental evidences that tighten the link between dopamine activity and RPE. First, I introduce the recent observation of a gradual backward shift of dopamine activity that had eluded researchers for over a decade. I also discuss several other findings, such as dopamine ramping, that were initially interpreted to conflict but later found to be consistent with RPE. These findings improve our understanding of neural computation in dopamine neurons.

Cortical and subcortical substrates of minutes and days-long object value memory in humans

Obtaining valuable objects motivates many of our daily decisions. However, the neural underpinnings of object processing based on human value memory are not yet fully understood. Here, we used whole-brain functional magnetic resonance imaging (fMRI) to examine activations due to value memory as participants passively viewed objects before, minutes after, and 1-70 days following value training. Significant value memory for objects was evident in the behavioral performance, which nevertheless faded over the days following training. Minutes after training, the occipital, ventral temporal, interparietal, and frontal areas showed strong value discrimination. Days after training, activation in the frontal, temporal, and occipital regions decreased, whereas the parietal areas showed sustained activation. In addition, days-long value responses emerged in certain subcortical regions, including the caudate, ventral striatum, and thalamus. Resting-state analysis revealed that these subcortical areas were functionally connected. Furthermore, the activation in the striatal cluster was positively correlated with participants' performance in days-long value memory. These findings shed light on the neural basis of value memory in humans with implications for object habit formation and cross-species comparisons.

Deep learning-based image analysis identifies a DAT-negative subpopulation of dopaminergic neurons in the lateral Substantia nigra

Here we present a deep learning-based image analysis platform (DLAP), tailored to autonomously quantify cell numbers, and fluorescence signals within cellular compartments, derived from RNAscope or immunohistochemistry. We utilised DLAP to analyse subtypes of tyrosine hydroxylase (TH)-positive dopaminergic midbrain neurons in mouse and human brain-sections. These neurons modulate complex behaviour, and are differentially affected in Parkinson's and other diseases. DLAP allows the analysis of large cell numbers, and facilitates the identification of small cellular subpopulations. Using DLAP, we identified a small subpopulation of TH-positive neurons (~5%), mainly located in the very lateral Substantia nigra (SN), that was immunofluorescence-negative for the plasmalemmal dopamine transporter (DAT), with ~40% smaller cell bodies. These neurons were negative for aldehyde dehydrogenase 1A1, with a lower co-expression rate for dopamine-D2-autoreceptors, but a ~7-fold higher likelihood of calbindin-d28k co-expression (~70%). These results have important implications, as DAT is crucial for dopamine signalling, and is commonly used as a marker for dopaminergic SN neurons.

Prefrontal cortex encodes value pop-out in visual search

Recent evidence demonstrates that long-term object value association can enhance visual search efficiency, a phenomenon known as value pop-out. However, the neural mechanism underlying this effect is not fully understood. Given the known role of the ventrolateral prefrontal cortex (vlPFC) in visual search and value memory, we recorded its single-unit activity (n = 526) in two macaque monkeys while they engaged in the value-driven search. Monkeys had to determine whether a high-value target was present within a variable number of low-value objects. Differential neural firing, as well as gamma-band power, indicated the presence of a target within ∼150ms of display onset. Notably, this differential activity was negatively correlated with search time and had reduced set-size dependence during efficient search. On the other hand, neural firing and its variability were higher in inefficient search. These findings implicate vlPFC in rapid detection of valuable targets which would be a crucial skill in competitive environments.

Anatomical and Functional Comparison of the Caudate Tail in Primates and the Tail of the Striatum in Rodents: Implications for Sensory Information Processing and Habitual Behavior

The tail of the striatum (TS) is located at the caudal end in the striatum. Recent studies have advanced our knowledge of the anatomy and function of the TS but also raised questions about the differences between rodent and primate TS. In this review, we compare the anatomy and function of the TS in rodent and primate brains. The primate TS is expanded more caudally during brain development in comparison with the rodent TS. Additionally, five sensory inputs from the cortex and thalamus converge in the rodent TS, but this convergence is not observed in the primate TS. The primate TS, including the caudate tail and putamen tail, primarily receives inputs from the visual areas, implying a specialized function in processing visual inputs for action generation. This anatomical difference leads to further discussion of cellular circuit models to comprehend how the primate brain processes a wider range of complex visual stimuli to produce habitual behavior as compared with the rodent brain. Examining these differences and considering possible neural models may provide better understanding of the anatomy and function of the primate TS.

Monkeys exhibit human-like gaze biases in economic decisions

In economic decision-making individuals choose between items based on their perceived value. For both humans and nonhuman primates, these decisions are often carried out while shifting gaze between the available options. Recent studies in humans suggest that these shifts in gaze actively influence choice, manifesting as a bias in favor of the items that are viewed first, viewed last, or viewed for the overall longest duration in a given trial. This suggests a mechanism that links gaze behavior to the neural computations underlying value-based choices. In order to identify this mechanism, it is first necessary to develop and validate a suitable animal model of this behavior. To this end, we have created a novel value-based choice task for macaque monkeys that captures the essential features of the human paradigms in which gaze biases have been observed. Using this task, we identified gaze biases in the monkeys that were both qualitatively and quantitatively similar to those in humans. In addition, the monkeys' gaze biases were well-explained using a sequential sampling model framework previously used to describe gaze biases in humans-the first time this framework has been used to assess value-based decision mechanisms in nonhuman primates. Together, these findings suggest a common mechanism that can explain gaze-related choice biases across species, and open the way for mechanistic studies to identify the neural origins of this behavior.

Environmental context-dependent activation of dopamine neurons via putative amygdala-nigra pathway in macaques

Seeking out good and avoiding bad objects is critical for survival. In practice, objects are rarely good every time or everywhere, but only at the right time or place. Whereas the basal ganglia (BG) are known to mediate goal-directed behavior, for example, saccades to rewarding objects, it remains unclear how such simple behaviors are rendered contingent on higher-order factors, including environmental context. Here we show that amygdala neurons are sensitive to environments and may regulate putative dopamine (DA) neurons via an inhibitory projection to the substantia nigra (SN). In male macaques, we combined optogenetics with multi-channel recording to demonstrate that rewarding environments induce tonic firing changes in DA neurons as well as phasic responses to rewarding events. These responses may be mediated by disinhibition via a GABAergic projection onto DA neurons, which in turn is suppressed by an inhibitory projection from the amygdala. Thus, the amygdala may provide an additional source of learning to BG circuits, namely contingencies imposed by the environment.

Structured memory representations develop at multiple time scales in hippocampal-cortical networks

Influential views of systems memory consolidation posit that the hippocampus rapidly forms representations of specific events, while neocortical networks extract regularities across events, forming the basis of schemas and semantic knowledge. Neocortical extraction of schematic memory representations is thought to occur on a protracted timescale of months, especially for information that is unrelated to prior knowledge. However, this theorized evolution of memory representations across extended timescales, and differences in the temporal dynamics of consolidation across brain regions, lack reliable empirical support. To examine the temporal dynamics of memory representations, we repeatedly exposed human participants to structured information via sequences of fractals, while undergoing longitudinal fMRI for three months. Sequence-specific activation patterns emerged in the hippocampus during the first 1-2 weeks of learning, followed one week later by high-level visual cortex, and subsequently the medial prefrontal and parietal cortices. Schematic, sequence-general representations emerged in the prefrontal cortex after 3 weeks of learning, followed by the medial temporal lobe and anterior temporal cortex. Moreover, hippocampal and most neocortical representations showed sustained rather than time-limited dynamics, suggesting that representations tend to persist across learning. These results show that specific hippocampal representations emerge early, followed by both specific and schematic representations at a gradient of timescales across hippocampal-cortical networks as learning unfolds. Thus, memory representations do not exist only in specific brain regions at a given point in time, but are simultaneously present at multiple levels of abstraction across hippocampal-cortical networks.

Hierarchical architecture of dopaminergic circuits enables second-order conditioning in Drosophila

Dopaminergic neurons with distinct projection patterns and physiological properties compose memory subsystems in a brain. However, it is poorly understood whether or how they interact during complex learning. Here, we identify a feedforward circuit formed between dopamine subsystems and show that it is essential for second-order conditioning, an ethologically important form of higher-order associative learning. The Drosophila mushroom body comprises a series of dopaminergic compartments, each of which exhibits distinct memory dynamics. We find that a slow and stable memory compartment can serve as an effective 'teacher' by instructing other faster and transient memory compartments via a single key interneuron, which we identify by connectome analysis and neurotransmitter prediction. This excitatory interneuron acquires enhanced response to reward-predicting odor after first-order conditioning and, upon activation, evokes dopamine release in the 'student' compartments. These hierarchical connections between dopamine subsystems explain distinct properties of first- and second-order memory long known by behavioral psychologists.

On the Relationship between Value- and Threat-Driven Attentional Capture and Approach-Avoidance Biases

Reward learning and aversive conditioning have consequences for attentional selection, such that stimuli that come to signal reward and threat bias attention regardless of their valence. Appetitive and aversive stimuli have distinctive influences on response selection, such that they activate an approach and an avoidance response, respectively. However, whether the involuntary influence of reward- and threat-history-laden stimuli extends to the manner in which a response is directed remains unclear. Using a feedback-joystick task and a manikin task, which are common paradigms for examining valence-action bias, we demonstrate that reward- and threat-signalling stimuli do not modulate response selection. Stimuli that came to signal reward and threat via training biased attention and invigorated action in general, but they did not facilitate an approach and avoidance response, respectively. We conclude that attention can be biased towards a stimulus as a function of its prior association with reward or aversive outcomes without necessarily influencing approach vs. avoidance tendencies, such that the mechanisms underlying the involuntary control of attention and behaviour evoked by valent stimuli can be decoupled.

Male DAT Val559 Mice Exhibit Compulsive Behavior under Devalued Reward Conditions Accompanied by Cellular and Pharmacological Changes

Identified across multiple psychiatric disorders, the dopamine (DA) transporter (DAT) Ala559Val substitution triggers non-vesicular, anomalous DA efflux (ADE), perturbing DA neurotransmission and behavior. We have shown that DAT Val559 mice display a waiting impulsivity and changes in cognitive performance associated with enhanced reward motivation. Here, utilizing a within-subject, lever-pressing paradigm designed to bias the formation of goal-directed or habitual behavior, we demonstrate that DAT Val559 mice modulate their nose poke behavior appropriately to match context, but demonstrate a perseverative checking behavior. Although DAT Val559 mice display no issues with the cognitive flexibility required to acquire and re-learn a visual pairwise discrimination task, devaluation of reward evoked habitual reward seeking in DAT Val559 mutants in operant tasks regardless of reinforcement schedule. The direct DA agonist apomorphine also elicits locomotor stereotypies in DAT Val559, but not WT mice. Our observation that dendritic spine density is increased in the dorsal medial striatum (DMS) of DAT Val559 mice speaks to an imbalance in striatal circuitry that might underlie the propensity of DAT Val559 mutants to exhibit compulsive behaviors when reward is devalued. Thus, DAT Val559 mice represent a model for dissection of how altered DA signaling perturbs circuits that normally balance habitual and goal-directed behaviors.

The zona incerta in control of novelty seeking and investigation across species

Many organisms rely on a capacity to rapidly replicate, disperse, and evolve when faced with uncertainty and novelty. But mammals do not evolve and replicate quickly. They rely on a sophisticated nervous system to generate predictions and select responses when confronted with these challenges. An important component of their behavioral repertoire is the adaptive context-dependent seeking or avoiding of perceptually novel objects, even when their values have not yet been learned. Here, we outline recent cross-species breakthroughs that shed light on how the zona incerta (ZI), a relatively evolutionarily conserved brain area, supports novelty-seeking and novelty-related investigations. We then conjecture how the architecture of the ZI's anatomical connectivity - the wide-ranging top-down cortical inputs to the ZI, and its specifically strong outputs to both the brainstem action controllers and to brain areas involved in action value learning - place the ZI in a unique role at the intersection of cognitive control and learning.

Striatal dopamine explains novelty-induced behavioral dynamics and individual variability in threat prediction

Animals both explore and avoid novel objects in the environment, but the neural mechanisms that underlie these behaviors and their dynamics remain uncharacterized. Here, we used multi-point tracking (DeepLabCut) and behavioral segmentation (MoSeq) to characterize the behavior of mice freely interacting with a novel object. Novelty elicits a characteristic sequence of behavior, starting with investigatory approach and culminating in object engagement or avoidance. Dopamine in the tail of the striatum (TS) suppresses engagement, and dopamine responses were predictive of individual variability in behavior. Behavioral dynamics and individual variability are explained by a reinforcement-learning (RL) model of threat prediction in which behavior arises from a novelty-induced initial threat prediction (akin to "shaping bonus") and a threat prediction that is learned through dopamine-mediated threat prediction errors. These results uncover an algorithmic similarity between reward- and threat-related dopamine sub-systems.

Long-term learning transforms prefrontal cortex representations during working memory

The role of the lateral prefrontal cortex (lPFC) in working memory (WM) is debated. Non-human primate (NHP) electrophysiology shows that the lPFC stores WM representations, but human neuroimaging suggests that the lPFC controls WM content in sensory cortices. These accounts are confounded by differences in task training and stimulus exposure. We tested whether long-term training alters lPFC function by densely sampling WM activity using functional MRI. Over 3 months, participants trained on both a WM and serial reaction time (SRT) task, wherein fractal stimuli were embedded within sequences. WM performance improved for trained (but not novel) fractals and, neurally, delay activity increased in distributed lPFC voxels across learning. Item-level WM representations became detectable within lPFC patterns, and lPFC activity reflected sequence relationships from the SRT task. These findings demonstrate that human lPFC develops stimulus-selective responses with learning, and WM representations are shaped by long-term experience, which could reconcile competing accounts of WM functioning.

Salience memories formed by value, novelty and aversiveness jointly shape object responses in the prefrontal cortex and basal ganglia

Ecological fitness depends on maintaining object histories to guide future interactions. Recent evidence shows that value memory changes passive visual responses to objects in ventrolateral prefrontal cortex (vlPFC) and substantia nigra reticulata (SNr). However, it is not known whether this effect is limited to reward history and if not how cross-domain representations are organized within the same or different neural populations in this corticobasal circuitry. To address this issue, visual responses of the same neurons across appetitive, aversive and novelty domains were recorded in vlPFC and SNr. Results showed that changes in visual responses across domains happened in the same rather than separate populations and were related to salience rather than valence of objects. Furthermore, while SNr preferentially encoded outcome related salience memory, vlPFC encoded salience memory across all domains in a correlated fashion, consistent with its role as an information hub to guide behavior.

Motivational salience drives habitual gazes during value memory retention and facilitates relearning of forgotten value

A habitual gaze is critical to efficiently identify and exploit valuable objects. However, it is unclear what salience components drive the habitual gaze choice. Here, we trained subjects to assign positive, neutral, and negative values to objects and found that motivational salience guided habitual gaze choices over 30 days of memory retention. The habitual preference for negatively valued objects emerged during memory retention. This habitual choice was not explained by a general model with salience components driven by physical features of objects and the rank of learned values. Instead, this is better explained by a model that contains an additional component driven by motivational salience. In a simulated value-forgotten condition, these motivational salience-based habitual choices facilitated re-learning. Our data indicate that after long-term retention, habitual gaze results from increased motivational salience, potentially facilitating the re-learning of forgotten values.

•

Habitual preference for negatively valued objects emerged during long-term retention

•

Changes in habitual preference were driven by 3 salience components over time

•

Preference for negatively valued objects facilitates re-learning of forgotten values

The effects of 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) on the cognitive and motor functions in rodents: A systematic review and meta-analysis

Memory and motor deficits are commonly identified in Parkinson's disease (PD). 1-Methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) is transformed to MPP+ via monoamine oxidase B (MAOB), which causes oxidative stress and destroys dopaminergic (DA) neurons in substantia nigra pars compacta (SNc) and is widely used to create animal models of PD. However, to-date, a comprehensive analysis of the MPTP effects on various aspects of PD does not exist. Here, we provide a systematic review and meta-analysis on the MPTP effects on memory and motor functions by analyzing 51 studies on more than one thousand animals mainly including rats and mice. The results showed that in addition to motor functions such as coordination, balance and locomotor activity, MPTP significantly affects various mnemonic processes including spatial memory, working memory, recognition memory, and associative memory compared with the control group with some differences between systemic and intra-nigral injections on spatial memory, familiar object recognition, and anxiety-like behaviors. Nevertheless, our analysis failed to find systematic relationship between MPTP injection protocol parameters reported and the extent of the induced PD symptoms that can be a cause of concern for replicability of MPTP studies.

The Subthalamic Nucleus Exclusively Evokes Dopamine Release in the Tail of the Striatum

A distinct population of dopamine neurons in the substantia nigra pars lateralis (SNL) has a unique projection to the most caudolateral (tail) region of the striatum. Here, using two electrochemical techniques to measure basal dopamine and electrically evoked dopamine release in anesthetized rats, we characterized this pathway, and compared it with the ‘classic’ nigrostriatal pathway from neighboring substantia nigra pars compacta (SNc) dopamine neurons to the dorsolateral striatum. We found that the tail striatum constitutes a distinct dopamine domain compared with the dorsolateral striatum, with consistently lower basal and evoked dopamine, and diverse dopamine release kinetics. Importantly, electrical stimulation of the SNL and SNc evoked dopamine release in entirely separate striatal regions; the tail and dorsolateral striatum, respectively. Furthermore, we showed that stimulation of the subthalamic nucleus (STN) evoked dopamine release exclusively in the tail striatum, likely via the SNL, consistent with previous anatomical evidence of STN afferents to SNL dopamine neurons. Our work identifies the STN as an important modulator of dopamine release in a novel dopamine pathway to the tail striatum, largely independent of the classic nigrostriatal pathway, which necessitates a revision of the basal ganglia circuitry with the STN positioned as a central integrator of striatal information.

Unbiased Stereological Estimates of Dopaminergic and GABAergic Neurons in the A10, A9, and A8 Subregions in the Young Male Macaque

The ventral midbrain is the primary source of dopamine- (DA) expressing neurons in most species. GABA-ergic and glutamatergic cell populations are intermixed among DA-expressing cells and purported to regulate both local and long-range dopamine neuron activity. Most work has been conducted in rodent models, however due to evolutionary expansion of the ventral midbrain in primates, the increased size and complexity of DA subpopulations warrants further investigation. Here, we quantified the number of DA neurons, and their GABA-ergic complement in classic DA cell groups A10 (midline ventral tegmental area nuclei [VTA] and parabrachial pigmented nucleus [PBP]), A9 (substantia nigra, pars compacta [SNc]) and A8 (retrorubral field [RRF]) in the macaque. Because the PBP is a disproportionately expanded feature of the A10 group, and has unique connectional features in monkeys, we analyzed A10 data by dividing it into 'classic' midline nuclei and the PBP. Unbiased stereology revealed total putative DA neuron counts to be 210,238 ± 17,127 (A10 = 110,319 ± 9649, A9 = 87,399 ± 7751 and A8 = 12,520 ± 827). Putative GABAergic neurons were fewer overall, and evenly dispersed across the DA subpopulations (GAD67 = 71,215 ± 5663; A10 = 16,836 ± 2743; A9 = 24,855 ± 3144 and A8 = 12,633 ± 3557). Calculating the GAD67/TH ratio for each subregion revealed differential balances of these two cell types across the DA subregions. The A8 subregion had the highest complement of GAD67-positive neurons compared to TH-positive neurons (1:1), suggesting a potentially high capacity for GABAergic inhibition of DA output in this region.

A unidirectional but not uniform striatal landscape of dopamine signaling for motivational stimuli

SignificanceAlthough it is undisputed that striatal dopamine plays a prominent role in motivated behavior and learning, the precise information conveyed by dopamine signals as such is under active debate. For a long time, the idea dominated that dopamine encodes a reward prediction error and that this signal is broadcast uniformly throughout the brain. However, here, we capture dopamine dynamics across many striatal regions and demonstrate that dopamine release is, regionally, extremely heterogeneous and that a reward prediction error-like signal is predominantly found in the relatively small limbic domain of the striatum. Another striking organizing principle is that stimulus valence directs dopamine concentration homogeneously across all regions (i.e., appetitive stimuli increase dopamine and aversive stimuli decrease dopamine).

Gustatory Cortex Is Involved in Evidence Accumulation during Food Choice

Food choice is one of the most fundamental and most frequent value-based decisions for all animals including humans. However, the neural circuitry involved in food-based decisions is only recently being addressed. Given the relatively fast dynamics of decision formation, electroencephalography (EEG)-informed fMRI analysis is highly beneficial for localizing this circuitry in humans. Here, by using the EEG correlates of evidence accumulation in a simultaneously recorded EEG-fMRI dataset, we found a significant role for the right temporal-parietal operculum (PO) and medial insula including gustatory cortex (GC) in binary choice between food items. These activations were uncovered by using the “EEG energy” (power 2 of EEG) as the BOLD regressor and were missed if conventional analysis with the EEG signal itself were to be used, in agreement with theoretical predictions for EEG and BOLD relations. No significant positive correlations were found with higher powers of EEG (powers 3 or 4) pointing to specificity and sufficiency of EEG energy as the main correlate of the BOLD response. This finding extends the role of cortical areas traditionally involved in palatability processing to value-based decision-making and offers the “EEG energy” as a key regressor of BOLD response in simultaneous EEG-fMRI designs.

Motor context modulates substantia nigra pars reticulata spike activity in patients with Parkinson's disease

OBJECTIVE

The severity of motor symptoms in Parkinson's disease (PD) depends on environmental conditions. For example, the presence of external patterns such as a rhythmic tone can attenuate bradykinetic impairments. However, the neural mechanisms for this context-dependent attenuation (e.g., paradoxical kinesis) remain unknown. Here, we investigate whether context-dependent symptom attenuation is reflected in single-unit activity recorded in the operating room from the substantia nigra pars reticulata (SNr) of patients with PD undergoing deep brain stimulation surgery. The SNr is known to influence motor planning and execution in animal models, but its role in humans remains understudied.

METHODS

We recorded SNr activity while subjects performed cued directional movements in response to auditory stimuli under interleaved 'patterned' and 'unpatterned' contexts. SNr localisation was independently confirmed with expert intraoperative assessment as well as post hoc imaging-based reconstructions.

RESULTS

As predicted, we found that motor performance was improved in the patterned context, reflected in increased reaction speed and accuracy compared with the unpatterned context. These behavioural differences were associated with enhanced responsiveness of SNr neurons-that is, larger changes in activity from baseline-in the patterned context. Unsupervised clustering analysis revealed two distinct subtypes of SNr neurons: one exhibited context-dependent enhanced responsiveness exclusively during movement preparation, whereas the other showed enhanced responsiveness during portions of the task associated with both motor and non-motor processes.

CONCLUSIONS

Our findings indicate the SNr participates in motor planning and execution, as well as warrants greater attention in the study of human sensorimotor integration and as a target for neuromodulatory therapies.

Lateral Habenula Responses During Eye Contact in a Reward Conditioning Task

For many animals, social interaction may have intrinsic reward value over and above its utility as a means to the desired end. Eye contact is the starting point of interactions in many social animals, including primates, and abnormal patterns of eye contact are present in many mental disorders. Whereas abundant previous studies have shown that negative emotions such as fear strongly affect eye contact behavior, modulation of eye contact by reward has received scant attention. Here we recorded eye movement patterns and neural activity in lateral habenula while monkeys viewed faces in the context of Pavlovian and instrumental conditioning tasks. Faces associated with larger rewards spontaneously elicited longer periods of eye contact from the monkeys, even though this behavior was not required or advantaged in the task. Concurrently, lateral habenula neurons were suppressed by faces signaling high value and excited by faces signaling low value. These results suggest that the reward signaling of lateral habenula may contribute to social behavior and disorders, presumably through its connections with the basal ganglia.

Determining Factors Affecting Customer Intention to Use Rooftop Solar Photovoltaics in Indonesia

Many developing countries on the equator, including Indonesia, have the potential for renewable and sustainable resources, such as solar energy. However, despite the enormous potential, the adoption level remains low. Previously, several studies discussed the potential, the feasibility, and the supporting policy of this technology, but none have been discussed from the customers’ perspective on a national scale. Therefore, this study attempts to determine the factors affecting the customers’ intention to use solar photovoltaics in Indonesia to develop a sustainable circular supply chain for renewable energy. This investigation was conducted based on integrating the unified theory of acceptance and use of technology 2 (UTAUT2) and the theory of planned behaviour (TPB). Furthermore, an online questionnaire was successfully distributed with a total of 208 participants. Structural equation modeling (SEM) was utilized to derive the causal relationships of the proposed hypotheses. The results indicated that price value (PV) has a positive relationship and a significant influence on attitude toward use (ATU), which leads to the behavioral intention (BI) to make the construct the most affecting factor. This is the first comprehensive study to analyze the intention to use rooftop solar panels based on the UTAUT2 and TPB framework. The successful approach to support photovoltaic use will bring less waste and strengthen the circular supply chain to support sustainable development.

Nigrostriatal dopamine signals sequence-specific action-outcome prediction errors

Dopamine has been suggested to encode cue-reward prediction errors during Pavlovian conditioning, signaling discrepancies between actual versus expected reward predicted by the cues.^1-5 While this theory has been widely applied to reinforcement learning concerning instrumental actions, whether dopamine represents action-outcome prediction errors and how it controls sequential behavior remain largely unknown. The vast majority of previous studies examining dopamine responses primarily have used discrete reward-predictive stimuli,^1-15 whether Pavlovian conditioned stimuli for which no action is required to earn reward or explicit discriminative stimuli that essentially instruct an animal how and when to respond for reward. Here, by training mice to perform optogenetic intracranial self-stimulation, we examined how self-initiated goal-directed behavior influences nigrostriatal dopamine transmission during single and sequential instrumental actions, in behavioral contexts with minimal overt changes in the animal's external environment. We found that dopamine release evoked by direct optogenetic stimulation was dramatically reduced when delivered as the consequence of the animal's own action, relative to non-contingent passive stimulation. This dopamine suppression generalized to food rewards was specific to the reinforced action, was temporally restricted to counteract the expected outcome, and exhibited sequence-selectivity consistent with hierarchical control of sequential behavior. These findings demonstrate that nigrostriatal dopamine signals sequence-specific prediction errors in action-outcome associations, with fundamental implications for reinforcement learning and instrumental behavior in health and disease.

Brain substrates for automatic retrieval of value memory in the primate basal ganglia

Our behavior is often carried out automatically. Automatic behavior can be guided by past experiences, such as learned values associated with objects. Passive-viewing and free-viewing tasks with no immediate outcomes provide a testable condition in which monkeys and humans automatically retrieve value memories and perform habitual searching. Interestingly, in these tasks, caudal regions of the basal ganglia structures are involved in automatic retrieval of learned object values and habitual gaze. In contrast, rostral regions do not participate in these activities but instead monitor the changes in outcomes. These findings indicate that automatic behaviors based on the value memories are processed selectively by the caudal regions of the primate basal ganglia system. Understanding the distinct roles of the caudal basal ganglia may provide insight into finding selective causes of behavioral disorders in basal ganglia disease.

Dopamine Circuit Mechanisms of Addiction-Like Behaviors

Addiction is a complex disease that impacts millions of people around the world. Clinically, addiction is formalized as substance use disorder (SUD), with three primary symptom categories: exaggerated substance use, social or lifestyle impairment, and risky substance use. Considerable efforts have been made to model features of these criteria in non-human animal research subjects, for insight into the underlying neurobiological mechanisms. Here we review evidence from rodent models of SUD-inspired criteria, focusing on the role of the striatal dopamine system. We identify distinct mesostriatal and nigrostriatal dopamine circuit functions in behavioral outcomes that are relevant to addictions and SUDs. This work suggests that striatal dopamine is essential for not only positive symptom features of SUDs, such as elevated intake and craving, but also for impairments in decision making that underlie compulsive behavior, reduced sociality, and risk taking. Understanding the functional heterogeneity of the dopamine system and related networks can offer insight into this complex symptomatology and may lead to more targeted treatments.

Optogenetic stimulation of striatal patches modifies habit formation and inhibits dopamine release

Habits are inflexible behaviors that develop after extensive repetition, and overreliance on habits is a hallmark of many pathological states. The striatum is involved in the transition from flexible to inflexible responding, and interspersed throughout the striatum are patches, or striosomes, which make up ~15% of the volume of the striatum relative to the surrounding matrix compartment. Previous studies have suggested that patches are necessary for normal habit formation, but it remains unknown exactly how patches contribute to habit formation and expression. Here, using optogenetics, we stimulated striatal patches in Sepw1-NP67 mice during variable interval training (VI60), which is used to establish habitual responding. We found that activation of patches at reward retrieval resulted in elevated responding during VI60 training by modifying the pattern of head entry and pressing. Further, this optogenetic manipulation reduced subsequent responding following reinforcer devaluation, suggesting modified habit formation. However, patch stimulation did not generally increase extinction rates during a subsequent extinction probe, but did result in a small 'extinction burst', further suggesting goal-directed behavior. On the other hand, this manipulation had no effect in omission trials, where mice had to withhold responses to obtain rewards. Finally, we utilized fast-scan cyclic voltammetry to investigate how patch activation modifies evoked striatal dopamine release and found that optogenetic activation of patch projections to the substantia nigra pars compacta (SNc) is sufficient to suppress dopamine release in the dorsal striatum. Overall, this work provides novel insight into the role of the patch compartment in habit formation, and provides a potential mechanism for how patches modify habitual behavior by exerting control over dopamine signaling.

Reward learning and working memory: Effects of massed versus spaced training and post-learning delay period

Neuroscience research has illuminated the mechanisms supporting learning from reward feedback, demonstrating a critical role for the striatum and midbrain dopamine system. However, in humans, short-term working memory that is dependent on frontal and parietal cortices can also play an important role, particularly in commonly used paradigms in which learning is relatively condensed in time. Given the growing use of reward-based learning tasks in translational studies in computational psychiatry, it is important to understand the extent of the influence of working memory and also how core gradual learning mechanisms can be better isolated. In our experiments, we manipulated the spacing between repetitions along with a post-learning delay preceding a test phase. We found that learning was slower for stimuli repeated after a long delay (spaced-trained) compared to those repeated immediately (massed-trained), likely reflecting the remaining contribution of feedback learning mechanisms when working memory is not available. For massed learning, brief interruptions led to drops in subsequent performance, and individual differences in working memory capacity positively correlated with overall performance. Interestingly, when tested after a delay period but not immediately, relative preferences decayed in the massed condition and increased in the spaced condition. Our results provide additional support for a large role of working memory in reward-based learning in temporally condensed designs. We suggest that spacing training within or between sessions is a promising approach to better isolate and understand mechanisms supporting gradual reward-based learning, with particular importance for understanding potential learning dysfunctions in addiction and psychiatric disorders.

Dopamine Axons in Dorsal Striatum Encode Contralateral Visual Stimuli and Choices

The striatum plays critical roles in visually-guided decision-making and receives dense axonal projections from midbrain dopamine neurons. However, the roles of striatal dopamine in visual decision-making are poorly understood. We trained male and female mice to perform a visual decision task with asymmetric reward payoff, and we recorded the activity of dopamine axons innervating striatum. Dopamine axons in the dorsomedial striatum (DMS) responded to contralateral visual stimuli and contralateral rewarded actions. Neural responses to contralateral stimuli could not be explained by orienting behavior such as eye movements. Moreover, these contralateral stimulus responses persisted in sessions where the animals were instructed to not move to obtain reward, further indicating that these signals are stimulus-related. Lastly, we show that DMS dopamine signals were qualitatively different from dopamine signals in the ventral striatum (VS), which responded to both ipsilateral and contralateral stimuli, conforming to canonical prediction error signaling under sensory uncertainty. Thus, during visual decisions, DMS dopamine encodes visual stimuli and rewarded actions in a lateralized fashion, and could facilitate associations between specific visual stimuli and actions.SIGNIFICANCE STATEMENT While the striatum is central to goal-directed behavior, the precise roles of its rich dopaminergic innervation in perceptual decision-making are poorly understood. We found that in a visual decision task, dopamine axons in the dorsomedial striatum (DMS) signaled stimuli presented contralaterally to the recorded hemisphere, as well as the onset of rewarded actions. Stimulus-evoked signals persisted in a no-movement task variant. We distinguish the patterns of these signals from those in the ventral striatum (VS). Our results contribute to the characterization of region-specific dopaminergic signaling in the striatum and highlight a role in stimulus-action association learning.

Tonic dopamine, uncertainty and basal ganglia action selection

To make optimal decisions in uncertain circumstances flexible adaption of behaviour is required; exploring alternatives when the best choice is unknown, exploiting what is known when that is best. Using a computational model of the basal ganglia, we propose that switches between exploratory and exploitative decisions are mediated by the interaction between tonic dopamine and cortical input to the basal ganglia. We show that a biologically detailed action selection circuit model, endowed with dopamine dependant striatal plasticity, can optimally solve the explore-exploit problem, estimating the true underlying state of a noisy Gaussian diffusion process. Critical to the model's performance was a fluctuating level of tonic dopamine which increased under conditions of uncertainty. With an optimal range of tonic dopamine, explore-exploit decisions were mediated by the effects of tonic dopamine on the precision of the model action selection mechanism. Under conditions of uncertain reward pay-out, the model's reduced selectivity allowed disinhibition of multiple alternative actions to be explored at random. Conversely, when uncertainly about reward pay-out was low, enhanced selectivity of the action selection circuit facilitated exploitation of the high value choice. Model performance was at the level of a Kalman filter which provides an optimal solution for the task. These simulations support the idea that this subcortical neural circuit may have evolved to facilitate decision making in non-stationary reward environments. The model generates several experimental predictions with relevance to abnormal decision making in neuropsychiatric and neurological disease.

Common coding of expected value and value uncertainty memories in the prefrontal cortex and basal ganglia output

Recent evidence implicates both basal ganglia and ventrolateral prefrontal cortex (vlPFC) in encoding value memories. However, comparative roles of cortical and basal nodes in value memory are not well understood. Here, single-unit recordings in vlPFC and substantia nigra reticulata (SNr), within macaque monkeys, revealed a larger value signal in SNr that was nevertheless correlated with and had a comparable onset to the vlPFC value signal. The value signal was maintained for many objects (>90) many weeks after reward learning and was resistant to extinction in both regions and to repetition suppression in vlPFC. Both regions showed comparable granularity in encoding expected value and value uncertainty, which was paralleled by enhanced gaze bias during free viewing. The value signal dynamics in SNr could be predicted by combining responses of vlPFC neurons according to their value preferences consistent with a scheme in which cortical neurons reached SNr via direct and indirect pathways.

Primate ventral striatum maintains neural representations of the value of previously rewarded objects for habitual seeking

The ventral striatum (VS) is considered a key region that flexibly updates recent changes in reward values for habit learning. However, this update process may not serve to maintain learned habitual behaviors, which are insensitive to value changes. Here, using fMRI in humans and single-unit electrophysiology in macaque monkeys we report another role of the primate VS: that the value memory subserving habitual seeking is stably maintained in the VS. Days after object-value associative learning, human and monkey VS continue to show increased responses to previously rewarded objects, even when no immediate reward outcomes are expected. The similarity of neural response patterns to each rewarded object increases after learning among participants who display habitual seeking. Our data show that long-term memory of high-valued objects is retained as a single representation in the VS and may be utilized to evaluate visual stimuli automatically to guide habitual behavior.

Emotion Induced Monoamine Neuromodulator Release Affects Functional Neurological Disorders

Functional neurologic disorders (FNDs), also called conversion disorder (previously called hysteria), can show almost all the symptoms of other neurological diseases, including both physical (for example, seizure, weakness, fatigue) and psychological (for instance, depression, anxiety) symptoms. In spite of our general knowledge about emotional processes and developmental defects in the formation of these somatic symptoms, there is still no systemic and comprehensive research on the effects of emotional developmental variables in FND. Recently, both experimental and theoretical emotion studies have been greatly increased, such as prediction error, conceptual act model, basic emotional theory, and monoamine neuromodulator based three primary emotions. In addition, a large amount of evidence has confirmed the role of psychosocial adversity (such as stressful life events, interpersonal difficulties) as an important risk factor for FND. Here, we review recent advances about emotional stress on FND, and pay special attention to the effects of monoamine neuromodulators, such as how norepinephrine and serotonin affect behaviors. Then, we discuss the significance of these changes for FND, which may contribute to clarifying the pathogenesis of FND, and thus provide potential therapeutic drug targets or psychological intervention methods in the future.

Environment-based object values learned by local network in the striatum tail

Choosing good objects is a fundamental behavior for all animals, to which the basal ganglia (BG) contribute extensively. However, the object choice needs to be changed in different environments. The mechanism of object choice is based on the neuronal circuits originating from output neurons (MSNs) in the striatum. We found that the environment information is provided by fast-spiking interneurons (FSIs) connecting to the MSN circuit. More critically, the experimental reduction of the FSI-input to MSNs disabled the monkey to learn the environment-based object choice. This proved that the object choice controlled by the downstream BG circuit is modulated by the environmental context controlled by the internal circuits in the top of BG circuit. This is important for our flexible decision.

Basal ganglia contribute to object-value learning, which is critical for survival. The underlying neuronal mechanism is the association of each object with its rewarding outcome. However, object values may change in different environments and we then need to choose different objects accordingly. The mechanism of this environment-based value learning is unknown. To address this question, we created an environment-based value task in which the value of each object was reversed depending on the two scene-environments (X and Y). After experiencing this task repeatedly, the monkeys became able to switch the choice of object when the scene-environment changed unexpectedly. When we blocked the inhibitory input from fast-spiking interneurons (FSIs) to medium spiny projection neurons (MSNs) in the striatum tail by locally injecting IEM-1460, the monkeys became unable to learn scene-selective object values. We then studied the mechanism of the FSI-MSN connection. Before and during this learning, FSIs responded to the scenes selectively, but were insensitive to object values. In contrast, MSNs became able to discriminate the objects (i.e., stronger response to good objects), but this occurred clearly in one of the two scenes (X or Y). This was caused by the scene-selective inhibition by FSI. As a whole, MSNs were divided into two groups that were sensitive to object values in scene X or in scene Y. These data indicate that the local network of striatum tail controls the learning of object values that are selective to the scene-environment. This mechanism may support our flexible switching behavior in various environments.

Combined influence of valence and statistical learning on the control of attention: Evidence for independent sources of bias

Selection history exerts a powerful influence on the control of attention. Stimuli signalling reward and punishment capture attention even when physically non-salient and task-irrelevant. Repeated presentation of a salient distractor at a particular location generates learned suppression, resulting in reduced attentional processing at that location. A debate in the field concerns whether different components of selection history influence attention via a common underlying mechanism of learning-dependent control or via distinct, independent mechanisms. We probed this question with a particular focus on reward/punishment history and learned suppression. Participants were trained to suppress a particular location (high probability distractor location) and associate colours with reward or no outcome (no-reward). In a subsequent task, reward and no-reward distractors appeared in all locations equally often. In a separate experiment, we replaced reward with electric shocks. Reward and shock distractors captured attention more strongly than no-reward and no-shock distractors irrespective of their location. Distractors appearing in the high probability location showed reduced capture irrespective of their type. The results imply that reward and punishment learning and learned suppression have independent influences on the attentional system.

Distinct temporal difference error signals in dopamine axons in three regions of the striatum in a decision-making task

Different regions of the striatum regulate different types of behavior. However, how dopamine signals differ across striatal regions and how dopamine regulates different behaviors remain unclear. Here, we compared dopamine axon activity in the ventral, dorsomedial, and dorsolateral striatum, while mice performed a perceptual and value-based decision task. Surprisingly, dopamine axon activity was similar across all three areas. At a glance, the activity multiplexed different variables such as stimulus-associated values, confidence, and reward feedback at different phases of the task. Our modeling demonstrates, however, that these modulations can be inclusively explained by moment-by-moment changes in the expected reward, that is the temporal difference error. A major difference between areas was the overall activity level of reward responses: reward responses in dorsolateral striatum were positively shifted, lacking inhibitory responses to negative prediction errors. The differences in dopamine signals put specific constraints on the properties of behaviors controlled by dopamine in these regions.

The Tail of the Striatum: From Anatomy to Connectivity and Function

The dorsal striatum, the largest subcortical structure of the basal ganglia, is critical in controlling motor, procedural, and reinforcement-based behaviors. Although in mammals the striatum extends widely along the rostro-caudal axis, current knowledge and derived theories about its anatomo-functional organization largely rely on results obtained from studies of its rostral sectors, leading to potentially oversimplified working models of the striatum as a whole. Recent findings indicate that the extreme caudal part of the striatum, also referred to as the tail of striatum (TS), represents an additional functional domain. Here, we provide an overview of past and recent studies revealing that the TS displays a heterogeneous cell-type-specific organization, and a unique input-output connectivity, which poises the TS as an integrator of sensory processing.

Spatiotemporal dissociation of fMRI activity in the caudate nucleus underlies human de novo motor skill learning

Numerous real-world motor skills require learning arbitrary relationships between actions and their consequences from scratch. However, little is understood about the neural signatures of de novo motor learning and associated individual variability. In a longitudinal fMRI experiment, where participants learned to control a cursor by moving fingers, we found a gradual transition of performance-related activity from the head to tail of the caudate nucleus. This finding reflects the flexible and stable reward representations in the head and tail, respectively. Additionally, intrinsic cortico-caudate connectivity predicted better learners with weaker head–prefrontal and stronger tail–sensorimotor interactions. The present study provides unprecedented insight into de novo motor learning, which may contribute to the understanding of motor-related disorders, and infant learning.

Motor skill learning involves a complex process of generating novel movement patterns guided by evaluative feedback, such as a reward. Previous literature has suggested anteroposteriorly separated circuits in the striatum to be implicated in early goal-directed and later automatic stages of motor skill learning, respectively. However, the involvement of these circuits has not been well elucidated in human de novomotor skill learning, which requires learning arbitrary action–outcome associations and value-based action selection. To investigate this issue, we conducted a human functional MRI (fMRI) experiment in which participants learned to control a computer cursor by manipulating their right fingers. We discovered a double dissociation of fMRI activity in the anterior and posterior caudate nucleus, which was associated with performance in the early and late learning stages. Moreover, cognitive and sensorimotor cortico-caudate interactions predicted individual learning performance. Our results suggest parallel cortico-caudate networks operating in different stages of human de novomotor skill learning.

Differential functional dysconnectivity of caudate nucleus subdivisions in Parkinson's disease

Caudate dopaminergic dysfunction is implied in the pathophysiology of patients with Parkinson's disease (PD). Still, connectivity specificities of the caudate nucleus (CN) subdivisions and the effect of dopamine are poorly understood. We collected MRI and neuropsychological data from 34 PD patients and 26 age- and sex-matched healthy elderly individuals (HEs) in this study. Resting-state functional connectivity analysis revealed that compared to the other CN subdivisions, the CN head was more strongly connected to the default mode network (DMN), the CN body to the frontoparietal network (FPN), and the CN tail to the visual network in HEs. PD patients off medication showed reduced connectivity within all these subdivision networks. In PD patients on medication, functional connectivity in the CN head network was significantly improved in the medial prefrontal cortex and in the body network it was improved in the dorsolateral prefrontal cortex. These improvements contributed to ameliorated motivation and cognitive function in PD patients. Our results highlighted the specific alterations and dopamine modulation in these CN subdivision networks in PD, which may provide insight into the pathophysiology and therapeutics of this disease.

Dopamine is associated with prioritization of reward-associated memories in Parkinson's disease

Patients with Parkinson's disease have reduced reward sensitivity related to dopaminergic neuron loss, which is associated with impairments in reinforcement learning. Increasingly, however, dopamine-dependent reward signals are recognized to play an important role beyond reinforcement learning. In particular, it has been shown that reward signals mediated by dopamine help guide the prioritization of events for long-term memory consolidation. Meanwhile, studies of memory in patients with Parkinson's disease have focused on overall memory capacity rather than what is versus what isn't remembered, leaving open questions about the effect of dopamine replacement on the prioritization of memories by reward and the time-dependence of this effect. The current study sought to fill this gap by testing the effect of reward and dopamine on memory in patients with Parkinson's disease. We tested the effect of dopamine modulation and reward on two forms of long-term memory: episodic memory for neutral objects and memory for stimulus-value associations. We measured both forms of memory in a single task, adapting a standard task of reinforcement learning with incidental episodic encoding events of trial-unique objects. Objects were presented on each trial at the time of feedback, which was either rewarding or not. Memory for the trial-unique images and for the stimulus-value associations, and the influence of reward on both, was tested immediately after learning and 2 days later. We measured performance in Parkinson's disease patients tested either ON or OFF their dopaminergic medications and in healthy older control subjects. We found that dopamine was associated with a selective enhancement of memory for reward-associated images, but that it did not influence overall memory capacity. Contrary to predictions, this effect did not differ between the immediate and delayed memory tests. We also found that while dopamine had an effect on reward-modulated episodic memory, there was no effect of dopamine on memory for stimulus-value associations. Our results suggest that impaired prioritization of cognitive resource allocation may contribute to the early cognitive deficits of Parkinson's disease.

Brain Networks Sensitive to Object Novelty, Value, and Their Combination

Novel and valuable objects are motivationally attractive for animals including primates. However, little is known about how novelty and value processing is organized across the brain. We used fMRI in macaques to map brain responses to visual fractal patterns varying in either novelty or value dimensions and compared the results with the structure of functionally connected brain networks determined at rest. The results show that different brain networks possess unique combinations of novelty and value coding. One network identified in the ventral temporal cortex preferentially encoded object novelty, whereas another in the parietal cortex encoded the learned value. A third network, broadly composed of temporal and prefrontal areas (TP network), along with functionally connected portions of the striatum, amygdala, and claustrum, encoded both dimensions with similar activation dynamics. Our results support the emergence of a common currency signal in the TP network that may underlie the common attitudes toward novel and valuable objects.

Topographic distinction in long-term value signals between presumed dopamine neurons and presumed striatal projection neurons in behaving monkeys

Nigrostriatal dopamine (DA) projections are anatomically organized along the dorsolateral-ventromedial axis, conveying long-term value signals to the striatum for shaping actions toward multiple future rewards. The present study examines whether the topographic organization of long-term value signals are observed upon activity of presumed DA neurons and presumed striatal projection neurons (phasically active neurons, PANs), as predicted based on anatomical literature. Our results indicate that DA neurons in the dorsolateral midbrain encode long-term value signals on a short timescale, while ventromedial midbrain DA neurons encode such signals on a relatively longer timescale. Activity of the PANs in the dorsal striatum is more heterogeneous for encoding long-term values, although significant differences in long-term value signals were observed between the caudate nucleus and putamen. These findings suggest that topographic DA signals for long-term values are not simply transferred to striatal neurons, possibly due to the contribution of other projections to the striatum.