Role of dopamine in the primate caudate nucleus in reward modulation of saccades

Implication of regional selectivity of dopamine deficits in impaired suppressing of involuntary movements in Parkinson's disease

To improve the initiation and speed of intended action, one of the crucial mechanisms is suppressing unwanted movements that interfere with goal-directed behavior, which is observed relatively aberrant in Parkinson's disease patients. Recent research has highlighted that dopamine deficits in Parkinson's disease predominantly occur in the caudal lateral part of the substantia nigra pars compacta (SNc) in human patients. We previously found two parallel circuits within the basal ganglia, primarily divided into circuits mediated by the rostral medial part and caudal lateral part of the SNc dopamine neurons. We have further discovered that the indirect pathway in caudal basal ganglia circuits, facilitated by the caudal lateral part of the SNc dopamine neurons, plays a critical role in suppressing unnecessary involuntary movements when animals perform voluntary goal-directed actions. We thus explored recent research in humans and non-human primates focusing on the distinct functions and networks of the caudal lateral part of the SNc dopamine neurons to elucidate the mechanisms involved in the impairment of suppressing involuntary movements in Parkinson's disease patients.

The Mesocortical System Encodes the Strength of Subsequent Force Generation

Our minds impact motor outputs. Such mind-motor interactions are critical for understanding motor control mechanisms and optimizing motor performance. In particular, incentive motivation strongly enhances motor performance. Dopaminergic neurons located in the ventral midbrain (VM) are believed to be the center of incentive motivation. Direct projections from the VM to the primary motor cortex constitute a mesocortical pathway. However, the functional role of this pathway in humans remains unclear. Recently, we demonstrated the functional role of the mesocortical pathway in human motor control in the context of incentive motivation by using functional magnetic resonance imaging (fMRI). Incentive motivation remarkably improved not only reaction times but also the peak grip force in subsequent grip responses. Although the reaction time has been used as a proxy for incentive motivation mediated by dopaminergic midbrain activity, the premovement activity of the mesocortical pathway is involved in controlling the force strength rather than the initiation of subsequent force generation. In this commentary, we review our recent findings and discuss remaining questions regarding the functional role of the mesocortical pathway in mind-motor interactions.

Neural underpinnings of fine motor skills under stress and anxiety: A review

This review offers a comprehensive examination of how stress and anxiety affect motor behavior, particularly focusing on fine motor skills and gait adaptability. We explore the role of several neurochemicals, including brain-derived neurotrophic factor (BDNF) and dopamine, in modulating neural plasticity and motor control under these affective states. The review highlights the importance of developing therapeutic strategies that enhance motor performance by leveraging the interactions between key neurochemicals. Additionally, we investigate the complex interplay between emotional-cognitive states and sensorimotor behaviors, showing how stress and anxiety disrupt neural integration, leading to impairments in skilled movements and negatively impacting quality of life. Synthesizing evidence from human and rodent studies, we provide a detailed understanding of the relationships among stress, anxiety, and motor behavior. Our findings reveal neurophysiological pathways, behavioral outcomes, and potential therapeutic targets, emphasizing the intricate connections between neurobiological mechanisms, environmental factors, and motor performance.

Relationship between functional connectivity and weight-gain risk of antipsychotics in schizophrenia

BACKGROUND

The mechanisms by which antipsychotic medications (APs) contribute to obesity in schizophrenia are not well understood. Because AP effects on functional brain connectivity may contribute to weight effects, the current study investigated how AP-associated weight-gain risk relates to functional connectivity in schizophrenia.

METHODS

Fifty-five individuals with schizophrenia (final N = 54) were divided into groups based on previously reported AP weight-gain risk (no APs/low risk [N = 19]; moderate risk [N = 17]; high risk [N = 18]). Resting-state functional magnetic resonance imaging (fMRI) was completed after an overnight fast ("fasted") and post-meal ("fed"). Correlations between AP weight-gain risk and functional connectivity were assessed at the whole-brain level and in reward- and eating-related brain regions (anterior insula, caudate, nucleus accumbens).

RESULTS

When fasted, greater AP weight-gain risk was associated with increased connectivity between thalamus and sensorimotor cortex (pFDR = 0.021). When fed, greater AP weight-gain risk was associated with increased connectivity between left caudate and left precentral/postcentral gyri (pFDR = 0.048) and between right caudate and multiple regions, including the left precentral/postcentral gyri (pFDR = 0.001), intracalcarine/precuneal/cuneal cortices (pFDR < 0.001), and fusiform gyrus (pFDR = 0.008). When fed, greater AP weight-gain risk was also associated with decreased connectivity between right anterior insula and ventromedial prefrontal cortex (pFDR = 0.002).

CONCLUSIONS

APs with higher weight-gain risk were associated with greater connectivity between reward-related regions and sensorimotor regions when fasted, perhaps relating to motor anticipation for consumption. Higher weight-gain risk APs were also associated with increased connectivity between reward, salience, and visual regions when fed, potentially reflecting greater desire for consumption following satiety.

Organization of reward and movement signals in the basal ganglia and cerebellum

The basal ganglia and the cerebellum are major subcortical structures in the motor system. The basal ganglia have been cast as the reward center of the motor system, whereas the cerebellum is thought to be involved in adjusting sensorimotor parameters. Recent findings of reward signals in the cerebellum have challenged this dichotomous view. To compare the basal ganglia and the cerebellum directly, we recorded from oculomotor regions in both structures from the same monkeys. We partitioned the trial-by-trial variability of the neurons into reward and eye-movement signals to compare the coding across structures. Reward expectation and movement signals were the most pronounced in the output structure of the basal ganglia, intermediate in the cerebellum, and the smallest in the input structure of the basal ganglia. These findings suggest that reward and movement information is sharpened through the basal ganglia, resulting in a higher signal-to-noise ratio than in the cerebellum.

A comparative study of gray matter volumetric alterations in adults with attention deficit hyperactivity disorder and bipolar disorder type I

BACKGROUND

Attention deficit hyperactivity disorder (ADHD) and bipolar disorder type I (BD-Ι) share great overlapping symptoms and are highly comorbid. We aimed to compare and obtain the common and distinct gray matter volume (GMV) patterns in adult patients.

METHOD

We searched four databases to include whole-brain voxel-based morphometry studies and compared the GMV patterns between ADHD and healthy controls (HCs), between BD-I and HCs, and between ADHD and BD-I using anisotropic effect-size signed differential mapping software.

RESULTS

We included 677 ADHD and 452 BD-Ι patients. Compared with HCs, ADHD patients showed smaller GMV in the anterior cingulate cortex (ACC) and supramarginal gyrus but a larger caudate nucleus. Compared with HCs, BD-Ι patients showed smaller GMV in the orbitofrontal cortex, parahippocampal gyrus, and amygdala. No common GMV alterations were found, whereas ADHD showed the smaller ACC and larger amygdala relative to BD-Ι. Subgroup analyses revealed the larger insula in manic patients, which was positively associated with the Young Mania Rating Scale. The decreased median cingulate cortex (MCC) was positively associated with the ages in ADHD, whereas the MCC was negatively associated with the ages in BD-Ι.

LIMITATIONS

All included data were cross-sectional; Potential effects of medication and disease course were not analyzed due to the limited data.

CONCLUSIONS

ADHD showed altered GMV in the frontal-striatal frontal-parietal circuits, and BD-Ι showed altered GMV in the prefrontal-amygdala circuit. These findings could contribute to a better understanding of the neuropathology of the two disorders.

Conditional Regulation of Blood Pressure in Response to Emotional Stimuli by the Central Nucleus of the Amygdala in Rats

Humans and animals can determine whether a situation is favorable to them and act accordingly. For this, the autonomic tuning of the cardiovascular system to supply energy to active skeletal muscles through the circulatory system is as important as motor control. However, how the autonomic cardiovascular responses are regulated in dynamically changing environments and the neuronal mechanisms underlying these responses remain unclear. To resolve these issues, we recorded the blood pressure and heart rate of head-restrained rats during dynamically changing appetitive and aversive classical conditioning tasks. The rats displayed various associations between conditioned stimuli and unconditioned stimuli in appetitive (sucrose water), neutral (no outcome), and aversive (air puff) blocks. The blood pressure and heart rate in the appetitive block gradually increased in response to the reward-predicting cue and the response to the actual reward vigorously increased. The reward-predictive response was significantly higher than the responses obtained in the neutral and aversive condition blocks. To investigate whether the reward-predictive pressor response was caused by orofacial movements such as anticipatory licking behavior, we separately analyzed high- and low-licking trials. The conditioned pressor response was observed even in trials with low-licking behaviors. Blood pressure and heart rate responses to the air puff-predicting cue in the aversive block were not significantly different from the responses in the neutral block. The conditioned blood pressure response rapidly changed with condition block switching. Furthermore, to examine the contribution of the amygdala as an emotion center to these conditioned responses, we bilaterally microinjected a GABA_A receptor agonist, muscimol, into the central nucleus of the amygdala. Pharmacological inactivation of the central nucleus of the amygdala significantly decreased the reward-predictive pressor responses. These results suggest that the blood pressure is adaptively and rapidly regulated by emotional conditioned stimuli and that the central nucleus of the amygdala participates in regulating the pressor response in dynamically changing situations.

Neural Substrates of the Drift-Diffusion Model in Brain Disorders

Many studies on the drift-diffusion model (DDM) explain decision-making based on a unified analysis of both accuracy and response times. This review provides an in-depth account of the recent advances in DDM research which ground different DDM parameters on several brain areas, including the cortex and basal ganglia. Furthermore, we discuss the changes in DDM parameters due to structural and functional impairments in several clinical disorders, including Parkinson's disease, Attention Deficit Hyperactivity Disorder (ADHD), Autism Spectrum Disorders, Obsessive-Compulsive Disorder (OCD), and schizophrenia. This review thus uses DDM to provide a theoretical understanding of different brain disorders.

Associations Between Chronic Irritability and Sensory Processing Difficulties in Children and Adolescents

Irritability is one of the most common reasons for which children and adolescents are referred for psychiatric evaluation and care. However, clinical irritability is difficult to define; thus, its prevalence varies widely. Chronic irritability may be associated with sensory processing difficulties (SPD), but little is known about the relationship between these two factors in clinical populations. In this study, we examined the prevalence of chronic irritability and its association with SPD in 166 children aged 5-16 years who were referred to the psychiatric outpatient clinic of the Osaka City University Hospital. Chronic irritability and parent-reported scores for the Short Sensory Profile, Infant Behavior Checklist-Revised, Child Behavior Checklist, and Kiddie Schedule for Affective Disorders and Schizophrenia for School-Age Children (Present and Lifetime version) questionnaires were used for assessment. A total of 22 children (13.2%) presented with chronic irritability (i.e., the irritability group) and were more likely to have oppositional defiant disorder, externalizing problems, and attention issues than those without chronic irritability (i.e., the control group). SPD were reported in eight (36%) patients in the irritability group and in 21 (15%) in the control group (p = 0.029). Moreover, compared to the control group, the irritability group showed a significant difference in almost all items of the Short Sensory Profile. Chronic irritability was associated with more severe overall SPD, even after adjusting for possible confounding factors (internalizing and externalizing problems, age, sex, and low income). We provide evidence to support our hypothesis that chronic irritability is associated with SPD in children and adolescents. Therefore, SPD should be assessed to provide appropriate interventions in children and adolescents with chronic irritability.

The neural substrates of subliminal attentional bias and reduced inhibition in individuals with a higher BMI: A VBM and resting state connectivity study

Previous studies have shown that individuals with overweight and obesity may experience attentional biases and reduced inhibition toward food stimuli. However, evidence is scarce as to whether the attentional bias is present even before stimuli are consciously recognized. Moreover, it is not known whether or not differences in the underlying brain morphometry and connectivity may co-occur with attentional bias and impulsivity towards food in individuals with different BMIs. To address these questions, we asked fifty-three participants (age M = 23.2, SD = 2.9, 13 males) to perform a breaking Continuous Flash Suppression (bCFS) task to measure the speed of subliminal processing, and a Go/No-Go task to measure inhibition, using food and nonfood stimuli. We collected whole-brain structural magnetic resonance images and functional resting-state activity. A higher BMI predicted slower subliminal processing of images independently of the type of stimulus (food or nonfood, p = 0.001, ε_p² = 0.17). This higher threshold of awareness is linked to lower grey matter (GM) density of key areas involved in awareness, high-level sensory integration, and reward, such as the orbitofrontal cortex [t = 4.55, p = 0.003], the right temporal areas [t = 4.18, p = 0.002], the operculum and insula [t = 4.14, p = 0.005] only in individuals with a higher BMI. In addition, individuals with a higher BMI exhibit a specific reduced inhibition to food in the Go/No-Go task [p = 0.02, ε_p² = 0.02], which is associated with lower GM density in reward brain regions [orbital gyrus, t = 4.97, p = 0.005, and parietal operculum, t = 5.14, p < 0.001] and lower resting-state connectivity of the orbital gyrus to visual areas [fusiform gyrus, t = -4.64, p < 0.001 and bilateral occipital cortex, t = -4.51, p < 0.001 and t = -4.34, p < 0.001]. Therefore, a higher BMI is predictive of non food-specific slower visual subliminal processing, which is linked to morphological alterations of key areas involved in awareness, high-level sensory integration, and reward. At a late, conscious stage of visual processing a higher BMI is associated with a specific bias towards food and with lower GM density in reward brain regions. Finally, independently of BMI, volumetric variations and connectivity patterns in different brain regions are associated with variability in bCFS and Go/No-Go performances.

Movement errors during skilled motor performance engage distinct prediction error mechanisms

The brain detects deviations from intended behaviors by estimating the mismatch between predicted and actual outcomes. Axiomatic to these computations are salience and valence prediction error signals, which alert the brain to the occurrence and value of unexpected events. Despite the theoretical assertion of these prediction error signals, it is unknown whether and how brain mechanisms underlying their computations support error processing during skilled motor behavior. Here we demonstrate, with functional magnetic resonance imaging, that internal detection, i.e., without externally-provided feedback, of self-generated movement errors evokes instantaneous activity increases within the salience network and delayed lingering decreases within the nucleus accumbens - a key structure in the reward valuation pathway. A widespread suppression within the sensorimotor network was also observed. Our findings suggest that neural computations of salience and valence prediction errors during skilled motor behaviors operate on different time-scales and, therefore, may contribute differentially to immediate and longer-term adaptive processes.

Frontal eye field and caudate neurons make different contributions to reward-biased perceptual decisions

Many decisions require trade-offs between sensory evidence and internal preferences. Potential neural substrates include the frontal eye field (FEF) and caudate nucleus, but their distinct roles are not understood. Previously we showed that monkeys’ decisions on a direction-discrimination task with asymmetric rewards reflected a biased accumulate-to-bound decision process (Fan et al., 2018) that was affected by caudate microstimulation (Doi et al., 2020). Here we compared single-neuron activity in FEF and caudate to each other and to accumulate-to-bound model predictions derived from behavior. Task-dependent neural modulations were similar in both regions. However, choice-selective neurons in FEF, but not caudate, encoded behaviorally derived biases in the accumulation process. Baseline activity in both regions was sensitive to reward context, but this sensitivity was not reliably associated with behavioral biases. These results imply distinct contributions of FEF and caudate neurons to reward-biased decision-making and put experimental constraints on the neural implementation of accumulation-to-bound-like computations.

Mechanisms for the Approach/Avoidance Decision Applied to Autism

As a neurodevelopmental disorder with serious lifelong consequences, autism has received considerable attention from neuroscientists and geneticists. We present a hypothesis of mechanisms plausibly affected during brain development in autism, based on neural pathways that are associated with social behavior and connect the prefrontal cortex (PFC) to the basal ganglia (BG). We consider failure of social approach in autism as a special case of imbalance in the fundamental dichotomy between behavioral approach and avoidance. Differential combinations of genes mutated, differences in the timing of their impact during development, and graded degrees of hormonal influences may help explain the heterogeneity in symptomatology in autism and predominance in boys.

The caudate nucleus contributes causally to decisions that balance reward and uncertain visual information

Our decisions often balance what we observe and what we desire. A prime candidate for implementing this complex balancing act is the basal ganglia pathway, but its roles have not yet been examined experimentally in detail. Here, we show that a major input station of the basal ganglia, the caudate nucleus, plays a causal role in integrating uncertain visual evidence and reward context to guide adaptive decision-making. In monkeys making saccadic decisions based on motion cues and asymmetric reward-choice associations, single caudate neurons encoded both sources of information. Electrical microstimulation at caudate sites during motion viewing affected the monkeys’ decisions. These microstimulation effects included coordinated changes in multiple computational components of the decision process that mimicked the monkeys’ similarly coordinated voluntary strategies for balancing visual and reward information. These results imply that the caudate nucleus plays causal roles in coordinating decision processes that balance external evidence and internal preferences.

Comparison of brain connectomes by MRI and genomics and its implication in Alzheimer's disease

BACKGROUND

The human brain is complex and interconnected structurally. Brain connectome change is associated with Alzheimer's disease (AD) and other neurodegenerative diseases. Genetics and genomics studies have identified molecular changes in AD; however, the results are often limited to isolated brain regions and are difficult to interpret its findings in respect to brain connectome. The mechanisms of how one brain region impacts the molecular pathways in other regions have not been systematically studied. And how the brain regions susceptible to AD pathology interact with each other at the transcriptome level and how these interactions relate to brain connectome change are unclear.

METHODS

Here, we compared structural brain connectomes defined by probabilistic tracts using diffusion magnetic resonance imaging data in Alzheimer's Disease Neuroimaging Initiative database and a brain transcriptome dataset covering 17 brain regions.

RESULTS

We observed that the changes in diffusion measures associated with AD diagnosis status and the associations were replicated in an independent cohort. The result suggests that disease associated white matter changes are focal. Analysis of the brain connectome by genomic data, tissue-tissue transcriptional synchronization between 17 brain regions, indicates that the regions connected by AD-associated tracts were likely connected at the transcriptome level with high number of tissue-to-tissue correlated (TTC) gene pairs (P = 0.03). And genes involved in TTC gene pairs between white matter tract connected brain regions were enriched in signaling pathways (P = 6.08 × 10-9). Further pathway interaction analysis identified ionotropic glutamate receptor pathway and Toll receptor signaling pathways to be important for tissue-tissue synchronization at the transcriptome level. Transcript profile entailing Toll receptor signaling in the blood was significantly associated with diffusion properties of white matter tracts, notable association between fractional anisotropy and bilateral cingulum angular bundles (Ppermutation = 1.0 × 10-2 and 4.9 × 10-4 for left and right respectively).

CONCLUSIONS

In summary, our study suggests that brain connectomes defined by MRI and transcriptome data overlap with each other.

Hypomania and saccadic changes in Parkinson's disease: influence of D2 and D3 dopaminergic signalling

In order to understand the influence of two dopaminergic signalling pathways, TaqIA rs1800497 (influencing striatal D2 receptor density) and Ser9Gly rs6280 (influencing the striatal D3 dopamine-binding affinity), on saccade generation and psychiatric comorbidities in Parkinson’s disease, this study aimed to investigate the association of saccadic performance in hypomanic or impulsive behaviour in parkinsonian patients; besides we questioned whether variants of D2 (A1+/A1−) and D3 (B1+/B1−) receptor polymorphism influence saccadic parameters differently, and if clinical parameters or brain connectivity changes modulate this association in the nigro-caudatal and nigro-collicular tract. Initially, patients and controls were compared regarding saccadic performance and differed in the parameter duration in memory-guided saccades (MGS) and visually guided saccades (VGS) trials (p < 0.0001) and in the MGS trial (p < 0.03). We were able to find associations between hypomanic behaviour (HPS) and saccade parameters (duration, latency, gain and amplitude) for both conditions [MGS (p = 0.036); VGS (p = 0.033)], but not for impulsive behaviour. For the A1 variant duration was significantly associated with HPS [VGS (p = 0.024); MGS (p = 0.033)]. In patients with the B1 variant, HPS scores were more consistently associated with duration [VGS (p = 0.005); MGS (p = 0.015), latency [VGS (p = 0.022)]] and amplitude [MGS (p = 0.006); VGS (p = 0.005)]. The mediation analysis only revealed a significant indirect effect for amplitude in the MGS modality for the variable UPDRS-ON (p < 0.05). All other clinical scales and brain connectivity parameters were not associated with behavioural traits. Collectively, our findings stress the role of striatal D2 and D3 signalling mechanisms in saccade generation and suggest that saccadic performance is associated with the clinical psychiatric state in Parkinson’s disease.

Multiple neuronal circuits for variable object-action choices based on short- and long-term memories

At each time in our life, we choose one or few behaviors, while suppressing many other behaviors. This is the basic mechanism in the basal ganglia, which is done by tonic inhibition and selective disinhibition. Dysfunctions of the basal ganglia then cause 2 types of disorders (difficulty in initiating necessary actions and difficulty in suppressing unnecessary actions) that occur in Parkinson's disease. The basal ganglia generate such opposite outcomes through parallel circuits: The direct pathway for initiation and indirect pathway for suppression. Importantly, the direct pathway processes good information and the indirect pathway processes bad information, which enables the choice of good behavior and the rejection of bad behavior. This is mainly enabled by dopaminergic inputs to these circuits. However, the value judgment is complex because the world is complex. Sometimes, the value must be based on recent events, thus is based on short-term memories. Or, the value must be based on historical events, thus is based on long-term memories. Such memory-based value judgment is generated by another parallel circuit originating from the caudate head and caudate tail. These circuit-information mechanisms allow other brain areas (e.g., prefrontal cortex) to contribute to decisions by sending information to these basal ganglia circuits. Moreover, the basal ganglia mechanisms (i.e., what to choose) are associated with cerebellum mechanisms (i.e., when to choose). Overall, multiple levels of parallel circuits in and around the basal ganglia are essential for coordinated behaviors. Understanding these circuits is useful for creating clinical treatments of disorders resulting from the failure of these circuits.

Dopamine D1 and muscarinic acetylcholine receptors in dorsal striatum are required for high speed running

Dopamine (DA) signaling in the basal ganglia plays important roles in motor control. Motor deficiencies were previously reported in dopamine receptor D1 (D1R) and D2 (D2R) knockout mice. While these results indicate the involvement of DA receptors in motor execution, the null knockout (KO) mouse lacks the specificity necessary to determine when and where in the brain D1R and D2R function in motor execution. To address these questions, we restricted the loss of function temporally and spatially by using D1R conditional knockdown (cKD) mice and mice injected with antagonists against DA receptors directly into the dorsal striatum. In addition, we address the DA and acetylcholine (ACh) balance hypothesis by using antagonists against ACh receptors. We tested the motor ability of the mice with a newly devised task named the accelerating step-wheel. In this task, the maximum running speed was measured in a situation where the wheel rotation speed was gradually accelerated in one trial. We found significant decreases in the maximum running speed of D1R cKD mice and the mice injected with the antagonist against D1R or muscarinic ACh receptor. These results indicated that D1R and muscarinic ACh receptor in the dorsal striatum play pivotal roles in the execution of walking/running.

A neural network for information seeking

Humans and other animals often show a strong desire to know the uncertain rewards their future has in store, even when they cannot use this information to influence the outcome. However, it is unknown how the brain predicts opportunities to gain information and motivates this information-seeking behavior. Here we show that neurons in a network of interconnected subregions of primate anterior cingulate cortex and basal ganglia predict the moment of gaining information about uncertain rewards. Spontaneous increases in their information prediction signals are followed by gaze shifts toward objects associated with resolving uncertainty, and pharmacologically disrupting this network reduces the motivation to seek information. These findings demonstrate a cortico-basal ganglia mechanism responsible for motivating actions to resolve uncertainty by seeking knowledge about the future.

Animals resolve uncertainty by seeking knowledge about the future. How the brain controls this is unclear. The authors show that a network including primate anterior cingulate cortex and basal ganglia encodes opportunities to gain information about uncertain rewards and mediates information seeking.

Distinct roles of striatal direct and indirect pathways in value-based decision making

The striatum is critically involved in value-based decision making. However, it is unclear how striatal direct and indirect pathways work together to make optimal choices in a dynamic and uncertain environment. Here, we examined the effects of selectively inactivating D1 receptor (D1R)- or D2 receptor (D2R)-expressing dorsal striatal neurons (corresponding to direct- and indirect-pathway neurons, respectively) on mouse choice behavior in a reversal task with progressively increasing reversal frequency and a dynamic two-armed bandit task. Inactivation of either D1R- or D2R-expressing striatal neurons impaired performance in both tasks, but the pattern of altered choice behavior differed between the two animal groups. A reinforcement learning model-based analysis indicated that inactivation of D1R- and D2R-expressing striatal neurons selectively impairs value-dependent action selection and value learning, respectively. Our results suggest differential contributions of striatal direct and indirect pathways to two distinct steps in value-based decision making.

Mind the gap: Congruence between present and future motivational states shapes prospective decisions

Poor estimation of one's future actions has been associated with the influence of reward over executive control processes during prospection. However, the neural mechanisms underlying this reward-control trade-off remain poorly understood. In the present study, we take advantage of projection bias, underestimating how motivations will change in the future, to examine brain and behavior changes during prospection about future decisions. To manipulate motivation, we altered satiety (hungry vs. satiated) and asked human participants (N = 25) to place bids on snack foods while undergoing fMRI scanning across two sessions. While hungry, participants bid for the right to consume snacks in both a future congruent motivational state (hungry) and a future incongruent motivational state (satiated). In a second session, while satiated, participants placed bids for the right to immediately consume the items. Imagination of a congruent future state was associated with brain activity in regions implicated in prospection. Imagination of an incongruent future state was related to brain activity in areas related to cognitive control. Projection bias, the difference between bids during incongruent prospection (hungry to satiated, session one) and realization (satiated, session two), was negatively related to thalamic and insular engagement. Bias was positively related to engagement of the ventral striatum, a region involved in reward processing. These results suggest that the relative activation between reward and control systems is influenced by the congruence of present and future motivational states, and shapes bias in predictions about future behavior.

How pupil responses track value-based decision-making during and after reinforcement learning

Cognition can reveal itself in the pupil, as latent cognitive processes map onto specific pupil responses. For instance, the pupil dilates when we make decisions and these pupil size fluctuations reflect decision-making computations during and after a choice. Surprisingly little is known, however, about how pupil responses relate to decisions driven by the learned value of stimuli. This understanding is important, as most real-life decisions are guided by the outcomes of earlier choices. The goal of this study was to investigate which cognitive processes the pupil reflects during value-based decision-making. We used a reinforcement learning task to study pupil responses during value-based decisions and subsequent decision evaluations, employing computational modeling to quantitatively describe the underlying cognitive processes. We found that the pupil closely tracks reinforcement learning processes independently across participants and across trials. Prior to choice, the pupil dilated as a function of trial-by-trial fluctuations in value beliefs about the to-be chosen option and predicted an individual's tendency to exploit high value options. After feedback a biphasic pupil response was observed, the amplitude of which correlated with participants' learning rates. Furthermore, across trials, early feedback-related dilation scaled with value uncertainty, whereas later constriction scaled with signed reward prediction errors. These findings show that pupil size fluctuations can provide detailed information about the computations underlying value-based decisions and the subsequent updating of value beliefs. As these processes are affected in a host of psychiatric disorders, our results indicate that pupillometry can be used as an accessible tool to non-invasively study the processes underlying ongoing reinforcement learning in the clinic.

Dopamine neurons projecting to the posterior striatum reinforce avoidance of threatening stimuli

Midbrain dopamine neurons are well known for their role in reward-based reinforcement learning. We found that the activity of dopamine axons in the posterior tail of the striatum (TS) scaled with the novelty and intensity of external stimuli, but did not encode reward value. We demonstrated that the ablation of TS-projecting dopamine neurons specifically inhibited avoidance of novel or high-intensity stimuli without affecting animals' initial avoidance responses, suggesting a role in reinforcement rather than simply in avoidance itself. Furthermore, we found that animals avoided optogenetic activation of dopamine axons in TS during a choice task and that this stimulation could partially reinstate avoidance of a familiar object. These results suggest that TS-projecting dopamine neurons reinforce avoidance of threatening stimuli. More generally, our results indicate that there are at least two axes of reinforcement learning using dopamine in the striatum: one based on value and one based on external threat.

Central serotonin modulates neural responses to virtual violent actions in emotion regulation networks

Disruptions in the cortico-limbic emotion regulation networks have been linked to depression, anxiety, impulsivity, and aggression. Altered transmission of the central nervous serotonin (5-HT) contributes to dysfunctions in the cognitive control of emotions. To date, studies relating to pharmaco-fMRI challenging of the 5-HT system have focused on emotion processing for facial expressions. We investigated effects of a single-dose selective 5-HT reuptake inhibitor (escitalopram) on emotion regulation during virtual violence. For this purpose, 38 male participants played a violent video game during fMRI scanning. The SSRI reduced neural responses to violent actions in right-hemispheric inferior frontal gyrus and medial prefrontal cortex encompassing the anterior cingulate cortex (ACC), but not to non-violent actions. Within the ACC, the drug effect differentiated areas with high inhibitory 5-HT1A receptor density (subgenual s25) from those with a lower density (pregenual p32, p24). This finding links functional responses during virtual violent actions with 5-HT neurotransmission in emotion regulation networks, underpinning the ecological validity of the 5-HT model in aggressive behavior. Available 5-HT receptor density data suggest that this SSRI effect is only observable when inhibitory and excitatory 5-HT receptors are balanced. The observed early functional changes may impact patient groups receiving SSRI treatment.

Monitoring and Updating of Action Selection for Goal-Directed Behavior through the Striatal Direct and Indirect Pathways

The basal ganglia play key roles in adaptive behaviors guided by reward and punishment. However, despite accumulating knowledge, few studies have tested how heterogeneous signals in the basal ganglia are organized and coordinated for goal-directed behavior. In this study, we investigated neuronal signals of the direct and indirect pathways of the basal ganglia as rats performed a lever push/pull task for a probabilistic reward. In the dorsomedial striatum, we found that optogenetically and electrophysiologically identified direct pathway neurons encoded reward outcomes, whereas indirect pathway neurons encoded no-reward outcome and next-action selection. Outcome coding occurred in association with the chosen action. In support of pathway-specific neuronal coding, light activation induced a bias on repeat selection of the same action in the direct pathway, but on switch selection in the indirect pathway. Our data reveal the mechanisms underlying monitoring and updating of action selection for goal-directed behavior through basal ganglia circuits.

Essential Control of the Function of the Striatopallidal Neuron by Pre-coupled Complexes of Adenosine A2A-Dopamine D2 Receptor Heterotetramers and Adenylyl Cyclase

The central adenosine system and adenosine receptors play a fundamental role in the modulation of dopaminergic neurotransmission. This is mostly achieved by the strategic co-localization of different adenosine and dopamine receptor subtypes in the two populations of striatal efferent neurons, striatonigral and striatopallidal, that give rise to the direct and indirect striatal efferent pathways, respectively. With optogenetic techniques it has been possible to dissect a differential role of the direct and indirect pathways in mediating "Go" responses upon exposure to reward-related stimuli and "NoGo" responses upon exposure to non-rewarded or aversive-related stimuli, respectively, which depends on their different connecting output structures and their differential expression of dopamine and adenosine receptor subtypes. The striatopallidal neuron selectively expresses dopamine D₂ receptors (D2R) and adenosine A_2A receptors (A2AR), and numerous experiments using multiple genetic and pharmacological in vitro, in situ and in vivo approaches, demonstrate they can form A2AR-D2R heteromers. It was initially assumed that different pharmacological interactions between dopamine and adenosine receptor ligands indicated the existence of different subpopulations of A2AR and D2R in the striatopallidal neuron. However, as elaborated in the present essay, most evidence now indicates that all interactions can be explained with a predominant population of striatal A2AR-D2R heteromers forming complexes with adenylyl cyclase subtype 5 (AC5). The A2AR-D2R heteromer has a tetrameric structure, with two homodimers, which allows not only multiple allosteric interactions between different orthosteric ligands, agonists, and antagonists, but also the canonical Gs-Gi antagonistic interaction at the level of AC5. We present a model of the function of the A2AR-D2R heterotetramer-AC5 complex, which acts as an integrative device of adenosine and dopamine signals that determine the excitability and gene expression of the striatopallidal neurons. The model can explain most behavioral effects of A2AR and D2R ligands, including the psychostimulant effects of caffeine. The model is also discussed in the context of different functional striatal compartments, mainly the dorsal and the ventral striatum. The current accumulated knowledge of the biochemical properties of the A2AR-D2R heterotetramer-AC5 complex offers new therapeutic possibilities for Parkinson's disease, schizophrenia, SUD and other neuropsychiatric disorders with dysfunction of dorsal or ventral striatopallidal neurons.

Direct and indirect pathways for choosing objects and actions

A prominent target of the basal ganglia is the superior colliculus (SC) which controls gaze orientation (saccadic eye movement in primates) to an important object. This 'object choice' is crucial for choosing an action on the object. SC is innervated by the substantia nigra pars reticulata (SNr) which is controlled mainly by the caudate nucleus (CD). This CD-SNr-SC circuit is sensitive to the values of individual objects and facilitates saccades to good objects. The object values are processed differently in two parallel circuits: flexibly by the caudate head (CDh) and stably by the caudate tail (CDt). To choose good objects, we need to reject bad objects. In fact, these contrasting functions are accomplished by the circuit originating from CDt: The direct pathway focuses on good objects and facilitates saccades to them; the indirect pathway focuses on bad objects and suppresses saccades to them. Inactivation of CDt deteriorated the object choice, because saccades to bad objects were no longer suppressed. This suggests that the indirect pathway is important for object choice. However, the direct and indirect pathways for 'object choice', which aim at the same action (i.e., saccade), may not work for 'action choice'. One possibility is that circuits controlling different actions are connected through the indirect pathway. Additional connections of the indirect pathway with brain areas outside the basal ganglia may also provide a wider range of behavioral choice. In conclusion, basal ganglia circuits are composed of the basic direct/indirect pathways and additional connections and thus have acquired multiple functions.

Control of saccadic latency in a dynamic environment: allocation of saccades in time follows the matching law

When exploring the visual environment, one uses saccades to shift gaze and fixation to gather spatially and temporally localized information. We propose that the temporal structure of our environment should constrain the temporal allocation of saccades. Here we probe the possibility of learning to control saccadic latencies in a choice paradigm. Six participants made saccades within 80–300 ms following a target horizontally stepping by 10° between two fixed locations. For each participant we constructed two classes of latencies, “short” and “long,” using the first and last quartiles of the individual baseline distribution (e.g., [80;152] ms and [185;300] ms, respectively). We then concurrently reinforced each class in three blocked conditions across ~60 experimental sessions per participant, using different reinforcement probabilities such that the relative ratio of reinforcement rates for short vs. long latencies was 9/1, 1/9, or 1/1. Latency distributions followed the reinforcement conditions: distributions shifted toward the shorter or longer values or became strongly bimodal. Moreover, the relative rates of short over long latencies matched the relative rates of reinforcers earned for the corresponding latencies (slope up to 0.95), which reveals the ability to choose when to saccade. Our results reveal that learned contingencies considerably affect the allocation of saccades in time and are in line with recent studies on the temporal adjustment of behavior to dynamic environments. This study provides strong evidence for fine operant control of saccadic latency, supporting the hypothesis of a cost-benefit control of saccade latencies.

NEW & NOTEWORTHY Saccades may be regarded as an information-foraging behavior mostly concerned with the spatial localization of objects, yet our world is dynamic and environmental temporal regularities should also affect saccade decisions. We present behavioral data from a choice task establishing that humans can learn to choose their saccadic latencies depending on the reinforcement contingencies. This suggests a cost-benefit-based policy that takes into account the learned temporal properties of the environmental contingencies for controlling saccade triggering.

Neuromodulation of Prefrontal Cortex in Non-Human Primates by Dopaminergic Receptors during Rule-Guided Flexible Behavior and Cognitive Control

The prefrontal cortex (PFC) is indispensable for several higher-order cognitive and executive capacities of primates, including representation of salient stimuli in working memory (WM), maintenance of cognitive task set, inhibition of inappropriate responses and rule-guided flexible behavior. PFC networks are subject to robust neuromodulation from ascending catecholaminergic systems. Disruption of these systems in PFC has been implicated in cognitive deficits associated with several neuropsychiatric disorders. Over the past four decades, a considerable body of work has examined the influence of dopamine on macaque PFC activity representing spatial WM. There has also been burgeoning interest in neuromodulation of PFC circuits involved in other cognitive functions of PFC, including representation of rules to guide flexible behavior. Here, we review recent neuropharmacological investigations conducted in our laboratory and others of the role of PFC dopamine receptors in regulating rule-guided behavior in non-human primates. Employing iontophoresis, we examined the effects of local manipulation of dopaminergic subtypes on neuronal activity during performance of rule-guided pro- and antisaccades, an experimental paradigm sensitive to PFC integrity, wherein deficits in performance are reliably observed in many neuropsychiatric disorders. We found dissociable effects of dopamine receptors on neuronal activity for rule representation and oculomotor responses and discuss these findings in the context of prior studies that have examined the role of dopamine in spatial delayed response tasks, attention, target selection, abstract rules, visuomotor learning and reward. The findings we describe here highlight the common features, as well as heterogeneity and context dependence of dopaminergic neuromodulation in regulating the efficacy of cognitive functions of PFC in health and disease.

Overt and covert attention to location-based reward

Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities.

Volumetric changes in the aging rat brain and its impact on cognitive and locomotor functions

Impairments in cognitive and locomotor functions usually occur with advanced age, as do changes in brain volume. This study was conducted to assess changes in brain volume, cognitive and locomotor functions, and oxidative stress levels in middle- to late-aged rats. Forty-four male Sprague-Dawley rats were divided into four groups: 14, 18, 23, and 27months of age. ¹H magnetic resonance imaging (MRI) was performed using a 7.0-Tesla MR scanner system. The volumes of the lateral ventricles, medial prefrontal cortex (mPFC), hippocampus, striatum, cerebellum, and whole brain were measured. Open field, object recognition, and Morris water maze tests were conducted to assess cognitive and locomotor functions. Blood was taken for measurements of malondialdehyde (MDA), protein carbonyl content, and antioxidant enzyme activity. The lateral ventricle volumes were larger, whereas the mPFC, hippocampus, and striatum volumes were smaller in 27-month-old rats than in 14-month-old rats. In behavioral tasks, the 27-month-old rats showed less exploratory activity and poorer spatial learning and memory than did the 14-month-old rats. Biochemical measurements likewise showed increased MDA and lower glutathione peroxidase (GPx) activity in the 27-month-old rats. In conclusion, age-related increases in oxidative stress, impairment in cognitive and locomotor functions, and changes in brain volume were observed, with the most marked impairments observed in later age.

The neural mechanism underpinning balance calibration between action inhibition and activation initiated by reward motivation

In everyday life, it is often the case that in some situations we are motivated and want not only to speed up our actions but also to avoid mistakes—for example, ballgames. How our brain works at that moment to resolve the situations and react properly has created an active research field. Previous findings indicated that maintaining a balance between withholding and executing an action are highly dynamic and involve many executive control processes. This fMRI study was set up to investigate how motivation affects these balancing processes. With manipulation of prospective rewards in a stop-signal task where both the proactive and reactive control were equally emphasized, our behavioral results replicated previous findings. The fMRI findings backed up the behavioral results. We found motivation effects in the anterior caudate and pre-SMA for action inhibition. The former works to register motivation status, the latter works to transform motivation into action inhibition control. Together with the results of connectivity analysis, our study also suggests a hierarchical relationship between functional roles of pre-SMA and right inferior frontal gyrus during action inhibition. While the pre-SMA acts to accommodate higher-order factors, such as motivation, for action control, the right inferior frontal cortex acts to participate in the execution of action inhibition. This study pinned down a neural mechanism that integrates reward motivation into action inhibition control.

Distinct Functions of the Primate Putamen Direct and Indirect Pathways in Adaptive Outcome-Based Action Selection

Cortico-basal ganglia circuits are critical regulators of reward-based decision making. Reinforcement learning models posit that action reward value is encoded by the firing activity of striatal medium spiny neurons (MSNs) and updated upon changing reinforcement contingencies by dopamine (DA) signaling to these neurons. However, it remains unclear how the anatomically distinct direct and indirect pathways through the basal ganglia are involved in updating action reward value under changing contingencies. MSNs of the direct pathway predominantly express DA D1 receptors and those of the indirect pathway predominantly D2 receptors, so we tested for distinct functions in behavioral adaptation by injecting D1 and D2 receptor antagonists into the putamen of two macaque monkeys performing a free choice task for probabilistic reward. In this task, monkeys turned a handle toward either a left or right target depending on an asymmetrically assigned probability of large reward. Reward probabilities of left and right targets changed after 30–150 trials, so the monkeys were required to learn the higher-value target choice based on action–outcome history. In the control condition, the monkeys showed stable selection of the higher-value target (that more likely to yield large reward) and kept choosing the higher-value target regardless of less frequent small reward outcomes. The monkeys also made flexible changes of selection away from the high-value target when two or three small reward outcomes occurred randomly in succession. DA D1 antagonist injection significantly increased the probability of the monkey switching to the alternate target in response to successive small reward outcomes. Conversely, D2 antagonist injection significantly decreased the switching probability. These results suggest distinct functions of D1 and D2 receptor-mediated signaling processes in action selection based on action–outcome history, with D1 receptor-mediated signaling promoting the stable choice of higher-value targets and D2 receptor-mediated signaling promoting a switch in action away from small reward outcomes. Therefore, direct and indirect pathways appear to have complementary functions in maintaining optimal goal-directed action selection and updating action value, which are dependent on D1 and D2 DA receptor signaling.

Fatigue-related impairments in oculomotor control are prevented by norepinephrine-dopamine reuptake inhibition

Fatigue-induced reductions in saccade velocity have been reported following acute, prolonged exercise. Interestingly, the detrimental impact of fatigue on oculomotor control can be prevented by a moderate dose of caffeine. This effect may be related to central catecholamine upregulation via caffeine's action as an adenosine antagonist. To test this hypothesis, we compared the protective effect of caffeine on oculomotor control post-exercise to that of a norepinephrine-dopamine reuptake inhibitor. Within a placebo-controlled crossover design, 12 cyclists consumed placebo, caffeine or a norepinephrine-dopamine reuptake inhibitor (bupropion) during 180 minutes of stationary cycling. Saccades, smooth pursuit and optokinetic nystagmus were measured using infrared oculography. Exercise fatigue was associated with an 8 ± 11% reduction in the peak velocity of prosaccades, and a 10 ± 11% decrement in antisaccade peak velocity. Optokinetic nystagmus quick phases decreased in velocity by 15 ± 17%. These differences were statistically significant (p < 0.05). Norepinephrine-dopamine reuptake inhibition and caffeine prevented fatigue-related decrements in eye movement velocity. Pursuit eye movements and visual attention were unaffected. These findings show that norepinephrine-dopamine reuptake inhibition protects oculomotor function during exercise fatigue. Caffeine's fatigue-reversing effects on eye movements appear to be mediated, at least in part, via modulation of central catecholamines.

Parallel basal ganglia circuits for decision making

The basal ganglia control body movements, mainly, based on their values. Critical for this mechanism is dopamine neurons, which sends unpredicted value signals, mainly, to the striatum. This mechanism enables animals to change their behaviors flexibly, eventually choosing a valuable behavior. However, this may not be the best behavior, because the flexible choice is focused on recent, and, therefore, limited, experiences (i.e., short-term memories). Our old and recent studies suggest that the basal ganglia contain separate circuits that process value signals in a completely different manner. They are insensitive to recent changes in value, yet gradually accumulate the value of each behavior (i.e., movement or object choice). These stable circuits eventually encode values of many behaviors and then retain the value signals for a long time (i.e., long-term memories). They are innervated by a separate group of dopamine neurons that retain value signals, even when no reward is predicted. Importantly, the stable circuits can control motor behaviors (e.g., hand or eye) quickly and precisely, which allows animals to automatically acquire valuable outcomes based on historical life experiences. These behaviors would be called 'skills', which are crucial for survival. The stable circuits are localized in the posterior part of the basal ganglia, separately from the flexible circuits located in the anterior part. To summarize, the flexible and stable circuits in the basal ganglia, working together but independently, enable animals (and humans) to reach valuable goals in various contexts.

How motivation and reward learning modulate selective attention

Motivational stimuli such as rewards elicit adaptive responses and influence various cognitive functions. Notably, increasing evidence suggests that stimuli with particular motivational values can strongly shape perception and attention. These effects resemble both selective top-down and stimulus-driven attentional orienting, as they depend on internal states but arise without conscious will, yet they seem to reflect attentional systems that are functionally and anatomically distinct from those classically associated with frontoparietal cortical networks in the brain. Recent research in human and nonhuman primates has begun to reveal how reward can bias attentional selection, and where within the cognitive system the signals providing attentional priority are generated. This review aims at describing the different mechanisms sustaining motivational attention, their impact on different behavioral tasks, and current knowledge concerning the neural networks governing the integration of motivational influences on attentional behavior.

Reappraising striatal D1- and D2-neurons in reward and aversion

The striatum has been involved in complex behaviors such as motor control, learning, decision-making, reward and aversion. The striatum is mainly composed of medium spiny neurons (MSNs), typically divided into those expressing dopamine receptor D1, forming the so-called direct pathway, and those expressing D2 receptor (indirect pathway). For decades it has been proposed that these two populations exhibit opposing control over motor output, and recently, the same dichotomy has been proposed for valenced behaviors. Whereas D1-MSNs mediate reinforcement and reward, D2-MSNs have been associated with punishment and aversion. In this review we will discuss pharmacological, genetic and optogenetic studies that indicate that there is still controversy to what concerns the role of striatal D1- and D2-MSNs in this type of behaviors, highlighting the need to reconsider the early view that they mediate solely opposing aspects of valenced behaviour.

Cognitive impairment in a young marmoset reveals lateral ventriculomegaly and a mild hippocampal atrophy: a case report

The number of studies that use the common marmoset (Callithrix jacchus) in various fields of neurosciences is increasing dramatically. In general, animals enter the study when their health status is considered satisfactory on the basis of classical clinical investigations. In behavioral studies, variations of score between individuals are frequently observed, some of them being considered as poor performers or outliers. Experimenters rarely consider the fact that it could be related to some brain anomaly. This raises the important issue of the reliability of such classical behavioral approaches without using complementary imaging, especially in animals lacking striking external clinical signs. Here we report the case of a young marmoset which presented a set of cognitive impairments in two different tasks compared to other age-matched animals. Brain imaging revealed a patent right lateral ventricular enlargement with a mild hippocampal atrophy. This abnormality could explain the cognitive impairments of this animal. Such a case points to the importance of complementing behavioral studies by imaging explorations to avoid experimental bias.

Decision making from economic and signal detection perspectives: development of an integrated framework

Behavior is comprised of decisions made from moment to moment (i.e., to respond one way or another). Often, the decision maker cannot be certain of the value to be accrued from the decision (i.e., the outcome value). Decisions made under outcome value uncertainty form the basis of the economic framework of decision making. Behavior is also based on perception-perception of the external physical world and of the internal bodily milieu, which both provide cues that guide decision making. These perceptual signals are also often uncertain: another person's scowling facial expression may indicate threat or intense concentration, alternatives that require different responses from the perceiver. Decisions made under perceptual uncertainty form the basis of the signals framework of decision making. Traditional behavioral economic approaches to decision making focus on the uncertainty that comes from variability in possible outcome values, and typically ignore the influence of perceptual uncertainty. Conversely, traditional signal detection approaches to decision making focus on the uncertainty that arises from variability in perceptual signals and typically ignore the influence of outcome value uncertainty. Here, we compare and contrast the economic and signals frameworks that guide research in decision making, with the aim of promoting their integration. We show that an integrated framework can expand our ability to understand a wider variety of decision-making behaviors, in particular the complexly determined real-world decisions we all make every day.

Feedback on Trait or Action Impacts on Caudate and Paracingulum Activity

There is a general conception that positive associations to one’s trait, e.g. ‘I’m clever’, are beneficial for cognitive performance. Scientific evidence shows that this is a simplification. In this functional magnetic resonance imaging (fMRI) study we used written trial-based trait feedback ‘you are clever’, or task feedback ‘your choice was correct’, on each correct response of a rule-switching task, to investigate how the character of positive self-associations influences performance outcome. Twenty participants took part in this crossover design study. We found that trait feedback was less beneficial for motivation and performance improvement, and resulting in enhanced neural activation on more difficult bivalent rule trials. This indicates that the task was treated as more complex in this condition. For example, ‘you are clever’ feedback led to enhanced activation in anterior caudate nucleus, an area known to process uncertainty. We further observed that activation in anterior paracingulate cortex was sensitive to whether self-reflection was imposed by external feedback or generated from internal processes, where the latter activation correlated positively with performance when following after task feedback. Our results illustrate how feedback can evoke self-reflections that either help or hinder motivation and performance, most likely by impacting on processes of uncertainty. The results support social psychological models stipulating that trait focus take resources away from task focus.

Parallel basal ganglia circuits for voluntary and automatic behaviour to reach rewards

The basal ganglia control body movements, value processing and decision-making. Many studies have shown that the inputs and outputs of each basal ganglia structure are topographically organized, which suggests that the basal ganglia consist of separate circuits that serve distinct functions. A notable example is the circuits that originate from the rostral (head) and caudal (tail) regions of the caudate nucleus, both of which target the superior colliculus. These two caudate regions encode the reward values of visual objects differently: flexible (short-term) values by the caudate head and stable (long-term) values by the caudate tail. These value signals in the caudate guide the orienting of gaze differently: voluntary saccades by the caudate head circuit and automatic saccades by the caudate tail circuit. Moreover, separate groups of dopamine neurons innervate the caudate head and tail and may selectively guide the flexible and stable learning/memory in the caudate regions. Studies focusing on manual handling of objects also suggest that rostrocaudally separated circuits in the basal ganglia control the action differently. These results suggest that the basal ganglia contain parallel circuits for two steps of goal-directed behaviour: finding valuable objects and manipulating the valuable objects. These parallel circuits may underlie voluntary behaviour and automatic skills, enabling animals (including humans) to adapt to both volatile and stable environments. This understanding of the functions and mechanisms of the basal ganglia parallel circuits may inform the differential diagnosis and treatment of basal ganglia disorders.

Basal ganglia circuits for reward value-guided behavior

The basal ganglia are equipped with inhibitory and disinhibitory mechanisms that enable a subject to choose valuable objects and actions. Notably, a value can be determined flexibly by recent experience or stably by prolonged experience. Recent studies have revealed that the head and tail of the caudate nucleus selectively and differentially process flexible and stable values of visual objects. These signals are sent to the superior colliculus through different parts of the substantia nigra so that the animal looks preferentially at high-valued objects, but in different manners. Thus, relying on short-term value memories, the caudate head circuit allows the subject's gaze to move expectantly to recently valued objects. Relying on long-term value memories, the caudate tail circuit allows the subject's gaze to move automatically to previously valued objects. The basal ganglia also contain an equivalent parallel mechanism for action values. Such flexible-stable parallel mechanisms for object and action values create a highly adaptable system for decision making.

Dopamine signals and physiological origin of cognitive dysfunction in Parkinson's disease

The pathological hallmark of Parkinson's disease (PD) is the degeneration of midbrain dopamine neurons. Cognitive dysfunction is a feature of PD patients even at the early stages of the disease. Electrophysiological studies on dopamine neurons in awake animals provide contradictory accounts of the role of dopamine. These studies have established that dopamine neurons convey a unique signal associated with rewards rather than cognitive functions. Emphasizing their role in reward processing leads to difficulty in developing hypothesis as to how cognitive impairments in PD are associated with the degeneration of dopamine circuitry. A hint to resolve this contradiction came from recent electrophysiological studies reporting that dopamine neurons transmit more diverse signals than previously thought. These studies suggest that dopamine neurons are divided into at least two functional subgroups, one signaling "motivational value" and the other signaling "salience." The former subgroup fits well with the conventional reward theory, whereas the latter subgroup has been shown to transmit signals related to salient but non-rewarding experiences such as aversive stimulations and cognitively demanding situations. This article reviews recent advances in understanding the non-reward functions of dopamine, and then discusses the possibility that cognitive dysfunction in PD is at least partially caused by the degeneration of the dopamine neuron subgroup signaling the salience of events in the environment.