Reward-modulated motor information in identified striatum neurons

Reward expectation and receipt differentially modulate the spiking of accumbens D1+ and D2+ neurons

The nucleus accumbens (NAc) helps govern motivation to pursue reward. Two distinct sets of NAc projection neurons-expressing dopamine D1 vs. D2 receptors-are thought to promote and suppress motivated behaviors, respectively. However, support for this conceptual framework is limited: in particular, the spiking patterns of these distinct cell types during motivated behavior have been largely unknown. Using optogenetic tagging, we recorded the spiking of identified D1+ and D2+ neurons in the NAc core as unrestrained rats performed an operant task in which motivation to initiate work tracks recent reward rate. D1+ neurons preferentially increased firing as rats initiated trials and fired more when reward expectation was higher. By contrast, D2+ cells preferentially increased firing later in the trial, especially in response to reward delivery-a finding not anticipated from current theoretical models. Our results provide new evidence for the specific contribution of NAc D1+ cells to self-initiated approach behavior and will spur updated models of how D2+ cells contribute to learning.

Cell-type-specific auditory responses in the striatum are shaped by feedforward inhibition

The posterior "tail" region of the striatum receives dense innervation from sensory brain regions and is important for behaviors that require sensorimotor integration. The output neurons of the striatum, D1 and D2 striatal projection neurons (SPNs), which make up the direct and indirect pathways, are thought to play distinct functional roles, although it remains unclear if these neurons show cell-type-specific differences in their response to sensory stimuli. Here, we examine the strength of synaptic inputs onto D1 and D2 SPNs following the stimulation of upstream auditory pathways. We report that auditory-evoked depolarizations onto D1 SPN responses are stronger and faster. This is due to differences in feedforward inhibition, with fast-spiking interneurons forming stronger synapses onto D2 SPNs. Our results support a model in which differences in feedforward inhibition enable the preferential recruitment of D1 SPNs by auditory stimuli, positioning the direct pathway to initiate sound-driven actions.

Striosomes control dopamine via dual pathways paralleling canonical basal ganglia circuits

Balanced activity of canonical direct D1 and indirect D2 basal ganglia pathways is considered a core requirement for normal movement, and their imbalance is an etiologic factor in movement and neuropsychiatric disorders. We present evidence for a conceptually equivalent pair of direct D1 and indirect D2 pathways that arise from striatal projection neurons (SPNs) of the striosome compartment rather than from SPNs of the matrix, as do the canonical pathways. These striosomal D1 (S-D1) and D2 (S-D2) pathways target substantia nigra dopamine-containing neurons instead of basal ganglia motor output nuclei. They modulate movement with net effects opposite to those exerted by the canonical pathways: S-D1 is net inhibitory and S-D2 is net excitatory. The S-D1 and S-D2 circuits likely influence motivation for learning and action, complementing and reorienting canonical pathway modulation. A major conceptual reformulation of the classic direct-indirect pathway model of basal ganglia function is needed, as well as reconsideration of the effects of D2-targeting therapeutic drugs.

Investigating changes in the premotor cortex-derived frontal-striatal-thalamic subcircuit in attenuated psychosis syndrome

Frontal-striatal-thalamic circuit impairment is presumed to underlie schizophrenia. Individuals with attenuated psychosis syndrome (APS) show longitudinal volume reduction of the putamen in the striatum, which has a neural connection with the premotor cortex through the frontal-striatal-thalamic subcircuit. However, comprehensive investigations into the biological changes in the frontal-striatal-thalamic subcircuit originating from the premotor cortex in APS are lacking. We investigated differences in fractional anisotropy (FA) values between the striatum and premotor cortex (ST-PREM) and between the thalamus and premotor cortex (T-PREM) in individuals with APS and healthy controls, using a novel method TractSeg. Our study comprised 36 individuals with APS and 38 healthy controls. There was a significant difference between the control and APS groups in the right T-PREM (odds ratio = 1.76, p = 0.02). Other factors, such as age, sex, other values of FA, and antipsychotic medication, were not associated with differences between groups. However, while FA value reduction of ST-PREM and T-PREM in schizophrenia has been previously reported, in the present study on APS, the alteration of the FA value was limited to T-PREM in APS. This finding suggests that ST-PREM impairment is not predominant in APS but emerges in schizophrenia. Impairment of the neural network originating from the premotor cortex can lead to catatonia and aberrant mirror neuron networks that are presumed to provoke various psychotic symptoms of schizophrenia. Our findings highlight the potential role of changes in a segment of the frontal-thalamic pathway derived from the premotor cortex as a biological basis of APS.

Dynamic ensemble balance in direct- and indirect-pathway striatal projection neurons underlying decision-related action selection

The posterior dorsal striatum (pDS) plays an essential role in sensory-guided decision-making. However, it remains unclear how the antagonizing direct- and indirect-pathway striatal projection neurons (dSPNs and iSPNs) work in concert to support action selection. Here, we employed deep-brain two-photon imaging to investigate pathway-specific single-neuron and population representations during an auditory-guided decision-making task. We found that the majority of pDS projection neurons predominantly encode choice information. Both dSPNs and iSPNs comprise divergent subpopulations of comparable sizes representing competing choices, rendering a multi-ensemble balance between the two pathways. Intriguingly, such ensemble balance displays a dynamic shift during the decision period: dSPNs show a significantly stronger preference for the contraversive choice than iSPNs. This dynamic shift is further manifested in the inter-neuronal coactivity and population trajectory divergence. Our results support a balance-shift model as a neuronal population mechanism coordinating the direct and indirect striatal pathways for eliciting selected actions during decision-making.

Neural underpinnings of fine motor skills under stress and anxiety: A review

This review offers a comprehensive examination of how stress and anxiety affect motor behavior, particularly focusing on fine motor skills and gait adaptability. We explore the role of several neurochemicals, including brain-derived neurotrophic factor (BDNF) and dopamine, in modulating neural plasticity and motor control under these affective states. The review highlights the importance of developing therapeutic strategies that enhance motor performance by leveraging the interactions between key neurochemicals. Additionally, we investigate the complex interplay between emotional-cognitive states and sensorimotor behaviors, showing how stress and anxiety disrupt neural integration, leading to impairments in skilled movements and negatively impacting quality of life. Synthesizing evidence from human and rodent studies, we provide a detailed understanding of the relationships among stress, anxiety, and motor behavior. Our findings reveal neurophysiological pathways, behavioral outcomes, and potential therapeutic targets, emphasizing the intricate connections between neurobiological mechanisms, environmental factors, and motor performance.

Striosomes Target Nigral Dopamine-Containing Neurons via Direct-D1 and Indirect-D2 Pathways Paralleling Classic Direct-Indirect Basal Ganglia Systems

Balanced activity of canonical direct D1 and indirect D2 basal ganglia pathways is considered a core requirement for normal movement, and their imbalance is an etiologic factor in movement and neuropsychiatric disorders. We present evidence for a conceptually equivalent pair of direct-D1 and indirect-D2 pathways that arise from striatal projection neurons (SPNs) of the striosome compartment rather than from SPNs of the matrix, as do the canonical pathways. These S-D1 and S-D2 striosomal pathways target substantia nigra dopamine-containing neurons instead of basal ganglia motor output nuclei. They modulate movement oppositely to the modulation by the canonical pathways: S-D1 is inhibitory and S-D2 is excitatory. The S-D1 and S-D2 circuits likely influence motivation for learning and action, complementing and reorienting canonical pathway modulation. A major conceptual reformulation of the classic direct-indirect pathway model of basal ganglia function is needed, as well as reconsideration of the effects of D2-targeting therapeutic drugs.

Globus pallidus is not independent from striatal direct pathway neurons: an up-to-date review

Striatal projection neurons, which are classified into two groups-direct and indirect pathway neurons, play a pivotal role in our understanding of the brain's functionality. Conventional models propose that these two pathways operate independently and have contrasting functions, akin to an "accelerator" and "brake" in a vehicle. This analogy further elucidates how the depletion of dopamine neurons in Parkinson's disease can result in bradykinesia. However, the question arises: are these direct and indirect pathways truly autonomous? Despite being distinct types of neurons, their interdependence cannot be overlooked. Single-neuron tracing studies employing membrane-targeting signals have shown that the majority of direct pathway neurons terminate not only in the output nuclei, but also in the external segment of the globus pallidus (GP in rodents), a relay nucleus of the indirect pathway. Recent studies have unveiled the existence of arkypallidal neurons, which project solely to the striatum, in addition to prototypic neurons. This raises the question of which type of GP neurons receive these striatal axon collaterals. Our morphological and electrophysiological experiments showed that the striatal direct pathway neurons may affect prototypic neurons via the action of substance P on neurokinin-1 receptors. Conversely, another research group has reported that direct pathway neurons inhibit arkypallidal neurons via GABA. Regardless of the neurotransmitter involved, it can be concluded that the GP is not entirely independent of direct pathway neurons. This review article underscores the intricate interplay between different neuronal pathways and challenges the traditional understanding of their independence.

Refinement of efficient encodings of movement in the dorsolateral striatum throughout learning

The striatum is required for normal action selection, movement, and sensorimotor learning. Although action-specific striatal ensembles have been well documented, it is not well understood how these ensembles are formed and how their dynamics may evolve throughout motor learning. Here we used longitudinal 2-photon Ca2+ imaging of dorsal striatal neurons in head-fixed mice as they learned to self-generate locomotion. We observed a significant activation of both direct- and indirect-pathway spiny projection neurons (dSPNs and iSPNs, respectively) during early locomotion bouts and sessions that gradually decreased over time. For dSPNs, onset- and offset-ensembles were gradually refined from active motion-nonspecific cells. iSPN ensembles emerged from neurons initially active during opponent actions before becoming onset- or offset-specific. Our results show that as striatal ensembles are progressively refined, the number of active nonspecific striatal neurons decrease and the overall efficiency of the striatum information encoding for learned actions increases.

Cell-type specific auditory responses in the striatum are shaped by feed forward inhibition

The posterior "tail" region of the striatum receives dense innervation from sensory brain regions and has been demonstrated to play a role in behaviors that require sensorimotor integration including discrimination 1,2 , avoidance 3 and defense 4 responses. The output neurons of the striatum, the D1 and D2 striatal projection neurons (SPNs) that make up the direct and indirect pathways, respectively, are thought to play differential roles in these behavioral responses, although it remains unclear if or how these neurons display differential responsivity to sensory stimuli. Here, we used whole-cell recordings in vivo and ex vivo to examine the strength of excitatory and inhibitory synaptic inputs onto D1 and D2 SPNs following the stimulation of upstream auditory pathways. While D1 and D2 SPNs both displayed stimulus-evoked depolarizations, D1 SPN responses were stronger and faster for all stimuli tested in vivo as well as in brain slices. This difference did not arise from differences in the strength of excitatory inputs but from differences in the strength of feed forward inhibition. Indeed, fast spiking interneurons, which are readily engaged by auditory afferents exerted stronger inhibition onto D2 SPNs compared to D1 SPNs. Our results support a model in which differences in feed forward inhibition enable the preferential recruitment of the direct pathway in response to auditory stimuli, positioning this pathway to initiate sound-driven actions.

Striatal Neurons Are Recruited Dynamically into Collective Representations of Self-Initiated and Learned Actions in Freely Moving Mice

Striatal spiny projection neurons are hyperpolarized-at-rest (HaR) and driven to action potential threshold by a small number of powerful inputs-an input-output configuration that is detrimental to response reliability. Because the striatum is important for habitual behaviors and goal-directed learning, we conducted a microendoscopic imaging in freely moving mice that express a genetically encoded Ca2+ indicator sparsely in striatal HaR neurons to evaluate their response reliability during self-initiated movements and operant conditioning. The sparse expression was critical for longitudinal studies of response reliability, and for studying correlations among HaR neurons while minimizing spurious correlations arising from contamination by the background signal. We found that HaR neurons are recruited dynamically into action representation, with distinct neuronal subsets being engaged in a moment-by-moment fashion. While individual neurons respond with little reliability, the population response remained stable across days. Moreover, we found evidence for the temporal coupling between neuronal subsets during conditioned (but not innate) behaviors.

The Secondary Motor Cortex-striatum Circuit Contributes to Suppressing Inappropriate Responses in Perceptual Decision Behavior

The secondary motor cortex (M2) encodes choice-related information and plays an important role in cue-guided actions. M2 neurons innervate the dorsal striatum (DS), which also contributes to decision-making behavior, yet how M2 modulates signals in the DS to influence perceptual decision-making is unclear. Using mice performing a visual Go/No-Go task, we showed that inactivating M2 projections to the DS impaired performance by increasing the false alarm (FA) rate to the reward-irrelevant No-Go stimulus. The choice signal of M2 neurons correlated with behavioral performance, and the inactivation of M2 neurons projecting to the DS reduced the choice signal in the DS. By measuring and manipulating the responses of direct or indirect pathway striatal neurons defined by M2 inputs, we found that the indirect pathway neurons exhibited a shorter response latency to the No-Go stimulus, and inactivating their early responses increased the FA rate. These results demonstrate that the M2-to-DS pathway is crucial for suppressing inappropriate responses in perceptual decision behavior.

Multiple dynamic interactions from basal ganglia direct and indirect pathways mediate action selection

The basal ganglia are known to be essential for action selection. However, the functional role of basal ganglia direct and indirect pathways in action selection remains unresolved. Here, by employing cell-type-specific neuronal recording and manipulation in mice trained in a choice task, we demonstrate that multiple dynamic interactions from the direct and indirect pathways control the action selection. While the direct pathway regulates the behavioral choice in a linear manner, the indirect pathway exerts a nonlinear inverted-U-shaped control over action selection, depending on the inputs and the network state. We propose a new center (direct)-surround (indirect)-context (indirect) 'Triple-control' functional model of basal ganglia, which can replicate the physiological and behavioral experimental observations that cannot be simply explained by either the traditional 'Go/No-go' or more recent 'Co-activation' model. These findings have important implications on understanding the basal ganglia circuitry and action selection in health and disease.

Reward expectation enhances action-related activity of nigral dopaminergic and two striatal output pathways

Neurons comprising nigrostriatal system play important roles in action selection. However, it remains unclear how this system integrates recent outcome information with current action (movement) and outcome (reward or no reward) information to achieve appropriate subsequent action. We examined how neuronal activity of substantia nigra pars compacta (SNc) and dorsal striatum reflects the level of reward expectation from recent outcomes in rats performing a reward-based choice task. Movement-related activity of direct and indirect pathway striatal projection neurons (dSPNs and iSPNs, respectively) were enhanced by reward expectation, similarly to the SNc dopaminergic neurons, in both medial and lateral nigrostriatal projections. Given the classical basal ganglia model wherein dopamine stimulates dSPNs and suppresses iSPNs through distinct dopamine receptors, dopamine might not be the primary driver of iSPN activity increasing following higher reward expectation. In contrast, outcome-related activity was affected by reward expectation in line with the classical model and reinforcement learning theory, suggesting purposive effects of reward expectation.

Multiple dynamic interactions from basal ganglia direct and indirect pathways mediate action selection

The basal ganglia are known to be essential for action selection. However, the functional role of basal ganglia direct and indirect pathways in action selection remains unresolved. Here by employing cell-type-specific neuronal recording and manipulation in mice trained in a choice task, we demonstrate that multiple dynamic interactions from the direct and indirect pathways control the action selection. While the direct pathway regulates the behavioral choice in a linear manner, the indirect pathway exerts a nonlinear inverted-U-shaped control over action selection, depending on the inputs and the network state. We propose a new center (direct) - surround (indirect) - context (indirect) "Triple-control" functional model of basal ganglia, which can replicate the physiological and behavioral experimental observations that cannot be simply explained by either the traditional "Go/No-go" or more recent "Co-activation" model. These findings have important implications on understanding the basal ganglia circuitry and action selection in health and disease.

Rat hippocampal CA1 region represents learning-related action and reward events with shorter latency than the lateral entorhinal cortex

The hippocampus and entorhinal cortex are deeply involved in learning and memory. However, little is known how ongoing events are processed in the hippocampal-entorhinal circuit. By recording from head-fixed rats during action-reward learning, here we show that the action and reward events are represented differently in the hippocampal CA1 region and lateral entorhinal cortex (LEC). Although diverse task-related activities developed after learning in both CA1 and LEC, phasic activities related to action and reward events differed in the timing of behavioral event representation. CA1 represented action and reward events almost instantaneously, whereas the superficial and deep layers of the LEC showed a delayed representation of the same events. Interestingly, we also found that ramping activity towards spontaneous action was correlated with waiting time in both regions and exceeded that in the motor cortex. Such functional activities observed in the entorhinal-hippocampal circuits may play a crucial role for animals in utilizing ongoing information to dynamically optimize their behaviors.

Unraveling the dynamics of dopamine release and its actions on target cells

The neuromodulator dopamine (DA) is essential for regulating learning, motivation, and movement. Despite its importance, however, the mechanisms by which DA influences the activity of target cells to alter behavior remain poorly understood. In this review, we describe recent methodological advances that are helping to overcome challenges that have historically hindered the field. We discuss how the employment of these methods is shedding light on the complex dynamics of extracellular DA in the brain, as well as how DA signaling alters the electrical, biochemical, and population activity of target neurons in vivo. These developments are generating novel hypotheses about the mechanisms through which DA release modifies behavior.

Task history dictates how the dorsolateral striatum controls action strategy and vigor

The dorsolateral striatum (DLS) is linked to the learning and honing of action routines. However, the DLS is also important for performing behaviors that have been successful in the past. The learning function can be thought of as prospective, helping to plan ongoing actions to be efficient and often optimal. The performance function is more retrospective, helping the animal continue to behave in a way that had worked previously. How the DLS manages this all is curious. What happens when a learned behavior becomes sub-optimal due to environment changes. In this case, the prospective function of the DLS would cause animals to (adaptively) learn and plan more optimal actions. In contrast, the retrospective function would cause animals to (maladaptively) favor the old behavior. Here we find that, during a change in learned task rules, DLS inhibition causes animals to adjust less rapidly to the new task (and to behave less vigorously) in a 'maladaptive' way. Yet, when the task is changed back to the initially learned rules, DLS inhibition instead causes a rapid and vigorous adjustment of behavior in an 'adaptive' way. These results show that inhibiting the DLS biases behavior towards initially acquired strategies, implying a more retrospective outlook in action selection when the DLS is offline. Thus, an active DLS could encourage planning and learning action routines more prospectively. Moreover, the DLS control over behavior can appear to be either advantageous/flexible or disadvantageous/inflexible depending on task context, and its control over vigor can change depending on task context.

Significant Statement

Basal ganglia networks aid behavioral learning (a prospective planning function) but also favor the use of old behaviors (a retrospective performance function), making it unclear what happens when learned behaviors become suboptimal. Here we inhibit the dorsolateral striatum (DLS) as animals encounter a change in task rules, and again when they shift back to those learned task rules. DLS inhibition reduces adjustment to new task rules (and reduces behavioral vigor), but it increases adjustment back to the initially learned task rules later (and increases vigor). Thus, in both cases, DLS inhibition favored the use of the initially learned behavioral strategy, which could appear either maladaptive or adaptive. We suggest that the DLS might promote a prospective orientation of action control.

Automated and parallelized spike collision tests to identify spike signal projections

The spike collision test is a highly reliable technique to identify the axonal projection of a neuron recorded electrophysiologically for investigating functional spike information among brain areas. It is potentially applicable to more neuronal projections by combining multi-channel recording with optogenetic stimulation. Yet, it remains inefficient and laborious because an experimenter must visually select spikes in every channel and manually repeat spike collision tests for each neuron serially. Here, we automated spike collision tests for all channels in parallel (Multi-Linc analysis) in a multi-channel real-time processing system. The rat cortical neurons identified with this technique displayed physiological spike features consistent with excitatory projection neurons. Their antidromic spikes were similar in shape but slightly larger in amplitude compared with spontaneous spikes. In addition, we demonstrated simultaneous identification of reciprocal or bifurcating projections among cortical areas. Thus, our Multi-Linc analysis will be a powerful approach to elucidate interareal spike communication.

Activation, but not inhibition, of the indirect pathway disrupts choice rejection in a freely moving, multiple-choice foraging task

The dorsomedial striatum (DMS) plays a key role in action selection, but less is known about how direct and indirect pathway spiny projection neurons (dSPNs and iSPNs, respectively) contribute to choice rejection in freely moving animals. Here, we use pathway-specific chemogenetic manipulation during a serial choice foraging task to test the role of dSPNs and iSPNs in learned choice rejection. We find that chemogenetic activation, but not inhibition, of iSPNs disrupts rejection of nonrewarded choices, contrary to predictions of a simple "select/suppress" heuristic. Our findings suggest that iSPNs' role in stopping and freezing does not extend in a simple fashion to choice rejection in an ethological, freely moving context. These data may provide insights critical for the successful design of interventions for addiction or other conditions in which it is desirable to strengthen choice rejection.

Conservation of the Direct and Indirect Pathway Dichotomy in Mouse Caudal Striatum With Uneven Distribution of Dopamine Receptor D1- and D2-Expressing Neurons

The striatum is one of the key nuclei for adequate control of voluntary behaviors and reinforcement learning. Two striatal projection neuron types, expressing either dopamine receptor D1 (D1R) or dopamine receptor D2 (D2R) constitute two independent output routes: the direct or indirect pathways, respectively. These pathways co-work in balance to achieve coordinated behavior. Two projection neuron types are equivalently intermingled in most striatal space. However, recent studies revealed two atypical zones in the caudal striatum: the zone in which D1R-neurons are the minor population (D1R-poor zone) and that in which D2R-neurons are the minority (D2R-poor zone). It remains obscure as to whether these imbalanced zones have similar properties on axonal projections and electrophysiology compared to other striatal regions. Based on morphological experiments in mice using immunofluorescence, in situ hybridization, and neural tracing, here, we revealed that the poor zones densely projected to the globus pallidus and substantia nigra pars lateralis, with a few collaterals in substantia nigra pars reticulata and compacta. Similar to that in other striatal regions, D1R-neurons were the direct pathway neurons. We also showed that the membrane properties of projection neurons in the poor zones were largely similar to those in the conventional striatum using in vitro electrophysiological recording. In addition, the poor zones existed irrespective of the age or sex of mice. We also identified the poor zones in the common marmoset as well as other rodents. These results suggest that the poor zones in the caudal striatum follow the conventional projection patterns irrespective of the imbalanced distribution of projection neurons. The poor zones could be an innate structure and common in mammals. The unique striatal zones possessing highly restricted projections could relate to functions different from those of motor-related striatum.

Modulation of lateral septal and dorsomedial striatal neurons by hippocampal sharp-wave ripples, theta rhythm, and running speed

Single units were recorded in hippocampus, lateral septum (LS), and dorsomedial striatum (DMS) while freely behaving rats (n = 3) ran trials in a T‐maze task and rested in a holding bucket between trials. In LS, 28% (64/226) of recorded neurons were excited and 14% (31/226) were inhibited during sharp wave ripples (SWRs). LS neurons that were excited during SWRs fired preferentially on the downslope of hippocampal theta rhythm and had firing rates that were positively correlated with running speed; LS neurons that were inhibited during SWRs fired preferentially on the upslope of hippocampal theta rhythm and had firing rates that were negatively correlated with running speed. In DMS, only 3.3% (12/366) of recorded neurons were excited and 5.7% (21/366) were inhibited during SWRs. As in LS, DMS neurons that were excited by SWRs tended to have firing rates that were positively modulated by running speed, whereas DMS neurons that were inhibited by SWRs tended to have firing rates that were negatively modulated by running speed. But in contrast with LS, these two DMS subpopulations did not clearly segregate their spikes to different phases of the theta cycle. Based on these results and a review of prior findings, we discuss how concurrent activation of spatial trajectories in hippocampus and motor representations in LS and DMS may contribute to neural computations that support reinforcement learning and value‐based decision making.

The learning of prospective and retrospective cognitive maps within neural circuits

Brain circuits are thought to form a "cognitive map" to process and store statistical relationships in the environment. A cognitive map is commonly defined as a mental representation that describes environmental states (i.e., variables or events) and the relationship between these states. This process is commonly conceptualized as a prospective process, as it is based on the relationships between states in chronological order (e.g., does reward follow a given state?). In this perspective, we expand this concept on the basis of recent findings to postulate that in addition to a prospective map, the brain forms and uses a retrospective cognitive map (e.g., does a given state precede reward?). In doing so, we demonstrate that many neural signals and behaviors (e.g., habits) that seem inflexible and non-cognitive can result from retrospective cognitive maps. Together, we present a significant conceptual reframing of the neurobiological study of associative learning, memory, and decision making.

Direct and indirect pathway neurons in ventrolateral striatum differentially regulate licking movement and nigral responses

Drinking behavior in rodents is characterized by stereotyped, rhythmic licking movement, which is regulated by the basal ganglia. It is unclear how direct and indirect pathways control the lick bout and individual spout contact. We find that inactivating D1 and D2 receptor-expressing medium spiny neurons (MSNs) in the ventrolateral striatum (VLS) oppositely alters the number of licks in a bout. D1- and D2-MSNs exhibit different patterns of lick-sequence-related activity and different phases of oscillation time-locked to the lick cycle. On the timescale of a lick cycle, transient inactivation of D1-MSNs during tongue protrusion reduces spout contact probability, whereas transiently inactivating D2-MSNs has no effect. On the timescale of a lick bout, inactivation of D1-MSNs (D2-MSNs) causes rate increase (decrease) in a subset of basal ganglia output neurons that decrease firing during licking. Our results reveal the distinct roles of D1- and D2-MSNs in regulating licking at both coarse and fine timescales.

Concomitant Processing of Choice and Outcome in Frontal Corticostriatal Ensembles Correlates with Performance of Rats

The frontal cortex-basal ganglia network plays a pivotal role in adaptive goal-directed behaviors. Medial frontal cortex (MFC) encodes information about choices and outcomes into sequential activation of neural population, or neural trajectory. While MFC projects to the dorsal striatum (DS), whether DS also displays temporally coordinated activity remains unknown. We studied this question by simultaneously recording neural ensembles in the MFC and DS of rodents performing an outcome-based alternative choice task. We found that the two regions exhibited highly parallel evolution of neural trajectories, transforming choice information into outcome-related information. When the two trajectories were highly correlated, spike synchrony was task-dependently modulated in some MFC-DS neuron pairs. Our results suggest that neural trajectories concomitantly process decision-relevant information in MFC and DS with increased spike synchrony between these regions.

Epigallocatechin-3-gallate PEGylated poly(lactic-co-glycolic) acid nanoparticles mitigate striatal pathology and motor deficits in 3-nitropropionic acid intoxicated mice

Aim: To compare free and nanoparticle (NP)-encapsulated epigallocatechin-3-gallate (EGCG) for the treatment of Huntington's disease (HD)-like symptoms in mice. Materials & methods: EGCG was incorporated into PEGylated poly(lactic-co-glycolic) acid NPs with ascorbic acid (AA). HD-like striatal lesions and motor deficit were induced in mice by 3-nitropropionic acid-intoxication. EGCG and EGCG/AA NPs were co-administered and behavioral motor assessments and striatal histology performed after 5 days. Results: EGCG/AA NPs were significantly more effective than free EGCG in reducing motor disturbances and depression-like behavior associated with 3-nitropropionic acid toxicity. EGCG/AA NPs treatment also mitigated neuroinflammation and prevented neuronal loss. Conclusion: NP encapsulation enhances therapeutic robustness of EGCG in this model of HD symptomatology. Together with our previous findings, this highlights the potential of EGCG/AA NPs in the symptomatic treatment of neurodegenerative diseases.

A Genetically Defined Compartmentalized Striatal Direct Pathway for Negative Reinforcement

The striosome compartment within the dorsal striatum has been implicated in reinforcement learning and regulation of motivation, but how striosomal neurons contribute to these functions remains elusive. Here, we show that a genetically identified striosomal population, which expresses the Teashirt family zinc finger 1 (Tshz1) and belongs to the direct pathway, drives negative reinforcement and is essential for aversive learning in mice. Contrasting a "conventional" striosomal direct pathway, the Tshz1 neurons cause aversion, movement suppression, and negative reinforcement once activated, and they receive a distinct set of synaptic inputs. These neurons are predominantly excited by punishment rather than reward and represent the anticipation of punishment or the motivation for avoidance. Furthermore, inhibiting these neurons impairs punishment-based learning without affecting reward learning or movement. These results establish a major role of striosomal neurons in behaviors reinforced by punishment and moreover uncover functions of the direct pathway unaccounted for in classic models.

Signaling models for dopamine-dependent temporal contiguity in striatal synaptic plasticity

Animals remember temporal links between their actions and subsequent rewards. We previously discovered a synaptic mechanism underlying such reward learning in D1 receptor (D1R)-expressing spiny projection neurons (D1 SPN) of the striatum. Dopamine (DA) bursts promote dendritic spine enlargement in a time window of only a few seconds after paired pre- and post-synaptic spiking (pre-post pairing), which is termed as reinforcement plasticity (RP). The previous study has also identified underlying signaling pathways; however, it still remains unclear how the signaling dynamics results in RP. In the present study, we first developed a computational model of signaling dynamics of D1 SPNs. The D1 RP model successfully reproduced experimentally observed protein kinase A (PKA) activity, including its critical time window. In this model, adenylate cyclase type 1 (AC1) in the spines/thin dendrites played a pivotal role as a coincidence detector against pre-post pairing and DA burst. In particular, pre-post pairing (Ca2+ signal) stimulated AC1 with a delay, and the Ca2+-stimulated AC1 was activated by the DA burst for the asymmetric time window. Moreover, the smallness of the spines/thin dendrites is crucial to the short time window for the PKA activity. We then developed a RP model for D2 SPNs, which also predicted the critical time window for RP that depended on the timing of pre-post pairing and phasic DA dip. AC1 worked for the coincidence detector in the D2 RP model as well. We further simulated the signaling pathway leading to Ca2+/calmodulin-dependent protein kinase II (CaMKII) activation and clarified the role of the downstream molecules of AC1 as the integrators that turn transient input signals into persistent spine enlargement. Finally, we discuss how such timing windows guide animals' reward learning.

Synergistic Nigral Output Pathways Shape Movement

Locomotion relies on the activity of basal ganglia networks, where, as the output, the substantia nigra pars reticulata (SNr) integrates incoming signals and relays them to downstream areas. The cellular and circuit substrates of such a complex function remain unclear. We hypothesized that the SNr controls different aspects of locomotion through coordinated cell-type-specific sub-circuits. Using anatomical mapping, single-cell qPCR, and electrophysiological techniques, we identified two SNr sub-populations: the centromedial-thalamo projectors (CMps) and the SN compacta projectors (SNcps), which are genetically targeted based on vesicular transporter for gamma-aminobutyric acid (VGAT) or parvalbumin (PV) expression, respectively. Optogenetic manipulation of these two sub-types across a series of motor tests provided evidence that they govern different aspects of motor behavior. While CMp activity supports the continuity of motor patterns, SNcp modulates the immediate motor drive behind them. Collectively, our data suggest that at least two different sub-circuits arise from the SNr, engage different behavioral motor components, and collaborate to produce correct locomotion.

Electrophysiological Effects of Transcranial Direct Current Stimulation on Neural Activity in the Rat Motor Cortex

Transcranial direct current stimulation (tDCS) is a non-invasive technique that modulates the neuronal membrane potential. We have previously documented a sustainable increase in extracellular dopamine levels in the rat striatum of cathodal tDCS, suggesting that cathodal tDCS enhances the neuronal excitability of the cortex. In the present study, we investigated changes in neuronal activity in the cerebral cortex induced by tDCS at the point beneath the stimulus electrode in anesthetized rats in vivo. Multiunit recordings were performed to examine changes in neuronal activity before and after the application of tDCS. In the cathodal tDCS group, multiunit activity (indicating the collective firing rate of recorded neuronal populations) increased in the cerebral cortex. Both anodal and cathodal tDCS increased the firing rate of isolated single units in the cerebral cortex. Significant differences in activity were observed immediately following stimulation and persisted for more than an hour after stimulation. The primary finding of this study was that both anodal and cathodal tDCS increased in vivo neuronal activity in the rat cerebral cortex underneath the stimulus electrode.

Cell-Type-Specific Outcome Representation in the Primary Motor Cortex

Adaptive movements are critical for animal survival. To guide future actions, the brain monitors various outcomes, including achievement of movement and appetitive goals. The nature of these outcome signals and their neuronal and network realization in the motor cortex (M1), which directs skilled movements, is largely unknown. Using a dexterity task, calcium imaging, optogenetic perturbations, and behavioral manipulations, we studied outcome signals in the murine forelimb M1. We found two populations of layer 2-3 neurons, termed success- and failure-related neurons, that develop with training, and report end results of trials. In these neurons, prolonged responses were recorded after success or failure trials independent of reward and kinematics. In addition, the initial state of layer 5 pyramidal tract neurons contained a memory trace of the previous trial's outcome. Intertrial cortical activity was needed to learn new task requirements. These M1 layer-specific performance outcome signals may support reinforcement motor learning of skilled behavior.

A neural network model of basal ganglia's decision-making circuitry

The basal ganglia have been increasingly recognized as an important structure involved in decision making. Neurons in the basal ganglia were found to reflect the evidence accumulation process during decision making. However, it is not well understood how the direct and indirect pathways of the basal ganglia work together for decision making. Here, we create a recurrent neural network model that is composed of the direct and indirect pathways and test it with the classic random dot motion discrimination task. The direct pathway drives the outputs, which are modulated through a gating mechanism controlled by the indirect pathway. We train the network to learn the task and find that the network reproduces the accuracy and reaction time patterns of previous animal studies. Units in the model exhibit ramping activities that reflect evidence accumulation. Finally, we simulate manipulations of the direct and indirect pathways and find that the manipulations of the direct pathway mainly affect the choice while the manipulations of the indirect pathway affect the model's reaction time. These results suggest a potential circuitry mechanism of the basal ganglia's role in decision making with predictions that can be tested experimentally in the future.

Opponent regulation of action performance and timing by striatonigral and striatopallidal pathways

The basal ganglia have been implicated in action selection and timing, but the relative contributions of the striatonigral (direct) and striatopallidal (indirect) pathways to these functions remain unclear. We investigated the effects of optogenetic stimulation of D1+ (direct) and A2A+ (indirect) neurons in the ventrolateral striatum in head-fixed mice on a fixed time reinforcement schedule. Direct pathway stimulation initiates licking, whereas indirect pathway stimulation suppresses licking and results in rebound licking after stimulation. Moreover, direct and indirect pathways also play distinct roles in timing. Direct pathway stimulation produced a resetting of the internal timing process, whereas indirect pathway stimulation transiently paused timing, and proportionally delayed the next bout of licking. Our results provide evidence for the continuous and opposing contributions of the direct and indirect pathways in the production and timing of reward-guided behavior.

Continuous Representations of Speed by Striatal Medium Spiny Neurons

The striatum is critical for controlling motor output. However, it remains unclear how striatal output neurons encode and facilitate movement. A prominent theory suggests that striatal units encode movements in bursts of activity near specific events, such as the start or end of actions. These bursts are theorized to gate or permit specific motor actions, thereby encoding and facilitating complex sequences of actions. An alternative theory has suggested that striatal neurons encode continuous changes in sensory or motor information with graded changes in firing rate. Supporting this theory, many striatal neurons exhibit such graded changes without bursting near specific actions. Here, we evaluated these two theories in the same recordings of mice (both male and female). We recorded single-unit and multiunit activity from the dorsomedial striatum of mice as they spontaneously explored an arena. We observed both types of encoding, although continuous encoding was more prevalent than bursting near movement initiation or termination. The majority of recorded units did not exhibit positive linear relationships with speed but instead exhibited nonlinear relationships that peaked at a range of locomotor speeds. Bulk calcium recordings of identified direct and indirect pathway neurons revealed similar speed tuning profiles, indicating that the heterogeneity in response profiles was not due to this genetic distinction. We conclude that continuous encoding of speed is a central component of movement encoding in the striatum.SIGNIFICANCE STATEMENT The striatum is a structure that is linked to volitional movements and is a primary site of pathology in movement disorders. It remains unclear how striatal neurons encode motor parameters and use them to facilitate movement. Here, we evaluated two models for this: a "discrete encoding model" in which striatal neurons facilitate movements with brief burst of activity near the start and end of movements, and a "continuous encoding model," in which striatal neurons encode the sensory or motor state of the animal with continuous changes in firing. We found evidence primarily in support of the continuous encoding model. This may have implications for understanding the striatal control of movement, as well as informing therapeutic approaches for treating movement disorders.

Transient Chemogenetic Inhibition of D1-MSNs in the Dorsal Striatum Enhances Methamphetamine Self-Administration

The dorsal striatum is important for the development of drug addiction; however, the role of dopamine D1 receptor (D1R) expressing medium-sized spiny striatonigral (direct pathway) neurons (D1-MSNs) in regulating excessive methamphetamine intake remains elusive. Here we seek to determine if modulating D1-MSNs in the dorsal striatum alters methamphetamine self-administration in animals that have demonstrated escalation of self-administration. A viral vector-mediated approach was used to induce expression of the inhibitory (G_i coupled-hM₄D) or stimulatory (G_s coupled-rM₃D) designer receptors exclusively activated by designer drugs (DREADDs) engineered to specifically respond to the exogenous ligand clozapine-N-oxide (CNO) selectively in D1-MSNs in the dorsal striatum. CNO in animals expressing hM₄D increased responding for methamphetamine compared to vehicle in a within subject treatment paradigm. CNO in animals that did not express DREADDs (DREADD naïve-CNO) or expressed rM₃D did not alter responding for methamphetamine, demonstrating specificity for hM₄D-CNO interaction in increasing self-administration. Postmortem tissue analysis reveals that hM₄D-CNO animals had reduced Fos immunoreactivity in the dorsal striatum compared to rM₃D-CNO animals and DREADD naïve-CNO animals. Cellular mechanisms in the dorsal striatum in hM₄D-CNO animals reveal enhanced expression of D1R and Ca²⁺/calmodulin-dependent kinase II (CaMKII). Conversely, rM₃D-CNO animals had enhanced activity of extracellular signal-regulated kinase (Erk1/2) and Akt in the dorsal striatum, supporting rM₃D-CNO interaction in these animals compared with drug naïve controls, DREADD naïve-CNO and hM₄D-CNO animals. Our studies indicate that transient inhibition of D1-MSNs-mediated strengthening of methamphetamine addiction-like behavior is associated with cellular adaptations that support dysfunctional dopamine signaling in the dorsal striatum.

Motor cortex can directly drive the globus pallidus neurons in a projection neuron type-dependent manner in the rat

The basal ganglia are critical for the control of motor behaviors and for reinforcement learning. Here, we demonstrate in rats that primary and secondary motor areas (M1 and M2) make functional synaptic connections in the globus pallidus (GP), not usually thought of as an input site of the basal ganglia. Morphological observation revealed that the density of axonal boutons from motor cortices in the GP was 47% and 78% of that in the subthalamic nucleus (STN) from M1 and M2, respectively. Cortical excitation of GP neurons was comparable to that of STN neurons in slice preparations. FoxP2-expressing arkypallidal neurons were preferentially innervated by the motor cortex. The connection probability of cortico-pallidal innervation was higher for M2 than M1. These results suggest that cortico-pallidal innervation is an additional excitatory input to the basal ganglia, and that it can affect behaviors via the cortex-basal ganglia-thalamus motor loop.

NF1-cAMP signaling dissociates cell type-specific contributions of striatal medium spiny neurons to reward valuation and motor control

The striatum plays a fundamental role in motor learning and reward-related behaviors that are synergistically shaped by populations of D1 dopamine receptor (D1R)- and D2 dopamine receptor (D2R)-expressing medium spiny neurons (MSNs). How various neurotransmitter inputs converging on common intracellular pathways are parsed out to regulate distinct behavioral outcomes in a neuron-specific manner is poorly understood. Here, we reveal that distinct contributions of D1R-MSNs and D2R-MSNs towards reward and motor behaviors are delineated by the multifaceted signaling protein neurofibromin 1 (NF1). Using genetic mouse models, we show that NF1 in D1R-MSN modulates opioid reward, whereas loss of NF1 in D2R-MSNs delays motor learning by impeding the formation and consolidation of repetitive motor sequences. We found that motor learning deficits upon NF1 loss were associated with the disruption in dopamine signaling to cAMP in D2R-MSN. Restoration of cAMP levels pharmacologically or chemogenetically rescued the motor learning deficits seen upon NF1 loss in D2R-MSN. Our findings illustrate that multiplex signaling capabilities of MSNs are deployed at the level of intracellular pathways to achieve cell-specific control over behavioral outcomes.

A mouse genetic study reveals that the multifaceted signaling protein neurofibromin (known for its role in the human genetic disease neurofibromatosis type 1) plays a key role in differential routing of motor and reward signals in populations of striatal medium spiny neurons.

Modular organization of cerebellar climbing fiber inputs during goal-directed behavior

The cerebellum has a parasagittal modular architecture characterized by precisely organized climbing fiber (CF) projections that are congruent with alternating aldolase C/zebrin II expression. However, the behavioral relevance of CF inputs into individual modules remains poorly understood. Here, we used two-photon calcium imaging in the cerebellar hemisphere Crus II in mice performing an auditory go/no-go task to investigate the functional differences in CF inputs to modules. CF signals in medial modules show anticipatory decreases, early increases, secondary increases, and reward-related increases or decreases, which represent quick motor initiation, go cues, fast motor behavior, and positive reward outcomes. CF signals in lateral modules show early increases and reward-related decreases, which represent no-go and/or go cues and positive reward outcomes. The boundaries of CF functions broadly correspond to those of aldolase C patterning. These results indicate that spatially segregated CF inputs in different modules play distinct roles in the execution of goal-directed behavior.

Striatal circuits for reward learning and decision-making

The striatum is essential for learning which actions lead to reward and for implementing those actions. Decades of experimental and theoretical work have led to several influential theories and hypotheses about how the striatal circuit mediates these functions. However, owing to technical limitations, testing these hypotheses rigorously has been difficult. In this Review, we briefly describe some of the classic ideas of striatal function. We then review recent studies in rodents that take advantage of optical and genetic methods to test these classic ideas by recording and manipulating identified cell types within the circuit. This new body of work has provided experimental support of some longstanding ideas about the striatal circuit and has uncovered critical aspects of the classic view that are incorrect or incomplete.

Indirect pathway from caudate tail mediates rejection of bad objects in periphery

The essential everyday task of making appropriate choices is a process controlled mainly by the basal ganglia. To this end, subjects need not only to find "good" objects in their environment but also to reject "bad" objects. To reveal this rejection mechanism, we created a sequential saccade choice task for monkeys and studied the role of the indirect pathway from the CDt (tail of the caudate nucleus) mediated by cvGPe (caudal-ventral globus pallidus externus). Neurons in cvGPe were typically inhibited by the appearance of bad objects; however, this inhibition was reduced on trials when the monkeys made undesired saccades to the bad objects. Moreover, disrupting the inhibitory influence of CDt on cvGPe by local injection of bicuculline (GABA_A receptor antagonist) impaired the monkeys' ability to suppress saccades to bad objects. Thus, the indirect pathway mediates the rejection of bad choices, a crucial component of goal-directed behavior.

A striatal interneuron circuit for continuous target pursuit

Most adaptive behaviors require precise tracking of targets in space. In pursuit behavior with a moving target, mice use distance to target to guide their own movement continuously. Here, we show that in the sensorimotor striatum, parvalbumin-positive fast-spiking interneurons (FSIs) can represent the distance between self and target during pursuit behavior, while striatal projection neurons (SPNs), which receive FSI projections, can represent self-velocity. FSIs are shown to regulate velocity-related SPN activity during pursuit, so that movement velocity is continuously modulated by distance to target. Moreover, bidirectional manipulation of FSI activity can selectively disrupt performance by increasing or decreasing the self-target distance. Our results reveal a key role of the FSI-SPN interneuron circuit in pursuit behavior and elucidate how this circuit implements distance to velocity transformation required for the critical underlying computation.

Many natural behaviours involve tracking of a target in space. Here, the authors describe a task to assess this behaviour in mice and use in vivo electrophysiology, calcium imaging, optogenetics, and chemogenetics to investigate the role of the striatum in target pursuit.

Emergence of stable striatal D1R and D2R neuronal ensembles with distinct firing sequence during motor learning

The dorsolateral striatum (DLS) is essential for motor and procedure learning, but the role of DLS spiny projection neurons (SPNs) of direct and indirect pathways, as marked, respectively, by D1 and D2 receptor (D1R and D2R) expression, remains to be clarified. Long-term two-photon calcium imaging of the same neuronal population during mouse learning of a cued lever-pushing task revealed a gradual emergence of distinct D1R and D2R neuronal ensembles that reproducibly fired in a sequential manner, with more D1R and D2R neurons fired during the lever-pushing period and intertrial intervals (ITIs), respectively. This sequential firing pattern was specifically associated with the learned motor behavior, because it changed markedly when the trained mice performed other cued motor tasks. Selective chemogenetic silencing of D1R and D2R neurons impaired the initiation of learned motor action and suppression of erroneous lever pushing during ITIs, respectively. Thus, motor learning involves reorganization of DLS neuronal activity, forming stable D1R and D2R neuronal ensembles that fired sequentially to regulate different aspects of the learned behavior.

In Vivo Spiking Dynamics of Intra- and Extratelencephalic Projection Neurons in Rat Motor Cortex

In motor cortex, 2 types of deep layer pyramidal cells send their axons to other areas: intratelencephalic (IT)-type neurons specifically project bilaterally to the cerebral cortex and striatum, whereas neurons of the extratelencephalic (ET)-type, termed conventionally pyramidal tract-type, project ipsilaterally to the thalamus and other areas. Although they have totally different synaptic and membrane potential properties in vitro, little is known about the differences between them in ongoing spiking dynamics in vivo. We identified IT-type and ET-type neurons, as well as fast-spiking-type interneurons, using novel multineuronal analysis based on optogenetically evoked spike collision along their axons in behaving/resting rats expressing channelrhodopsin-2 (Multi-Linc method). We found "postspike suppression" (~100 ms) as a characteristic of ET-type neurons in spike auto-correlograms, and it remained constant independent of behavioral conditions in functionally different ET-type neurons. Postspike suppression followed even solitary spikes, and spike bursts significantly extended its duration. We also observed relatively strong spike synchrony in pairs containing IT-type neurons. Thus, spiking dynamics in IT-type and ET-type neurons may be optimized differently for precise and coordinated motor control.

What, If, and When to Move: Basal Ganglia Circuits and Self-Paced Action Initiation

Deciding what to do and when to move is vital to our survival. Clinical and fundamental studies have identified basal ganglia circuits as critical for this process. The main input nucleus of the basal ganglia, the striatum, receives inputs from frontal, sensory, and motor cortices and interconnected thalamic areas that provide information about potential goals, context, and actions and directly or indirectly modulates basal ganglia outputs. The striatum also receives dopaminergic inputs that can signal reward prediction errors and also behavioral transitions and movement initiation. Here we review studies and models of how direct and indirect pathways can modulate basal ganglia outputs to facilitate movement initiation, and we discuss the role of cortical and dopaminergic inputs to the striatum in determining what to do and if and when to do it. Complex but exciting scenarios emerge that shed new light on how basal ganglia circuits modulate self-paced movement initiation.

Optogenetic Editing Reveals the Hierarchical Organization of Learned Action Sequences

The organization of action into sequences underlies complex behaviors that are essential for organismal survival and reproduction. Despite extensive studies of innate sequences in relation to central pattern generators, how learned action sequences are controlled and whether they are organized as a chain or a hierarchy remain largely unknown. By training mice to perform heterogeneous action sequences, we demonstrate that striatal direct and indirect pathways preferentially encode different behavioral levels of sequence structure. State-dependent closed-loop optogenetic stimulation of the striatal direct pathway can selectively insert a single action element into the sequence without disrupting the overall sequence length. Optogenetic manipulation of the striatal indirect pathway completely removes the ongoing subsequence while leaving the following subsequence to be executed with the appropriate timing and length. These results suggest that learned action sequences are not organized in a serial but rather a hierarchical structure that is distinctly controlled by basal ganglia pathways.

Neuronal connections of direct and indirect pathways for stable value memory in caudal basal ganglia

Direct and indirect pathways in the basal ganglia work together for controlling behavior. However, it is still a controversial topic whether these pathways are segregated or merged with each other. To address this issue, we studied the connections of these two pathways in the caudal parts of the basal ganglia of rhesus monkeys using anatomical tracers. Our previous studies showed that the caudal basal ganglia control saccades by conveying long-term values (stable values) of many visual objects toward the superior colliculus. In experiment 1, we injected a tracer in the caudate tail (CDt), and found local dense plexuses of axon terminals in the caudal-dorsal-lateral part of substantia nigra pars reticulata (cdlSNr) and the caudal-ventral part of globus pallidus externus (cvGPe). These anterograde projections may correspond to the direct and indirect pathways, respectively. To verify this in experiment 2, we injected different tracers into cdlSNr and cvGPe, and found many retrogradely labeled neurons in CDt and, in addition, the caudal-ventral part of the putamen (cvPut). These cdlSNr-projecting and cvGPe-projecting neurons were found intermingled in both CDt and cvPut (which we call "striatum tail"). A small but significant proportion of neurons (<15%) were double-labeled, indicating that they projected to both cdlSNr and cvGPe. These anatomical results suggest that stable value signals (good vs. bad) are sent from the striatum tail to cdlSNr and cvGPe in a biased (but not exclusive) manner. These connections may play an important role in biasing saccades toward higher valued objects and away from lower valued objects.