Parallel basal ganglia circuits for decision making

Pathways for Naturalistic Looking Behavior in Primate II. Superior Colliculus Integrates Parallel Top-down and Bottom-up Inputs

Volitional signals for gaze control are provided by multiple parallel pathways converging on the midbrain superior colliculus (SC), whose deeper layers output to the brainstem gaze circuits. In the first of two papers (Takahashi and Veale, 2023), we described the properties of gaze behavior of several species under both laboratory and natural conditions, as well as the current understanding of the brainstem and spinal cord circuits implementing gaze control in primate. In this paper, we review the parallel pathways by which sensory and task information reaches SC and how these sensory and task signals interact within SC's multilayered structure. This includes both bottom-up (world statistics) signals mediated by sensory cortex, association cortex, and subcortical structures, as well as top-down (goal and task) influences which arrive via either direct excitatory pathways from cerebral cortex, or via indirect basal ganglia relays resulting in inhibition or dis-inhibition as appropriate for alternative behaviors. Models of attention such as saliency maps serve as convenient frameworks to organize our understanding of both the separate computations of each neural pathway, as well as the interaction between the multiple parallel pathways influencing gaze. While the spatial interactions between gaze's neural pathways are relatively well understood, the temporal interactions between and within pathways will be an important area of future study, requiring both improved technical methods for measurement and improvement of our understanding of how temporal dynamics results in the observed spatiotemporal allocation of gaze.

Inhibitory Pedunculopontine Neurons Gate Dopamine-Mediated Motor Actions of Unsigned Valence

BACKGROUND

The pedunculopontine nucleus (PPN) maintains a bidirectional connectivity with the basal ganglia that supports their shared roles in the selection and execution of motor actions. Previous studies identified a role for PPN neurons in goal-directed behavior, but the cellular substrates underlying this function have not been elucidated. We recently revealed the existence of a monosynaptic GABAergic input from the PPN that inhibits dopamine neurons of the substantia nigra. Activation of this pathway interferes with the execution of learned motor sequences when the actions are rewarded, even though the inhibition of dopamine neurons did not shift the value of the action, hence suggesting executive control over the gating of behavior.

OBJECTIVE

To test the attributes of the inhibition of dopamine neurons by the PPN in the context of goal-directed behavior regardless of whether the outcome is positive or negative.

METHODS

We delivered optogenetic stimulation to PPN GABAergic axon terminals in the substantia nigra during a battery of behavioral tasks with positive and negative valence.

RESULTS

Inhibition of dopamine neurons by PPN optogenetic activation during an appetitive task impaired the initiation and overall execution of the behavioral sequence without affecting the consumption of reward. During an active avoidance task, the same activation impaired the ability of mice to avoid a foot shock, but their escape response was unaffected. In addition, responses to potential threats were significantly attenuated.

CONCLUSION

Our results show that PPN GABAergic neurons modulate learned, goal-directed behavior of unsigned valence without affecting overall motor behavior.

Progressive neuronal plasticity in primate visual cortex during stimulus familiarization

The primate brain is equipped to learn and remember newly encountered visual stimuli such as faces and objects. In the macaque inferior temporal (IT) cortex, neurons mark the familiarity of a visual stimulus through response modification, often involving a decrease in spiking rate. Here, we investigate the emergence of this neural plasticity by longitudinally tracking IT neurons during several weeks of familiarization with face images. We found that most neurons in the anterior medial (AM) face patch exhibited a gradual decline in their late-phase visual responses to multiple stimuli. Individual neurons varied from days to weeks in their rates of plasticity, with time constants determined by the number of days of exposure rather than the cumulative number of presentations. We postulate that the sequential recruitment of neurons with experience-modified responses may provide an internal and graded measure of familiarity strength, which is a key mnemonic component of visual recognition.

Striatopallidal adenosine A2A receptor modulation of goal-directed behavior: Homeostatic control with cognitive flexibility

Dysfunction of goal-directed behaviors under stressful or pathological conditions results in impaired decision-making and loss of flexibility of thoughts and behaviors, which underlie behavioral deficits ranging from depression, obsessive-compulsive disorders and drug addiction. Tackling the neuromodulators fine-tuning this core behavioral element may facilitate the development of effective strategies to control these deficits present in multiple psychiatric disorders. The current investigation of goal-directed behaviors has concentrated on dopamine and glutamate signaling in the corticostriatal pathway. In accordance with the beneficial effects of caffeine intake on mood and cognitive dysfunction, we now propose that caffeine's main site of action - adenosine A2A receptors (A2AR) - represent a novel target to homeostatically control goal-directed behavior and cognitive flexibility. A2AR are abundantly expressed in striatopallidal neurons and colocalize and interact with dopamine D2, NMDA and metabotropic glutamate 5 receptors to integrate dopamine and glutamate signaling. Specifically, striatopallidal A2AR (i) exert an overall "break" control of a variety of cognitive processes, making A2AR antagonists a novel strategy for improving goal-directed behavior; (ii) confer homeostatic control of goal-directed behavior by acting at multiple sites with often opposite effects, to enhance cognitive flexibility; (iii) integrate dopamine and adenosine signaling through multimeric A2AR-D2R heterocomplexes allowing a temporally precise fine-tuning in response to local signaling changes. As the U.S. Food and Drug Administration recently approved the A2AR antagonist Nourianz® (istradefylline) to treat Parkinson's disease, striatal A2AR-mediated control of goal-directed behavior may offer a new and real opportunity for improving deficits of goal-directed behavior and enhance cognitive flexibility under various neuropsychiatric conditions. This article is part of the Special Issue on "Purinergic Signaling: 50 years".

Negative symptoms, striatal dopamine and model-free reward decision-making in schizophrenia

Negative symptoms, such as lack of motivation or social withdrawal, are highly prevalent and debilitating in patients with schizophrenia. Underlying mechanisms of negative symptoms are incompletely understood, thereby preventing the development of targeted treatments. We hypothesized that in patients with schizophrenia during psychotic remission, impaired influences of both model-based and model-free reward predictions on decision-making ('reward prediction influence', RPI) underlie negative symptoms. We focused on psychotic remission, because psychotic symptoms might confound reward-based decision-making. Moreover, we hypothesized that impaired model-based/model-free RPIs depend on alterations of both associative striatum dopamine synthesis and storage (DSS) and executive functioning. Both factors influence RPI in healthy subjects and are typically impaired in schizophrenia. Twenty-five patients with schizophrenia with pronounced negative symptoms during psychotic remission and 24 healthy controls were included in the study. Negative symptom severity was measured by the Positive and Negative Syndrome Scale negative subscale, model-based/model-free RPI by the two-stage decision task, associative striatum DSS by 18F-DOPA positron emission tomography and executive functioning by the symbol coding task. Model-free RPI was selectively reduced in patients and associated with negative symptom severity as well as with reduced associative striatum DSS (in patients only) and executive functions (both in patients and controls). In contrast, model-based RPI was not altered in patients. Results provide evidence for impaired model-free reward prediction influence as a mechanism for negative symptoms in schizophrenia as well as for reduced associative striatum dopamine and executive dysfunction as relevant factors. Data suggest potential treatment targets for patients with schizophrenia and pronounced negative symptoms.

Efficiency analysis by training sequence of high-fidelity simulation-based neonatal resuscitation program (NRP)

OBJECTIVE

This study was conducted to find a more effective education method in a neonatal resuscitation program (NRP) using a high-fidelity simulation that has recently shown positive results in terms of its effectiveness.

STUDY DESIGN

A single-blind prospective cohort study was performed. The high-fidelity simulation model was used in a formal NRP training course for trainees caring for neonatal patients. The trainees were divided into a group that conducted the scenario after the lecture (Group A) and a group that attended the lecture after the scenario (Group B) and they both took the test before, during, and after the training.

RESULTS

The increase in score after theory training was statistically significant in both groups, but the final score did not differ between the two groups. However, when compared by career, in Group A, trainees under 24 months tended to be more effective, and in Group B, trainees over 24 months tended to be more effective.

CONCLUSION

The difference in short-term memory of trainees according to the order of education identified by the test score was not prominent, but it was found that the degree of difference in test scores for the order of education tended to be different according to the career. It is thought that the effectiveness of the training might be increased by changing the education order according to the degree of experience of each trainee. More effective educational methods should be introduced by continuously developing lectures for repeated education of various trainees in the future.

Bio-inspired neural networks for decision-making mechanisms and neuromodulation for motor control in a differential robot

The aim of this work is to propose bio-inspired neural networks for decision-making mechanisms and modulation of motor control of an automaton. In this work, we have adapted and applied cortical synaptic circuits, such as short-term memory circuits, winner-take-all (WTA) class competitive neural networks, modulation neural networks, and nonlinear oscillation circuits, in order to make the automaton able to avoid obstacles and explore simulated and real environments. The performance achieved by using biologically inspired neural networks to solve the task at hand is similar to that of several works mentioned in the specialized literature. Furthermore, this work contributed to bridging the fields of computational neuroscience and robotics.

Cilia in the Striatum Mediate Timing-Dependent Functions

Almost all brain cells contain cilia, antennae-like microtubule-based organelles. Yet, the significance of cilia, once considered vestigial organelles, in the higher-order brain functions is unknown. Cilia act as a hub that senses and transduces environmental sensory stimuli to generate an appropriate cellular response. Similarly, the striatum, a brain structure enriched in cilia, functions as a hub that receives and integrates various types of environmental information to drive appropriate motor response. To understand cilia's role in the striatum functions, we used loxP/Cre technology to ablate cilia from the dorsal striatum of male mice and monitored the behavioral consequences. Our results revealed an essential role for striatal cilia in the acquisition and brief storage of information, including learning new motor skills, but not in long-term consolidation of information or maintaining habitual/learned motor skills. A fundamental aspect of all disrupted functions was the "time perception/judgment deficit." Furthermore, the observed behavioral deficits form a cluster pertaining to clinical manifestations overlapping across psychiatric disorders that involve the striatum functions and are known to exhibit timing deficits. Thus, striatal cilia may act as a calibrator of the timing functions of the basal ganglia-cortical circuit by maintaining proper timing perception. Our findings suggest that dysfunctional cilia may contribute to the pathophysiology of neuro-psychiatric disorders, as related to deficits in timing perception.

Salience memories formed by value, novelty and aversiveness jointly shape object responses in the prefrontal cortex and basal ganglia

Ecological fitness depends on maintaining object histories to guide future interactions. Recent evidence shows that value memory changes passive visual responses to objects in ventrolateral prefrontal cortex (vlPFC) and substantia nigra reticulata (SNr). However, it is not known whether this effect is limited to reward history and if not how cross-domain representations are organized within the same or different neural populations in this corticobasal circuitry. To address this issue, visual responses of the same neurons across appetitive, aversive and novelty domains were recorded in vlPFC and SNr. Results showed that changes in visual responses across domains happened in the same rather than separate populations and were related to salience rather than valence of objects. Furthermore, while SNr preferentially encoded outcome related salience memory, vlPFC encoded salience memory across all domains in a correlated fashion, consistent with its role as an information hub to guide behavior.

Clinical neuroscience and neurotechnology: An amazing symbiosis

In the last decades, clinical neuroscience found a novel ally in neurotechnologies, devices able to record and stimulate electrical activity in the nervous system. These technologies improved the ability to diagnose and treat neural disorders. Neurotechnologies are concurrently enabling a deeper understanding of healthy and pathological dynamics of the nervous system through stimulation and recordings during brain implants. On the other hand, clinical neurosciences are not only driving neuroengineering toward the most relevant clinical issues, but are also shaping the neurotechnologies thanks to clinical advancements. For instance, understanding the etiology of a disease informs the location of a therapeutic stimulation, but also the way stimulation patterns should be designed to be more effective/naturalistic. Here, we describe cases of fruitful integration such as Deep Brain Stimulation and cortical interfaces to highlight how this symbiosis between clinical neuroscience and neurotechnology is closer to a novel integrated framework than to a simple interdisciplinary interaction.

Modulation of neural co-firing to enhance network transmission and improve motor function after stroke

Stroke is a leading cause of disability. While neurotechnology has shown promise for improving upper limb recovery after stroke, efficacy in clinical trials has been variable. Our central thesis is that to improve clinical translation, we need to develop a common neurophysiological framework for understanding how neurotechnology alters network activity. Our perspective discusses principles for how motor networks, both healthy and those recovering from stroke, subserve reach-to-grasp movements. We focus on neural processing at the resolution of single movements, the timescale at which neurotechnologies are applied, and discuss how this activity might drive long-term plasticity. We propose that future studies should focus on cross-area communication and bridging our understanding of timescales ranging from single trials within a session to across multiple sessions. We hope that this perspective establishes a combined path forward for preclinical and clinical research with the goal of more robust clinical translation of neurotechnology.

An insula hierarchical network architecture for active interoceptive inference

In the brain, the insular cortex receives a vast amount of interoceptive information, ascending through deep brain structures, from multiple visceral organs. The unique hierarchical and modular architecture of the insula suggests specialization for processing interoceptive afferents. Yet, the biological significance of the insula's neuroanatomical architecture, in relation to deep brain structures, remains obscure. In this opinion piece, we propose the Insula Hierarchical Modular Adaptive Interoception Control (IMAC) model to suggest that insula modules (granular, dysgranular and agranular), forming parallel networks with the prefrontal cortex and striatum, are specialized to form higher order interoceptive representations. These interoceptive representations are recruited in a context-dependent manner to support habitual, model-based and exploratory control of visceral organs and physiological processes. We discuss how insula interoceptive representations may give rise to conscious feelings that best explain lower order deep brain interoceptive representations, and how the insula may serve to defend the body and mind against pathological depression.

Motor context modulates substantia nigra pars reticulata spike activity in patients with Parkinson's disease

OBJECTIVE

The severity of motor symptoms in Parkinson's disease (PD) depends on environmental conditions. For example, the presence of external patterns such as a rhythmic tone can attenuate bradykinetic impairments. However, the neural mechanisms for this context-dependent attenuation (e.g., paradoxical kinesis) remain unknown. Here, we investigate whether context-dependent symptom attenuation is reflected in single-unit activity recorded in the operating room from the substantia nigra pars reticulata (SNr) of patients with PD undergoing deep brain stimulation surgery. The SNr is known to influence motor planning and execution in animal models, but its role in humans remains understudied.

METHODS

We recorded SNr activity while subjects performed cued directional movements in response to auditory stimuli under interleaved 'patterned' and 'unpatterned' contexts. SNr localisation was independently confirmed with expert intraoperative assessment as well as post hoc imaging-based reconstructions.

RESULTS

As predicted, we found that motor performance was improved in the patterned context, reflected in increased reaction speed and accuracy compared with the unpatterned context. These behavioural differences were associated with enhanced responsiveness of SNr neurons-that is, larger changes in activity from baseline-in the patterned context. Unsupervised clustering analysis revealed two distinct subtypes of SNr neurons: one exhibited context-dependent enhanced responsiveness exclusively during movement preparation, whereas the other showed enhanced responsiveness during portions of the task associated with both motor and non-motor processes.

CONCLUSIONS

Our findings indicate the SNr participates in motor planning and execution, as well as warrants greater attention in the study of human sensorimotor integration and as a target for neuromodulatory therapies.

Neuroprotective role of apocynin against pentylenetetrazole kindling epilepsy and associated comorbidities in mice by suppression of ROS/RNS

Epilepsy is a neurological disease that transpires due to the unusual synchronized neuronal discharge within the central nervous system, which drives repetitious unprovoked seizures. Nicotinamide adenine dinucleotide phosphate (NADPH) oxidase is a complex enzyme accountable for reactive oxygen species (ROS) production, neurodegeneration, neurotoxicity, memory impairment, vitiates normal cellular processes, long term potentiation, and thus, implicated in the pathogenesis of epilepsy. Therefore, the present study was sketched to examine the neuroprotective effect of apocynin, NADPH oxidase inhibitor in pentylenetetrazole kindling epilepsy, and induced comorbidities in mice. Mice (either sex) were given pentylenetetrazole (35 mg/kg, i.p.) every other day up to 29 days, and a challenge test was executed on the 33^rd day. Pretreatment with apocynin (25, 50, and 100 mg/kg, i.p.) was carried out from 1^st to 33^rd day. Rotarod and open field test were performed on the 1^st, 10^th, 20^th, and 30^th days of the study. Animals were tutored on the morris water maze from 30^th to 33^rd day, and the retention was registered on the 34^th day. Tail suspension test and elevated plus maze were sequentially performed on the 32^nd and 33^rd day of the study. On the 34^th day, animals were sacrificed, and their brains were isolated to conduct biochemical estimation. NADPH oxidase activation due to chronic pentylenetetrazole treatment resulted in generalized tonic-clonic seizures, enhanced oxidative stress, remodeled neurotransmitters' level, and resulted in comorbidities (anxiety, depression, and memory impairment). Pretreatment with apocynin significantly restricted the pentylenetetrazole induced seizure severity, ROS production, neurotransmitter alteration, and comorbid conditions by inhibiting the NADPH oxidase enzyme.

Basal ganglia: From the bench to the bed

The basal ganglia (BG) encompass a set of archaic structures of the vertebrate brain that have evolved relatively little during the phylogenetic process. From an anatomic point of view, they are widely distributed throughout brain from the telencephalon to the mesencephalon. The fact that they have been preserved through evolution suggests that they may play a critical role in behavioral monitoring. Indeed, a line of evidence suggests that they are involved in the building of behavioral routines and habits that drive most of our activities in everyday life. In this article, we first examine the organization and physiology of the basal ganglia to explain their function in the control of behavior. Then, we show how disruption of the putamen, and to a lesser extent of the cerebellum, might lead to various dystonic syndromes that frequently arise during childhood.

Thalamostriatal System Controls the Acquisition, Performance, and Flexibility of Learning Behavior

The dorsal striatum (DS) is a key structure of the basal ganglia circuitry, which regulates various types of learning processes and flexible switching of behavior. Intralaminar thalamic nuclei (ILNs) provide the main source of thalamostriatal inputs to the DS and constitute multiple nuclear groups, each of which innervates specific subdivisions of the striatum. Although the anatomical and electrophysiological properties of thalamostriatal neurons have been previously characterized, the behavioral and physiological functions of these neurons remain unclarified. Two representative thalamostriatal cell groups in the parafascicular nucleus (PF) and the central lateral nucleus (CL) are located in the caudal and rostral regions of the ILNs in rodents. Recently, the behavioral roles of these thalamostriatal cell groups have been investigated by the use of genetic and pharmacological manipulation techniques. In the current review, we summarize behavioral studies on thalamostriatal neurons, showing the key roles of these neurons in different learning processes, such as the acquisition, performance, and flexibility of behavior.

Reward modulates cortical representations of action

People are capable of rapid improvements in performance when they are offered a reward. The neural mechanism by which this performance enhancement occurs remains unclear. We investigated this phenomenon by offering people monetary reward for successful performance in a sequence production task. We found that people performed actions more quickly and accurately when they were offered large reward. Increasing reward magnitude was associated with elevated activity throughout the brain prior to movement. Multivariate patterns of activity in these reward-responsive regions encoded information about the upcoming action. Follow-up analyses provided evidence that action decoding in pre-SMA and other motor planning areas was improved for large reward trials and successful action decoding in SMA was associated with improved performance. These results suggest that reward may enhance performance by enhancing neural representations of action used in motor planning.

In vivo patch-clamp recordings reveal distinct subthreshold signatures and threshold dynamics of midbrain dopamine neurons

The in vivo firing patterns of ventral midbrain dopamine neurons are controlled by afferent and intrinsic activity to generate sensory cue and prediction error signals that are essential for reward-based learning. Given the absence of in vivo intracellular recordings during the last three decades, the subthreshold membrane potential events that cause changes in dopamine neuron firing patterns remain unknown. To address this, we established in vivo whole-cell recordings and obtained over 100 spontaneously active, immunocytochemically-defined midbrain dopamine neurons in isoflurane-anaesthetized adult mice. We identified a repertoire of subthreshold membrane potential signatures associated with distinct in vivo firing patterns. Dopamine neuron activity in vivo deviated from single-spike pacemaking by phasic increases in firing rate via two qualitatively distinct biophysical mechanisms: 1) a prolonged hyperpolarization preceding rebound bursts, accompanied by a hyperpolarizing shift in action potential threshold; and 2) a transient depolarization leading to high-frequency plateau bursts, associated with a depolarizing shift in action potential threshold. Our findings define a mechanistic framework for the biophysical implementation of dopamine neuron firing patterns in the intact brain.

Mechanisms for the Approach/Avoidance Decision Applied to Autism

As a neurodevelopmental disorder with serious lifelong consequences, autism has received considerable attention from neuroscientists and geneticists. We present a hypothesis of mechanisms plausibly affected during brain development in autism, based on neural pathways that are associated with social behavior and connect the prefrontal cortex (PFC) to the basal ganglia (BG). We consider failure of social approach in autism as a special case of imbalance in the fundamental dichotomy between behavioral approach and avoidance. Differential combinations of genes mutated, differences in the timing of their impact during development, and graded degrees of hormonal influences may help explain the heterogeneity in symptomatology in autism and predominance in boys.

Phase of firing coding of learning variables across the fronto-striatal network during feature-based learning

The prefrontal cortex and striatum form a recurrent network whose spiking activity encodes multiple types of learning-relevant information. This spike-encoded information is evident in average firing rates, but finer temporal coding might allow multiplexing and enhanced readout across the connected network. We tested this hypothesis in the fronto-striatal network of nonhuman primates during reversal learning of feature values. We found that populations of neurons encoding choice outcomes, outcome prediction errors, and outcome history in their firing rates also carry significant information in their phase-of-firing at a 10–25 Hz band-limited beta frequency at which they synchronize across lateral prefrontal cortex, anterior cingulate cortex and anterior striatum when outcomes were processed. The phase-of-firing code exceeds information that can be obtained from firing rates alone and is evident for inter-areal connections between anterior cingulate cortex, lateral prefrontal cortex and anterior striatum. For the majority of connections, the phase-of-firing information gain is maximal at phases of the beta cycle that were offset from the preferred spiking phase of neurons. Taken together, these findings document enhanced information of three important learning variables at specific phases of firing in the beta cycle at an inter-areally shared beta oscillation frequency during goal-directed behavior.

The average spiking frequency in the fronto-striatal network encodes multiple types of learning-relevant information. Here, the authors show that populations of neurons in non-human primates also carry significant information in their phase-of-firing when learning-relevant outcomes are processed.

Brain Networks Sensitive to Object Novelty, Value, and Their Combination

Novel and valuable objects are motivationally attractive for animals including primates. However, little is known about how novelty and value processing is organized across the brain. We used fMRI in macaques to map brain responses to visual fractal patterns varying in either novelty or value dimensions and compared the results with the structure of functionally connected brain networks determined at rest. The results show that different brain networks possess unique combinations of novelty and value coding. One network identified in the ventral temporal cortex preferentially encoded object novelty, whereas another in the parietal cortex encoded the learned value. A third network, broadly composed of temporal and prefrontal areas (TP network), along with functionally connected portions of the striatum, amygdala, and claustrum, encoded both dimensions with similar activation dynamics. Our results support the emergence of a common currency signal in the TP network that may underlie the common attitudes toward novel and valuable objects.

Optogenetic manipulation of a value-coding pathway from the primate caudate tail facilitates saccadic gaze shift

In the primate basal ganglia, the caudate tail (CDt) encodes the historical values (good or bad) of visual objects (i.e., stable values), and electrical stimulation of CDt evokes saccadic eye movements. However, it is still unknown how output from CDt conveys stable value signals to govern behavior. Here, we apply a pathway-selective optogenetic manipulation to elucidate how such value information modulates saccades. We express channelrhodopsin-2 in CDt delivered by viral vector injections. Selective optical activation of CDt-derived terminals in the substantia nigra pars reticulata (SNr) inhibits SNr neurons. Notably, these SNr neurons show inhibitory responses to good objects. Furthermore, the optical stimulation causes prolonged excitation of visual-saccadic neurons in the superior colliculus (SC), and induces contralateral saccades. These SC neurons respond more strongly to good than to bad objects in the contralateral hemifield. The present results demonstrate that CDt facilitates saccades toward good objects by serial inhibitory pathways through SNr.

Affective valence in the brain: modules or modes?

How do brain systems evaluate the affective valence of a stimulus - that is, its quality of being good or bad? One possibility is that a neural subsystem, or 'module' (such as a subregion of the brain, a projection pathway, a neuronal population or an individual neuron), is permanently dedicated to mediate only one affective function, or at least only one specific valence - an idea that is termed here the 'affective modules' hypothesis. An alternative possibility is that a given neural module can exist in multiple neurobiological states that give it different affective functions - an idea termed here the 'affective modes' hypothesis. This suggests that the affective function or valence mediated by a neural module need not remain permanently stable but rather can change dynamically across different situations. An evaluation of evidence for the 'affective modules' versus 'affective modes' hypotheses may be useful for advancing understanding of the affective organization of limbic circuitry.

Dystonia and dopamine: From phenomenology to pathophysiology

A line of evidence suggests that the pathophysiology of dystonia involves the striatum, whose activity is modulated among other neurotransmitters, by the dopaminergic system. However, the link between dystonia and dopamine appears complex and remains unclear. Here, we propose a physiological approach to investigate the clinical and experimental data supporting a role of the dopaminergic system in the pathophysiology of dystonic syndromes. Because dystonia is a disorder of motor routines, we first focus on the role of dopamine and striatum in procedural learning. Second, we consider the phenomenology of dystonia from every angle in order to search for features giving food for thought regarding the pathophysiology of the disorder. Then, for each dystonic phenotype, we review, when available, the experimental and imaging data supporting a connection with the dopaminergic system. Finally, we propose a putative model in which the different phenotypes could be explained by changes in the balance between the direct and indirect striato-pallidal pathways, a process critically controlled by the level of dopamine within the striatum. Search strategy and selection criteria References for this article were identified through searches in PubMed with the search terms « dystonia », « dopamine", « striatum », « basal ganglia », « imaging data », « animal model », « procedural learning », « pathophysiology », and « plasticity » from 1998 until 2018. Articles were also identified through searches of the authors' own files. Only selected papers published in English were reviewed. The final reference list was generated on the basis of originality and relevance to the broad scope of this review.

Oscillations in cortico-basal ganglia circuits: implications for Parkinson’s disease and other neurologic and psychiatric conditions

Cortico-basal ganglia circuits are thought to play a crucial role in the selection and control of motor behaviors and have also been implicated in the processing of motivational content and in higher cognitive functions. During the last two decades, electrophysiological recordings in basal ganglia circuits have shown that several disease conditions are associated with specific changes in the temporal patterns of neuronal activity. In particular, synchronized oscillations have been a frequent finding suggesting that excessive synchronization of neuronal activity may be a pathophysiological mechanism involved in a wide range of neurologic and psychiatric conditions. We here review the experimental support for this hypothesis primarily in relation to Parkinson’s disease but also in relation to dystonia, essential tremor, epilepsy, and psychosis/schizophrenia.

Translating striatal activity from brain slice to whole animal neurophysiology: A guide for neuroscience research integrating diverse levels of analysis

An important goal of this review is highlighting research in neuroscience as examples of multilevel functional and anatomical analyses addressing basic science issues and applying results to the understanding of diverse disorders. The research of Dr. Michael Levine, a leader in neuroscience, exemplifies this approach by uncovering fundamental properties of basal ganglia function and translating these findings to clinical applications. The review focuses on neurophysiological research connecting results from in vitro and in vivo recordings. A second goal is to utilize these research connections to produce novel, accurate descriptions for corticostriatal processing involved in varied, complex functions. Medium spiny neurons in striatum act as integrators combining input with baseline activity creating motivational "events." Basic research on corticostriatal synapses is described and links developed to issues with clinical relevance such as inhibitory gating, self-injurious behavior, and relative reward valuation. Work is highlighted on dopamine-glutamate interactions. Individual medium spiny neurons express both D₁ and D₂ receptors and encode information in a bivalent manner depending upon the mix of receptors involved. Current work on neurophysiology of reward processing has taken advantage of these basic approaches at the cellular and molecular levels. Future directions in studying physiology of reward processing and action sequencing could profit by incorporating the divergent ways dopamine modulates incoming neurochemical signals. Primary investigators leading research teams should mirror Mike Levine's efforts in "climbing the mountain" of scientific inquiry by performing analyses at different levels of inquiry, integrating the findings, and building comprehensive answers to problems unsolvable without this bold approach.

Neuronal connections of direct and indirect pathways for stable value memory in caudal basal ganglia

Direct and indirect pathways in the basal ganglia work together for controlling behavior. However, it is still a controversial topic whether these pathways are segregated or merged with each other. To address this issue, we studied the connections of these two pathways in the caudal parts of the basal ganglia of rhesus monkeys using anatomical tracers. Our previous studies showed that the caudal basal ganglia control saccades by conveying long-term values (stable values) of many visual objects toward the superior colliculus. In experiment 1, we injected a tracer in the caudate tail (CDt), and found local dense plexuses of axon terminals in the caudal-dorsal-lateral part of substantia nigra pars reticulata (cdlSNr) and the caudal-ventral part of globus pallidus externus (cvGPe). These anterograde projections may correspond to the direct and indirect pathways, respectively. To verify this in experiment 2, we injected different tracers into cdlSNr and cvGPe, and found many retrogradely labeled neurons in CDt and, in addition, the caudal-ventral part of the putamen (cvPut). These cdlSNr-projecting and cvGPe-projecting neurons were found intermingled in both CDt and cvPut (which we call "striatum tail"). A small but significant proportion of neurons (<15%) were double-labeled, indicating that they projected to both cdlSNr and cvGPe. These anatomical results suggest that stable value signals (good vs. bad) are sent from the striatum tail to cdlSNr and cvGPe in a biased (but not exclusive) manner. These connections may play an important role in biasing saccades toward higher valued objects and away from lower valued objects.

Modeling Saccadic Action Selection: Cortical and Basal Ganglia Signals Coalesce in the Superior Colliculus

The distributed nature of information processing in the brain creates a complex variety of decision making behavior. Likewise, computational models of saccadic decision making behavior are numerous and diverse. Here we present a generative model of saccadic action selection in the context of competitive decision making in the superior colliculus (SC) in order to investigate how independent neural signals may converge to interact and guide saccade selection, and to test if systematic variations can better replicate the variability in responses that are part of normal human behavior. The model was tasked with performing pro- and anti-saccades in order to replicate specific attributes of healthy human saccade behavior. Participants (ages 18-39) were instructed to either look toward (pro-saccade, well-practiced automated response) or away from (anti-saccade, combination of inhibitory and voluntary responses) a peripheral visual stimulus. They generated express and regular latency saccades in the pro-saccade task. In the anti-saccade task, correct reaction times were longer and participants occasionally looked at the stimulus (direction error) at either express or regular latencies. To gain a better understanding of the underlying neural processes that lead to saccadic action selection and response inhibition, we implemented 8 inputs inspired by systems neuroscience. These inputs reflected known sensory, automated, voluntary, and inhibitory components of cortical and basal ganglia activity that coalesces in the intermediate layers of the SC (SCi). The model produced bimodal reaction time distributions, where express and regular latency saccades had distinct modes, for both correct pro-saccades and direction errors in the anti-saccade task. Importantly, express and regular latency direction errors resulted from interactions of different inputs in the model. Express latency direction errors were due to a lack of pre-emptive fixation and inhibitory activity, which aloud sensory and automated inputs to initiate a stimulus-driven saccade. Regular latency errors occurred when the automated motor signals were stronger than the voluntary motor signals. While previous models have emulated fewer aspects of these behavioral findings, the focus of the simulations here is on the interaction of a wide variety of physiologically-based information integration producing a richer set of natural behavioral variability.

Feature-specific prediction errors and surprise across macaque fronto-striatal circuits

To adjust expectations efficiently, prediction errors need to be associated with the precise features that gave rise to the unexpected outcome, but this credit assignment may be problematic if stimuli differ on multiple dimensions and it is ambiguous which feature dimension caused the outcome. Here, we report a potential solution: neurons in four recorded areas of the anterior fronto-striatal networks encode prediction errors that are specific to feature values of different dimensions of attended multidimensional stimuli. The most ubiquitous prediction error occurred for the reward-relevant dimension. Feature-specific prediction error signals a) emerge on average shortly after non-specific prediction error signals, b) arise earliest in the anterior cingulate cortex and later in dorsolateral prefrontal cortex, caudate and ventral striatum, and c) contribute to feature-based stimulus selection after learning. Thus, a widely-distributed feature-specific eligibility trace may be used to update synaptic weights for improved feature-based attention.

In order to adjust expectations efficiently, prediction errors need to be associated with the features that gave rise to the unexpected outcome. Here, the authors show that neurons in anterior fronto-striatal networks encode prediction errors that are specific to feature values of different stimulus dimensions.

Prefrontal Cortex Represents Long-Term Memory of Object Values for Months

As a central hub for cognitive control, prefrontal cortex (PFC) is thought to utilize memories. However, unlike working or short-term memory, the neuronal representation of long-term memory in PFC has not been systematically investigated. Using single-unit recordings in macaques, we show that PFC neurons rapidly update and maintain responses to objects based on short-term reward history. Interestingly, after repeated object-reward association, PFC neurons continue to show value-biased responses to objects even in the absence of reward. This value-biased response is retained for several months after training and is resistant to extinction and to interference from new object-reward learning for many complex objects (>90). Accordingly, the monkeys remember the values of the learned objects for several months in separate testing. These findings reveal that in addition to flexible short-term and low-capacity memories, primate PFC represents stable long-term and high-capacity memories, which could prioritize valuable objects far into the future.

Direct and indirect pathways for choosing objects and actions

A prominent target of the basal ganglia is the superior colliculus (SC) which controls gaze orientation (saccadic eye movement in primates) to an important object. This 'object choice' is crucial for choosing an action on the object. SC is innervated by the substantia nigra pars reticulata (SNr) which is controlled mainly by the caudate nucleus (CD). This CD-SNr-SC circuit is sensitive to the values of individual objects and facilitates saccades to good objects. The object values are processed differently in two parallel circuits: flexibly by the caudate head (CDh) and stably by the caudate tail (CDt). To choose good objects, we need to reject bad objects. In fact, these contrasting functions are accomplished by the circuit originating from CDt: The direct pathway focuses on good objects and facilitates saccades to them; the indirect pathway focuses on bad objects and suppresses saccades to them. Inactivation of CDt deteriorated the object choice, because saccades to bad objects were no longer suppressed. This suggests that the indirect pathway is important for object choice. However, the direct and indirect pathways for 'object choice', which aim at the same action (i.e., saccade), may not work for 'action choice'. One possibility is that circuits controlling different actions are connected through the indirect pathway. Additional connections of the indirect pathway with brain areas outside the basal ganglia may also provide a wider range of behavioral choice. In conclusion, basal ganglia circuits are composed of the basic direct/indirect pathways and additional connections and thus have acquired multiple functions.

Temporal-prefrontal cortical network for discrimination of valuable objects in long-term memory

Remembering and discriminating objects based on their previously learned values are essential for goal-directed behaviors. While the cerebral cortex is known to contribute to object recognition, surprisingly little is known about its role in retaining long-term object-value associations. To address this question, we trained macaques to arbitrarily associate small or large rewards with many random fractal objects (>100) and then used fMRI to study the long-term retention of value-based response selectivity across the brain. We found a pronounced long-term value memory in core subregions of temporal and prefrontal cortex where, several months after training, fractals previously associated with high reward ("good" stimuli) elicited elevated fMRI responses compared with those associated with low reward ("bad" stimuli). Similar long-term value-based modulation was also observed in subregions of the striatum, amygdala, and claustrum, but not in the hippocampus. The value-modulated temporal-prefrontal subregions showed strong resting-state functional connectivity to each other. Moreover, for areas outside this core, the magnitude of long-term value responses was predicted by the strength of resting-state functional connectivity to the core subregions. In separate testing, free-viewing gaze behavior indicated that the monkeys retained stable long-term memory of object value. These results suggest an implicit and high-capacity memory mechanism in the temporal-prefrontal circuitry and its associated subcortical regions for long-term retention of object-value memories that can guide value-oriented behavior.

Flexible and Stable Value Coding Areas in Caudate Head and Tail Receive Anatomically Distinct Cortical and Subcortical Inputs

Anatomically distinct areas within the basal ganglia encode flexible- and stable-value memories for visual objects (Hikosaka et al., 2014), but an important question remains: do they receive inputs from the same or different brain areas or neurons? To answer this question, we first located flexible and stable value-coding areas in the caudate head (CDh) and caudate tail (CDt) of two rhesus macaque monkeys, and then injected different retrograde tracers into these areas of each monkey. We found that CDh and CDt received different inputs from several cortical and subcortical areas including temporal cortex, prefrontal cortex, cingulate cortex, amygdala, claustrum and thalamus. Superior temporal cortex and inferior temporal cortex projected to both CDh and CDt, with more CDt-projecting than CDh-projecting neurons. In superior temporal cortex and dorsal inferior temporal cortex, layers 3 and 5 projected to CDh while layers 3 and 6 projected to CDt. Prefrontal and cingulate cortex projected mostly to CDh bilaterally, less to CDt unilaterally. A cluster of neurons in the basolateral amygdala projected to CDt. Rostral-dorsal claustrum projected to CDh while caudal-ventral claustrum projected to CDt. Within the thalamus, different nuclei projected to either CDh or CDt. The medial centromedian nucleus and lateral parafascicular nucleus projected to CDt while the medial parafascicular nucleus projected to CDh. The inferior pulvinar and lateral dorsal nuclei projected to CDt. The ventral anterior and medial dorsal nuclei projected to CDh. We found little evidence of neurons projecting to both CDh and CDt across the brain. These data suggest that CDh and CDt can control separate functions using anatomically separate circuits. Understanding the roles of these striatal projections will be important for understanding how value memories are created and stored.

Overt and covert attention to location-based reward

Recent research on the impact of location-based reward on attentional orienting has indicated that reward factors play an influential role in spatial priority maps. The current study investigated whether and how reward associations based on spatial location translate from overt eye movements to covert attention. If reward associations can be tied to locations in space, and if overt and covert attention rely on similar overlapping neuronal populations, then both overt and covert attentional measures should display similar spatial-based reward learning. Our results suggest that location- and reward-based changes in one attentional domain do not lead to similar changes in the other. Specifically, although we found similar improvements at differentially rewarded locations during overt attentional learning, this translated to the least improvement at a highly rewarded location during covert attention. We interpret this as the result of an increased motivational link between the high reward location and the trained eye movement response acquired during learning, leading to a relative slowing during covert attention when the eyes remained fixated and the saccade response was suppressed. In a second experiment participants were not required to keep fixated during the covert attention task and we no longer observed relative slowing at the high reward location. Furthermore, the second experiment revealed no covert spatial priority of rewarded locations. We conclude that the transfer of location-based reward associations is intimately linked with the reward-modulated motor response employed during learning, and alternative attentional and task contexts may interfere with learned spatial priorities.