The organization of the basal ganglia-thalamocortical circuits: open interconnected rather than closed segregated

Neural systems analysis of decision making during goal-directed navigation

The ability to make adaptive decisions during goal-directed navigation is a fundamental and highly evolved behavior that requires continual coordination of perceptions, learning and memory processes, and the planning of behaviors. Here, a neurobiological account for such coordination is provided by integrating current literatures on spatial context analysis and decision-making. This integration includes discussions of our current understanding of the role of the hippocampal system in experience-dependent navigation, how hippocampal information comes to impact midbrain and striatal decision making systems, and finally the role of the striatum in the implementation of behaviors based on recent decisions. These discussions extend across cellular to neural systems levels of analysis. Not only are key findings described, but also fundamental organizing principles within and across neural systems, as well as between neural systems functions and behavior, are emphasized. It is suggested that studying decision making during goal-directed navigation is a powerful model for studying interactive brain systems and their mediation of complex behaviors.

Molecular substrates of action control in cortico-striatal circuits

The purpose of this review is to describe the molecular mechanisms in the striatum that mediate reward-based learning and action control during instrumental conditioning. Experiments assessing the neural bases of instrumental conditioning have uncovered functional circuits in the striatum, including dorsal and ventral striatal sub-regions, involved in action-outcome learning, stimulus-response learning, and the motivational control of action by reward-associated cues. Integration of dopamine (DA) and glutamate neurotransmission within these striatal sub-regions is hypothesized to enable learning and action control through its role in shaping synaptic plasticity and cellular excitability. The extracellular signal regulated kinase (ERK) appears to be particularly important for reward-based learning and action control due to its sensitivity to combined DA and glutamate receptor activation and its involvement in a range of cellular functions. ERK activation in striatal neurons is proposed to have a dual role in both the learning and performance factors that contribute to instrumental conditioning through its regulation of plasticity-related transcription factors and its modulation of intrinsic cellular excitability. Furthermore, perturbation of ERK activation by drugs of abuse may give rise to behavioral disorders such as addiction.

Striatal dopamine D1 and D2 receptors: widespread influences on methamphetamine-induced dopamine and serotonin neurotoxicity

Methamphetamine (mAMPH) is an addictive psychostimulant drug that releases monoamines through nonexocytotic mechanisms. In animals, binge mAMPH dosing regimens deplete markers for monoamine nerve terminals, for example, dopamine and serotonin transporters (DAT and SERT), in striatum and cerebral cortex. Although the precise mechanism of mAMPH-induced damage to monoaminergic nerve terminals is uncertain, both dopamine D1 and D2 receptors are known to be important. Systemic administration of dopamine D1 or D2 receptor antagonists to rodents prevents mAMPH-induced damage to striatal dopamine nerve terminals. Because these studies employed systemic antagonist administration, the specific brain regions involved remain to be elucidated. The present study examined the contribution of dopamine D1 and D2 receptors in striatum to mAMPH-induced DAT and SERT neurotoxicities. In this experiment, either the dopamine D1 antagonist, SCH23390, or the dopamine D2 receptor antagonist, sulpiride, was intrastriatally infused during a binge mAMPH regimen. Striatal DAT and cortical, hippocampal, and amygdalar SERT were assessed as markers of mAMPH-induced neurotoxicity 1 week following binge mAMPH administration. Blockade of striatal dopamine D1 or D2 receptors during an otherwise neurotoxic binge mAMPH regimen produced widespread protection against mAMPH-induced striatal DAT loss and cortical, hippocampal, and amygdalar SERT loss. This study demonstrates that (1) dopamine D1 and D2 receptors in striatum, like nigral D1 receptors, are needed for mAMPH-induced striatal DAT reductions, (2) these same receptors are needed for mAMPH-induced SERT loss, and (3) these widespread influences of striatal dopamine receptor antagonists are likely attributable to circuits connecting basal ganglia to thalamus and cortex.

Functional magnetic resonance imaging exploration of combined hand and speech movements in Parkinson's disease

Among the repertoire of motor functions, although hand movement and speech production tasks have been investigated widely by functional neuroimaging, paradigms combining both movements have been studied less so. Such paradigms are of particular interest in Parkinson's disease, in which patients have specific difficulties performing two movements simultaneously. In 9 unmedicated patients with Parkinson's disease and 15 healthy control subjects, externally cued tasks (i.e., hand movement, speech production, and combined hand movement and speech production) were performed twice in a random order and functional magnetic resonance imaging detected cerebral activations, compared to the rest. F-statistics tested within-group (significant activations at P values < 0.05, familywise error corrected), between-group, and between-task comparisons (regional activations significant at P values < 0.001, uncorrected, with cluster size > 10 voxels). For control subjects, the combined task activations comprised the sum of those obtained during hand movement and speech production performed separately, reflecting the neural correlates of performing movements sharing similar programming modalities. In patients with Parkinson's disease, only activations underlying hand movement were observed during the combined task. We interpreted this phenomenon as patients' potential inability to recruit facilitatory activations while performing two movements simultaneously. This lost capacity could be related to a functional prioritization of one movement (i.e., hand movement), in comparison with the other (i.e., speech production). Our observation could also reflect the inability of patients with Parkinson's disease to intrinsically engage the motor coordination necessary to perform a combined task.

Parallel associative processing in the dorsal striatum: segregation of stimulus-response and cognitive control subregions

Although evidence suggests that the dorsal striatum contributes to multiple learning and memory functions, there nevertheless remains considerable disagreement on the specific associative roles of different neuroanatomical subregions. We review evidence indicating that the dorsolateral striatum (DLS) is a substrate for stimulus-response habit formation - incremental strengthening of simple S-R bonds - via input from sensorimotor neocortex while the dorsomedial striatum (DMS) contributes to behavioral flexibility - the cognitive control of behavior - via prefrontal and limbic circuits engaged in relational and spatial information processing. The parallel circuits through dorsal striatum interact with incentive/affective motivational processing in the ventral striatum and portions of the prefrontal cortex leading to overt responding under specific testing conditions. Converging evidence obtained through a detailed task analysis and neurobehavioral assessment is beginning to illuminate striatal subregional interactions and relations to the rest of the mammalian brain.

Loss of specificity in Basal Ganglia related movement disorders

The basal ganglia (BG) are a group of interconnected nuclei which play a pivotal part in limbic, associative, and motor functions. This role is mirrored by the wide range of motor and behavioral abnormalities directly resulting from dysfunction of the BG. Studies of normal behavior have found that BG neurons tend to phasically modulate their activity in relation to different behavioral events. In the normal BG, this modulation is highly specific, with each neuron related only to a small subset of behavioral events depending on specific combinations of movement parameters and context. In many pathological conditions involving BG dysfunction and motor abnormalities, this neuronal specificity is lost. Loss of specificity (LOS) manifests in neuronal activity related to a larger spectrum of events and consequently a large overlap of movement-related activation patterns between different neurons. We review the existing evidence for LOS in BG-related movement disorders, the possible neural mechanisms underlying LOS, its effects on frequently used measures of neuronal activity and its relation to theoretical models of the BG. The prevalence of LOS in a many BG-related disorders suggests that neuronal specificity may represent a key feature of normal information processing in the BG system. Thus, the concept of neuronal specificity may underlie a unifying conceptual framework for the BG role in normal and abnormal motor control.

Putative cholinergic interneurons in the ventral and dorsal regions of the striatum have distinct roles in a two choice alternative association task

The striatum consists of GABAergic projection neurons and various types of interneurons. Despite their relative scarcity, these interneurons play a key role in information processing in the striatum. One such class of interneurons is the cholinergic tonically active neurons (TANs). In the dorsal striatum, TANs are traditionally considered to be responsive to events of motivational significance. However, in recent years, studies have suggested that TANs are not exclusively related to reward and reward-predicting stimuli, but may contribute to other processes, including responses to aversive stimuli, detecting the spatial location of stimuli and generating movement. Currently there is little data concerning TAN activity in the ventral striatum (VS) of behaving animals. Here, we simultaneously recorded neurons in the ventral and the dorsolateral (DLS) regions of the striatum while animals performed a two choice alternative association task. Our data show that a large percentage of the putative TANs in both regions responded around movement initiation and execution. The majority of these neurons exhibited directional selectivity which was stronger in DLS relative to VS. In addition, the preferred directions in VS were mostly contralateral to the recording site whereas the observed preferred directions in DLS were equally distributed contralaterally and ipsilaterally to the recording site. The most interesting difference between DLS and VS was that DLS TANs maintained activity alterations throughout the movement whereas TANs in VS exhibited short-lasting phasic activity alterations that were maintained throughout the movement by different neurons. Our findings suggest that coding of movement by TANs in both regions overlaps to some degree, yet the differences in response patterns support the notion that the TANs in DLS participate in the motor loop whereas TANs in VS convey event-related information such as movement initiation, movement direction, and end of movement.

The contribution of the putamen to sensory aspects of pain: insights from structural connectivity and brain lesions

Cerebral cortical activity is heavily influenced by interactions with the basal ganglia. These interactions occur via cortico-basal ganglia-thalamo-cortical loops. The putamen is one of the major sites of cortical input into basal ganglia loops and is frequently activated during pain. This activity has been typically associated with the processing of pain-related motor responses. However, the potential contribution of putamen to the processing of sensory aspects of pain remains poorly characterized. In order to more directly determine if the putamen can contribute to sensory aspects of pain, nine individuals with lesions involving the putamen underwent both psychophysical and functional imaging assessment of perceived pain and pain-related brain activation. These individuals exhibited intact tactile thresholds, but reduced heat pain sensitivity and widespread reductions in pain-related cortical activity in comparison with 14 age-matched healthy subjects. Using magnetic resonance imaging to assess structural connectivity in healthy subjects, we show that portions of the putamen activated during pain are connected not only with cortical regions involved in sensory-motor processing, but also regions involved in attention, memory and affect. Such a framework may allow cognitive information to flow from these brain areas to the putamen where it may be used to influence how nociceptive information is processed. Taken together, these findings indicate that the putamen and the basal ganglia may contribute importantly to the shaping of an individual subjective sensory experience by utilizing internal cognitive information to influence activity of large areas of the cerebral cortex.

Dorsolateral prefrontal cortex modulates striatal reward encoding during reappraisal of reward anticipation

Recent research showed that cognitive emotion regulation (ER) both increases activity in the dorsolateral prefrontal cortex (DLPFC) and decreases striatal responsivity to monetary rewards. Using a mixed monetary incentive delay/memory task as well as functional magnetic resonance imaging, we tested in healthy subjects whether ER effectively attenuates striatal reward encoding during the anticipation of reward (€1.00 vs. €0.05 reward cues) as well as subsequent target reaction times (RTs), which are an indicator of motivation to obtain reward. ER significantly diminished feelings of pleasant anticipation and slowed down €1.00 target RT. At the neural level, ER increased activity in the DLPFC and attenuated reward encoding in the left putamen. Analyses of psychophysiological interaction revealed that DLPFC activity correlated more positively with putamen activity during €0.05 than during €1.00 reward trials. Furthermore, parametric modulations showed that anticipatory left putamen activity correlated with target RT during nonregulation. No such correlation could be observed during ER, suggesting that ER had abolished preparatory target RT encoding. Our results provide evidence that ER can attenuate behavioral and striatal measures of reward-related motivation and motor preparation. Furthermore, the present findings suggest that the DLPFC might contribute to successful regulation of reward via increased promotion of low-reward responses.

Interactions within and between corticostriatal loops during component processes of category learning

We examined dynamic interactions between cortex and BG during stimulus-response and feedback processing phases of categorization. First, we dissociated stimulus-response processing from feedback processing using "jittered" intervals of time between response and feedback to examine how each recruits the four primary corticostriatal loops (motor, executive, visual, and motivational). Second, we examined dynamic interactions within and between corticostriatal loops using Granger causality mapping. On each trial, subjects viewed one of six abstract visual stimuli, pressed a button indicating category membership, and then received feedback as to whether the decision was right or wrong. Stimulus-response processing was associated with greater activity in the visual loop, whereas feedback processing resulted in activity in the executive loop that was sensitive to feedback valence. Granger causality mapping showed patterns of directed influence within corticostriatal loops and between loops from the motor to the executive, to the visual, and finally to the motivational loop. These patterns of interaction are consistent with functional integration of motor processing in the motor loop with feedback processing in the executive loop and maintenance of stimulus-response history for future responses in the motivational loop.

Interactions between the Midbrain Superior Colliculus and the Basal Ganglia

An important component of the architecture of cortico-basal ganglia connections is the parallel, re-entrant looped projections that originate and return to specific regions of the cerebral cortex. However, such loops are unlikely to have been the first evolutionary example of a closed-loop architecture involving the basal ganglia. A phylogenetically older, series of subcortical loops can be shown to link the basal ganglia with many brainstem sensorimotor structures. While the characteristics of individual components of potential subcortical re-entrant loops have been documented, the full extent to which they represent functionally segregated parallel projecting channels remains to be determined. However, for one midbrain structure, the superior colliculus (SC), anatomical evidence for closed-loop connectivity with the basal ganglia is robust, and can serve as an example against which the loop hypothesis can be evaluated for other subcortical structures. Examination of ascending projections from the SC to the thalamus suggests there may be multiple functionally segregated systems. The SC also provides afferent signals to the other principal input nuclei of the basal ganglia, the dopaminergic neurones in substantia nigra and to the subthalamic nucleus. Recent electrophysiological investigations show that the afferent signals originating in the SC carry important information concerning the onset of biologically significant events to each of the basal ganglia input nuclei. Such signals are widely regarded as crucial for the proposed functions of selection and reinforcement learning with which the basal ganglia have so often been associated.

Neural correlates of stimulus-response and response-outcome associations in dorsolateral versus dorsomedial striatum

Considerable evidence suggests that there is functional heterogeneity in the control of behavior by the dorsal striatum. Dorsomedial striatum may support goal-directed behavior by representing associations between responses and outcomes (R-O associations). The dorsolateral striatum, in contrast, may support motor habits by encoding associations between stimuli and responses (S-R associations). To test whether neural correlates in striatum in fact conform to this pattern, we recorded single-units in dorsomedial and dorsolateral striatum of rats performing a task in which R-O contingencies were manipulated independently of S-R contingencies. Among response-selective neurons in both regions, activity was significantly modulated by the initial stimulus, providing evidence of S-R encoding. Similarly, response selectivity was significantly modulated by the associated outcome in both regions, providing evidence of R-O encoding. In both regions, this outcome-modulation did not seem to reflect the relative value of the expected outcome, but rather its specific identity. Finally, in both regions we found correlates of the available action-outcome contingencies reflected in the baseline activity of many neurons. These results suggest that differences in information content in these two regions may not determine the differential roles they play in controlling behavior, demonstrated in previous studies.

Internalizing versus externalizing comorbidity: neural circuit hypothesis

The aim of the present study was to review and update historical controversies in relation to the limbic system in light of advances in the neuroanatmy and neurobiology of cortico-striatal-thalamic-cortical (CSTC) neural circuits. It is hypothesized that observed comorbidities between internalizing and externalizing childhood syndromes may be better understood in terms of excess communication between subcortical brain circuits. A neuroanatomical understanding of reciprocal and non-reciprocal connections between modular circuits provides a basis for understanding previously puzzling aspects of internalizing, externalizing comorbidity. Function depends on the degree of cooperative integration of goal orientation, Pavlovian stimulus response, and operant processing in cortical-subcortical circuits, and interventions may be targeted at any of these functions.

Conditional routing of information to the cortex: a model of the basal ganglia's role in cognitive coordination

The basal ganglia play a central role in cognition and are involved in such general functions as action selection and reinforcement learning. Here, we present a model exploring the hypothesis that the basal ganglia implement a conditional information-routing system. The system directs the transmission of cortical signals between pairs of regions by manipulating separately the selection of sources and destinations of information transfers. We suggest that such a mechanism provides an account for several cognitive functions of the basal ganglia. The model also incorporates a possible mechanism by which subsequent transfers of information control the release of dopamine. This signal is used to produce novel stimulus-response associations by internalizing transferred cortical representations in the striatum. We discuss how the model is related to production systems and cognitive architectures. A series of simulations is presented to illustrate how the model can perform simple stimulus-response tasks, develop automatic behaviors, and provide an account of impairments in Parkinson's and Huntington's diseases.

Changing views of basal ganglia circuits and circuit disorders

The basal ganglia (BG) have long been considered to play an important role in the control of movement and the pathophysiology of movement disorders, such as Parkinson's disease (PD). Studies over the past decades have considerably broadened this view, indicating that the BG participate in multiple, parallel, largely segregated, cortico-subcortical reentrant pathways involving motor, associative and limbic functions. Research has shown that dysfunction within individual circuits is associated not only with movement disorders, but also with neuropsychiatric disorders. Accordingly, a number of movement disorders and neuropsychiatric disorders such as obsessive compulsive disorder and Tourette's syndrome are viewed as "circuit disorders." We here discuss the changes in our current understanding of the anatomic and functional organization of BG circuits and related circuit disorders.

Update on models of basal ganglia function and dysfunction

Circuit models of basal ganglia function and dysfunction have undergone significant changes over time. The previous view that the basal ganglia are centers in which massive convergence of cortical information occurred has now been replaced by a view in which these structures process information in a highly specific manner, participating in anatomical and functional modules that also involve cortex and thalamus. In addition, much has been learned about the intrinsic connections of the basal ganglia. While the basal ganglia-thalamocortical circuitry was originally seen almost exclusively in its relationship to the control of movement, these structures are now viewed as essential for higher level behavioral control, for instance in the regulation of habit learning or action selection. Probably the greatest benefit of these models has been that they have motivated a wealth of studies of the pathophysiology of movement disorders of basal ganglia origin, such as Parkinson's disease. Such studies, in turn, have helped to reshape the existing circuit models. In this paper we review these fascinating changes of our appreciation of the basal ganglia circuitry, and comment on the current state of our knowledge in this field.

The neurobiology of repetitive behavior: of mice…

Repetitive and stereotyped behavior is a prominent element of both animal and human behavior. Similar behavior is seen across species, in diverse neuropsychiatric disorders and in key phases of typical development. This raises the question whether these similar classes of behavior are caused by similar neurobiological mechanisms or whether they are neurobiologically unique? In this paper we discuss fundamental animal research and translational models. Imbalances in corticostriatal function often result in repetitive behavior, where different classes of behavior appear to be supported by similar neural mechanisms. Although the exact nature of these imbalances are not yet fully understood, synthesizing the literature in this area provides a framework for studying the neurobiological systems involved in repetitive behavior.

Basal ganglia control of sleep-wake behavior and cortical activation

The basal ganglia (BG) are involved in numerous neurobiological processes that operate on the basis of wakefulness, including motor function, learning, emotion and addictive behaviors. We hypothesized that the BG might play an important role in the regulation of wakefulness. To test this prediction, we made cell body-specific lesions in the striatum and globus pallidus (GP) using ibotenic acid. We found that rats with striatal (caudoputamen) lesions exhibited a 14.95% reduction in wakefulness and robust fragmentation of sleep-wake behavior, i.e. an increased number of state transitions and loss of ultra-long wake bouts (> 120 min). These lesions also resulted in a reduction in the diurnal variation of sleep-wakefulness. On the other hand, lesions of the accumbens core resulted in a 26.72% increase in wakefulness and a reduction in non-rapid eye movement (NREM) sleep bout duration. In addition, rats with accumbens core lesions exhibited excessive digging and scratching. GP lesions also produced a robust increase in wakefulness (45.52%), and frequent sleep-wake transitions and a concomitant decrease in NREM sleep bout duration. Lesions of the subthalamic nucleus or the substantia nigra reticular nucleus produced only minor changes in the amount of sleep-wakefulness and did not alter sleep architecture. Finally, power spectral analysis revealed that lesions of the striatum, accumbens and GP slowed down the cortical electroencephalogram. Collectively, our results suggest that the BG, via a cortico-striato-pallidal loop, are important neural circuitry regulating sleep-wake behaviors and cortical activation.

The reward circuit: linking primate anatomy and human imaging

Although cells in many brain regions respond to reward, the cortical-basal ganglia circuit is at the heart of the reward system. The key structures in this network are the anterior cingulate cortex, the orbital prefrontal cortex, the ventral striatum, the ventral pallidum, and the midbrain dopamine neurons. In addition, other structures, including the dorsal prefrontal cortex, amygdala, hippocampus, thalamus, and lateral habenular nucleus, and specific brainstem structures such as the pedunculopontine nucleus, and the raphe nucleus, are key components in regulating the reward circuit. Connectivity between these areas forms a complex neural network that mediates different aspects of reward processing. Advances in neuroimaging techniques allow better spatial and temporal resolution. These studies now demonstrate that human functional and structural imaging results map increasingly close to primate anatomy.

Dissociating the contributions of independent corticostriatal systems to visual categorization learning through the use of reinforcement learning modeling and Granger causality modeling

We dissociated the contributions to learning of four corticostriatal "loops" (interacting striatal and cortical regions): motor (putamen and motor cortex), visual (posterior caudate and visual cortex), executive (anterior caudate and prefrontal cortex), and motivational (ventral striatum and ventromedial frontal cortex). Subjects learned to categorize individual repeated images into one of two arbitrary categories via trial and error. We identified (1) regions sensitive to correct categorization, categorization learning, and feedback valence; (2) regions sensitive to prediction error (violation of feedback expectancy) and reward prediction (expected feedback associated with category response) using reinforcement learning modeling; and (3) directed influences between regions using Granger causality modeling. Each loop showed a unique pattern of sensitivity to each of these factors. Both the motor and visual loops were involved in acquisition of categorization ability: activity during correct categorization increased across learning and was sensitive to reward prediction. However, the posterior caudate received directed influence from visual cortex, whereas the putamen exerted directed influence on motor cortex. The motivational and executive loops were involved in feedback processing: both regions were sensitive to feedback valence, which interacted with learning across scans. However, the motivational loop activity reflected prediction error, whereas executive loop activity reflected reward prediction, consistent with the executive loop role in integrating reward and action. Granger causality modeling found directed influences between striatal and cortical regions within each loop. Across loops, the motor loop exerted directed influence on the executive loop which is consistent with the role of the executive loop in integrating feedback with stimulus-response history.

Frontal-striatal abnormalities underlying behaviours in the compulsive-impulsive spectrum

In this paper, we tentatively bring together the psychiatric, neurological and addiction perspectives on the impulsive-compulsive spectrum of neuropsychiatric disorders, in order to understand the pathophysiology of impulse control disorders (ICDs) in Parkinson's disease. In an attempt to try to pool the various levels of information we will therefore focus on three disorders within the impulse-compulsive spectrum, i.e., obsessive-compulsive disorder (OCD), ICDs in Parkinson's disease, and cocaine seeking behaviour. Whereas there are large differences between these three domains, each with their own nomenclature, hypotheses and study results, they share the focus on an imbalance within and between the frontal-striatal circuits as underlying substrate for the behaviours. For each disorder, we summarize the results from recent studies in order to describe in which way alterations in the frontal-striatal circuits contribute to the phenotype. The phenomenological overlap between ICDs in Parkinson's disease, addiction and OCD needs further investigation, since better understanding of the overlapping and differentiating characteristics will contribute to our understanding of the pathophysiology of the disturbances and treatment alternatives.

Dorsal striatal-midbrain connectivity in humans predicts how reinforcements are used to guide decisions

It has been suggested that the target areas of dopaminergic midbrain neurons, the dorsal (DS) and ventral striatum (VS), are differently involved in reinforcement learning especially as actor and critic. Whereas the critic learns to predict rewards, the actor maintains action values to guide future decisions. The different midbrain connections to the DS and the VS seem to play a critical role in this functional distinction. Here, subjects performed a dynamic, reward-based decision-making task during fMRI acquisition. A computational model of reinforcement learning was used to estimate the different effects of positive and negative reinforcements on future decisions for each subject individually. We found that activity in both the DS and the VS correlated with reward prediction errors. Using functional connectivity, we show that the DS and the VS are differentially connected to different midbrain regions (possibly corresponding to the substantia nigra [SN] and the ventral tegmental area [VTA], respectively). However, only functional connectivity between the DS and the putative SN predicted the impact of different reinforcement types on future behavior. These results suggest that connections between the putative SN and the DS are critical for modulating action values in the DS according to both positive and negative reinforcements to guide future decision making.

Physiology and pharmacology of striatal neurons

The basal ganglia occupy the core of the forebrain and consist of evolutionarily conserved motor nuclei that form recurrent circuits critical for motivation and motor planning. The striatum is the main input nucleus of the basal ganglia and a key neural substrate for procedural learning and memory. The vast majority of striatal neurons are spiny GABAergic projection neurons, which exhibit slow but temporally precise spiking in vivo. Contributing to this precision are several different types of interneurons that constitute only a small fraction of total neuron number but play a critical role in regulating striatal output. This review examines the cellular physiology and modulation of striatal neurons that give rise to their unique properties and function.

Striatal plasticity and basal ganglia circuit function

The dorsal striatum, which consists of the caudate and putamen, is the gateway to the basal ganglia. It receives convergent excitatory afferents from cortex and thalamus and forms the origin of the direct and indirect pathways, which are distinct basal ganglia circuits involved in motor control. It is also a major site of activity-dependent synaptic plasticity. Striatal plasticity alters the transfer of information throughout basal ganglia circuits and may represent a key neural substrate for adaptive motor control and procedural memory. Here, we review current understanding of synaptic plasticity in the striatum and its role in the physiology and pathophysiology of basal ganglia function.

Reward-guided learning beyond dopamine in the nucleus accumbens: the integrative functions of cortico-basal ganglia networks

Here we challenge the view that reward-guided learning is solely controlled by the mesoaccumbens pathway arising from dopaminergic neurons in the ventral tegmental area and projecting to the nucleus accumbens. This widely accepted view assumes that reward is a monolithic concept, but recent work has suggested otherwise. It now appears that, in reward-guided learning, the functions of ventral and dorsal striata, and the cortico-basal ganglia circuitry associated with them, can be dissociated. Whereas the nucleus accumbens is necessary for the acquisition and expression of certain appetitive Pavlovian responses and contributes to the motivational control of instrumental performance, the dorsal striatum is necessary for the acquisition and expression of instrumental actions. Such findings suggest the existence of multiple independent yet interacting functional systems that are implemented in iterating and hierarchically organized cortico-basal ganglia networks engaged in appetitive behaviors ranging from Pavlovian approach responses to goal-directed instrumental actions controlled by action-outcome contingencies.

Silencing the critics: understanding the effects of cocaine sensitization on dorsolateral and ventral striatum in the context of an actor/critic model

A critical problem in daily decision making is how to choose actions now in order to bring about rewards later. Indeed, many of our actions have long-term consequences, and it is important to not be myopic in balancing the pros and cons of different options, but rather to take into account both immediate and delayed consequences of actions. Failures to do so may be manifest as persistent, maladaptive decision-making, one example of which is addiction where behavior seems to be driven by the immediate positive experiences with drugs, despite the delayed adverse consequences. A recent study by Takahashi et al. (2007) investigated the effects of cocaine sensitization on decision making in rats and showed that drug use resulted in altered representations in the ventral striatum and the dorsolateral striatum, areas that have been implicated in the neural instantiation of a computational solution to optimal long-term actions selection called the Actor/Critic framework. In this Focus article we discuss their results and offer a computational interpretation in terms of drug-induced impairments in the Critic. We first survey the different lines of evidence linking the subparts of the striatum to the Actor/Critic framework, and then suggest two possible scenarios of breakdown that are suggested by Takahashi et al.'s (2007) data. As both are compatible with the current data, we discuss their different predictions and how these could be empirically tested in order to further elucidate (and hopefully inch towards curing) the neural basis of drug addiction.

Role of attentional resources on gait performance in Huntington's disease

Patients with Huntington's disease (HD) suffer from cognitive deficits with impaired executive functions, including limited attentional resources. We sought to use a dual-task paradigm to evaluate attentional demands and the ability of patients with HD to concentrate on two tasks simultaneously. We analyzed the interference effects of cognitive and motor tasks on walking in HD and the contribution of clinical symptoms to gait disturbances. Patients and controls were asked to perform either a motor task (carrying a tray with four glasses), a cognitive task (counting backwards), or no task at all while walking at their preferred speed. Kinematic spatial parameters, temporal parameters, and angular parameters related to gait were recorded in 15 patients and 15 controls by means of a videomotion analysis system. Gait instability was assessed using the stride-to-stride variability of the various gait parameters. For patients with HD, performing a concurrent cognitive task resulted in a lower gait speed (compared with free walking), with decreased cadence and stride length. However, this effect was not observed in controls. Performing a motor task did not change any kinematic gait parameters in either HD or control subjects. We found correlations between gait speed in the dual cognitive/walking task on one hand and the motor UHDRS score, cognitive status and executive function on the other. Patients with HD had greater difficulty walking while performing a concurrent cognitive task; the drain on attentional resources deteriorated walking performance.

Set-shifting and behavioral dysfunction in primary focal dystonia

The occurrence of cognitive and behavioral symptoms in patients with primary dystonia remains a matter of debate. We compared 45 patients with primary dystonia with 27 control subjects for performance on neuropsychological tasks with a load on executive-Wisconsin Card Sorting Test (WCST) and Stroop test, and visuospatial-Benton's visual retention test (BVRT) and Block assembly test from Wechsler Adult Intelligence Scale BAT-functions, as well as for intensity of obsessive-compulsive symptoms (Yale Brown Obsessive Compulsive Scale, Y-BOCS). Correlation analysis was performed between neuropsychological performance, dystonia characteristics (duration, age of onset) and severity (Unified Dystonia Rating Scale, UDRS), and Y-BOCS. Patients made more perseverative errors on the WCST (P = 0.042) and had a higher mean Y-BOCS (P = 0.003) score than controls. Timed tests (BVRT, BAT, Stroop test) correlated with UDRS. Y-BOCS, WCST, and UDRS scores were not significantly correlated with one another.These results suggest that patients with primary dystonia may have set-shifting deficits and a higher intensity of obsessive compulsive symptoms when compared to healthy subjects. This may reflect a pattern of complex neurophysiological dysfunction involving dorsolateral, orbitofrontal, and motor frontostriatal circuits.

Low-pass filter properties of basal ganglia cortical muscle loops in the normal and MPTP primate model of parkinsonism

Oscillatory bursting activity is commonly found in the basal ganglia (BG) and the thalamus of the parkinsonian brain. The frequency of these oscillations is often similar to or higher than that of the parkinsonian tremor, but their relationship to the tremor and other parkinsonian symptoms is still under debate. We studied the frequency dependency of information transmission in the cortex-BG and cortex-periphery loops by recording simultaneously from multiple electrodes located in the arm-related primary motor cortex (MI) and in the globus pallidus (GP) of two vervet monkeys before and after 1-methyl-4-phenyl-1,2,3,6-tetrahydropyridine (MPTP) treatment and induction of parkinsonian symptoms. We mimicked the parkinsonian bursting oscillations by stimulating with 35 ms bursts given at different frequencies through microelectrodes located in MI or GP while recording the evoked neuronal and motor responses. In the normal state, microstimulation of MI or GP does not modulate the discharge rate in the other structure. However, the functional-connectivity between MI and GP is greatly enhanced after MPTP treatment. In the frequency domain, GP neurons usually responded equally to 1-15 Hz stimulation bursts in both states. In contrast, MI neurons demonstrated low-pass filter properties, with a cutoff frequency above 5 Hz for the MI stimulations, and below 5 Hz for the GP stimulations. Finally, muscle activation evoked by MI microstimulation was markedly attenuated at frequencies higher than 5 Hz. The low-pass properties of the pathways connecting GP to MI to muscles suggest that parkinsonian tremor is not directly driven by the BG 5-10 Hz burst oscillations despite their similar frequencies.

Multilevel structure in behaviour and in the brain: a model of Fuster's hierarchy

A basic question, intimately tied to the problem of action selection, is that of how actions are assembled into organized sequences. Theories of routine sequential behaviour have long acknowledged that it must rely not only on environmental cues but also on some internal representation of temporal or task context. It is assumed, in most theories, that such internal representations must be organized into a strict hierarchy, mirroring the hierarchical structure of naturalistic sequential behaviour. This article reviews an alternative computational account, which asserts that the representations underlying naturalistic sequential behaviour need not, and arguably cannot, assume a strictly hierarchical form. One apparent liability of this theory is that it seems to contradict neuroscientific evidence indicating that different levels of sequential structure in behaviour are represented at different levels in a hierarchy of cortical areas. New simulations, reported here, show not only that the original computational account can be reconciled with this alignment between behavioural and neural organization, but also that it gives rise to a novel explanation for how this alignment might develop through learning.

Dopamine reward circuitry: two projection systems from the ventral midbrain to the nucleus accumbens-olfactory tubercle complex

Anatomical and functional refinements of the meso-limbic dopamine system of the rat are discussed. Present experiments suggest that dopaminergic neurons localized in the posteromedial ventral tegmental area (VTA) and central linear nucleus raphe selectively project to the ventromedial striatum (medial olfactory tubercle and medial nucleus accumbens shell), whereas the anteromedial VTA has few if any projections to the ventral striatum, and the lateral VTA largely projects to the ventrolateral striatum (accumbens core, lateral shell and lateral tubercle). These findings complement the recent behavioral findings that cocaine and amphetamine are more rewarding when administered into the ventromedial striatum than into the ventrolateral striatum. Drugs such as nicotine and opiates are more rewarding when administered into the posterior VTA or the central linear nucleus than into the anterior VTA. A review of the literature suggests that (1) the midbrain has corresponding zones for the accumbens core and medial shell; (2) the striatal portion of the olfactory tubercle is a ventral extension of the nucleus accumbens shell; and (3) a model of two dopamine projection systems from the ventral midbrain to the ventral striatum is useful for understanding reward function. The medial projection system is important in the regulation of arousal characterized by affect and drive and plays a different role in goal-directed learning than the lateral projection system, as described in the variation-selection hypothesis of striatal functional organization.

How do the basal ganglia contribute to categorization? Their roles in generalization, response selection, and learning via feedback

This article examines how independent corticostriatal loops linking basal ganglia with cerebral cortex contribute to visual categorization. The first aspect of categorization discussed is the role of the visual corticostriatal loop, which connects the visual cortex and the body/tail of the caudate, in mapping visual stimuli to categories, including evaluating the degree to which this loop may generalize across individual category members. The second aspect of categorization discussed is the selection of appropriate actions or behaviors on the basis of category membership, and the role of the visual corticostriatal loop output and the motor corticostriatal loop, which connects motor planning areas with the putamen, in action selection. The third aspect of categorization discussed is how categories are learned with the aid of feedback linked dopaminergic projections to the basal ganglia. These projections underlie corticostriatal synaptic plasticity across the basal ganglia, and also serve as input to the executive and motivational corticostriatal loops that play a role in strategic use of feedback.

The nucleus accumbens as part of a basal ganglia action selection circuit

BACKGROUND

The nucleus accumbens is the ventral extent of the striatum, the main input nucleus of the basal ganglia. Recent hypotheses propose that the accumbens and its dopamine projection from the midbrain contribute to appetitive behaviors required to obtain reward. However, the specific nature of this contribution is unclear. In contrast, significant advances have been made in understanding the role of the dorsal striatum in action selection and decision making.

OBJECTIVE

In order to develop a hypothesis of the role of nucleus accumbens dopamine in action selection, the physiology and behavioral pharmacology of the nucleus accumbens are compared to those of the dorsal striatum.

HYPOTHESES

Three hypotheses concerning the role of dopamine in these structures are proposed: (1) that dopamine release in the dorsal striatum serves to facilitate the ability to respond appropriately to temporally predictable stimuli (that is, stimuli that are so predictable that animals engage in anticipatory behavior just prior to the stimulus); (2) that dopamine in the nucleus accumbens facilitates the ability to respond to temporally unpredictable stimuli (which require interruption of ongoing behavior); and (3) that accumbens neurons participate in action selection in response to such stimuli by virtue of their direct (monosynaptic inhibitory) and indirect (polysynaptic excitatory) projections to basal ganglia output nuclei.

Manganese-enhanced MRI in a rat model of Parkinson's disease

PURPOSE

To measure intra- and inter-hemispheric connectivity within the basal ganglia (BG) nuclei in healthy and in unilateral 6-hydroxydopamine (6-OHDA) Parkinson disease rat model in order to test the BG interhemispheric connectivity hypothesis.

MATERIAL AND METHODS

The manganese-enhanced MRI (MEMRI) method with direct injection of manganese chloride into the entopeduncular (EP), substantia nigra (SN), and the Habenula nuclei in unilateral 6-OHDA (N = 22) and sham-operated (N = 16) rat groups was used. MEMRI measurements were applied before, 3, 24, and 48 hours post-manganese injection. Signal enhancements in T1-weighted images were compared between groups.

RESULTS

Manganese injection into the EP nucleus resulted with bihemispheric signal enhancements in the habenular complex (Hab) at both groups with stronger enhancements in the 6-OHDA group. It also exhibited lower sensorimotor cortex signal enhancement in the 6-OHDA rat group. SN manganese injection caused enhanced anteroventral thalamic and habenular nuclei signals in the 6-OHDA rat group. Manganese habenula injection revealed enhanced interpeduncular (IP) and raphe nuclei signals of the 6-OHDA rat group.

CONCLUSION

Modulations in the effective intra- and interhemispheric BG connectivity in unilateral 6-OHDA Parkinson's disease (PD) rat model support the BG interhemispheric connectivity hypothesis and suggest a linkage between the dopaminergic and serotonergic systems in PD, in line with clinical symptoms.

Striatal delta opioid receptor binding in experimental models of Parkinson's disease and dyskinesia

Enhanced delta opioid receptor transmission may represent an endogenous compensatory mechanism in parkinsonism to reduce the activity of the indirect striatopallidal pathway following dopamine depletion. Furthermore, increased delta opioid receptor transmission may be causative in the production of dyskinesia following repeated dopaminergic treatment in Parkinson's disease. The present study employed radioligand receptor autoradiography, using [3H]naltrindole, a ligand selective for the delta opioid receptor, to assess delta opioid receptor binding sites in forebrain regions of reserpine-treated rats, and in parkinsonian nondyskinetic, and dyskinetic MPTP-lesioned macaques. In reserpine-treated animals, specific delta opioid binding was increased in premotor cortex (+30%), sensorimotor striatum (+20%), and associative striatum (+17%) rostrally, but was not changed in caudal forebrain. In contrast, delta opioid receptor binding was not significantly altered at any region analyzed, in either nondyskinetic or dyskinetic, MPTP-lesioned macaques, compared to normal. These results suggest that transient changes in delta opioid receptor binding may occur in motor circuits following acute dopamine depletion. However, in the more chronic MPTP-lesioned macaque model, simple changes in delta opioid receptor number or affinity are unlikely to contribute to mechanisms for abnormal opioid transmission in Parkinson's disease and dyskinesia.

The pars reticulata of the substantia nigra: a window to basal ganglia output

Together with the internal segment of the globus pallidus (GP(i)), the pars reticulata of the substantia nigra (SNr) provides a main output nucleus of the basal ganglia (BG) where the final stage of information processing within this system takes place. In the last decade, progress on the anatomical organization and functional properties of BG output neurons have shed some light on the mechanisms of integration taking place in these nuclei and leading to normal and pathological BG outflow. In this review focused on the SNr, after describing how the anatomical arrangement of nigral cells and their afferents determines specific input-output registers, we examine how the basic electrophysiological properties of the cells and their interaction with synaptic inputs contribute to the spatio-temporal shaping of BG output. The reported data show that the intrinsic membrane properties of the neurons subserves a tonic discharge allowing BG to gate the transmission of information to motor and cognitive systems thereby contributing to appropriate selection of behavior.

Separate neural substrates for skill learning and performance in the ventral and dorsal striatum

It is widely accepted that the striatum of the basal ganglia is a primary substrate for the learning and performance of skills. We provide evidence that two regions of the rat striatum, ventral and dorsal, play distinct roles in instrumental conditioning (skill learning), with the ventral striatum being critical for learning and the dorsal striatum being important for performance but, notably, not for learning. This implies an actor (dorsal) versus director (ventral) division of labor, which is a new variant of the widely discussed actor-critic architecture. Our results also imply that the successful performance of a skill can ultimately result in its establishment as a habit outside the basal ganglia.

Glutamate and GABA receptors and transporters in the basal ganglia: what does their subsynaptic localization reveal about their function?

GABA and glutamate, the main transmitters in the basal ganglia, exert their effects through ionotropic and metabotropic receptors. The dynamic activation of these receptors in response to released neurotransmitter depends, among other factors, on their precise localization in relation to corresponding synapses. The use of high resolution quantitative electron microscope immunocytochemical techniques has provided in-depth description of the subcellular and subsynaptic localization of these receptors in the CNS. In this article, we review recent findings on the ultrastructural localization of GABA and glutamate receptors and transporters in monkey and rat basal ganglia, at synaptic, extrasynaptic and presynaptic sites. The anatomical evidence supports numerous potential locations for receptor-neurotransmitter interactions, and raises important questions regarding mechanisms of activation and function of synaptic versus extrasynaptic receptors in the basal ganglia.

Cognitive deficits and psychosis in Parkinson's disease: a review of pathophysiology and therapeutic options

Parkinson's disease is a neurodegenerative disorder causing not only motor dysfunction but also cognitive, psychiatric, autonomic and sensory disturbances. Symptoms of dementia and psychosis are common: longitudinal studies suggest that up to 75% of patients with Parkinson's disease may eventually develop dementia, and the prevalence of hallucinations ranges from 16-17% in population-based surveys to 30-40% in hospital-based series. These cognitive and behavioural features are important in terms of prognosis, nursing home placement and mortality. The pattern of cognitive deficits in Parkinson's disease is variable, but often includes executive impairment similar to that seen in patients with frontal lesions, as well as episodic memory impairment, visuospatial dysfunction and impaired verbal fluency. The most common manifestation of psychosis in Parkinson's disease is visual hallucinations, but delusions, paranoid beliefs, agitation and florid psychosis can also occur. An understanding of the pathophysiology underlying these symptoms is essential to the development of targeted therapeutic strategies. Post-mortem studies suggest an association between Lewy body deposition and dementia in Parkinson's disease, and indeed Parkinson's disease and dementia with Lewy bodies may form part of the same disease spectrum. Whether Lewy bodies actually play a causative role in cognitive dysfunction, however, is unknown. Deficits in neurotransmitter systems provide more obvious therapeutic targets and dysfunction of dopaminergic, cholinergic, noradrenergic and serotonergic systems have all been implicated; these may each underlie different features of Parkinson's disease dementia, perhaps explaining some of the heterogeneity of the syndrome. Psychosis has traditionally been considered as a dopaminergic drug-induced phenomenon, but factors intrinsic to the disease process itself also cause hallucinations and delusions. These factors may include Lewy body deposition in the limbic system, cholinergic deficits and impairments of primary visual processing. Therapeutic intervention for cognitive and behavioural symptoms in Parkinson's disease currently focuses on two main groups of drugs: cholinesterase inhibitors and atypical antipsychotics. A recent large, randomised, controlled trial suggests that cholinesterase inhibitors can produce a modest improvement in cognitive function, as well as psychotic symptoms, generally without an adverse effect on motor function. Certain atypical antipsychotics allow hallucinations, delusions and behavioural problems to be brought under control with minimal deleterious effects on motor function and cognition, but their safety in elderly patients has recently been called into question. Deep brain stimulation does not appear to be a useful treatment for cognitive and psychiatric dysfunction in patients with Parkinson's disease. Modafinil improves alertness in Parkinson's disease and warrants further investigation to establish its effects on cognitive performance.

Obsessive-compulsive disorder and executive deficits in two patients with primary dystonia

In spite of the high prevalence of behavioral and cognitive disturbances found in most basal ganglia disorders and attributed to fronto-striatal dysfunction, the existence of psychiatric and cognitive symptoms in patients with primary dystonia remains controversial. We present a 42-year-old female with primary writer's cramp and obsessive-compulsive disorder (OCD) and a 59-year-old male with Meigs syndrome, idiopathic torticollis and OCD. Both patients had mild executive dysfunction. The coexistence of psychiatric, cognitive and motor symptoms of different intensity may be explained by variable dysfunction on different frontal-striatal loops, as proposed by the open interconnected model of fronto-striatal circuits.

Interactions among the medial prefrontal cortex, hippocampus and midline thalamus in emotional and cognitive processing in the rat

The medial prefrontal cortex (mPFC) participates in several higher order functions including selective attention, visceromotor control, decision making and goal-directed behaviors. We discuss the role of the infralimbic cortex (IL) in visceromotor control and the prelimbic cortex (PL) in cognition and their interactions in goal-directed behaviors in the rat. The PL strongly interconnects with a relatively small group of structures that, like PL, subserve cognition, and together have been designated the 'PL circuit.' These structures primarily include the hippocampus, insular cortex, nucleus accumbens, basolateral nucleus of the amygdala, the mediodorsal and reuniens nuclei of the thalamus and the ventral tegmental area of the midbrain. Lesions of each of these structures, like those of PL, produce deficits in delayed response tasks and memory. The PL (and ventral anterior cingulate cortex) (AC) of rats is ideally positioned to integrate current and past information, including its affective qualities, and act on it through its projections to the ventral striatum/ventral pallidum. We further discuss the role of nucleus reuniens of thalamus as a major interface between the mPFC and the hippocampus, and as a prominent source of afferent limbic information to the mPFC and hippocampus. We suggest that the IL of rats is functionally homologous to the orbitomedial cortex of primates and the prelimbic (and ventral AC) cortex to the lateral/dorsolateral cortex of primates, and that the IL/PL complex of rats exerts significant control over emotional and cognitive aspects of goal-directed behavior.

The role of the basal ganglia in habit formation

Many organisms, especially humans, are characterized by their capacity for intentional, goal-directed actions. However, similar behaviours often proceed automatically, as habitual responses to antecedent stimuli. How are goal-directed actions transformed into habitual responses? Recent work combining modern behavioural assays and neurobiological analysis of the basal ganglia has begun to yield insights into the neural basis of habit formation.

Psychomotor and executive functioning after unilateral posteroventral pallidotomy in patients with Parkinson's disease

The goal of the study was to explore the immediate effects of unilateral posteroventral stereotactic pallidotomy (PVP) on psychomotor and executive functioning in patients with Parkinson's disease (PD). The original drawing task, conducted on a digitizing tablet, and neuropsychological tests were administered to 25 patients with PD, 2 or 3 days before and after the surgery. To assess executive functions, the following tests were used: Trail Making Test (TMT), Stroop Colour Interference Test and Wisconsin Card Sorting Test (WCST). To evaluate global mental functioning, Mini Mental State Examination (MMSE) was applied. Benton Visual Retention Test (BVRT) was introduced as a control non-executive task. The patients undergoing a surgery were compared with age and education matched healthy and PD controls. PVP resulted in an increased movability of the upper contralateral limbs reflected in larger average pressure put during the drawing task after the surgery. Assessment of the emotional state showed a significant postoperative improvement. An isolated significant decline of WCST performance, not related to the side of the lesion, was observed immediately after the surgery. The performance of the other executive and non-executive tasks remained unchanged. The results showed that unilateral PVP may lead to immediate selective executive impairment and is needed to be explored in further studies.

Negative symptoms: A review of schizophrenia, melancholic depression and Parkinson's disease

Negative symptoms generally refer to a reduction in normal functioning. In schizophrenia they encompass apathy, anhedonia, flat affect, avolition, social withdrawal and, on some accounts, psychomotor retardation. Negative symptoms have been identified in other psychiatric disorders, including melancholic depression, and also in neurological disorders, such Parkinson's disease. Achieving a better understanding of negative symptoms constitutes a priority in mental health. Primarily, negative symptoms represent an unrelenting, intractable and disabling feature for patients, often amounting to a severe burden on families, carers and the patients themselves. Identifying and understanding subgroups within disorders may also contribute to the clinical care and scientific understanding of the pathophysiology of these disorders. The purpose of this paper is to review the current literature on negative symptoms in schizophrenia and explore the idea that negative symptoms may play an important role not only in other psychiatric disorders such as melancholic depression, but also in neurological disorders, such as Parkinson's disease. In each disorder negative symptoms manifest with similar motor and cognitive impairments and are associated with comparable neuropathological and biochemical findings, possibly reflecting analogous impairments in the functioning of frontostriatal-limbic circuits.