Building action repertoires: memory and learning functions of the basal ganglia

Procedural memory and speed of grammatical processing: Comparison between typically developing children and language impaired children

BACKGROUND

Procedural memory has been proposed to underlie the acquisition of a range of skills including grammar, reading, and motor skills. In developmental language disorder (DLD) it has been suggested that procedural memory problems lead to the difficulties with grammar in this group.

AIMS

This study aimed to extend previous research by exploring associations between procedural memory and a range of cognitive skills, in children with and without language impairments.

METHODS AND PROCEDURES

Twenty children with DLD and 20 age-matched non-language impaired children undertook tasks assessing procedural memory, grammatical processing speed, single word and nonword reading, and motor skills (as indexed by a pegboard task).

OUTCOMES AND RESULTS

For the DLD group, no significant correlations between procedural memory and any of the variables were observed. The typically developing group showed a significant correlation (r=.482, p<0.05) between the measure of procedural memory and grammatical processing speed. Correlations between procedural memory and the remaining variables were all non-significant for this group.

CONCLUSIONS AND IMPLICATIONS

This study provides new evidence showing that grammatical processing speed is correlated with procedural memory in typically developing children. Furthermore, results suggest that the relationship with procedural memory does not extend to reading or the types of motor skills used on a pegboard task. For the DLD group the pattern of result indicate grammatical processing, reading, and motor sequencing are not supported by procedural memory or a common memory system.

Subcortical Effects on Voice and Fluency in Dysarthria: Observations from Subthalamic Nucleus Stimulation

OBJECTIVE

Parkinson's disease (PD), caused by basal ganglia dysfunction, is associated with motor disturbances including dysarthria. Stimulation of the subthalamic nucleus, a preferred treatment targeting basal ganglia function, improves features of the motor disorder, but has uncertain effects on speech.We studied speech during contrasting stimulation states to reveal subcortical effects on voice and articulation. Measures were made on selected samples of spontaneous and repeated speech.

METHODS

Persons with Parkinson's disease (PWP) who had undergone bilateral deep brain stimulation of the subthalamic nucleus (DBS-STN) provided spontaneous speech samples and then repeated portions of their monologue both on and off stimulation. Excerpts were presented in a listening protocol probing intelligibility. Also analysed were a continuous phrase repetition task and a second spontaneous speech sample. Fundamental frequency (F0), harmonic-to-noise ratio (HNR), jitter, shimmer and fluency were measured in these three speech samples performed with DBS stimulation on and off.

RESULTS

During subcortical stimulation, spontaneous excerpts were less intelligible than repeated excerpts. F0 and HNR were higher and shimmer was decreased in repetition and stimulation. Articulatory dysfluencies were increased for spontaneous speech and during stimulation in all three speech samples.

CONCLUSION

Deep brain stimulation disrupts fluency and improves voice in spontaneous speech, reflecting an inverse influence of subcortical systems on articulatory posturing and laryngeal mechanisms. Better voice and less dysfluency in repetition may occur because an external model reduces the speech planning burden, as seen for gait and arm reach. These orthogonal results for fluency versus phonatory competence may account for ambivalent reports from dysarthric speakers and reveal the complexity of subcortical control of motor speech.

A systematic linguistic profile of spontaneous narrative speech in pre-symptomatic and early stage Huntington's disease

Cognitive decline accompanying the clinically more salient motor symptoms of Huntington's disease (HD) has been widely noted and can precede motor symptoms onset. Less clear is how such decline bears on language functions in everyday life, though a small number of experimental studies have revealed difficulties with the application of rule-based aspects of language in early stages of the disease. Here we aimed to determine whether there is a systematic linguistic profile that characterizes spontaneous narrative speech in both pre-manifest and/or early manifest HD, and how it is related to striatal degeneration and neuropsychological profiles. Twenty-eight early-stage patients (19 manifest and 9 gene-carriers in the pre-manifest stage), matched with 28 controls, participated in a story-telling task. Speech was blindly scored by independent raters according to fine-grained linguistic variables distributed over 5 domains for which composite scores were computed (Quantitative, Fluency, Reference, Connectivity, and Concordance). Voxel-based morphometry (VBM) was used to link specific brain degeneration patterns to loci of linguistic decline. In all of these domains, significant differences were observed between groups. Deficits in Reference and Connectivity were seen in the pre-manifest stage, where no other neuropsychological impairment was detected. Among HD patients, there was a significant positive correlation only between the values in the Quantitative domain and gray matter volume bilaterally in the putamen and pallidum. These results fill the gap of qualitative data of spontaneous narrative speech in HD and reveal that HD is characterized by systematic linguistic impairments leading to dysfluencies and disorganization in core domains of grammatical organization. This includes the referential use of noun phrases and the embedding of clauses, which mediate crucial dimensions of meaning in language in its normal social use. Moreover, such impairment is seen prior to motor symptoms onset and when standardized neuropsychological test profiles are otherwise normal.

Long-term plasticity of corticostriatal synapses is modulated by pathway-specific co-release of opioids through κ-opioid receptors

KEY POINTS

Both endogenous opioids and opiate drugs of abuse modulate learning of habitual and goal-directed actions, and can also modify long-term plasticity of corticostriatal synapses. Striatal projection neurons of the direct pathway co-release the opioid neuropeptide dynorphin which can inhibit dopamine release via κ-opioid receptors. Theta-burst stimulation of corticostriatal fibres produces long-term potentiation (LTP) in striatal projection neurons when measured using whole-cell patch recording. Optogenetic activation of direct pathway striatal projection neurons inhibits LTP while reducing dopamine release. Because the endogenous release of opioids is activity dependent, this modulation of synaptic plasticity represents a negative feedback mechanism that may limit runaway enhancement of striatal neuron activity in response to drugs of abuse.

ABSTRACT

Synaptic plasticity in the striatum adjusts behaviour adaptively during skill learning, or maladaptively in the case of addiction. Just as dopamine plays a critical role in synaptic plasticity underlying normal skill learning and addiction, endogenous and exogenous opiates also modulate learning and addiction-related striatal plasticity. Though the role of opioid receptors in long-term depression in striatum has been characterized, their effect on long-term potentiation (LTP) remains unknown. In particular, direct pathway (dopamine D1 receptor-containing; D1R-) spiny projection neurons (SPNs) co-release the opioid neuropeptide dynorphin, which acts at presynaptic κ-opioid receptors (KORs) on dopaminergic afferents and can negatively regulate dopamine release. Therefore, we evaluated the interaction of co-released dynorphin and KOR on striatal LTP. We optogenetically facilitate the release of endogenous dynorphin from D1R-SPNs in brain slice while using whole-cell patch recording to measure changes in the synaptic response of SPNs following theta-burst stimulation (TBS) of cortical afferents. Our results demonstrate that TBS evokes corticostriatal LTP, and that optogenetic activation of D1R-SPNs during induction impairs LTP. Additional experiments demonstrate that optogenetic activation of D1R-SPNs reduces stimulation-evoked dopamine release and that bath application of a KOR antagonist provides full rescue of both LTP induction and dopamine release during optogenetic activation of D1R-SPNs. These results suggest that an increase in the opioid neuropeptide dynorphin is responsible for reduced TBS LTP and illustrate a physiological phenomenon whereby heightened D1R-SPN activity can regulate corticostriatal plasticity. Our findings have important implications for learning in addictive states marked by elevated direct pathway activation.

Cognitive and neuroimaging changes in healthy immigrants upon relocation to a high altitude: A panel study

BACKGROUND

Cognitive and neuroimaging changes under chronic high-altitude exposure have never been followed up and dynamically assessed.

OBJECTIVES

To investigate the cognitive and brain structural/functional alterations associated with chronic high-altitude exposure.

METHODS

Sixty-nine college freshmen that were immigrating to Tibet were enrolled and followed up for two years. Neuropsychological tests, including verbal/visual memory and simple/recognition reaction time, were utilized to determine whether the subjects' cognitive function had changed in response to chronic high-altitude exposure. Structural magnetic resonance imaging (MRI) and resting-state functional MRI (rs-fMRI) were used to quantify brain gray matter (GM) volumes, regional homogeneity (ReHo) and functional connectivity (FC) alterations before and after exposure. Areas with changes in both GM and ReHo were used as seeds in the inter-regional FC analysis.

RESULTS

The subjects showed significantly lower accuracy in memory tests and longer reaction times after exposure, and neuroimaging analysis showed markedly decreased GM volumes and ReHo in the left putamen. FC analysis seeding of the left putamen showed significantly weakened FC with the superior temporal gyrus, anterior/middle cingulate gyrus and other brain regions. In addition, decreased ReHo was found in the superior temporal gyrus, superior parietal lobule, anterior cingulate gyrus and medial frontal gyrus, while increased ReHo was found in the hippocampus. Differences in ReHo/FC before and after high-altitude exposure in multiple regions were significantly correlated with the cognitive changes.

CONCLUSION

Cognitive functions such as working memory and psychomotor function are impaired during chronic high-altitude exposure. The putamen may play an important role in chronic hypoxia-induced cognitive impairment. Hum Brain Mapp 38:3865-3877, 2017. © 2017 Wiley Periodicals, Inc.

Habit formation generates secondary modules that emulate the efficiency of evolved behavior

We discuss the evolutionary implications of connections drawn between the authors' learned “secondary modules” and the habit-formation system that appears to be ubiquitous among vertebrates. Prior to any subsequent coevolution with social learning, we suggest that aspects of general intelligence likely arose in tandem with mechanisms of adaptive motor control that rely on basal ganglia circuitry.

Reversal Learning in Humans and Gerbils: Dynamic Control Network Facilitates Learning

Biologically plausible modeling of behavioral reinforcement learning tasks has seen great improvements over the past decades. Less work has been dedicated to tasks involving contingency reversals, i.e., tasks in which the original behavioral goal is reversed one or multiple times. The ability to adjust to such reversals is a key element of behavioral flexibility. Here, we investigate the neural mechanisms underlying contingency-reversal tasks. We first conduct experiments with humans and gerbils to demonstrate memory effects, including multiple reversals in which subjects (humans and animals) show a faster learning rate when a previously learned contingency re-appears. Motivated by recurrent mechanisms of learning and memory for object categories, we propose a network architecture which involves reinforcement learning to steer an orienting system that monitors the success in reward acquisition. We suggest that a model sensory system provides feature representations which are further processed by category-related subnetworks which constitute a neural analog of expert networks. Categories are selected dynamically in a competitive field and predict the expected reward. Learning occurs in sequentialized phases to selectively focus the weight adaptation to synapses in the hierarchical network and modulate their weight changes by a global modulator signal. The orienting subsystem itself learns to bias the competition in the presence of continuous monotonic reward accumulation. In case of sudden changes in the discrepancy of predicted and acquired reward the activated motor category can be switched. We suggest that this subsystem is composed of a hierarchically organized network of dis-inhibitory mechanisms, dubbed a dynamic control network (DCN), which resembles components of the basal ganglia. The DCN selectively activates an expert network, corresponding to the current behavioral strategy. The trace of the accumulated reward is monitored such that large sudden deviations from the monotonicity of its evolution trigger a reset after which another expert subnetwork can be activated-if it has already been established before-or new categories can be recruited and associated with novel behavioral patterns.

Functional Relevance of Different Basal Ganglia Pathways Investigated in a Spiking Model with Reward Dependent Plasticity

The brain enables animals to behaviorally adapt in order to survive in a complex and dynamic environment, but how reward-oriented behaviors are achieved and computed by its underlying neural circuitry is an open question. To address this concern, we have developed a spiking model of the basal ganglia (BG) that learns to dis-inhibit the action leading to a reward despite ongoing changes in the reward schedule. The architecture of the network features the two pathways commonly described in BG, the direct (denoted D1) and the indirect (denoted D2) pathway, as well as a loop involving striatum and the dopaminergic system. The activity of these dopaminergic neurons conveys the reward prediction error (RPE), which determines the magnitude of synaptic plasticity within the different pathways. All plastic connections implement a versatile four-factor learning rule derived from Bayesian inference that depends upon pre- and post-synaptic activity, receptor type, and dopamine level. Synaptic weight updates occur in the D1 or D2 pathways depending on the sign of the RPE, and an efference copy informs upstream nuclei about the action selected. We demonstrate successful performance of the system in a multiple-choice learning task with a transiently changing reward schedule. We simulate lesioning of the various pathways and show that a condition without the D2 pathway fares worse than one without D1. Additionally, we simulate the degeneration observed in Parkinson's disease (PD) by decreasing the number of dopaminergic neurons during learning. The results suggest that the D1 pathway impairment in PD might have been overlooked. Furthermore, an analysis of the alterations in the synaptic weights shows that using the absolute reward value instead of the RPE leads to a larger change in D1.

The functional logic of corticostriatal connections

Unidirectional connections from the cortex to the matrix of the corpus striatum initiate the cortico-basal ganglia (BG)-thalamocortical loop, thought to be important in momentary action selection and in longer-term fine tuning of behavioural repertoire; a discrete set of striatal compartments, striosomes, has the complementary role of registering or anticipating reward that shapes corticostriatal plasticity. Re-entrant signals traversing the cortico-BG loop impact predominantly frontal cortices, conveyed through topographically ordered output channels; by contrast, striatal input signals originate from a far broader span of cortex, and are far more divergent in their termination. The term 'disclosed loop' is introduced to describe this organisation: a closed circuit that is open to outside influence at the initial stage of cortical input. The closed circuit component of corticostriatal afferents is newly dubbed 'operative', as it is proposed to establish the bid for action selection on the part of an incipient cortical action plan; the broader set of converging corticostriatal afferents is described as contextual. A corollary of this proposal is that every unit of the striatal volume, including the long, C-shaped tail of the caudate nucleus, should receive a mandatory component of operative input, and hence include at least one area of BG-recipient cortex amongst the sources of its corticostriatal afferents. Individual operative afferents contact twin classes of GABAergic striatal projection neuron (SPN), distinguished by their neurochemical character, and onward circuitry. This is the basis of the classic direct and indirect pathway model of the cortico-BG loop. Each pathway utilises a serial chain of inhibition, with two such links, or three, providing positive and negative feedback, respectively. Operative co-activation of direct and indirect SPNs is, therefore, pictured to simultaneously promote action, and to restrain it. The balance of this rival activity is determined by the contextual inputs, which summarise the external and internal sensory environment, and the state of ongoing behavioural priorities. Notably, the distributed sources of contextual convergence upon a striatal locus mirror the transcortical network harnessed by the origin of the operative input to that locus, thereby capturing a similar set of contingencies relevant to determining action. The disclosed loop formulation of corticostriatal and subsequent BG loop circuitry, as advanced here, refines the operating rationale of the classic model and allows the integration of more recent anatomical and physiological data, some of which can appear at variance with the classic model. Equally, it provides a lucid functional context for continuing cellular studies of SPN biophysics and mechanisms of synaptic plasticity.

Influence of Aerobic Training and Combinations of Interventions on Cognition and Neuroplasticity after Stroke

Stroke often aggravated age-related cognitive impairments that strongly affect several aspects of quality of life. However, few studies are, to date, focused on rehabilitation strategies that could improve cognition. Among possible interventions, aerobic training is well known to enhance cardiovascular and motor functions but may also induce beneficial effects on cognitive functions. To assess the effectiveness of aerobic training on cognition, it seems necessary to know whether training promotes the neuroplasticity in brain areas involved in cognitive functions. In the present review, we first explore in both human and animal how aerobic training could improve cognition after stroke by highlighting the neuroplasticity mechanisms. Then, we address the potential effect of combinations between aerobic training with other interventions, including resistance exercises and pharmacological treatments. In addition, we postulate that classic recommendations for aerobic training need to be reconsidered to target both cognition and motor recovery because the current guidelines are only focused on cardiovascular and motor recovery. Finally, methodological limitations of training programs and cognitive function assessment are also developed in this review to clarify their effectiveness in stroke patients.

Reappraising striatal D1- and D2-neurons in reward and aversion

The striatum has been involved in complex behaviors such as motor control, learning, decision-making, reward and aversion. The striatum is mainly composed of medium spiny neurons (MSNs), typically divided into those expressing dopamine receptor D1, forming the so-called direct pathway, and those expressing D2 receptor (indirect pathway). For decades it has been proposed that these two populations exhibit opposing control over motor output, and recently, the same dichotomy has been proposed for valenced behaviors. Whereas D1-MSNs mediate reinforcement and reward, D2-MSNs have been associated with punishment and aversion. In this review we will discuss pharmacological, genetic and optogenetic studies that indicate that there is still controversy to what concerns the role of striatal D1- and D2-MSNs in this type of behaviors, highlighting the need to reconsider the early view that they mediate solely opposing aspects of valenced behaviour.

An inhibitory corticostriatal pathway

Anatomical and physiological studies have led to the assumption that the dorsal striatum receives exclusively excitatory afferents from the cortex. Here we test the hypothesis that the dorsal striatum receives also GABAergic projections from the cortex. We addressed this fundamental question by taking advantage of optogenetics and directly examining the functional effects of cortical GABAergic inputs to spiny projection neurons (SPNs) of the mouse auditory and motor cortex. We found that the cortex, via corticostriatal somatostatin neurons (CS-SOM), has a direct inhibitory influence on the output of the striatum SPNs. Our results describe a corticostriatal long-range inhibitory circuit (CS-SOM inhibitory projections → striatal SPNs) underlying the control of spike timing/generation in SPNs and attributes a specific function to a genetically defined type of cortical interneuron in corticostriatal communication.

DOI:http://dx.doi.org/10.7554/eLife.15890.001

The striatum is located beneath the cerebral cortex, where it contributes to processes including learning and movement. The Spanish anatomist Ramon y Cajal, working in the early 20^th century, was the first to observe individual neurons extending from the cortex to the striatum. Cajal published drawings of these neurons in his now celebrated anatomical papers, but knew little about their properties.

In the 1980s, advances in techniques for labeling individual cells made it possible to study these neurons in detail. The results suggested that the pathways are exclusively excitatory: that is, the cortical neurons always increase the activity of their partners in the striatum. However, this result made it difficult to explain why electrically stimulating the cortex can sometimes reduce or inhibit the activity of the striatum. To reconcile these facts, most people assumed that inhibition must occur when excitatory cortical neurons activate networks of inhibitory cells within the striatum itself.

Rock et al. now challenge this view by providing anatomical and physiological evidence for the existence of long-range inhibitory pathways from the cortex to the striatum in the mouse brain. These inhibitory neurons project from the auditory and motor regions of the cortex, and contain a substance called somatostatin. These neurons form connections with a specific type of striatal neuron called medium spiny neurons, which in turn project to other brain regions outside the striatum. The inhibitory cortical neurons can alter the activity of the medium spiny neurons, and can therefore directly control the output of the striatum.

The discovery that the striatum receives both excitatory and inhibitory inputs from cortex suggests that the timing and relative strength of these inputs can affect the activity of the striatum. Future experiments should examine whether this is a general mechanism by which sensory stimuli can influence the processes controlled by the striatum, such as movement.

DOI:http://dx.doi.org/10.7554/eLife.15890.002

Neural plasticity and behavior - sixty years of conceptual advances

This brief review summarizes 60 years of conceptual advances that have demonstrated a role for active changes in neuronal connectivity as a controller of behavior and behavioral change. Seminal studies in the first phase of the six-decade span of this review firmly established the cellular basis of behavior - a concept that we take for granted now, but which was an open question at the time. Hebbian plasticity, including long-term potentiation and long-term depression, was then discovered as being important for local circuit refinement in the context of memory formation and behavioral change and stabilization in the mammalian central nervous system. Direct demonstration of plasticity of neuronal circuit function in vivo, for example, hippocampal neurons forming place cell firing patterns, extended this concept. However, additional neurophysiologic and computational studies demonstrated that circuit development and stabilization additionally relies on non-Hebbian, homoeostatic, forms of plasticity, such as synaptic scaling and control of membrane intrinsic properties. Activity-dependent neurodevelopment was found to be associated with cell-wide adjustments in post-synaptic receptor density, and found to occur in conjunction with synaptic pruning. Pioneering cellular neurophysiologic studies demonstrated the critical roles of transmembrane signal transduction, NMDA receptor regulation, regulation of neural membrane biophysical properties, and back-propagating action potential in critical time-dependent coincidence detection in behavior-modifying circuits. Concerning the molecular mechanisms underlying these processes, regulation of gene transcription was found to serve as a bridge between experience and behavioral change, closing the 'nature versus nurture' divide. Both active DNA (de)methylation and regulation of chromatin structure have been validated as crucial regulators of gene transcription during learning. The discovery of protein synthesis dependence on the acquisition of behavioral change was an influential discovery in the neurochemistry of behavioral modification. Higher order cognitive functions such as decision making and spatial and language learning were also discovered to hinge on neural plasticity mechanisms. The role of disruption of these processes in intellectual disabilities, memory disorders, and drug addiction has recently been clarified based on modern genetic techniques, including in the human. The area of neural plasticity and behavior has seen tremendous advances over the last six decades, with many of those advances being specifically in the neurochemistry domain. This review provides an overview of the progress in the area of neuroplasticity and behavior over the life-span of the Journal of Neurochemistry. To organize the broad literature base, the review collates progress into fifteen broad categories identified as 'conceptual advances', as viewed by the author. The fifteen areas are delineated in the figure above. This article is part of the 60th Anniversary special issue.

Iron in Frontotemporal Lobar Degeneration: A New Subcortical Pathological Pathway?

INTRODUCTION

Brain iron homeostasis dysregulation has been widely related to neurodegeneration. In particular, human haemochromatosis protein (HFE) is involved in iron metabolism, and HFE H63D polymorphism has been related to the risk of amyotrophic lateral sclerosis and Alzheimer's disease. Recently, iron accumulation in the basal ganglia of frontotemporal lobar degeneration (FTLD) patients has been described.

OBJECTIVE

To explore the relationship between HFE genetic variation and demographic, clinical and imaging characteristics in a large cohort of FTLD patients.

METHODS

A total of 110 FTLD patients underwent neuropsychological and imaging evaluation and blood sampling for HFE polymorphism determination. HFE H63D polymorphism was considered in the present study. Two imaging approaches were applied to evaluate the effect of HFE genetic variation on brain atrophy, namely voxel-based morphometry and region of interest-based probabilistic approach (SPM8; Wellcome Trust Centre for Neuroimaging).

RESULTS

FTLD patients carrying the D* genotype (H/D or D/D) showed greater atrophy in the basal ganglia, bilaterally, compared to H/H carriers (x, y, z: -22, -4, 0; T = 3.45; cluster size: 33 voxels, x, y, z: 24, 4, -2; T = 3.38; cluster size: 36 voxels). The former group had even more pronounced behavioural symptoms, as defined by the Frontal Behavioural Inventory total scores.

CONCLUSIONS

Our data suggest that H63D polymorphism could represent a disease-modifying gene in FTLD, fostering iron deposition in the basal ganglia. This suggests a new possible mechanism of FTLD-associated neurodegeneration.

The importance of neural aromatization in the acquisition, recall, and integration of song and spatial memories in passerines

This article is part of a Special Issue "Estradiol and cognition". In addition to their well-studied and crucial effects on brain development and aging, an increasing number of investigations across vertebrate species indicate that estrogens like 17β-estradiol (E2) have pronounced and rapid effects on cognitive function. The incidence and regulation of the E2-synthesizing enzyme aromatase at the synapse in regions of the brain responsible for learning, memory, social communication and other complex cognitive processes suggest that local E2 production and action affect the acute and chronic activity of individual neurons and circuits. Songbirds in particular are excellent models for the study of this "synaptocrine" hormone provision given that aromatase is abundantly expressed in neuronal soma, dendrites, and at the synapse across many brain regions in both sexes. Additionally, songbirds readily acquire and recall memories in laboratory settings, and their stereotyped behaviors may be manipulated and measured with relative ease. This leads to a rather unparalleled advantage in the use of these animals in studies of the role of neural aromatization in cognition. In this review we describe the results of a number of experiments in songbird species with a focus on the influence of synaptic E2 provision on two cognitive processes: auditory discrimination reliant on the caudomedial nidopallium (NCM), a telencephalic region likely homologous to the auditory cortex in mammals, and spatial memory dependent on the hippocampus. Data from these studies are providing evidence that the local and acute provision of E2 modulates the hormonal, electrical, and cognitive outputs of the vertebrate brain and aids in memory acquisition, retention, and perhaps the confluence of memory systems.

Pathophysiology of L-dopa-induced motor and non-motor complications in Parkinson's disease

Involuntary movements, or dyskinesia, represent a debilitating complication of levodopa (L-dopa) therapy for Parkinson's disease (PD). L-dopa-induced dyskinesia (LID) are ultimately experienced by the vast majority of patients. In addition, psychiatric conditions often manifested as compulsive behaviours, are emerging as a serious problem in the management of L-dopa therapy. The present review attempts to provide an overview of our current understanding of dyskinesia and other L-dopa-induced dysfunctions, a field that dramatically evolved in the past twenty years. In view of the extensive literature on LID, there appeared a critical need to re-frame the concepts, to highlight the most suitable models, to review the central nervous system (CNS) circuitry that may be involved, and to propose a pathophysiological framework was timely and necessary. An updated review to clarify our understanding of LID and other L-dopa-related side effects was therefore timely and necessary. This review should help in the development of novel therapeutic strategies aimed at preventing the generation of dyskinetic symptoms.

Cell Assembly Signatures Defined by Short-Term Synaptic Plasticity in Cortical Networks

The cell assembly (CA) hypothesis has been used as a conceptual framework to explain how groups of neurons form memories. CAs are defined as neuronal pools with synchronous, recurrent and sequential activity patterns. However, neuronal interactions and synaptic properties that define CAs signatures have been difficult to examine because identities and locations of assembly members are usually unknown. In order to study synaptic properties that define CAs, we used optical and electrophysiological approaches to record activity of identified neurons in mouse cortical cultures. Population analysis and graph theory techniques allowed us to find sequential patterns that represent repetitive transitions between network states. Whole cell pair recordings of neurons participating in repeated sequences demonstrated that synchrony is exhibited by groups of neurons with strong synaptic connectivity (concomitant firing) showing short-term synaptic depression (STD), whereas alternation (sequential firing) is seen in groups of neurons with weaker synaptic connections showing short-term synaptic facilitation (STF). Decreasing synaptic weights of a network promoted the generation of sequential activity patterns, whereas increasing synaptic weights restricted state transitions. Thus in simple cortical networks of real neurons, basic signatures of CAs, the properties that underlie perception and memory in Hebb's original description, are already present.

Role of the indirect pathway of the basal ganglia in perceptual decision making

The basal ganglia (BG) play an important role in motor control, reinforcement learning, and perceptual decision making. Modeling and experimental evidence suggest that, in a speed-accuracy tradeoff, the corticostriatal pathway can adaptively adjust a decision threshold (the amount of information needed to make a choice). In this study, we go beyond the focus of previous works on the direct and hyperdirect pathways to examine the contribution of the indirect pathway of the BG system to decision making in a biophysically based spiking network model. We find that the mechanism of adjusting the decision threshold by plasticity of the corticostriatal connections is effective, provided that the indirect pathway counterbalances the direct pathway in their projections to the output nucleus. Furthermore, in our model, changes within basal ganglia connections similar to those that arise in parkinsonism give rise to strong beta oscillations. Specifically, beta oscillations are produced by an abnormal enhancement of the interactions between the subthalamic nucleus (STN) and the external segment of globus pallidus (GPe) in the indirect pathway, with an oscillation frequency that depends on the excitatory cortical input to the STN and the inhibitory input to the GPe from the striatum. In a parkinsonian state characterized by pronounced beta oscillations, the mean reaction time and range of threshold variation (a measure of behavioral flexibility) are significantly reduced compared with the normal state. Our work thus reveals a specific circuit mechanism for impairments of perceptual decision making associated with Parkinson's disease.

Converging structural and functional connectivity of orbitofrontal, dorsolateral prefrontal, and posterior parietal cortex in the human striatum

Modification of spatial attention via reinforcement learning (Lee and Shomstein, 2013) requires the integration of reward, attention, and executive processes. Corticostriatal pathways are an ideal neural substrate for this integration because these projections exhibit a globally parallel (Alexander et al., 1986), but locally overlapping (Haber, 2003), topographical organization. Here we explore whether there are unique striatal regions that exhibit convergent anatomical connections from orbitofrontal cortex, dorsolateral prefrontal cortex, and posterior parietal cortex. Deterministic fiber tractography on diffusion spectrum imaging data from neurologically healthy adults (N = 60) was used to map frontostriatal and parietostriatal projections. In general, projections from cortex were organized according to both a medial-lateral and a rostral-caudal gradient along the striatal nuclei. Within rostral aspects of the striatum, we identified two bilateral convergence zones (one in the caudate nucleus and another in the putamen) that consisted of voxels with unique projections from orbitofrontal cortex, dorsolateral prefrontal cortex, and parietal regions. The distributed cortical connectivity of these striatal convergence zones was confirmed with follow-up functional connectivity analysis from resting state fMRI data, in which a high percentage of structurally connected voxels also showed significant functional connectivity. The specificity of this convergent architecture to these regions of the rostral striatum was validated against control analysis of connectivity within the motor putamen. These results delineate a neurologically plausible network of converging corticostriatal projections that may support the integration of reward, executive control, and spatial attention that occurs during spatial reinforcement learning.

Brain functional plasticity associated with the emergence of expertise in extreme language control

We used functional magnetic resonance imaging (fMRI) to longitudinally examine brain plasticity arising from long-term, intensive simultaneous interpretation training. Simultaneous interpretation is a bilingual task with heavy executive control demands. We compared brain responses observed during simultaneous interpretation with those observed during simultaneous speech repetition (shadowing) in a group of trainee simultaneous interpreters, at the beginning and at the end of their professional training program. Age, sex and language-proficiency matched controls were scanned at similar intervals. Using multivariate pattern classification, we found distributed patterns of changes in functional responses from the first to second scan that distinguished the interpreters from the controls. We also found reduced recruitment of the right caudate nucleus during simultaneous interpretation as a result of training. Such practice-related change is consistent with decreased demands on multilingual language control as the task becomes more automatized with practice. These results demonstrate the impact of simultaneous interpretation training on the brain functional response in a cerebral structure that is not specifically linguistic, but that is known to be involved in learning, in motor control, and in a variety of domain-general executive functions. Along with results of recent studies showing functional and structural adaptations in the caudate nuclei of experts in a broad range of domains, our results underline the importance of this structure as a central node in expertise-related networks.

Enhanced GABAergic Inputs Contribute to Functional Alterations of Cholinergic Interneurons in the R6/2 Mouse Model of Huntington's Disease

Although large cholinergic interneurons (LCIs) in striatum are spared in Huntington's disease (HD), deficits in cholinergic function have been described. Here we demonstrate in a mouse model of HD that the firing patterns of LCIs are disrupted and this is due to aberrant GABAergic neurotransmission. This explains cholinergic deficits in HD.

In Huntington’s disease (HD), a hereditary neurodegenerative disorder, striatal medium-sized spiny neurons undergo degenerative changes. In contrast, large cholinergic interneurons (LCIs) are relatively spared. However, their ability to release acetylcholine (ACh) is impaired. The present experiments examined morphological and electrophysiological properties of LCIs in the R6/2 mouse model of HD. R6/2 mice show a severe, rapidly progressing phenotype. Immunocytochemical analysis of choline acetyltransferase-positive striatal neurons showed that, although the total number of cells was not changed, somatic areas were significantly smaller in symptomatic R6/2 mice compared to wild-type (WT) littermates, For electrophysiology, brain slices were obtained from presymptomatic (3-4 weeks) and symptomatic (>8 weeks) R6/2 mice and their WT littermates. Striatal LCIs were identified by somatic size and spontaneous action potential firing in the cell-attached mode. Passive and active membrane properties of LCIs were similar in presymptomatic R6/2 and WT mice. In contrast, LCIs from symptomatic R6/2 animals displayed smaller membrane capacitance and higher input resistance, consistent with reduced somatic size. In addition, more LCIs from symptomatic mice displayed irregular firing patterns and bursts of action potentials. They also displayed a higher frequency of spontaneous GABAergic IPSCs and larger amplitude of electrically evoked IPSCs. Selective optogenetic stimulation of somatostatin- but not parvalbumin-containing interneurons also evoked larger amplitude IPSCs in LCIs from R6/2 mice. In contrast, glutamatergic spontaneous or evoked postsynaptic currents were not affected. Morphological and electrophysiological alterations, in conjunction with the presence of mutant huntingtin in LCIs, could explain impaired ACh release in HD mouse models.

Robust retention of individual sensorimotor skill after self-guided practice

Long-term retention of a motor skill has received relatively little systematic study, even though lasting neuroplasticity is the holy grail of any clinical intervention. This study examined the acquisition and retention of a novel bimanual polyrhythmic skill, practiced with sparse explicit feedback mimicking real-life scenarios. Self-paced and metronome-paced practice conditions were compared in their effect on long-term retention. Two groups of subjects first underwent extensive practice of 20 practice sessions over 2 mo, then followed up with three retention sessions after 3 mo. Results showed that subjects developed robust spatiotemporal patterns, despite the lack of reward and little quantitative error feedback about their performance (Hypothesis 1). These movement patterns were reproduced after a 3-mo interval, frequently even in the first trial, with no intermediate practice (Hypothesis 2). Self-paced training of movement patterns led to slightly less variability in the retention test (Hypothesis 3). These results document the specificity and stability of kinematic patterns and their underlying neuroplastic changes and underscore the effectiveness of self-guided practice. The findings are discussed in the context of current neuroimaging results and their clinical implications.

Presynaptic adenosine A2A receptors dampen cannabinoid CB1 receptor-mediated inhibition of corticostriatal glutamatergic transmission

BACKGROUND AND PURPOSE

Both cannabinoid CB1 and adenosine A2A receptors (CB1 receptors and A2A receptors) control synaptic transmission at corticostriatal synapses, with great therapeutic importance for neurological and psychiatric disorders. A postsynaptic CB1 -A2A receptor interaction has already been elucidated, but the presynaptic A2A receptor-mediated control of presynaptic neuromodulation by CB1 receptors remains to be defined. Because the corticostriatal terminals provide the major input to the basal ganglia, understanding the interactive nature of converging neuromodulation on them will provide us with novel powerful tools to understand the physiology of corticostriatal synaptic transmission and interpret changes associated with pathological conditions.

EXPERIMENTAL APPROACH

Pharmacological manipulation of CB1 and A2A receptors was carried out in brain nerve terminals isolated from rats and mice, using flow synaptometry, immunoprecipitation, radioligand binding, ATP and glutamate release measurement. Whole-cell patch-clamp recordings were made in horizontal corticostriatal slices.

KEY RESULTS

Flow synaptometry showed that A2A receptors were extensively co-localized with CB1 receptor-immunopositive corticostriatal terminals and A2A receptors co-immunoprecipitated CB1 receptors in these purified terminals. A2A receptor activation decreased CB1 receptor radioligand binding and decreased the CB1 receptor-mediated inhibition of high-K(+) -evoked glutamate release in corticostriatal terminals. Accordingly, A2A receptor activation prevented CB1 receptor-mediated paired-pulse facilitation and attenuated the CB1 receptor-mediated inhibition of synaptic transmission in glutamatergic synapses of corticostriatal slices.

CONCLUSIONS AND IMPLICATIONS

Activation of presynaptic A2A receptors dampened CB1 receptor-mediated inhibition of corticostriatal terminals. This constitutes a thus far unrecognized mechanism to modulate the potent CB1 receptor-mediated presynaptic inhibition, allowing frequency-dependent enhancement of synaptic efficacy at corticostriatal synapses.

Delay Period Activity of the Substantia Nigra during Proactive Control of Response Selection as Determined by a Novel fMRI Localization Method

The ability to proactively control motor responses, particularly to overcome overlearned or automatic actions, is an essential prerequisite for adaptive, goal-oriented behavior. The substantia nigra (SN), an element of the BG, has figured prominently in current models of response selection. However, because of its small size and proximity to functionally distinct subcortical structures, it has been challenging to test the SN's involvement in response selection using conventional in vivo functional neuroimaging approaches. We developed a new fMRI localization method for directly distinguishing, on echo-planar images, the SN BOLD signal from that of neighboring structures, including the subthalamic nucleus (STN). Using this method, we tested the hypothesis that the SN supports the proactive control of response selection. We acquired high-resolution EPI volumes at 3 T from 16 healthy participants while they completed the Preparing to Overcome Prepotency task of proactive control. There was significantly elevated delay period signal selectively during high- compared with low-control trials in the SN. The STN did not show delay period activity in either condition. SN delay period signal was significantly inversely associated with task performance RTs across participants. These results suggest that our method offers a novel means for measuring SN BOLD responses, provides unique evidence of SN involvement in cognitive control in humans, and suggests a novel mechanism for proactive response selection.

Potentiated gene regulation by methylphenidate plus fluoxetine treatment: Long-term gene blunting (Zif268, Homer1a) and behavioral correlates

Use of psychostimulants such as methylphenidate (Ritalin) in medical treatments and as cognitive enhancers in the healthy is increasing. Methylphenidate produces some addiction-related gene regulation in animal models. Recent findings show that combining selective serotonin reuptake inhibitor (SSRI) antidepressants such as fluoxetine with methylphenidate potentiates methylphenidate-induced gene regulation. We investigated the endurance of such abnormal gene regulation by assessing an established marker for altered gene regulation after drug treatments - blunting (repression) of immediate-early gene (IEG) inducibility - 14 days after repeated methylphenidate+fluoxetine treatment in adolescent rats. Thus, we measured the effects of a 6-day repeated treatment with methylphenidate (5 mg/kg), fluoxetine (5 mg/kg) or their combination on the inducibility (by cocaine) of neuroplasticity-related IEGs (Zif268, Homer1a) in the striatum, by in situ hybridization histochemistry. Repeated methylphenidate treatment alone produced modest gene blunting, while fluoxetine alone had no effect. In contrast, fluoxetine given in conjunction with methylphenidate produced pronounced potentiation of methylphenidate-induced blunting for both genes. This potentiation was seen in many functional domains of the striatum, but was most robust in the lateral, sensorimotor striatum. These enduring molecular changes were associated with potentiated induction of behavioral stereotypies in an open-field test. For illicit psychostimulants, blunting of gene expression is considered part of the molecular basis of addiction. Our results thus suggest that SSRIs such as fluoxetine may increase the addiction liability of methylphenidate. Key words: cognitive enhancer, dopamine, serotonin, gene expression, psychostimulant, SSRI antidepressant, striatum.

Distinct motor impairments of dopamine D1 and D2 receptor knockout mice revealed by three types of motor behavior

Both D1R and D2R knock out (KO) mice of the major dopamine receptors show significant motor impairments. However, there are some discrepant reports, which may be due to the differences in genetic background and experimental procedures. In addition, only few studies directly compared the motor performance of D1R and D2R KO mice. In this paper, we examined the behavioral difference among N10 congenic D1R and D2R KO, and wild type (WT) mice. First, we examined spontaneous motor activity in the home cage environment for consecutive 5 days. Second, we examined motor performance using the rota-rod task, a standard motor task in rodents. Third, we examined motor ability with the Step-Wheel task in which mice were trained to run in a motor-driven turning wheel adjusting their steps on foothold pegs to drink water. The results showed clear differences among the mice of three genotypes in three different types of behavior. In monitoring spontaneous motor activities, D1R and D2R KO mice showed higher and lower 24 h activities, respectively, than WT mice. In the rota-rod tasks, at a low speed, D1R KO mice showed poor performance but later improved, whereas D2R KO mice showed a good performance at early days without further improvement. When first subjected to a high speed task, the D2R KO mice showed poorer rota-rod performance at a low speed than the D1R KO mice. In the Step-Wheel task, across daily sessions, D2R KO mice increased the duration that mice run sufficiently close to the spout to drink water, and decreased time to touch the floor due to missing the peg steps and number of times the wheel was stopped, which performance was much better than that of D1R KO mice. These incongruent results between the two tasks for D1R and D2R KO mice may be due to the differences in the motivation for the rota-rod and Step-Wheel tasks, aversion- and reward-driven, respectively. The Step-Wheel system may become a useful tool for assessing the motor ability of WT and mutant mice.

Differences in the emergent coding properties of cortical and striatal ensembles

The function of a given brain region is often defined by the coding properties of its individual neurons, yet how this information is combined at the ensemble level is an equally important consideration. In the present study, multiple neurons from the anterior cingulate cortex (ACC) and the dorsal striatum (DS) were recorded simultaneously as rats performed different sequences of the same three actions. Sequence and lever decoding was remarkably similar on a per-neuron basis in the two regions. At the ensemble level, sequence-specific representations in the DS appeared synchronously but transiently along with the representation of lever location, while these two streams of information appeared independently and asynchronously in the ACC. As a result the ACC achieved superior ensemble decoding accuracy overall. Thus, the manner in which information was combined across neurons in an ensemble determined the functional separation of the ACC and DS on this task.

Both neurons and astrocytes exhibited tetrodotoxin-resistant metabotropic glutamate receptor-dependent spontaneous slow Ca2+ oscillations in striatum

The striatum plays an important role in linking cortical activity to basal ganglia outputs. Group I metabotropic glutamate receptors (mGluRs) are densely expressed in the medium spiny projection neurons and may be a therapeutic target for Parkinson's disease. The group I mGluRs are known to modulate the intracellular Ca²⁺ signaling. To characterize Ca²⁺ signaling in striatal cells, spontaneous cytoplasmic Ca²⁺ transients were examined in acute slice preparations from transgenic mice expressing green fluorescent protein (GFP) in the astrocytes. In both the GFP-negative cells (putative-neurons) and astrocytes of the striatum, spontaneous slow and long-lasting intracellular Ca²⁺ transients (referred to as slow Ca²⁺ oscillations), which lasted up to approximately 200 s, were found. Neither the inhibition of action potentials nor ionotropic glutamate receptors blocked the slow Ca²⁺ oscillation. Depletion of the intracellular Ca²⁺ store and the blockade of inositol 1,4,5-trisphosphate receptors greatly reduced the transient rate of the slow Ca²⁺ oscillation, and the application of an antagonist against mGluR5 also blocked the slow Ca²⁺ oscillation in both putative-neurons and astrocytes. Thus, the mGluR5-inositol 1,4,5-trisphosphate signal cascade is the primary contributor to the slow Ca²⁺ oscillation in both putative-neurons and astrocytes. The slow Ca²⁺ oscillation features multicellular synchrony, and both putative-neurons and astrocytes participate in the synchronous activity. Therefore, the mGluR5-dependent slow Ca²⁺ oscillation may involve in the neuron-glia interaction in the striatum.

Sensitivity to theta-burst timing permits LTP in dorsal striatal adult brain slice

Long-term potentiation (LTP) of excitatory afferents to the dorsal striatum likely occurs with learning to encode new skills and habits, yet corticostriatal LTP is challenging to evoke reliably in brain slice under physiological conditions. Here we test the hypothesis that stimulating striatal afferents with theta-burst timing, similar to recently reported in vivo temporal patterns corresponding to learning, evokes LTP. Recording from adult mouse brain slice extracellularly in 1 mM Mg(2+), we find LTP in dorsomedial and dorsolateral striatum is preferentially evoked by certain theta-burst patterns. In particular, we demonstrate that greater LTP is produced using moderate intraburst and high theta-range frequencies, and that pauses separating bursts of stimuli are critical for LTP induction. By altering temporal pattern alone, we illustrate the importance of burst-patterning for LTP induction and demonstrate that corticostriatal long-term depression is evoked in the same preparation. In accord with prior studies, LTP is greatest in dorsomedial striatum and relies on N-methyl-d-aspartate receptors. We also demonstrate a requirement for both Gq- and Gs/olf-coupled pathways, as well as several kinases associated with memory storage: PKC, PKA, and ERK. Our data build on previous reports of activity-directed plasticity by identifying effective values for distinct temporal parameters in variants of theta-burst LTP induction paradigms. We conclude that those variants which best match reports of striatal activity during learning behavior are most successful in evoking dorsal striatal LTP in adult brain slice without altering artificial cerebrospinal fluid. Future application of this approach will enable diverse investigations of plasticity serving striatal-based learning.

The effect of Parkinson's disease and levodopa on adaptation of anticipatory postural adjustments

Postural support alters anticipatory postural adjustments (APAs). Efficient adaptation to changes in postural support in reactive and centrally initiated postural synergies is impaired in Parkinson's disease (PD). This study examined whether APAs are affected differently by familiar and novel supports in people with PD, ON and OFF levodopa. The effect of PD and levodopa on the ability to immediately adapt APAs to changes in support and refine with practice was also investigated. Fourteen people with PD and 14 healthy control participants performed 20 single rapid leg lift tasks in four support conditions: unsupported, bilateral handgrip (familiar), bite plate (novel) and a combined handgrip+bite plate condition. APAs, identified from force plate data, were characterized by an increase in the vertical ground reaction force under the lifted leg as a result of a shift of weight toward the stance limb. Results showed the ability to incorporate familiar and novel external supports into the postural strategy was preserved in PD. Controls and PD patients in the OFF state further refined the postural strategy with practice as evidenced by changes in amplitude of vertical ground reaction forces and forces applied to support apparatus within conditions between the initial and final trials. In the ON state, people with PD failed to refine the use of postural supports in any condition. The results suggest that immediate postural adaptation is intact in people with PD and unaffected by levodopa administration but the ability to refine postural adaptations with task experience is compromised by dopamine therapy.

Aberrant restoration of spines and their synapses in L-DOPA-induced dyskinesia: involvement of corticostriatal but not thalamostriatal synapses

We examined the structural plasticity of excitatory synapses from corticostriatal and thalamostriatal pathways and their postsynaptic targets in adult Sprague-Dawley rats to understand how these striatal circuits change in l-DOPA-induced dyskinesias (LIDs). We present here detailed electron and light microscopic analyses that provide new insight into the nature of the structural and synaptic remodeling of medium spiny neurons in response to LIDs. Numerous studies have implicated enhanced glutamate signaling and persistent long-term potentiation as central to the behavioral sensitization phenomenon of LIDs. Moreover, experience-dependent alterations in behavior are thought to involve structural modifications, specifically alterations in patterns of synaptic connectivity. Thus, we hypothesized that in the striatum of rats with LIDs, one of two major glutamatergic pathways would form new or altered contacts, especially onto the spines of medium spiny neuron (MSNs). Our data provide compelling evidence for a dramatic rewiring of the striatum of dyskinetic rats and that this rewiring involves corticostriatal but not thalamostriatal contacts onto MSNs. There is a dramatic increase in corticostriatal contacts onto spines and dendrites that appear to be directly linked to dyskinetic behaviors, since they were not seen in the striatum of animals that did not develop dyskinesia. There is also an aberrant increase in spines receiving more than one excitatory contact(i.e., multisynaptic spines) in the dyskinetic animals compared with the 6-hydroxydopamine-treated and control rats. Such alterations could substantially impair the ability of striatal neurons to gate cortically driven signals and contribute to the loss of bidirectional synaptic plasticity.

Complementary Roles of the Hippocampus and the Dorsomedial Striatum during Spatial and Sequence-Based Navigation Behavior

We investigated the neural bases of navigation based on spatial or sequential egocentric representation during the completion of the starmaze, a complex goal-directed navigation task. In this maze, mice had to swim along a path composed of three choice points to find a hidden platform. As reported previously, this task can be solved by using two hippocampal-dependent strategies encoded in parallel i) the allocentric strategy requiring encoding of the contextual information, and ii) the sequential egocentric strategy requiring temporal encoding of a sequence of successive body movements associated to specific choice points. Mice were trained during one day and tested the following day in a single probe trial to reveal which of the two strategies was spontaneously preferred by each animal. Imaging of the activity-dependent gene c-fos revealed that both strategies are supported by an overlapping network involving the dorsal hippocampus, the dorsomedial striatum (DMS) and the medial prefrontal cortex. A significant higher activation of the ventral CA1 subregion was observed when mice used the sequential egocentric strategy. To investigate the potential different roles of the dorsal hippocampus and the DMS in both types of navigation, we performed region-specific excitotoxic lesions of each of these two structures. Dorsal hippocampus lesioned mice were unable to optimally learn the sequence but improved their performances by developing a serial strategy instead. DMS lesioned mice were severely impaired, failing to learn the task. Our data support the view that the hippocampus organizes information into a spatio-temporal representation, which can then be used by the DMS to perform goal-directed navigation.

Differential innervation of direct- and indirect-pathway striatal projection neurons

The striatum integrates information from multiple brain regions to shape motor learning. The two major projection cell types in striatum target different downstream basal ganglia targets and have opposing effects on motivated behavior, yet differential innervation of these neuronal subtypes is not well understood. To examine whether input specificity provides a substrate for information segregation in these circuits, we used a monosynaptic rabies virus system to generate brain-wide maps of neurons that form synapses with direct- or indirect-pathway striatal projection neurons. We discovered that sensory cortical and limbic structures preferentially innervated the direct pathway, whereas motor cortex preferentially targeted the indirect pathway. Thalamostriatal input, dopaminergic input, as well as input from specific cortical layers, was similar onto both pathways. We also confirm synaptic innervation of striatal projection neurons by the raphe and pedunculopontine nuclei. Together, these findings provide a framework for guiding future studies of basal ganglia circuit function.

Role of the striatum in language: Syntactic and conceptual sequencing

The basal ganglia (BG) have long been associated with cognitive control, and it is widely accepted that they also subserve an indirect, control role in language. Nevertheless, it cannot be completely ruled out that the BG may be involved in language in some domain-specific manner. The present study aimed to investigate one type of cognitive control-sequencing, a function that has long been connected with the BG-and to test whether the BG could be specifically implicated in language. Participants were required to rearrange materials sequentially based on linguistic (syntactic or conceptual) or non-linguistic (order switching) rules, or to repeat a previously ordered sequence as a control task. Functional magnetic resonance imaging (fMRI) data revealed a strongly active left-lateralized corticostriatal network, encompassing the anterior striatum, dorsolaterial and ventrolateral prefrontal cortex and presupplementary motor area, while the participants were sequencing materials using linguistic vs. non-linguistic rules. This functional network has an anatomical basis and is strikingly similar to the well-known associative loop implicated in sensorimotor sequence learning. We concluded that the anterior striatum has extended its original sequencing role and worked in concert with frontal cortical regions to subserve the function of linguistic sequencing in a domain-specific manner.

Action selection performance of a reconfigurable basal ganglia inspired model with Hebbian-Bayesian Go-NoGo connectivity

Several studies have shown a strong involvement of the basal ganglia (BG) in action selection and dopamine dependent learning. The dopaminergic signal to striatum, the input stage of the BG, has been commonly described as coding a reward prediction error (RPE), i.e., the difference between the predicted and actual reward. The RPE has been hypothesized to be critical in the modulation of the synaptic plasticity in cortico-striatal synapses in the direct and indirect pathway. We developed an abstract computational model of the BG, with a dual pathway structure functionally corresponding to the direct and indirect pathways, and compared its behavior to biological data as well as other reinforcement learning models. The computations in our model are inspired by Bayesian inference, and the synaptic plasticity changes depend on a three factor Hebbian–Bayesian learning rule based on co-activation of pre- and post-synaptic units and on the value of the RPE. The model builds on a modified Actor-Critic architecture and implements the direct (Go) and the indirect (NoGo) pathway, as well as the reward prediction (RP) system, acting in a complementary fashion. We investigated the performance of the model system when different configurations of the Go, NoGo, and RP system were utilized, e.g., using only the Go, NoGo, or RP system, or combinations of those. Learning performance was investigated in several types of learning paradigms, such as learning-relearning, successive learning, stochastic learning, reversal learning and a two-choice task. The RPE and the activity of the model during learning were similar to monkey electrophysiological and behavioral data. Our results, however, show that there is not a unique best way to configure this BG model to handle well all the learning paradigms tested. We thus suggest that an agent might dynamically configure its action selection mode, possibly depending on task characteristics and also on how much time is available.

Prefrontal and limbic resting state brain network functional connectivity differs between nicotine-dependent smokers and non-smoking controls

BACKGROUND

Brain dysfunction in prefrontal cortex (PFC) and dorsal striatum (DS) contributes to habitual drug use. These regions are constituents of brain networks thought to be involved in drug addiction. To investigate whether networks containing these regions differ between nicotine dependent female smokers and age-matched female non-smokers, we employed functional MRI (fMRI) at rest.

METHODS

Data were processed with independent component analysis (ICA) to identify resting state networks (RSNs). We identified a subcortical limbic network and three discrete PFC networks: a medial prefrontal cortex (mPFC) network and right and left lateralized fronto-parietal networks common to all subjects. We then compared these RSNs between smokers and non-smokers using a dual regression approach.

RESULTS

Smokers had greater coupling versus non-smokers between left fronto-parietal and mPFC networks. Smokers with the greatest mPFC-left fronto-parietal coupling had the most DS smoking cue reactivity as measured during an fMRI smoking cue reactivity paradigm. This may be important because the DS plays a critical role in maintaining drug-cue associations. Furthermore, subcortical limbic network amplitude was greater in smokers.

CONCLUSIONS

Our results suggest that prefrontal brain networks are more strongly coupled in smokers, which could facilitate drug-cue responding. Our data also are the first to document greater reward-related network fMRI amplitude in smokers. Our findings suggest that resting state PFC network interactions and limbic network amplitude can differentiate nicotine-dependent smokers from controls, and may serve as biomarkers for nicotine dependence severity and treatment efficacy.

Information content and reward processing in the human striatum during performance of a declarative memory task

Negative feedback can signal poor performance, but it also provides information that can help learners reach the goal of task mastery. The primary aim of this study was to test the hypothesis that the amount of information provided by negative feedback during a paired-associate learning task influences feedback-related processing in the caudate nucleus. To do this, we manipulated the number of response options: With two options, positive and negative feedback provide equal amounts of information, whereas with four options, positive feedback provides more information than does negative feedback. We found that positive and negative feedback activated the caudate similarly when there were two response options. With four options, the caudate’s response to negative feedback was reduced. A secondary goal was to investigate the link between brain-based measures of feedback-related processing and behavioral indices of learning. Analysis of the posttest measures showed that trials with positive feedback were associated with higher posttest confidence ratings. Additionally, when positive feedback was delivered, caudate activity was greater for trials with high than with low posttest confidence. This experiment demonstrated the context sensitivity of feedback processing and provided evidence that feedback processing in the striatum can contribute to the strengthening of the representations available within declarative memory.

The influence of movement initiation deficits on the quantification of retention in Parkinson's disease

In patients with an impaired motor system, like Parkinson’s disease (PD), deficits in motor learning are expected and results of various studies seem to confirm these expectations. However, most studies in this regard are behaviorally based and quantify learning by performance changes between at least two points in time, e.g., baseline and retention. But, performance in a retention test is also dependent on other factors than learning. Especially in patients, the functional capacity of the control system might be altered unspecific to a certain task and learning episode. The aim of the study is to test whether characteristic temporal deficits exist in PD patients that affect retention performance. We tested the confounding effects of typical PD motor control deficits, here movement initiation deficits, on retention performance in the motor learning process. 12 PD patients and 16 healthy control participants practiced a virtual throwing task over 3 days with 24 h rest between sessions. Retention was tested comparing performance before rest with performance after rest. Movement initiation deficits were quantified by the timing of throwing release that should be affected by impairments in movement initiation. To scrutinize the influence of the initiation deficits on retention performance we gave participants a specific initiation intervention prior to practice on one of the three practice days. We found that only for the PD patients, post-rest performance as well as release timing was better with intervention as compared to without intervention. Their performance could be enhanced through a tuning of release initiation. Thus, we suggest that in PD patients, performance decline after rest that might be easily interpreted as learning deficits could rather result from disease-related deficiencies in motor control.

Changes in multifinger interaction and coordination in Parkinson's disease

In this study, we tested several hypotheses related to changes in finger interaction and multifinger synergies during multifinger force production tasks in Parkinson's disease. Ten patients with Parkinson's disease, mostly early stage, and 11 healthy control subjects participated in the study. Synergies were defined as covaried adjustment of commands to fingers that stabilized the total force produced by the hand. Both Parkinson's disease patients and control subjects performed accurate isometric force production tasks with the fingers of both the dominant and nondominant hands. The Parkinson's disease patients showed significantly lower maximal finger forces and higher unintended force production (enslaving). These observations suggest that changes in supraspinal control have a major effect on finger individuation. The synergy indexes in the patients were weaker in both steady-state and cyclic force production tasks compared with the controls. These indexes also were stronger in the left (nondominant) hand in support of the dynamic-dominance hypothesis. Half of the patients could not perform the cyclic task at the highest frequency (2 Hz). Anticipatory adjustments of synergies prior to a quick force pulse production were delayed and reduced in the patients compared with the controls. Similar differences were observed between the asymptomatic hands of the patients with symptoms limited to one side of the body and matched hands of control subjects. Our study demonstrates that the elusive changes in motor coordination in Parkinson's disease can be quantified objectively, even in patients at a relatively early stage of the disease. The results suggest an important role of the basal ganglia in synergy formation and demonstrate a previously unknown component of impaired feedforward control in Parkinson's disease reflected in the reduced and delayed anticipatory synergy adjustments.