Bilateral intracortical inhibition during unilateral motor preparation and sequence learning

Motor sequence learning gradually quickens reaction time, suggesting that sequence learning alters motor preparation processes. Interestingly, evidence has shown that preparing sequence movements decreases short intracortical inhibition (SICI) in the contralateral motor cortex (M1), but also that sequence learning alters motor preparation processes in both the contralateral and ipsilateral M1s. Therefore, one possibility is that sequence learning alters the SICI decreases occurring during motor preparation in bilateral M1s. To examine this, two novel hypotheses were tested: unilateral sequence preparation would decrease SICI in bilateral M1s, and sequence learning would alter such bilateral SICI responses. Paired-pulse transcranial magnetic stimulation was delivered over the contralateral and ipsilateral M1s to assess SICI in an index finger muscle during the preparation of sequences initiated by either the right index or little finger. In the absence of sequence learning, SICI decreased in both the contralateral and ipsilateral M1s during the preparation of sequences initiated by the right index finger, suggesting that SICI decreases in bilateral M1s during unilateral motor preparation. As sequence learning progressed, SICI decreased in the contralateral M1 whilst it increased in the ipsilateral M1. Moreover, these bilateral SICI responses were observed at the onset of motor preparation, suggesting that sequence learning altered baseline SICI levels rather than the SICI decreases occurring during motor preparation per se. Altogether, these results suggest that SICI responses in bilateral M1s reflect two motor processes: an acute decrease of inhibition during motor preparation, and a cooperative but bidirectional shift of baseline inhibition levels as sequence learning progresses.

The intracortical excitability changes underlying the enhancing effects of rewards and punishments on motor performance

Monetary rewards and punishments enhance motor performance and are associated with corticospinal excitability (CSE) increases within the motor cortex (M1) during movement preparation. However, such CSE changes have unclear origins. Based on converging evidence, one possibility is that they stem from increased glutamatergic (GLUTergic) facilitation and/or decreased type A gamma-aminobutyric acid (GABAA)-mediated inhibition within M1. To investigate this, paired-pulse transcranial magnetic stimulation was used over the left M1 to evaluate intracortical facilitation (ICF) and short intracortical inhibition (SICI), indirect assays of GLUTergic activity and GABAA-mediated inhibition, in an index finger muscle during the preparation of sequences initiated by either the right index or little finger. Behaviourally, rewards and punishments enhanced both reaction and movement time. During movement preparation, regardless of rewards or punishments, ICF increased when the index finger initiated sequences, whereas SICI decreased when both the index and little fingers initiated sequences. This finding suggests that GLUTergic activity increases in a finger-specific manner whilst GABAA-mediated inhibition decreases in a finger-unspecific manner during preparation. In parallel, both rewards and punishments non-specifically increased ICF, but only rewards non-specifically decreased SICI as compared to neutral. This suggests that to enhance performance rewards both increase GLUTergic activity and decrease GABAA-mediated inhibition, whereas punishments selectively increase GLUTergic activity. A control experiment revealed that such changes were not observed post-movement as participants processed reward and punishment feedback, indicating they were selective to movement preparation. Collectively, these results map the intracortical excitability changes in M1 by which incentives enhance motor performance.

Short duration event related cerebellar TDCS enhances visuomotor adaptation

BACKGROUND

Transcranial direct current stimulation (TDCS) is typically applied before or during a task, for periods ranging from 5 to 30 min.

HYPOTHESIS

We hypothesise that briefer stimulation epochs synchronous with individual task actions may be more effective.

METHODS

In two separate experiments, we applied brief bursts of event-related anodal stimulation (erTDCS) to the cerebellum during a visuomotor adaptation task.

RESULTS

The first study demonstrated that 1 s duration erTDCS time-locked to the participants' reaching actions enhanced adaptation significantly better than sham. A close replication in the second study demonstrated 0.5 s erTDCS synchronous with the reaching actions again resulted in better adaptation than standard TDCS, significantly better than sham. Stimulation either during the inter-trial intervals between movements or after movement, during assessment of visual feedback, had no significant effect. Because short duration stimulation with rapid onset and offset is more readily perceived by the participants, we additionally show that a non-electrical vibrotactile stimulation of the scalp, presented with the same timing as the erTDCS, had no significant effect.

CONCLUSIONS

We conclude that short duration, event related, anodal TDCS targeting the cerebellum enhances motor adaptation compared to the standard model. We discuss possible mechanisms of action and speculate on neural learning processes that may be involved.

Sensorimotor feedback loops are selectively sensitive to reward

Although it is well established that motivational factors such as earning more money for performing well improve motor performance, how the motor system implements this improvement remains unclear. For instance, feedback-based control, which uses sensory feedback from the body to correct for errors in movement, improves with greater reward. But feedback control encompasses many feedback loops with diverse characteristics such as the brain regions involved and their response time. Which specific loops drive these performance improvements with reward is unknown, even though their diversity makes it unlikely that they are contributing uniformly. We systematically tested the effect of reward on the latency (how long for a corrective response to arise?) and gain (how large is the corrective response?) of seven distinct sensorimotor feedback loops in humans. Only the fastest feedback loops were insensitive to reward, and the earliest reward-driven changes were consistently an increase in feedback gains, not a reduction in latency. Rather, a reduction of response latencies only tended to occur in slower feedback loops. These observations were similar across sensory modalities (vision and proprioception). Our results may have implications regarding feedback control performance in athletic coaching. For instance, coaching methodologies that rely on reinforcement or 'reward shaping' may need to specifically target aspects of movement that rely on reward-sensitive feedback responses.

The dissociable effects of reward on sequential motor behavior

Reward has consistently been shown to enhance motor behavior; however, its beneficial effects appear to be largely unspecific. For example, reward is associated with both rapid and training-dependent improvements in performance, with a mechanistic account of these effects currently lacking. Here we tested the hypothesis that these distinct reward-based improvements are driven by dissociable reward types: monetary incentive and performance feedback. Whereas performance feedback provides information on how well a motor task has been completed (knowledge of performance), monetary incentive increases the motivation to perform optimally without providing a performance-based learning signal. Experiment 1 showed that groups who received monetary incentive rapidly improved movement times (MTs), using a novel sequential reaching task. In contrast, only groups with correct performance-based feedback showed learning-related improvements. Importantly, pairing both maximized MT performance gains and accelerated movement fusion. Fusion describes an optimization process during which neighboring sequential movements blend together to form singular actions. Results from experiment 2 served as a replication and showed that fusion led to enhanced performance speed while also improving movement efficiency through increased smoothness. Finally, experiment 3 showed that these improvements in performance persist for 24 h even without reward availability. This highlights the dissociable impact of monetary incentive and performance feedback, with their combination maximizing performance gains and leading to stable improvements in the speed and efficiency of sequential actions.NEW & NOTEWORTHY Our work provides a mechanistic framework for how reward influences motor behavior. Specifically, we show that rapid improvements in speed and accuracy are driven by reward presented in the form of money, whereas knowledge of performance through performance feedback leads to training-based improvements. Importantly, combining both maximized performance gains and led to improvements in movement quality through fusion, which describes an optimization process during which sequential movements blend into a single action.

Domain-Specific Working Memory, But Not Dopamine-Related Genetic Variability, Shapes Reward-Based Motor Learning

The addition of rewarding feedback to motor learning tasks has been shown to increase the retention of learning, spurring interest in its possible utility for rehabilitation. However, motor tasks using rewarding feedback have repeatedly been shown to lead to great interindividual variability in performance. Understanding the causes of such variability is vital for maximizing the potential benefits of reward-based motor learning. Thus, using a large human cohort of both sexes (n = 241), we examined whether spatial (SWM), verbal, and mental rotation (RWM) working memory capacity and dopamine-related genetic profiles were associated with performance in two reward-based motor tasks. The first task assessed the participant's ability to follow a slowly shifting reward region based on hit/miss (binary) feedback. The second task investigated the participant's capacity to preserve performance with binary feedback after adapting to the rotation with full visual feedback. Our results demonstrate that higher SWM is associated with greater success and an enhanced capacity to reproduce a successful motor action, measured as change in reach angle following reward. In contrast, higher RWM was predictive of an increased propensity to express an explicit strategy when required to make large reach angle adjustments. Therefore, SWM and RWM were reliable, but dissociable, predictors of success during reward-based motor learning. Change in reach direction following failure was also a strong predictor of success rate, although we observed no consistent relationship with working memory. Surprisingly, no dopamine-related genotypes predicted performance. Therefore, working memory capacity plays a pivotal role in determining individual ability in reward-based motor learning.SIGNIFICANCE STATEMENT Reward-based motor learning tasks have repeatedly been shown to lead to idiosyncratic behaviors that cause varying degrees of task success. Yet, the factors determining an individual's capacity to use reward-based feedback are unclear. Here, we assessed a wide range of possible candidate predictors, and demonstrate that domain-specific working memory plays an essential role in determining individual capacity to use reward-based feedback. Surprisingly, genetic variations in dopamine availability were not found to play a role. This is in stark contrast with seminal work in the reinforcement and decision-making literature, which show strong and replicated effects of the same dopaminergic genes in decision-making. Therefore, our results provide novel insights into reward-based motor learning, highlighting a key role for domain-specific working memory capacity.

Delineating cerebellar mechanisms in DYT11 myoclonus-dystonia

BACKGROUND

Recent research has highlighted the role of the cerebellum in the pathophysiology of myoclonus-dystonia syndrome as a result of mutations in the ɛ-sarcoglycan gene (DYT11). Specifically, a cerebellar-dependent saccadic adaptation task is dramatically impaired in this patient group.

OBJECTIVES

The objective of this study was to investigate whether saccadic deficits coexist with impairments of limb adaptation to provide a potential mechanism linking cerebellar dysfunction to the movement disorder within symptomatic body regions.

METHODS

Limb adaptation to visuomotor (visual feedback rotated by 30°) and forcefield (force applied by robot to deviate arm) perturbations were examined in 5 patients with DYT11 and 10 aged-matched controls.

RESULTS

Patients with DYT11 successfully adapted to both types of perturbation. Modelled and averaged summary metrics that captured adaptation behaviors were equivalent to the control group across conditions.

CONCLUSIONS

DYT11 is not characterized by a uniform deficit in adaptation. The previously observed large deficit in saccadic adaption is not reflected in an equivalent deficit in limb adaptation in symptomatic body regions. We suggest potential mechanisms at the root of this discordance and identify key research questions that need future study. © 2018 International Parkinson and Movement Disorder Society.

Age-dependent Pavlovian biases influence motor decision-making

Motor decision-making is an essential component of everyday life which requires weighing potential rewards and punishments against the probability of successfully executing an action. To achieve this, humans rely on two key mechanisms; a flexible, instrumental, value-dependent process and a hardwired, Pavlovian, value-independent process. In economic decision-making, age-related decline in risk taking is explained by reduced Pavlovian biases that promote action toward reward. Although healthy ageing has also been associated with decreased risk-taking in motor decision-making, it is currently unknown whether this is a result of changes in Pavlovian biases, instrumental processes or a combination of both. Using a newly established approach-avoidance computational model together with a novel app-based motor decision-making task, we measured sensitivity to reward and punishment when participants (n = 26,532) made a ‘go/no-go’ motor gamble based on their perceived ability to execute a complex action. We show that motor decision-making can be better explained by a model with both instrumental and Pavlovian parameters, and reveal age-related changes across punishment- and reward-based instrumental and Pavlovian processes. However, the most striking effect of ageing was a decrease in Pavlovian attraction towards rewards, which was associated with a reduction in optimality of choice behaviour. In a subset of participants who also played an independent economic decision-making task (n = 17,220), we found similar decision-making tendencies for motor and economic domains across a majority of age groups. Pavlovian biases, therefore, play an important role in not only explaining motor decision-making behaviour but also the changes which occur through normal ageing. This provides a deeper understanding of the mechanisms which shape motor decision-making across the lifespan.

Decisions in everyday life often require weighing the probability of successfully executing an action (e.g., successfully crossing a street) against potential rewards and punishments. Although older individuals take fewer risks during such motor decision-making scenarios, the underlying mechanism remains unclear. Similar age-related changes in economic decision-making are explained by a decrease in Pavlovian attraction toward reward. However, despite the role of Pavlovian biases in linking action with reward and avoidance with punishment, their impact on motor decision-making is unclear. To address this, we developed a novel app-based motor decision-making task (n = 26,532). We found that motor decision-making was subject to Pavlovian influences. Although we found age-related changes for both punishment and reward-based decision-making processes, the most striking effect of ageing was a decrease in the facilitatory effect of Pavlovian attraction on action in pursuit of reward. Using data from an independent economic decision task in the same individuals (n = 17,220), we demonstrate similar decision-making tendencies for motor and economic domains across a majority of age groups. Hence, Pavlovian biases play an essential role in not only explaining motor decision-making behaviour but also the changes which occur through normal ageing.

The relationship between reinforcement and explicit control during visuomotor adaptation

The motor system’s ability to adapt to environmental changes is essential for maintaining accurate movements. Such adaptation recruits several distinct systems: cerebellar sensory-prediction error learning, success-based reinforcement, and explicit control. Although much work has focused on the relationship between cerebellar learning and explicit control, there is little research regarding how reinforcement and explicit control interact. To address this, participants first learnt a 20° visuomotor displacement. After reaching asymptotic performance, binary, hit-or-miss feedback (BF) was introduced either with or without visual feedback, the latter promoting reinforcement. Subsequently, retention was assessed using no-feedback trials, with half of the participants in each group being instructed to stop aiming off target. Although BF led to an increase in retention of the visuomotor displacement, instructing participants to stop re-aiming nullified this effect, suggesting explicit control is critical to BF-based reinforcement. In a second experiment, we prevented the expression or development of explicit control during BF performance, by either constraining participants to a short preparation time (expression) or by introducing the displacement gradually (development). Both manipulations strongly impaired BF performance, suggesting reinforcement requires both recruitment and expression of an explicit component. These results emphasise the pivotal role explicit control plays in reinforcement-based motor learning.

Contribution of explicit processes to reinforcement-based motor learning

Despite increasing interest in the role of reward in motor learning, the underlying mechanisms remain ill defined. In particular, the contribution of explicit processes to reward-based motor learning is unclear. To address this, we examined subjects' ( n = 30) ability to learn to compensate for a gradually introduced 25° visuomotor rotation with only reward-based feedback (binary success/failure). Only two-thirds of subjects ( n = 20) were successful at the maximum angle. The remaining subjects initially followed the rotation but after a variable number of trials began to reach at an insufficiently large angle and subsequently returned to near-baseline performance ( n = 10). Furthermore, those who were successful accomplished this via a large explicit component, evidenced by a reduction in reach angle when they were asked to remove any strategy they employed. However, both groups displayed a small degree of remaining retention even after the removal of this explicit component. All subjects made greater and more variable changes in reach angle after incorrect (unrewarded) trials. However, subjects who failed to learn showed decreased sensitivity to errors, even in the initial period in which they followed the rotation, a pattern previously found in parkinsonian patients. In a second experiment, the addition of a secondary mental rotation task completely abolished learning ( n = 10), while a control group replicated the results of the first experiment ( n = 10). These results emphasize a pivotal role of explicit processes during reinforcement-based motor learning, and the susceptibility of this form of learning to disruption has important implications for its potential therapeutic benefits. NEW & NOTEWORTHY We demonstrate that learning a visuomotor rotation with only reward-based feedback is principally accomplished via the development of a large explicit component. Furthermore, this form of learning is susceptible to disruption with a secondary task. The results suggest that future experiments utilizing reward-based feedback should aim to dissect the roles of implicit and explicit reinforcement learning systems. Therapeutic motor learning approaches based on reward should be aware of the sensitivity to disruption.

High motor variability in DYT1 dystonia is associated with impaired visuomotor adaptation

For the healthy motor control system, an essential regulatory role is maintaining the equilibrium between keeping unwanted motor variability in check whilst allowing informative elements of motor variability. Kinematic studies in children with generalised dystonia (due to mixed aetiologies) show that movements are characterised by increased motor variability. In this study, the mechanisms by which high motor variability may influence movement generation in dystonia were investigated. Reaching movements in the symptomatic arm of 10 patients with DYT1 dystonia and 12 age-matched controls were captured using a robotic manipulandum and features of motor variability were extracted. Given that task-relevant variability and sensorimotor adaptation are related in health, markers of variability were then examined for any co-variance with performance indicators during an error-based learning visuomotor adaptation task. First, we confirmed that motor variability on a trial-by-trial basis was selectively increased in the homogenous and prototypical dystonic disorder DYT1 dystonia. Second, high baseline variability predicted poor performance in the subsequent visuomotor adaptation task offering insight into the rules which appear to govern dystonic motor control. The potential mechanisms behind increased motor variability and its corresponding implications for the rehabilitation of patients with DYT1 dystonia are highlighted.

Neural changes associated with cerebellar tDCS studied using MR spectroscopy

Anodal cerebellar transcranial direct current stimulation (tDCS) is known to enhance motor learning, and therefore, has been suggested to hold promise as a therapeutic intervention. However, the neural mechanisms underpinning the effects of cerebellar tDCS are currently unknown. We investigated the neural changes associated with cerebellar tDCS using magnetic resonance spectroscopy (MRS). 34 healthy participants were divided into two groups which received either concurrent anodal or sham cerebellar tDCS during a visuomotor adaptation task. The anodal group underwent an additional session involving MRS in which the main inhibitory and excitatory neurotransmitters: GABA and glutamate (Glu) were measured pre-, during, and post anodal cerebellar tDCS, but without the behavioural task. We found no significant group-level changes in GABA or glutamate during- or post-tDCS compared to pre-tDCS levels, however, there was large degree of variability across participants. Although cerebellar tDCS did not affect visuomotor adaptation, surprisingly cerebellar tDCS increased motor memory retention with this being strongly correlated with a decrease in cerebellar glutamate levels during tDCS across participants. This work provides novel insights regarding the neural mechanisms which may underlie cerebellar tDCS, but also reveals limitations in the ability to produce robust effects across participants and between studies.

Reward and punishment enhance motor adaptation in stroke

BACKGROUND AND OBJECTIVE

The effects of motor learning, such as motor adaptation, in stroke rehabilitation are often transient, thus mandating approaches that enhance the amount of learning and retention. Previously, we showed in young individuals that reward and punishment feedback have dissociable effects on motor adaptation, with punishment improving adaptation and reward enhancing retention. If these findings were able to generalise to patients with stroke, they would provide a way to optimise motor learning in these patients. Therefore, we tested this in 45 patients with chronic stroke allocated in three groups.

METHODS

Patients performed reaching movements with their paretic arm with a robotic manipulandum. After training (day 1), day 2 involved adaptation to a novel force field. During the adaptation phase, patients received performance-based feedback according to the group they were allocated: reward, punishment or no feedback (neutral). On day 3, patients readapted to the force field but all groups now received neutral feedback.

RESULTS

All patients adapted, with reward and punishment groups displaying greater adaptation and readaptation than the neutral group, irrespective of demographic, cognitive or functional differences. Remarkably, the reward and punishment groups adapted to similar degree as healthy controls. Finally, the reward group showed greater retention.

CONCLUSIONS

This study provides, for the first time, evidence that reward and punishment can enhance motor adaptation in patients with stroke. Further research on reinforcement-based motor learning regimes is warranted to translate these promising results into clinical practice and improve motor rehabilitation outcomes in patients with stroke.

No consistent effect of cerebellar transcranial direct current stimulation on visuomotor adaptation

Cerebellar transcranial direct current stimulation (ctDCS) is known to enhance motor adaptation and thus holds promise as a therapeutic intervention. However, understanding the reliability of ctDCS across varying task parameters is crucial. To examine this, we investigated whether ctDCS enhanced visuomotor adaptation across a range of varying task parameters. We found ctDCS to have no consistent effect on visuomotor adaptation, questioning the validity of using ctDCS within a clinical context.

Cerebellar transcranial direct current stimulation (ctDCS) is known to enhance adaptation to a novel visual rotation (visuomotor adaptation), and it is suggested to hold promise as a therapeutic intervention. However, it is unknown whether this effect is robust across varying task parameters. This question is crucial if ctDCS is to be used clinically, because it must have a consistent and robust effect across a relatively wide range of behaviors. The aim of this study was to examine the effect of ctDCS on visuomotor adaptation across a wide range of task parameters that were systematically varied. Therefore, 192 young healthy individuals participated in 1 of 7 visuomotor adaptation experiments in either an anodal or sham ctDCS group. Each experiment examined whether ctDCS had a positive effect on adaptation when a unique feature of the task was altered: position of the monitor, offline tDCS, use of a tool, and perturbation schedule. Although we initially replicated the previously reported positive effect of ctDCS on visuomotor adaptation, this was not maintained during a second replication study or across a large range of varying task parameters. At the very least, this may call into question the validity of using ctDCS within a clinical context where a robust and consistent effect across behavior would be required.

NEW & NOTEWORTHY Cerebellar transcranial direct current stimulation (ctDCS) is known to enhance motor adaptation and thus holds promise as a therapeutic intervention. However, understanding the reliability of ctDCS across varying task parameters is crucial. To examine this, we investigated whether ctDCS enhanced visuomotor adaptation across a range of varying task parameters. We found ctDCS to have no consistent effect on visuomotor adaptation, questioning the validity of using ctDCS within a clinical context.

The Role of Dopamine in Temporal Uncertainty

The temporal preparation of motor responses to external events (temporal preparation) relies on internal representations of the accumulated elapsed time (temporal representations) before an event occurs and on estimates about its most likely time of occurrence (temporal expectations). The precision (inverse of uncertainty) of temporal preparation, however, is limited by two sources of uncertainty. One is intrinsic to the nervous system and scales with the length of elapsed time such that temporal representations are least precise for longest time durations. The other is external and arises from temporal variability of events in the outside world. The precision of temporal expectations thus decreases if events become more variable in time. It has long been recognized that the processing of time durations within the range of hundreds of milliseconds (interval timing) strongly depends on dopaminergic (DA) transmission. The role of DA for the precision of temporal preparation in humans, however, remains unclear. This study therefore directly assesses the role of DA in the precision of temporal preparation of motor responses in healthy humans. In a placebo-controlled double-blind design using a selective D2-receptor antagonist (sulpiride) and D1/D2 receptor antagonist (haloperidol), participants performed a variable foreperiod reaching task, under different conditions of internal and external temporal uncertainty. DA blockade produced a striking impairment in the ability of extracting temporal expectations across trials and on the precision of temporal representations within a trial. Large Weber fractions for interval timing, estimated by fitting subjective hazard functions, confirmed that this effect was driven by an increased uncertainty in the way participants were experiencing time. This provides novel evidence that DA regulates the precision with which we process time when preparing for an action.

Cerebellar Transcranial Direct Current Stimulation (ctDCS): A Novel Approach to Understanding Cerebellar Function in Health and Disease

The cerebellum is critical for both motor and cognitive control. Dysfunction of the cerebellum is a component of multiple neurological disorders. In recent years, interventions have been developed that aim to excite or inhibit the activity and function of the human cerebellum. Transcranial direct current stimulation of the cerebellum (ctDCS) promises to be a powerful tool for the modulation of cerebellar excitability. This technique has gained popularity in recent years as it can be used to investigate human cerebellar function, is easily delivered, is well tolerated, and has not shown serious adverse effects. Importantly, the ability of ctDCS to modify behavior makes it an interesting approach with a potential therapeutic role for neurological patients. Through both electrical and non-electrical effects (vascular, metabolic) ctDCS is thought to modify the activity of the cerebellum and alter the output from cerebellar nuclei. Physiological studies have shown a polarity-specific effect on the modulation of cerebellar–motor cortex connectivity, likely via cerebellar–thalamocortical pathways. Modeling studies that have assessed commonly used electrode montages have shown that the ctDCS-generated electric field reaches the human cerebellum with little diffusion to neighboring structures. The posterior and inferior parts of the cerebellum (i.e., lobules VI-VIII) seem particularly susceptible to modulation by ctDCS. Numerous studies have shown to date that ctDCS can modulate motor learning, and affect cognitive and emotional processes. Importantly, this intervention has a good safety profile; similar to when applied over cerebral areas. Thus, investigations have begun exploring ctDCS as a viable intervention for patients with neurological conditions.

Non-invasive cerebellar stimulation--a consensus paper

The field of neurostimulation of the cerebellum either with transcranial magnetic stimulation (TMS; single pulse or repetitive (rTMS)) or transcranial direct current stimulation (tDCS; anodal or cathodal) is gaining popularity in the scientific community, in particular because these stimulation techniques are non-invasive and provide novel information on cerebellar functions. There is a consensus amongst the panel of experts that both TMS and tDCS can effectively influence cerebellar functions, not only in the motor domain, with effects on visually guided tracking tasks, motor surround inhibition, motor adaptation and learning, but also for the cognitive and affective operations handled by the cerebro-cerebellar circuits. Verbal working memory, semantic associations and predictive language processing are amongst these operations. Both TMS and tDCS modulate the connectivity between the cerebellum and the primary motor cortex, tuning cerebellar excitability. Cerebellar TMS is an effective and valuable method to evaluate the cerebello-thalamo-cortical loop functions and for the study of the pathophysiology of ataxia. In most circumstances, DCS induces a polarity-dependent site-specific modulation of cerebellar activity. Paired associative stimulation of the cerebello-dentato-thalamo-M1 pathway can induce bidirectional long-term spike-timing-dependent plasticity-like changes of corticospinal excitability. However, the panel of experts considers that several important issues still remain unresolved and require further research. In particular, the role of TMS in promoting cerebellar plasticity is not established. Moreover, the exact positioning of electrode stimulation and the duration of the after effects of tDCS remain unclear. Future studies are required to better define how DCS over particular regions of the cerebellum affects individual cerebellar symptoms, given the topographical organization of cerebellar symptoms. The long-term neural consequences of non-invasive cerebellar modulation are also unclear. Although there is an agreement that the clinical applications in cerebellar disorders are likely numerous, it is emphasized that rigorous large-scale clinical trials are missing. Further studies should be encouraged to better clarify the role of using non-invasive neurostimulation techniques over the cerebellum in motor, cognitive and psychiatric rehabilitation strategies.

Increased use-dependent plasticity in chronic insomnia

STUDY OBJECTIVES

During normal sleep several neuroplasticity changes occur, some of which are considered to be fundamental to strengthen memories. Given the evidence linking sleep to neuroplasticity, it is conceivable that individuals with chronic sleep disruption, such as patients with chronic insomnia (CI), would experience abnormalities in neuroplastic processes during daytime. Protocols testing use-dependent plasticity (UDP), one of the mechanisms underlying formation of motor memories traces, provide a sensitive measure to assess neuroplasticity in the context of motor training.

DESIGN AND PARTICIPANTS

A well-established transcranial magnetic stimulation (TMS) paradigm was used to evaluate the ability of patients with CI and age-matched good sleeper controls to undergo UDP. We also investigated the effect of insomnia on intracortical motor excitability measures reflecting GABAergic and glutamatergic mechanisms.

SETTING

Human Brain Physiology Laboratory, Johns Hopkins Medical Institutions.

MEASUREMENTS AND RESULTS

We found that patients with CI experienced increased UDP changes relative to controls. This effect was not due to differences in motor training. In addition, patients with CI showed enhanced intracortical facilitation relative to controls, in the absence of changes in intracortical inhibitory measures.

CONCLUSION

This study provides the first evidence that patients with chronic insomnia have an increased plasticity response to physical exercise, possibly due to larger activation of glutamatergic mechanisms. This suggests a heightened state of neuroplasticity, which may reflect a form of maladaptive plasticity, similar to what has been described in dystonia patients and chronic phantom pain after amputation. These results could lead to development of novel treatments for chronic insomnia.

The Role of Dopamine in Motor Flexibility

Humans carry out many daily tasks in a seemingly automatic fashion. However, when unexpected changes in the environment occur, we have the capacity to inhibit prepotent behavior and replace it with an alternative one. Such behavioral flexibility is a hallmark of executive functions. The neurotransmitter dopamine is known to be crucial for fast, efficient, and accurate cognitive flexibility. Despite the perceived similarities between cognitive and motor flexibility, less is known regarding the role of dopamine within the motor domain. Therefore, the aim of this study was to determine the role of dopamine in motor flexibility. In a double-blind, five-session, within-subject pharmacological experiment, human participants performed an RT task within a probabilistic context that was either predictable or unpredictable. The probabilistic nature of the predictable context resulted in prediction errors. This required participants to replace the prepotent or prepared action with an unprepared action (motor flexibility). The task was overlearned, and changes in context were explicitly instructed, thus controlling for contributions from other dopamine-related processes such as probabilistic or reversal learning and interactions with other types of uncertainty. We found that dopamine receptor blockade by high-dose haloperidol (D1/D2 dopamine receptors) impaired participants' ability to react to unexpected events occurring in a predictable context, which elicit large prediction errors and necessitate motor flexibility. This effect was not observed with selective D2 receptor blockade (sulpiride), with a general increase in tonic dopamine levels (levodopa), or during an unpredictable context, which evoked minimal prediction error. We propose that dopamine is vital in responding to low-level prediction errors about stimulus outcome that requires motor flexibility.

Laterality Differences in Cerebellar-Motor Cortex Connectivity

Lateralization of function is an important organizational feature of the motor system. Each effector is predominantly controlled by the contralateral cerebral cortex and the ipsilateral cerebellum. Transcranial magnetic stimulation studies have revealed hemispheric differences in the stimulation strength required to evoke a muscle response from the primary motor cortex (M1), with the dominant hemisphere typically requiring less stimulation than the nondominant. The current study assessed whether the strength of the connection between the cerebellum and M1 (CB-M1), known to change in association with motor learning, have hemispheric differences and whether these differences have any behavioral correlate. We observed, in right-handed individuals, that the connection between the right cerebellum and left M1 is typically stronger than the contralateral network. Behaviorally, we detected no lateralized learning processes, though we did find a significant effect on the amplitude of reaching movements across hands. Furthermore, we observed that the strength of the CB-M1 connection is correlated with the amplitude variability of reaching movements, a measure of movement precision, where stronger connectivity was associated with better precision. These findings indicate that lateralization in the motor system is present beyond the primary motor cortex, and points to an association between cerebellar M1 connectivity and movement execution.

Punishment-induced behavioral and neurophysiological variability reveals dopamine-dependent selection of kinematic movement parameters

Action selection describes the high-level process that selects between competing movements. In animals, behavioral variability is critical for the motor exploration required to select the action that optimizes reward and minimizes cost/punishment and is guided by dopamine (DA). The aim of this study was to test in humans whether low-level movement parameters are affected by punishment and reward in ways similar to high-level action selection. Moreover, we addressed the proposed dependence of behavioral and neurophysiological variability on DA and whether this may underpin the exploration of kinematic parameters. Participants performed an out-and-back index finger movement and were instructed that monetary reward and punishment were based on its maximal acceleration (MA). In fact, the feedback was not contingent on the participant's behavior but predetermined. Blocks highly biased toward punishment were associated with increased MA variability relative to blocks either with reward or without feedback. This increase in behavioral variability was positively correlated with neurophysiological variability, as measured by changes in corticospinal excitability with transcranial magnetic stimulation over the primary motor cortex. Following the administration of a DA antagonist, the variability associated with punishment diminished and the correlation between behavioral and neurophysiological variability no longer existed. Similar changes in variability were not observed when participants executed a predetermined MA, nor did DA influence resting neurophysiological variability. Thus, under conditions of punishment, DA-dependent processes influence the selection of low-level movement parameters. We propose that the enhanced behavioral variability reflects the exploration of kinematic parameters for less punishing, or conversely more rewarding, outcomes.

Muscle and timing-specific functional connectivity between the dorsolateral prefrontal cortex and the primary motor cortex

The pFC has a crucial role in cognitive control, executive function, and sensory processing. Functional imaging, neurophysiological, and animal studies provide evidence for a functional connectivity between the dorsolateral pFC (DLPFC) and the primary motor cortex (M1) during free choice but not instructed choice selection tasks. In this study, twin coil, neuronavigated TMS was used to examine the precise timing of the functional interaction between human left DLPFC and ipsilateral M1 during the execution of a free/specified choice selection task involving the digits of the right hand. In a thumb muscle that was not involved in the task, a conditioning pulse to the left DLPFC enhanced the excitability of the ipsilateral M1 during free selection more than specified selection 100 msec after presentation of the cue; the opposite effect was seen at 75 msec. However, the difference between free and externally specified conditions disappeared when a task-specific muscle was investigated. In this case, the influence from DLPFC was dominated by task involvement rather than mode of selection, suggesting that other processes related to movement execution were also operating. Finally, we show that the effects were spatially specific because they were absent when an adjacent area of DLPFC was stimulated. These results reveal temporally and spatially selective interactions between BA 46 and M1 that are both task and muscle specific.

Cerebellar modulation of human associative plasticity

Paired associative stimulation (PAS) is a method commonly used in human studies of motor cortex synaptic plasticity. It involves repeated pairs of electrical stimuli to the median nerve and transcranial magnetic stimulation (TMS) of the motor cortex. If the interval between peripheral and TMS stimulation is around 21–25 ms, corticospinal excitability is increased for the following 30–60 min via a long term potentiation (LTP)-like effect within the primary motor cortex. Previous work has shown that PAS depends on the present and previous levels of activity in cortex, and that it can be modified by motor learning or attention. Here we show that simultaneous transcranial direct current stimulation (TDCS; 2 mA) over the cerebellum can abolish the PAS effect entirely. Surprisingly, the effect is seen when the PAS interval is 25 ms but not when it is 21.5 ms. There are two implications from this work. First, the cerebellum influences PAS effects in motor cortex; second, LTP-like effects of PAS have at least two different mechanisms. The results are relevant for interpretation of pathological changes that have been reported in response to PAS in people with movement disorders and to changes in healthy individuals following exercise or other interventions.

Dopamine, affordance and active inference

The role of dopamine in behaviour and decision-making is often cast in terms of reinforcement learning and optimal decision theory. Here, we present an alternative view that frames the physiology of dopamine in terms of Bayes-optimal behaviour. In this account, dopamine controls the precision or salience of (external or internal) cues that engender action. In other words, dopamine balances bottom-up sensory information and top-down prior beliefs when making hierarchical inferences (predictions) about cues that have affordance. In this paper, we focus on the consequences of changing tonic levels of dopamine firing using simulations of cued sequential movements. Crucially, the predictions driving movements are based upon a hierarchical generative model that infers the context in which movements are made. This means that we can confuse agents by changing the context (order) in which cues are presented. These simulations provide a (Bayes-optimal) model of contextual uncertainty and set switching that can be quantified in terms of behavioural and electrophysiological responses. Furthermore, one can simulate dopaminergic lesions (by changing the precision of prediction errors) to produce pathological behaviours that are reminiscent of those seen in neurological disorders such as Parkinson's disease. We use these simulations to demonstrate how a single functional role for dopamine at the synaptic level can manifest in different ways at the behavioural level.

Direct-current-dependent shift of theta-burst-induced plasticity in the human motor cortex

Animal studies using polarising currents have shown that induction of synaptic long-term potentiation (LTP) and long-term depression (LTD) by bursts of patterned stimulation is affected by the membrane potential of the postsynaptic neurone. The aim of the present experiments was to test whether it is possible to observe similar phenomena in humans with the aim of improving present protocols of inducing synaptic plasticity for therapeutic purposes. We tested whether the LTP/LTD-like after effects of transcranial theta-burst stimulation (TBS) of human motor cortex, an analogue of patterned electrical stimulation in animals, were affected by simultaneous transcranial direct-current stimulation (tDCS), a non-invasive method of polarising cortical neurones in humans. Nine healthy volunteers were investigated in a single-blind, balanced cross-over study; continuous TBS (cTBS) was used to introduce LTD-like after effects, whereas intermittent TBS (iTBS) produced LTP-like effects. Each pattern was coupled with concurrent application of tDCS (<200 s, anodal, cathodal, sham). Cathodal tDCS increased the response to iTBS and abolished the effects of cTBS. Anodal tDCS changed the effects of cTBS towards facilitation, but had no impact on iTBS. Cortical motor thresholds and intracortical inhibitory/facilitatory networks were not altered by any of the stimulation protocols. We conclude that the after effects of TBS can be modulated by concurrent tDCS. We hypothesise that tDCS changes the membrane potential of the apical dendrites of cortical pyramidal neurones and that this changes the response to patterned synaptic input evoked by TBS. The data show that it may be possible to enhance LTP-like plasticity after TBS in the human cortex.

Speech facilitation by left inferior frontal cortex stimulation

Electrophysiological studies in humans and animals suggest that noninvasive neurostimulation methods such as transcranial direct current stimulation (tDCS) can elicit long-lasting [1], polarity-dependent [2] changes in neocortical excitability. Application of tDCS can have significant and selective behavioral consequences that are associated with the cortical location of the stimulation electrodes and the task engaged during stimulation [3–8]. However, the mechanism by which tDCS affects human behavior is unclear. Recently, functional magnetic resonance imaging (fMRI) has been used to determine the spatial topography of tDCS effects [9–13], but no behavioral data were collected during stimulation. The present study is unique in this regard, in that both neural and behavioral responses were recorded using a novel combination of left frontal anodal tDCS during an overt picture-naming fMRI study. We found that tDCS had significant behavioral and regionally specific neural facilitation effects. Furthermore, faster naming responses correlated with decreased blood oxygen level-dependent (BOLD) signal in Broca's area. Our data support the importance of Broca's area within the normal naming network and as such indicate that Broca's area may be a suitable candidate site for tDCS in neurorehabilitation of anomic patients, whose brain damage spares this region.

Disrupting the ventral premotor cortex interferes with the contribution of action observation to use-dependent plasticity

Action observation (AO), observing another individual perform an action, has been implicated in several higher cognitive processes including forming basic motor memories. Previous work has shown that physical practice (PP) results in cortical motor representational changes, referred to as use-dependent plasticity (UDP), and that AO combined with PP potentiates UDP in both healthy adults and stroke patients. In humans, AO results in activation of the ventral premotor cortex (PMv), however, whether this PMv activation has a functional contribution to UDP is not known. Here, we studied the effects disruption of PMv has on UDP when subjects performed PP combined with AO (PP + AO). Subjects participated in two randomized crossover sessions measuring the amount of UDP resulting from PP + AO while receiving disruptive (1 Hz) TMS over the fMRI-activated PMv or over frontal cortex (Sham). We found that, unlike the sham session, disruptive TMS over PMv reduced the beneficial contribution of AO to UDP. To ensure that disruption of PMv was specifically interfering with the contribution of AO and not PP, subjects completed two more control sessions where they performed only PP while receiving disruptive TMS over PMv or frontal cortex. We found that the magnitude of UDP for both control sessions was similar to PP + AO with TMS over PMv. These findings suggest that the fMRI activation found in PMv during AO studies is functionally relevant to task performance, at least for the beneficial effects that AO exerts over motor training.

Human locomotor adaptive learning is proportional to depression of cerebellar excitability

Human locomotor adaptive learning is thought to involve the cerebellum, but the neurophysiological mechanisms underlying this process are not known. While animal research has pointed to depressive modulation of cerebellar outputs, a direct correlation between adaptive learning and cerebellar depression has never been demonstrated. Here, we used transcranial magnetic stimulation to assess excitability changes occurring in the cerebellum and primary motor cortex (M1) after individuals learned a new locomotor pattern on a split-belt treadmill. To control for potential changes associated to task performance complexity, the same group of subjects was also assessed after performing 2 other locomotor tasks that did not elicit learning. We found that only adaptive learning resulted in reduction of cerebellar inhibition. This effect was strongly correlated with the magnitude of learning (r = 0.78). In contrast, M1 excitability changes were not specific to learning but rather occurred in association with task complexity performance. Our results demonstrate that locomotor adaptive learning in humans is proportional to cerebellar excitability depression. This finding supports the theory that adaptive learning is mediated, at least in part, by long-term depression in Purkinje cells. This knowledge opens the opportunity to target cerebellar processes with noninvasive brain stimulation to enhance motor learning.

Dissociating the roles of the cerebellum and motor cortex during adaptive learning: the motor cortex retains what the cerebellum learns

Adaptation to a novel visuomotor transformation has revealed important principles regarding learning and memory. Computational and behavioral studies have suggested that acquisition and retention of a new visuomotor transformation are distinct processes. However, this dissociation has never been clearly shown. Here, participants made fast reaching movements while unexpectedly a 30-degree visuomotor transformation was introduced. During visuomotor adaptation, subjects received cerebellar, primary motor cortex (M1) or sham anodal transcranial direct current stimulation (tDCS), a noninvasive form of brain stimulation known to increase excitability. We found that cerebellar tDCS caused faster adaptation to the visuomotor transformation, as shown by a rapid reduction of movement errors. These findings were not present with similar modulation of visual cortex excitability. In contrast, tDCS over M1 did not affect adaptation, but resulted in a marked increase in retention of the newly learnt visuomotor transformation. These results show a clear dissociation in the processes of acquisition and retention during adaptive motor learning and demonstrate that the cerebellum and primary motor cortex have distinct functional roles. Furthermore, they show that is possible to enhance cerebellar function using tDCS.

Disruption of the dorsolateral prefrontal cortex facilitates the consolidation of procedural skills

In explicit sequence learning tasks, an improvement in performance (skill) typically occurs after sleep-leading to the recent literature on sleep-dependent motor consolidation. Consolidation can also be facilitated during wakefulness if declarative knowledge for the sequence is reduced through a secondary cognitive task. Accordingly, declarative and procedural consolidation processes appear to mutually interact. Here we used TMS to test the hypothesis that functions in the dorsolateral prefrontal cortex (DLPFC) that support declarative memory formation indirectly reduce the formation of procedural representations. We hypothesize that disrupting the DLPFC immediately after sequence learning would degrade the retention or the consolidation of the sequence within the declarative memory system and thus facilitate consolidation within procedural memory systems, evident as wakeful off-line skill improvement. Inhibitory theta-burst TMS was applied to the left DLPFC (n = 10), to the right DLPFC (n = 10), or to an occipital cortical control site (n = 10) immediately after training on the serial reaction time task (SRTT). All groups were retested after eight daytime hours without sleep. TMS of either left or right DLPFC lead to skill improvements on the SRTT. Increase in skill was greater following right DLPFC stimulation than left DLPFC stimulation; there was no improvement in skill for the control group. Across all participants, free recall of the sequence was inversely related to the improvements in performance on the SRTT. These results support the hypothesis of interference between declarative and procedural consolidation processes and are discussed in the framework of the interactions between memory systems.

Secondary tasks impair adaptation to step- and gradual-visual displacements

Motor adaptation is impaired by the performance of a secondary task which divides cognitive resources. Additionally, we previously reported slowed adaptation when participants were required to switch from one visual displacement adaptation task to another. Here, we examined whether a dividing secondary task had a similar effect on adaptation as switching between opposing visual displacements. The resource-dividing task involved simultaneously adapting to a step-visual displacement whilst vocally shadowing an auditory stimulus. The switching task required participants to adapt to opposing visual displacements in an alternating manner with the left and right hands. We found that both manipulations had a detrimental effect on adaptation rate. We then integrated these tasks and found the combination caused a greater decrease in adaptation rate than either manipulation in isolation. A second set of experiments showed that adaptation to a gradually imposed visual displacement was influenced in a similar manner to step adaptation. In summary, step adaptation slows the learning rate of gradual adaptation to a large degree, whereas gradual adaptation only slightly slows the learning rate of step adaptation. Therefore, although gradual adaptation involves minimal awareness it can still be disrupted with a cognitively demanding secondary task. We propose that awareness and cognitive resource can be regarded as qualitatively different, but that awareness may be a marker of the amount of resource required. For example, large errors are both noticed and require substantial cognitive resource. However, a lack of awareness does not mean an adaptation task will be resistant to interference from a resource-consuming secondary task.

Brain polarization enhances the formation and retention of motor memories

One of the first steps in the acquisition of a new motor skill is the formation of motor memories. Here we tested the capacity of transcranial DC stimulation (tDCS) applied over the motor cortex during motor practice to increase motor memory formation and retention. Nine healthy individuals underwent a crossover transcranial magnetic stimulation (TMS) study designed to test motor memory formation resulting from training. Anodal tDCS elicited an increase in the magnitude and duration of motor memories in a polarity-specific manner, as reflected by changes in the kinematic characteristics of TMS-evoked movements after anodal, but not cathodal or sham stimulation. This effect was present only when training and stimulation were associated and mediated by a differential modulation of corticomotor excitability of the involved muscles. These results indicate that anodal brain polarization can enhance the initial formation and retention of a new motor memory resulting from training. These processes may be the underlying mechanisms by which tDCS enhances motor learning.

Asymmetric interlimb transfer of concurrent adaptation to opposing dynamic forces

Interlimb transfer of a novel dynamic force has been well documented. It has also been shown that unimanual adaptation to opposing novel environments is possible if they are associated with different workspaces. The main aim of this study was to test if adaptation to opposing velocity dependent viscous forces with one arm could improve the initial performance of the other arm. The study also examined whether this interlimb transfer occurred across an extrinsic, spatial, coordinative system or an intrinsic, joint based, coordinative system. Subjects initially adapted to opposing viscous forces separated by target location. Our measure of performance was the correlation between the speed profiles of each movement within a force condition and an ‘average’ trajectory within null force conditions. Adaptation to the opposing forces was seen during initial acquisition with a significantly improved coefficient in epoch eight compared to epoch one. We then tested interlimb transfer from the dominant to non-dominant arm (D → ND) and vice-versa (ND → D) across either an extrinsic or intrinsic coordinative system. Interlimb transfer was only seen from the dominant to the non-dominant limb across an intrinsic coordinative system. These results support previous studies involving adaptation to a single dynamic force but also indicate that interlimb transfer of multiple opposing states is possible. This suggests that the information available at the level of representation allowing interlimb transfer can be more intricate than a general movement goal or a single perceived directional error.

Concurrent adaptation to opposing visual displacements during an alternating movement

It has been suggested that, during tasks in which subjects are exposed to a visual rotation of cursor feedback, alternating bimanual adaptation to opposing rotations is as rapid as unimanual adaptation to a single rotation (Bock et al. in Exp Brain Res 162:513–519, 2005). However, that experiment did not test strict alternation of the limbs but short alternate blocks of trials. We have therefore tested adaptation under alternate left/right hand movement with opposing rotations. It was clear that the left and right hand, within the alternating conditions, learnt to adapt to the opposing displacements at a similar rate suggesting that two adaptive states were formed concurrently. We suggest that the separate limbs are used as contextual cues to switch between the relevant adaptive states. However, we found that during online correction the alternating conditions had a significantly slower rate of adaptation in comparison to the unimanual conditions. Control conditions indicate that the results are not directly due the alternation between limbs or to the constant switching of vision between the two eyes. The negative interference may originate from the requirement to dissociate the visual information of these two alternating displacements to allow online control of the two arms.