Unlearning versus savings in visuomotor adaptation: comparing effects of washout, passage of time, and removal of errors on motor memory

Distinct learning, retention, and generalization patterns in de novo learning versus motor adaptation

People correct for movement errors when acquiring new motor skills (de novo learning) or adapting well-known movements (motor adaptation). While de novo learning establishes new control policies, adaptation modifies existing ones, and previous work have distinguished behavioral and underlying brain mechanisms for each motor learning type. However, it is still unclear whether learning in each type interferes with the other. In study 1, we use a within-subjects design where participants train with both 30° visuomotor rotation and mirror reversal perturbations, to compare adaptation and de novo learning respectively. We find no perturbation order effects, and find no evidence for differences in learning rates and asymptotes for both perturbations. Explicit instructions also provide an advantage during early learning in both perturbations. However, mirror reversal learning shows larger inter-participant variability and slower movement initiation. Furthermore, we only observe reach aftereffects following rotation training. In study 2, we incorporate the mirror reversal in a browser-based task, to investigate under-studied de novo learning mechanisms like retention and generalization. Learning persists across three or more days, substantially transfers to the untrained hand, and to targets on both sides of the mirror axis. Our results extend insights for distinguishing motor skill acquisition from adapting well-known movements.

The cerebellum acts as the analog to the medial temporal lobe for sensorimotor memory

The cerebellum is critical for sensorimotor learning. The specific contribution that it makes, however, remains unclear. Inspired by the classic finding that, for declarative memories, medial temporal lobe structures provide a gateway to the formation of long-term memory but are not required for short-term memory, we hypothesized that, for sensorimotor memories, the cerebellum may play an analogous role. Here we studied the sensorimotor learning of individuals with severe ataxia from cerebellar degeneration. We dissected the memories they formed during sensorimotor learning into a short-term temporally-volatile component, that decays rapidly with a time constant of just 15-20sec and thus cannot lead to long-term retention, and a longer-term temporally-persistent component that is stable for 60 sec or more and leads to long-term retention. Remarkably, we find that these individuals display dramatically reduced levels of temporally-persistent sensorimotor memory, despite spared and even elevated levels of temporally-volatile sensorimotor memory. In particular, we find both impairment that systematically increases with memory window duration over shorter memory windows (<12 sec) and near-complete impairment of memory maintenance over longer memory windows (>25 sec). This dissociation uncovers a new role for the cerebellum as a gateway for the formation of long-term but not short-term sensorimotor memories, mirroring the role of the medial temporal lobe for declarative memories. It thus reveals the existence of distinct neural substrates for short-term and long-term sensorimotor memory, and it explains both newly-identified trial-to-trial differences and long-standing study-to-study differences in the effects of cerebellar damage on sensorimotor learning ability.

Significance Statement

A key discovery about the neural underpinnings of memory, made more than half a century ago, is that long-term, but not short-term, memory formation depends on neural structures in the brain's medial temporal lobe (MTL). However, this dichotomy holds only for declarative memories - memories for explicit facts such as names and dates - as long-term procedural memories - memories for implicit knowledge such as sensorimotor skills - are largely unaffected even with substantial MTL damage. Here we demonstrate that the formation of long-term, but not short-term, sensorimotor memory depends on a neural structure known as the cerebellum, and we show that this finding explains the variability previously reported in the extent to which cerebellar damage affects sensorimotor learning.

Movement-goal relevant object shape properties act as poor but viable cues for the attribution of motor errors to external objects

When a context change is detected during motor learning, motor memories-internal models for executing movements within some context-may be created or existing motor memories may be activated and modified. Assigning credit to plausible causes of errors can allow for fast retrieval and activation of a motor memory, or a combination of motor memories, when the presence of such causes is detected. Features of the movement-context intrinsic to the movement dynamics, such as posture of the end effector, are often effective cues for detecting context change whereas features extrinsic to the movement dynamics, such as the colour of an object being moved, are often not. These extrinsic cues are typically not relevant to the motor task at hand and can be safely ignored by the motor system. We conducted two experiments testing if extrinsic but movement-goal relevant object-shape cues during an object-transport task can act as viable contextual cues for error assignment to the object, and the creation of new, object-shape-associated motor memories. In the first experiment we find that despite the object-shape cues, errors are primarily attributed to the hand transporting the object. In a second experiment, we find participants can execute differing movements cued by the object shape in a dual adaptation task, but the extent of adaptation is small, suggesting that movement-goal relevant object-shape properties are poor but viable cues for creating context specific motor memories.

The effects of a single bout of moderate-intensity aerobic exercise on visuomotor adaptation and its savings

Performing exercise before or after motor skill learning is thought to have a positive impact on acquisition and retention of motor memories stored in our nervous system. It has been shown that performing 25 min of moderate-intensity aerobic exercise prior to visuomotor adaptation can enhance both visuomotor adaptation and its retention compared to 25 min of rest before the adaptation. To determine whether a single bout of aerobic exercise could actually facilitate the formation of a neural representation associated with a novel visuomotor condition, we examined aftereffects and savings associated with a visuomotor adaptation task following either an exercise or a rest condition. Sixteen healthy young individuals (18-35 years) first experienced 25 min of moderate-intensity cycling or rest, and then adapted to a 30-degree visuomotor rotation condition. Immediately following that, participants experienced a washout session, which was followed by a readaptation session. Results indicated that all subjects adapted to the visuomotor rotation completely, although no difference was found between the cycling and rest conditions. Aftereffects and savings were also observed in both conditions, but with no difference between the conditions. These findings suggest that compared to a short rest session, a single bout of moderate-intensity cycling may not have a greater impact for enhancing visuomotor adaptation and its retention. Further research is needed, in which the effects of certain factors such as exercise intensity, duration and timing are more systematically investigated.

Neural representations for multi-context visuomotor adaptation and the impact of common representation on multi-task performance: a multivariate decoding approach

The human brain's remarkable motor adaptability stems from the formation of context representations and the use of a common context representation (e.g., an invariant task structure across task contexts) derived from structural learning. However, direct evaluation of context representations and structural learning in sensorimotor tasks remains limited. This study aimed to rigorously distinguish neural representations of visual, movement, and context levels crucial for multi-context visuomotor adaptation and investigate the association between representation commonality across task contexts and adaptation performance using multivariate decoding analysis with fMRI data. Here, we focused on three distinct task contexts, two of which share a rotation structure (i.e., visuomotor rotation contexts with -90° and +90° rotations, in which the mouse cursor's movement was rotated 90 degrees counterclockwise and clockwise relative to the hand-movement direction, respectively) and the remaining one does not (i.e., mirror-reversal context where the horizontal movement of the computer mouse was inverted). This study found that visual representations (i.e., visual direction) were decoded in the occipital area, while movement representations (i.e., hand-movement direction) were decoded across various visuomotor-related regions. These findings are consistent with prior research and the widely recognized roles of those areas. Task-context representations (i.e., either -90° rotation, +90° rotation, or mirror-reversal) were also distinguishable in various brain regions. Notably, these regions largely overlapped with those encoding visual and movement representations. This overlap suggests a potential intricate dependency of encoding visual and movement directions on the context information. Moreover, we discovered that higher task performance is associated with task-context representation commonality, as evidenced by negative correlations between task performance and task-context-decoding accuracy in various brain regions, potentially supporting structural learning. Importantly, despite limited similarities between tasks (e.g., rotation and mirror-reversal contexts), such association was still observed, suggesting an efficient mechanism in the brain that extracts commonalities from different task contexts (such as visuomotor rotations or mirror-reversal) at multiple structural levels, from high-level abstractions to lower-level details. In summary, while illuminating the intricate interplay between visuomotor processing and context information, our study highlights the efficiency of learning mechanisms, thereby paving the way for future exploration of the brain's versatile motor ability.

The Influence of Age and Physical Activity on Locomotor Adaptation

BACKGROUND

Aging increases individual susceptibility to falls and injuries, suggesting poorer adaptation of balance responses to perturbation during locomotion, which can be measured with the locomotor adaptation task (LAT). However, it is unclear how aging and lifestyle factors affect these responses during walking. Hence, the present study investigates the relationship between balance and lifestyle factors during the LAT in healthy individuals across the adult lifespan using a correlational design.

METHODS

Thirty participants aged 20-78 years performed an LAT on a split-belt treadmill (SBT). We evaluated the magnitude and rate of adaptation and deadaptation during the LAT. Participants reported their lifelong physical and cognitive activity.

RESULTS

Age positively correlated with gait-line length asymmetry at the late post-adaptation phase (p = 0.007). These age-related effects were mediated by recent physical activity levels (p = 0.040).

CONCLUSION

Our results confirm that locomotor adaptive responses are preserved in aging, but the ability to deadapt newly learnt balance responses is compromised with age. Physical activity mediates these age-related effects. Therefore, gait symmetry post-adaptation could effectively measure the risk of falling, and maintaining physical activity could protect against declines in balance.

Boost your brain: a simple 100% normobaric oxygen treatment improves human motor learning processes

Introduction

Human motor learning processes are a fundamental part of our daily lives and can be adversely affected by neurologic conditions. Motor learning largely depends on successfully integrating cognitive and motor-related sensory information, and a simple, easily accessible treatment that could enhance such processes would be exciting and clinically impactful. Normobaric 100% oxygen treatment (NbOxTr) is often used as a first-line intervention to improve survival rates of brain cells in neurological trauma, and recent work indicates that improvements in elements crucial for cognitive-motor-related functions can occur during NbOxTr. However, whether NbOxTr can enhance the motor learning processes of healthy human brains is unknown. Here, we investigated whether a brief NbOxTr administered via nasal cannula improves motor learning processes during a visuomotor adaptation task where participants adapt to a visual distortion between visual feedback and hand movements.

Methods

40 healthy young adults (M = 21 years) were randomly assigned to a NbOxTr (N = 20; 100% oxygen) or air (N = 20; regular air) group and went through four typical visuomotor adaptation phases (Baseline, Adaptation, After-Effect, Refresher). Gas treatment (flow rate 5 L/min) was only administered during the Adaptation phase of the visuomotor experiment, in both groups.

Results

The NbOxTr provided during the Adaptation phase led to significantly faster and about 30% improved learning (p < 0.05). Notably, these motor learning improvements consolidated into the subsequent experiment phases, i.e., after the gas treatment was terminated (p < 0.05).

Discussion

We conclude that this simple and brief NbOxTr dramatically improved fundamental human motor learning processes and may provide promising potential for neurorehabilitation and skill-learning approaches. Further studies should investigate whether similar improvements exist in elderly and neurologically impaired individuals, other motor learning tasks, and also long-lasting effects.

Memory decay and generalization following distinct motor learning mechanisms

Motor skill learning is considered to arise out of contributions from multiple learning mechanisms, including error-based learning (EBL), use-dependent learning (UDL), and reinforcement learning (RL). These learning mechanisms exhibit dissociable roles and engage different neural circuits during skill acquisition. However, it remains largely unknown how a newly formed motor memory acquired through each learning mechanism decays over time and whether distinct learning mechanisms produce different generalization patterns. Here, we used variants of reaching paradigms that dissociated these learning mechanisms to examine the time course of memory decay following each learning and the generalization patterns of each learning. We found that motor memories acquired through these learning mechanisms decayed as a function of time. Notably, 15 min, 6 h, and 24 h after acquisition, the memory of EBL decayed much greater than that of RL. The memory acquired through UDL faded away within a few minutes. Motor memories formed through EBL and RL for given movement directions generalized to untrained movement directions, with the generalization of EBL being greater than that of RL. In contrast, motor memory of UDL could not generalize to untrained movement directions. These results suggest that distinct learning mechanisms exhibit different patterns of memory decay and generalization.NEW & NOTEWORTHY Motor skill learning is likely to involve error-based learning, use-dependent plasticity, and operant reinforcement. Here, we showed that these dissociable learning mechanisms exhibited distinct patterns of memory decay and generalization. With a better understanding of the characteristics of these learning mechanisms, it becomes possible to regulate each learning process separately to improve neurological rehabilitation.

Random Practice Enhances Retention and Spatial Transfer in Force Field Adaptation

The contextual-interference effect is a frequently examined phenomenon in motor skill learning but has not been extensively investigated in motor adaptation. Here, we first tested experimentally if the contextual-interference effect is detectable in force field adaptation regarding retention and spatial transfer, and then fitted state-space models to the data to relate the findings to the “forgetting-and-reconstruction hypothesis”. Thirty-two participants were divided into two groups with either a random or a blocked practice schedule. They practiced reaching to four targets and were tested 10 min and 24 h afterward for motor retention and spatial transfer on an interpolation and an extrapolation target, and on targets which were shifted 10 cm away. The adaptation progress was participant-specifically fitted with 4-slow-1-fast state-space models accounting for generalization and set breaks. The blocked group adapted faster (p = 0.007) but did not reach a better adaptation at practice end. We found better retention (10 min), interpolation transfer (10 min), and transfer to shifted targets (10 min and 24 h) for the random group (each p < 0.05). However, no differences were found for retention or for the interpolation target after 24 h. Neither group showed transfer to the extrapolation target. The extended state-space model could replicate the behavioral results with some exceptions. The study shows that the contextual-interference effect is partially detectable in practice, short-term retention, and spatial transfer in force field adaptation; and that state-space models provide explanatory descriptions for the contextual-interference effect in force field adaptation.

Competition between parallel sensorimotor learning systems

Sensorimotor learning is supported by at least two parallel systems: a strategic process that benefits from explicit knowledge and an implicit process that adapts subconsciously. How do these systems interact? Does one system’s contributions suppress the other, or do they operate independently? Here, we illustrate that during reaching, implicit and explicit systems both learn from visual target errors. This shared error leads to competition such that an increase in the explicit system’s response siphons away resources that are needed for implicit adaptation, thus reducing its learning. As a result, steady-state implicit learning can vary across experimental conditions, due to changes in strategy. Furthermore, strategies can mask changes in implicit learning properties, such as its error sensitivity. These ideas, however, become more complex in conditions where subjects adapt using multiple visual landmarks, a situation which introduces learning from sensory prediction errors in addition to target errors. These two types of implicit errors can oppose each other, leading to another type of competition. Thus, during sensorimotor adaptation, implicit and explicit learning systems compete for a common resource: error.

The decay and consolidation of effector-independent motor memories

Learning a motor adaptation task produces intrinsically unstable or transient motor memories. Despite the presence of effector-independent motor memories following the learning of novel environmental dynamics, it remains largely unknown how those memory traces decay in different contexts and whether an "offline" consolidation period protects memories against decay. Here, we exploit inter-effector transfer to address these questions. We found that newly acquired motor memories formed with one effector could be partially retrieved by the untrained effector to enhance its performance when the decay occurred with the passage of time or "washout" trials on which error feedback was provided. The decay of motor memories was slower following "error-free" trials, on which errors were artificially clamped to zero or removed, compared with "washout" trials. However, effector-independent memory components were abolished following movements made in the absence of task errors, resulting in no transfer gains. The brain can stabilize motor memories during daytime wakefulness. We found that 6 h of wakeful resting increased the resistance of effector-independent memories to decay. Collectively, our results suggest that the decay of effector-independent motor memories is context-dependent, and offline processing preserves those memories against decay, leading to improvements of the subsequent inter-effector transfer.

The influence of awareness on implicit visuomotor adaptation

It is well documented that reaches are adapted when reaching with a visuomotor distortion (i.e., rotated cursor feedback). Less clear is the influence of awareness on visuomotor adaptation, where awareness encompasses knowledge of the changes in one's reaches and the visuomotor distortion itself. In the current experiment, we asked if awareness governs the magnitude of implicit (i.e., unconscious) visuomotor adaptation achieved, independent of how the distortion is introduced (i.e., abruptly vs. gradually introduced visuomotor distortion), and hence initial errors experienced. Participants were divided into two groups that differed with respect to how the visuomotor distortion was introduced (i.e., Abrupt vs. Gradual Groups) and reached in a virtual environment where a cursor on the screen misrepresented the position of their hand. Participants completed three blocks of 150 reach training trials in the following order: aligned cursor feedback (baseline), rotated cursor feedback (adaptation) and aligned cursor feedback (washout). For the Abrupt Group, the cursor was immediately rotated 45° clockwise (CW) relative to hand motion in the adaptation block, whereas in the Gradual Group, the 45° cursor rotation was gradually introduced over adaptation trials. Following reach training, participants' awareness of changes in their reaches and the visuomotor distortion were established based on a drawing task, where participants drew the path their hand took to get the cursor on target, as well as a post-experiment questionnaire. Participants were subsequently divided into the following 3 groups: Abrupt-Aware (n = 16), Gradual-Aware (n = 11) and Gradual-Unaware (n = 14). Results revealed that errors differed for the Gradual-Unaware Group at the end of adaptation training compared to the Gradual-Aware Group and at the start of the washout block compared to the Abrupt-Aware Group. Errors in the two aware groups did not differ from each other. These results suggest that awareness may lead to reduced implicit adaptation, regardless of the size of initial errors experienced.

Evidence that endpoint feedback facilitates intermanual transfer of visuomotor force learning by a cognitive strategy

Humans continuously adapt their movement to a novel environment by recalibrating their sensorimotor system. Recent evidence, however, shows that explicit planning to compensate for external changes, i.e., a cognitive strategy, can also aid performance. If such a strategy is planned in external space, it should improve performance in an effector-independent manner. We tested this hypothesis by examining whether promoting a cognitive strategy during a visual-force adaptation task performed in one hand can facilitate learning for the opposite hand. Participants rapidly adjusted the height of visual bar on screen to a target level by isometrically exerting force on a handle using their right hand. Visuomotor gain increased during the task and participants learned the increased gain. Visual feedback was continuously provided for one group, whereas for another group only the endpoint of the force trajectory was presented. The latter has been reported to promote cognitive strategy use. We found that endpoint feedback produced stronger intermanual transfer of learning and slower response times than continuous feedback. In a separate experiment, we found evidence that aftereffects are reduced when only endpoint feedback is provided, a finding that has been consistently observed when cognitive strategies are used. The results suggest that intermanual transfer can be facilitated by a cognitive strategy. This indicates that the behavioral observation of intermanual transfer can be achieved either by forming an effector-independent motor representation or by sharing an effector-independent cognitive strategy between the hands.

NEW & NOTEWORTHY The causes and consequences of cognitive strategy use are poorly understood. We tested whether a visuomotor task learned in a manner that may promote cognitive strategy use causes greater generalization across effectors. Visual feedback was manipulated to promote cognitive strategy use. Learning consistent with cognitive strategy use for one hand transferred to the unlearned hand. Our result suggests that intermanual transfer can result from a common cognitive strategy used to control both hands.

Contextual inference underlies the learning of sensorimotor repertoires

ASBTRACT

Humans spend a lifetime learning, storing and refining a repertoire of motor memories. For example, through experience, we become proficient at manipulating a large range of objects with distinct dynamical properties. However, it is unknown what principle underlies how our continuous stream of sensorimotor experience is segmented into separate memories and how we adapt and use this growing repertoire. Here we develop a theory of motor learning based on the key principle that memory creation, updating and expression are all controlled by a single computation-contextual inference. Our theory reveals that adaptation can arise both by creating and updating memories (proper learning) and by changing how existing memories are differentially expressed (apparent learning). This insight enables us to account for key features of motor learning that had no unified explanation: spontaneous recovery¹, savings², anterograde interference³, how environmental consistency affects learning rate^4,5 and the distinction between explicit and implicit learning⁶. Critically, our theory also predicts new phenomena-evoked recovery and context-dependent single-trial learning-which we confirm experimentally. These results suggest that contextual inference, rather than classical single-context mechanisms^1,4,7-9, is the key principle underlying how a diverse set of experiences is reflected in our motor behaviour.

The nature of savings associated with a visuomotor adaptation task that involves one arm or both arms

The nature of savings in visuomotor adaptation is typically studied using a paradigm in which one arm experiences multiple conditions such as adaptation, washout and readaptation. It has seldom been studied, however, using a paradigm that involves both arms. Here, we examined the effect of (1) using different arms and (2) the availability of visual feedback during a washout session following visuomotor adaptation on savings. We first had healthy young adults adapt to a visuomotor rotation condition during reaching movements with the left arm. Following that, they experienced a washout session with either the left or right arm, with or without visual feedback, and then the readaptation session with the left arm again. We hypothesized that if savings occurred due to the explicit recall of cognitive strategies, the pattern of savings would be similar regardless of which arm was used during the washout session. Results showed that in terms of the percentage of savings, there was a significant difference between the conditions in which the left or right arm was used during the washout, but not between the conditions in which visual feedback was provided or absent. In terms of the rate of relearning, a significant difference was observed between the conditions in which the left or right arm was used during the washout, and also between the conditions in which visual feedback was provided or absent. These findings suggest that the explicit recall of strategies is not the only source for savings and further suggest that effector-specific, use-dependent learning can also contribute to savings.

Normal Aging Affects the Short-Term Temporal Stability of Implicit, But Not Explicit, Motor Learning following Visuomotor Adaptation

Normal aging is associated with a decline in memory and motor learning ability. However, the exact form of these impairments (e.g., the short-term temporal stability and affected learning mechanisms) is largely unknown. Here, we used a sensorimotor adaptation task to examine changes in the temporal stability of two forms of learning (explicit and implicit) because of normal aging. Healthy young subjects (age range, 19–28 years; 20 individuals) and older human subjects (age range, 63–85 years; 19 individuals) made reaching movements in response to altered visual feedback. On each trial, subjects turned a rotation dial to select an explicit aiming direction. Once selected, the display was removed and subjects moved the cursor from the start position to the target. After initial training with the rotational feedback perturbation, subjects completed a series of probe trials at different delay periods to systematically assess the short-term retention of learning. For both groups, the explicit aiming showed no significant decrease over 1.5 min. However, this was not the case for implicit learning; the decay pattern was markedly different between groups. Older subjects showed a linear decrease of the implicit component of adaptation over time, while young subjects showed an exponential decay over the same period (time constant, 25.61 s). Although older subjects adapted at a similar rate, these results suggest natural aging selectively impacts the short-term (seconds to minutes) temporal stability of implicit motor learning mechanisms. This understanding may provide a means to dissociate natural aging memory impairments from deficits caused by brain disorders that progress with aging.

How Do Violinists Adapt to Dynamic Assistive Support? A Study Focusing on Kinematics, Muscle Activity, and Musical Performance

OBJECTIVE

Assessing violinists' motor and musical performance adaptations to dynamic assistive support (DAS) provided by a passive device, using a force-field adaptation paradigm.

BACKGROUND

Up to 93% of instrumentalists are affected by musculoskeletal injuries and particularly violinists. The repetitive nature of their work may lead to muscle fatigue, an injury risk factor. DAS has been used in occupational settings to minimize muscle activations and limit fatigue accumulation. DAS may however affect motor and musical performance.

METHOD

Fifteen expert violinists were equipped with reflective markers and surface and intramuscular electromyography (EMG) sensors. Movements, muscle activations, and sound were recorded while participants completed three experimental conditions for which they continuously played a 13-s musical excerpt: Control (no DAS), Adaptation (DAS), and Washout (no DAS). DAS was applied at the left elbow (violin-holding side). Conditions were repeated 1 week later. Participants later listened to their own audio recordings playing with and without DAS and blindly assessed their performances. Linear mixed models were used to compare DAS and no-DAS conditions' kinematic, EMG, and musical performance data.

RESULTS

DAS perturbed user kinematics but reduced mean activations of left medial deltoid and superior trapezius. Joint kinematic and muscle activation patterns between DAS and no DAS conditions however remained similar. Musical performance was unchanged with DAS.

CONCLUSION

Though DAS modified violinists' upper-limb configurations, resulting kinematics were not detrimental to musical performance. Reduced muscle activations with DAS could contribute to lessening muscle fatigue.

APPLICATION

Although its effect on muscle fatigue should be further investigated, DAS might be useful in preventing violinists' injuries.

An implicit memory of errors limits human sensorimotor adaptation

During extended motor adaptation, learning appears to saturate despite persistence of residual errors. This adaptation limit is not fixed but varies with perturbation variance; when variance is high, residual errors become larger. These changes in total adaptation could relate to either implicit or explicit learning systems. Here, we found that when adaptation relied solely on the explicit system, residual errors disappeared and learning was unaltered by perturbation variability. In contrast, when learning depended entirely, or in part, on implicit learning, residual errors reappeared. Total implicit adaptation decreased in the high-variance environment due to changes in error sensitivity, not in forgetting. These observations suggest a model in which the implicit system becomes more sensitive to errors when they occur in a consistent direction. Thus, residual errors in motor adaptation are at least in part caused by an implicit learning system that modulates its error sensitivity in response to the consistency of past errors.

Did We Get Sensorimotor Adaptation Wrong? Implicit Adaptation as Direct Policy Updating Rather than Forward-Model-Based Learning

The human motor system can rapidly adapt its motor output in response to errors. The prevailing theory of this process posits that the motor system adapts an internal forward model that predicts the consequences of outgoing motor commands and uses this forward model to plan future movements. However, despite clear evidence that adaptive forward models exist and are used to help track the state of the body, there is no definitive evidence that such models are used in movement planning. An alternative to the forward-model-based theory of adaptation is that movements are generated based on a learned policy that is adjusted over time by movement errors directly ("direct policy learning"). This learning mechanism could act in parallel with, but independent of, any updates to a predictive forward model. Forward-model-based learning and direct policy learning generate very similar predictions about behavior in conventional adaptation paradigms. However, across three experiments with human participants (N = 47, 26 female), we show that these mechanisms can be dissociated based on the properties of implicit adaptation under mirror-reversed visual feedback. Although mirror reversal is an extreme perturbation, it still elicits implicit adaptation; however, this adaptation acts to amplify rather than to reduce errors. We show that the pattern of this adaptation over time and across targets is consistent with direct policy learning but not forward-model-based learning. Our findings suggest that the forward-model-based theory of adaptation needs to be re-examined and that direct policy learning provides a more plausible explanation of implicit adaptation.SIGNIFICANCE STATEMENT The ability of our brain to adapt movements in response to error is one of the most widely studied phenomena in motor learning. Yet, we still do not know the process by which errors eventually result in adaptation. It is known that the brain maintains and updates an internal forward model, which predicts the consequences of motor commands, and the prevailing theory of motor adaptation posits that this updated forward model is responsible for trial-by-trial adaptive changes. Here, we question this view and show instead that adaptation is better explained by a simpler process whereby motor output is directly adjusted by task errors. Our findings cast doubt on long-held beliefs about adaptation.

Recognition memory for human motor learning

Motor skill retention is typically measured by asking participants to reproduce previously learned movements from memory. The analog of this retention test (recall memory) in human verbal memory is known to underestimate how much learning is actually retained. Here we asked whether information about previously learned movements, which can no longer be reproduced, is also retained. Following visuomotor adaptation, we used tests of recall that involved reproduction of previously learned movements and tests of recognition in which participants were asked whether a candidate limb displacement, produced by a robot arm held by the subject, corresponded to a movement direction that was experienced during active training. The main finding was that 24 h after training, estimates of recognition memory were about twice as accurate as those of recall memory. Thus, there is information about previously learned movements that is not retrieved using recall testing but can be accessed in tests of recognition. We conducted additional tests to assess whether, 24 h after learning, recall for previously learned movements could be improved by presenting passive movements as retrieval cues. These tests were conducted immediately prior to recall testing and involved the passive playback of a small number of movements, which were spread across the workspace and included both adapted and baseline movements, without being marked as such. This technique restored recall memory for movements to levels close to those of recognition memory performance. Thus, somatic information may enable retrieval of otherwise inaccessible motor memories.

Combining Observation and Physical Practice: Benefits of an Interleaved Schedule for Visuomotor Adaptation and Motor Memory Consolidation

Visuomotor adaptation to novel environments can occur via non-physical means, such as observation. Observation does not appear to activate the same implicit learning processes as physical practice, rather it appears to be more strategic in nature. However, there is evidence that interspersing observational practice with physical practice can benefit performance and memory consolidation either through the combined benefits of separate processes or through a change in processes activated during observation trials. To test these ideas, we asked people to practice aiming to targets with visually rotated cursor feedback or engage in a combined practice schedule comprising physical practice and observation of projected videos showing successful aiming. Ninety-three participants were randomly assigned to one of five groups: massed physical practice (Act), distributed physical practice (Act+Rest), or one of 3 types of combined practice: alternating blocks (Obs_During), or all observation before (Obs_Pre) or after (Obs_Post) blocked physical practice. Participants received 100 practice trials (all or half were physical practice). All groups improved in adaptation trials and showed savings across the 24-h retention interval relative to initial practice. There was some forgetting for all groups, but the magnitudes were larger for physical practice groups. The Act and Obs_During groups were most accurate in retention and did not differ, suggesting that observation can serve as a replacement for physical practice if supplied intermittently and offers advantages above just resting. However, after-effects associated with combined practice were smaller than those for physical practice control groups, suggesting that beneficial learning effects as a result of observation were not due to activation of implicit learning processes. Reaction time, variable error, and post-test rotation drawings supported this conclusion that adaptation for observation groups was promoted by explicit/strategic processes.

Cerebellar contribution to sensorimotor adaptation deficits in humans with spinal cord injury

Humans with spinal cord injury (SCI) show deficits in associating motor commands and sensory feedback. Do these deficits affect their ability to adapt movements to new demands? To address this question, we used a robotic exoskeleton to examine learning of a sensorimotor adaptation task during reaching movements by distorting the relationship between hand movement and visual feedback in 22 individuals with chronic incomplete cervical SCI and 22 age-matched control subjects. We found that SCI individuals showed a reduced ability to learn from movement errors compared with control subjects. Sensorimotor areas in anterior and posterior cerebellar lobules contribute to learning of movement errors in intact humans. Structural brain imaging showed that sensorimotor areas in the cerebellum, including lobules I-VI, were reduced in size in SCI compared with control subjects and cerebellar atrophy increased with increasing time post injury. Notably, the degree of spared tissue in the cerebellum was positively correlated with learning rates, indicating participants with lesser atrophy showed higher learning rates. These results suggest that the reduced ability to learn from movement errors during reaching movements in humans with SCI involves abnormalities in the spinocerebellar structures. We argue that this information might help in the rehabilitation of people with SCI.

Sensorimotor adaptation of speech depends on the direction of auditory feedback alteration

A hallmark feature of speech motor control is its ability to learn to anticipate and compensate for persistent feedback alterations, a process referred to as sensorimotor adaptation. Because this process involves adjusting articulation to counter the perceived effects of altering acoustic feedback, there are a number of factors that affect it, including the complex relationship between acoustics and articulation and non-uniformities of speech perception. As a consequence, sensorimotor adaptation is hypothesised to vary as a function of the direction of the applied auditory feedback alteration in vowel formant space. This hypothesis was tested in two experiments where auditory feedback was altered in real time, shifting the frequency values of the first and second formants (F1 and F2) of participants' speech. Shifts were designed on a subject-by-subject basis and sensorimotor adaptation was quantified with respect to the direction of applied shift, normalised for individual speakers. Adaptation was indeed found to depend on the direction of the applied shift in vowel formant space, independent of shift magnitude. These findings have implications for models of sensorimotor adaptation of speech.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

Use-dependent plasticity explains aftereffects in visually guided locomotor learning of a novel step length asymmetry

Studies of upper extremity reaching show that use-dependent plasticity, or learning from repetition, plays an important role in shaping motor behaviors. Yet the impact of repetition on locomotor learning is unclear, despite the fact that gait is developed and practiced over millions of repetitions. To test whether repetition alone can induce storage of a novel walking pattern, we instructed two groups of young healthy subjects to learn an asymmetric walking pattern through two distinct learning paradigms. The first group learned a new pattern through an established visual distortion paradigm, which provided both sensory prediction error and repetition of movement patterns to induce walking aftereffects, and the second received veridical feedback with a target change, which provided only repetition (use-dependent plasticity) to induce aftereffects. When feedback was removed, both groups demonstrated aftereffects in the primary outcome, step asymmetry index. Surprisingly, despite the different task demands, both groups produced similar aftereffect magnitudes, which also had similar rates of decay, suggesting that the addition of sensory prediction errors did not improve storage of learning beyond that induced by the use-dependent process alone. To further characterize the use-dependent process, we conducted a second experiment to quantify aftereffect size in a third group who practiced double the asymmetry magnitude. This new group showed a proportionately greater magnitude of the use-dependent aftereffect. Together, these findings show that the primary driver of storage of a new step length asymmetry during visually guided locomotor learning is repetition, not sensory prediction error, and this effect scales with the learning magnitude.NEW & NOTEWORTHY Use-dependent plasticity, or learning from repetition, is an important process for upper extremity reaching tasks, but its contribution to walking is not well established. Here, we demonstrate the existence of a dose-dependent, use-dependent process during visually guided treadmill walking. We also show that sensory prediction errors, previously thought to drive aftereffects in similar locomotor learning paradigms, do not appear to play a significant role in visually driven learning of a novel step asymmetry during treadmill walking.

A functional analysis-based approach to quantify upper limb impairment level in chronic stroke patients: a pilot study

The accurate assessment of upper limb motion impairment induced by stroke - which represents one of the primary causes of disability world-wide - is the first step to successfully monitor and guide patients' recovery. As of today, the majority of the procedures relies on clinical scales, which are mostly based on ordinal scaling, operator-dependent, and subject to floor and ceiling effects. In this work, we intend to overcome these limitations by proposing a novel approach to analytically evaluate the level of pathological movement coupling, based on the quantification of movement complexity. To this goal, we consider the variations of functional Principal Components applied to the reconstruction of joint angle trajectories of the upper limb during daily living task execution, and compared these variations between two conditions, i.e. the affected and non-affected arm. A Dissimilarity Index, which codifies the severity of the upper limb motor impairment with respect to the movement complexity of the non-affected arm, is then proposed. This methodology was validated as a proof of concept upon a set of four chronic stroke subjects with mild to moderate arm and hand impairments. As a first step, we evaluated whether the derived outcomes differentiate between the two conditions upon the whole data-set. Secondly, we exploited this concept to discern between different subjects and impairment levels. Results show that: i) differences in terms of movement variability between the affected and nonaffected upper limb are detectable and ii) different impairment profiles can be characterized for single subjects using the proposed approach. Although provisional, these results are very promising and suggest this approach as a basis ingredient for the definition of a novel, operator-independent, sensitive, intuitive and widely applicable scale for the evaluation of upper limb motion impairment.

Memories of motor adaptation do not necessarily decay with behavioral unlearning

Motor adaptation reshapes behaviors to habituate novel predictable demands caused by dramatic changes in our body (or environment). In the absence of error signals, behaviors rapidly return to the manner before adaptation. It is still in debate whether this behavioral unlearning is due to memory decay. Recent studies suggested that unlearning may be related to the detection of a context change between adaptation phase and error-absent phase. This context-dependent idea is extended in the present study, which examined the motor adaptation in a ball-tossing task. To facilitate the manipulation of the task and the measurement of the behavior, this tossing task was conducted in a virtual environment. Experiment 1 found that unlearning was more likely to occur when the context in the adaptation phase was less similar to that in the error-absent phase. Experiment 2 further demonstrated that the memory of motor adaptation can bias behavior even after behavioral unlearning. Experiment 3 confirmed that the results in Experiment 1 and 2 were not artifacts. These findings indicate that memories of adaptation are independent of behavioral unlearning, and the contextual similarity between adaptation and error-absent phase determines the unlearning rate.

Visuomotor perturbation in a continuous circle tracing task: novel approach for quantifying motor adaptation

The study of motor adaptation certainly has advanced greatly through the years and helped to shed light on the mechanisms of motor learning. Most paradigms used to study adaptation employ a discrete approach, where people adapt in successive attempts. Continuous tasks on the other hand, while known to possess different characteristics than discrete ones, have received little attention regarding the study motor adaptation. In this paper, we test for adaptation using a continuous circle tracing task with a visuomotor gain perturbation. To examine the feasibility of this task, 45 normal subjects divided into 3 groups were tested for adaptation, aftereffects, and generalization. All subjects exhibited a gradual adaptation when faced with a perturbation as well as opposite aftereffects once the perturbation was removed. Aftereffects tended to persist unless veridical feedback was given. The task generalized well both in size and in space. We believe that this task, by being continuous, could allow for a thorough investigation of visuomotor adaptation to gain perturbations in particular, and perhaps be expanded to other types of adaptations as well, especially when used alongside discrete tasks.

Practice induces a qualitative change in the memory representation for visuomotor learning

Adaptation of our movements to changes in the environment is known to be supported by multiple learning processes that operate in parallel. One is an implicit recalibration process driven by sensory-prediction errors; the other process counters the perturbation through more deliberate compensation. Prior experience is known to enable adaptation to occur more rapidly, a phenomenon known as “savings,” but exactly how experience alters each underlying learning process remains unclear. We measured the relative contributions of implicit recalibration and deliberate compensation to savings across 2 days of practice adapting to a visuomotor rotation. The rate of implicit recalibration showed no improvement with repeated practice. Instead, practice led to deliberate compensation being expressed even when preparation time was very limited. This qualitative change is consistent with the proposal that practice establishes a cached association linking target locations to appropriate motor output, facilitating a transition from deliberate to automatic action selection.

NEW & NOTEWORTHY Recent research has shown that savings for visuomotor adaptation is attributable to retrieval of intentional, strategic compensation. This does not seem consistent with the implicit nature of memory for motor skills and calls into question the validity of visuomotor adaptation of reaching movements as a model for motor skill learning. Our findings suggest a solution: that additional practice adapting to a visuomotor perturbation leads to the caching of the initially explicit strategy for countering it.

The 24-h savings of adaptation to novel movement dynamics initially reflects the recall of previous performance

Humans rapidly adapt reaching movements in response to perturbations (e.g., manipulations of movement dynamics or visual feedback). Following a break, when reexposed to the same perturbation, subjects demonstrate savings, a faster learning rate compared with the time course of initial training. Although this has been well studied, there are open questions on the extent early savings reflects the rapid recall of previous performance. To address this question, we examined how the properties of initial training (duration and final adaptive state) influence initial single-trial adaptation to force-field perturbations when training sessions were separated by 24 h. There were two main groups that were distinct based on the presence or absence of a washout period at the end of day 1 (with washout vs. without washout). We also varied the training duration on day 1 (15, 30, 90, or 160 training trials), resulting in 8 subgroups of subjects. We show that single-trial adaptation on day 2 scaled with training duration, even for similar asymptotic levels of learning on day 1 of training. Interestingly, the temporal force profile following the first perturbation on day 2 matched that at the end of day 1 for the longest training duration group that did not complete the washout. This correspondence persisted but was significantly lower for shorter training durations and the washout subject groups. Collectively, the results suggest that the adaptation observed very early in reexposure results from the rapid recall of the previously learned motor recalibration but is highly dependent on the initial training duration and final adaptive state.NEW & NOTEWORTHY The extent initial readaptation reflects the recall of previous motor performance is largely unknown. We examined early single-trial force-field adaptation on the second day of training and distinguished initial retention from recall. We found that the single-trial adaptation following the 24-h break matched that at the end of the first day, but this recall was modified by the training duration and final level of learning on the first day of training.

Effects of the amount of practice and time interval between practice sessions on the retention of internal models

The amount of practice and time interval between practice sessions are important factors that influence motor learning efficiency. Here, we aimed to reveal the relationship between the retention and consolidation of a new internal model, and the amount of practice and time interval between practice sessions. We employed a visuomotor rotation tracking task to test the hypotheses that (1) a new internal model consolidates owing to extensive practice after reaching a task performance plateau and (2) a longer time interval between practice sessions makes it difficult to activate a new internal model. The participants were assigned to one of the four groups that differed in terms of the amount of practice and the time interval between practice sessions. They performed a tracking task in which they experienced 120° clockwise visuomotor rotation and were required to track a moving target on a computer display using a mouse cursor. To evaluate the retention and consolidation of a new internal model, we calculated the aftereffects and savings as measures of motor learning. To the best our knowledge, this is the first study to manipulate both the amount of practice and the time interval between practice sessions simultaneously in one experiment using a visuomotor tracking task. Our results support the previously reported idea that extensive practice is necessary for the consolidation of a new internal model.

Adaptation to visual feedback delays on touchscreens with hand vision

Direct touch finger interaction on a smartphone or a tablet is now ubiquitous. However, the latency inherent in digital computation produces an average feedback delay of ~ 75 ms between the action of the hand and its visible effect on digital content. This delay has been shown to affect users' performance, but it is unclear whether users adapt to this delay and whether it influences skill learning. Previous work studied adaptation to feedback delays but only for longer delays, with hidden hand or indirect devices. This paper addresses adaptation to touchscreen delay in two empirical studies involving the tracking of a target moving along an elliptical path. Participants were trained for the task either at the minimal delay the system allows (~ 9 ms) or at a longer delay equivalent to commercialized touch devices latencies (75 ms). After 10 training sessions over a minimum of 2 weeks (Experiment 1), participants adapt to the delay. They also display long-term retention 7 weeks after the last training session. This adaptation generalizes to a similar tracking path (e.g., infinity symbol). We also observed generalization of learning from the longer delay to the minimal-delay condition (Experiment 2). The delay thus does not prevent the learning of tracking skill, which suggests that delay adaptation and tracking skill could be two separate components of learning.

Pharmacological Dopamine Manipulation Does Not Alter Reward-Based Improvements in Memory Retention during a Visuomotor Adaptation Task

Motor adaptation tasks investigate our ability to adjust motor behaviors to an ever-changing and unpredictable world. Previous work has shown that punishment-based feedback delivered during a visuomotor adaptation task enhances error-reduction, whereas reward increases memory retention. While the neural underpinnings of the influence of punishment on the adaptation phase remain unclear, reward has been hypothesized to increase retention through dopaminergic mechanisms. We directly tested this hypothesis through pharmacological manipulation of the dopaminergic system. A total of 96 young healthy human participants were tested in a placebo-controlled double-blind between-subjects design in which they adapted to a 40° visuomotor rotation under reward or punishment conditions. We confirmed previous evidence that reward enhances retention, but the dopamine (DA) precursor levodopa (LD) or the DA antagonist haloperidol failed to influence performance. We reason that such a negative result could be due to experimental limitations or it may suggest that the effect of reward on motor memory retention is not driven by dopaminergic processes. This provides further insight regarding the role of motivational feedback in optimizing motor learning, and the basis for further decomposing the effect of reward on the subprocesses known to underlie motor adaptation paradigms.

Closing the Loop: From Motor Neuroscience to Neurorehabilitation

The fields of human motor control, motor learning, and neurorehabilitation have long been linked by the intuition that understanding how we move (and learn to move) leads to better rehabilitation. In reality, these fields have remained largely separate. Our knowledge of the neural control of movement has expanded, but principles that can directly impact rehabilitation efficacy remain somewhat sparse. This raises two important questions: What can basic studies of motor learning really tell us about rehabilitation, and are we asking the right questions to improve the lives of patients? This review aims to contextualize recent advances in computational and behavioral studies of human motor learning within the framework of neurorehabilitation. We also discuss our views of the current challenges facing rehabilitation and outline potential clinical applications from recent theoretical and basic studies of motor learning and control.

The relationship between reinforcement and explicit control during visuomotor adaptation

The motor system’s ability to adapt to environmental changes is essential for maintaining accurate movements. Such adaptation recruits several distinct systems: cerebellar sensory-prediction error learning, success-based reinforcement, and explicit control. Although much work has focused on the relationship between cerebellar learning and explicit control, there is little research regarding how reinforcement and explicit control interact. To address this, participants first learnt a 20° visuomotor displacement. After reaching asymptotic performance, binary, hit-or-miss feedback (BF) was introduced either with or without visual feedback, the latter promoting reinforcement. Subsequently, retention was assessed using no-feedback trials, with half of the participants in each group being instructed to stop aiming off target. Although BF led to an increase in retention of the visuomotor displacement, instructing participants to stop re-aiming nullified this effect, suggesting explicit control is critical to BF-based reinforcement. In a second experiment, we prevented the expression or development of explicit control during BF performance, by either constraining participants to a short preparation time (expression) or by introducing the displacement gradually (development). Both manipulations strongly impaired BF performance, suggesting reinforcement requires both recruitment and expression of an explicit component. These results emphasise the pivotal role explicit control plays in reinforcement-based motor learning.

Long-term retention of proprioceptive recalibration

Sensorimotor changes are well documented following reaches with altered visual feedback of the hand. Specifically, reaches are adapted and proprioceptive estimates of felt hand position shifted in the direction of the visual feedback experienced. While research has examined one's ability to retain reach adaptation, limited attention has been given to the retention of proprioceptive recalibration. This experiment examined retention of proprioceptive recalibration in the form of recall and savings (i.e., faster proprioceptive recalibration on subsequent testing days) over an extended period of time (i.e., four days). As well, we looked to determine the benefits of additional training on short-term retention (i.e., one day) of proprioceptive recalibration. Twenty-four participants trained to reach to a visual target while seeing a cursor that was rotated 30° clockwise relative to their hand on an initial day of testing. Half of the participants then completed additional reach training trials on 4 subsequent testing days (Training group), whereas the second half of participants did not complete additional training until Day 5 (Non-Training group). Participants provided estimates of their felt hand position on all 5 testing days to establish retention of proprioceptive recalibration. Results revealed that proprioceptive recalibration was recalled 24 h after initial training across all participants. Recall of proprioceptive recalibration was not observed on subsequent testing days for the Non-Training group, while recall of proprioceptive recalibration was retained at a similar level across all subsequent testing days for the Training group. Retention of proprioceptive recalibration in the form of savings was observed on Day 5 in the Non-Training group. These results reveal that short-term recall of proprioceptive recalibration does not benefit from additional training. Moreover, the different time scales (i.e., retention in the form of recall seen only at 24 h after initial training versus savings observed 4 days after initial training in the Non-Training group), suggest that distinct processes may underlie recall and savings of proprioceptive recalibration.

Creating flexible motor memories in human walking

The human nervous system has the ability to save newly learned movements (i.e. re-learn faster after initial learning) and generalize learning to new conditions. In the context of walking, we rely on savings and generalization of newly learned walking patterns to navigate changing environments and make progressive improvements with gait rehabilitation. Here, we used a split-belt treadmill to study how different perturbation parameters can influence savings and generalization of learning during walking. In Experiment 1, we investigated the effect of split perturbation size on savings of a newly learned walking pattern. We found that larger perturbations led to better savings than smaller perturbations. In Experiment 2, we studied how different features of the initial split perturbation influenced the generalization of learning. Interestingly, we found that practicing the same thing twice did not lead to fastest learning. Instead, initial exposure to larger perturbation ratios led to faster subsequent learning of smaller perturbation ratios as compared to repeated exposures to small perturbations. Collectively, our findings reveal that initial learning conditions can be leveraged to increase savings and shape flexible motor memories during walking.

Estimating properties of the fast and slow adaptive processes during sensorimotor adaptation

Experience of a prediction error recruits multiple motor learning processes, some that learn strongly from error but have weak retention and some that learn weakly from error but exhibit strong retention. These processes are not generally observable but are inferred from their collective influence on behavior. Is there a robust way to uncover the hidden processes? A standard approach is to consider a state space model where the hidden states change following experience of error and then fit the model to the measured data by minimizing the squared error between measurement and model prediction. We found that this least-squares algorithm (LMSE) often yielded unrealistic predictions about the hidden states, possibly because of its neglect of the stochastic nature of error-based learning. We found that behavioral data during adaptation was better explained by a system in which both error-based learning and movement production were stochastic processes. To uncover the hidden states of learning, we developed a generalized expectation maximization (EM) algorithm. In simulation, we found that although LMSE tracked the measured data marginally better than EM, EM was far more accurate in unmasking the time courses and properties of the hidden states of learning. In a power analysis designed to measure the effect of an intervention on sensorimotor learning, EM significantly reduced the number of subjects that were required for effective hypothesis testing. In summary, we developed a new approach for analysis of data in sensorimotor experiments. The new algorithm improved the ability to uncover the multiple processes that contribute to learning from error. NEW & NOTEWORTHY Motor learning is supported by multiple adaptive processes, each with distinct error sensitivity and forgetting rates. We developed a generalized expectation maximization algorithm that uncovers these hidden processes in the context of modern sensorimotor learning experiments that include error-clamp trials and set breaks. The resulting toolbox may improve the ability to identify the properties of these hidden processes and reduce the number of subjects needed to test the effectiveness of interventions on sensorimotor learning.

Adult zebra finches rehearse highly variable song patterns during sleep

Brain activity during sleep is fairly ubiquitous and the best studied possible function is a role in memory consolidation, including motor memory. One suggested mechanism of how neural activity effects these benefits is through reactivation of neurons in patterns resembling those of the preceding experience. The specific patterns of motor activation replayed during sleep are largely unknown for any system. Brain areas devoted to song production in the songbird brain exhibit spontaneous song-like activity during sleep, but single cell neural recordings did not permit detection of the specific song patterns. We have now discovered that this sleep activation can be detected in the muscles of the vocal organ, thus providing a unique window into song-related brain activity at night. We show that male zebra finches (Taeniopygia guttata) frequently exhibit spontaneous song-like activity during the night, but that the fictive song patterns are highly variable and uncoordinated compared to the highly stereotyped day-time song production. This substantial variability is not consistent with the idea that night-time activity replays day-time experiences for consolidation. Although the function of this frequent activation is unknown, it may represent a mechanism for exploring motor space or serve to generate internal error signals that help maintain the high stereotypy of day-time song. In any case, the described activity supports the emerging insight that brain activity during sleep may serve a variety of functions.

Structural Learning in a Visuomotor Adaptation Task Is Explicitly Accessible

Structural learning is a phenomenon characterized by faster learning in a new situation that shares features of previously experienced situations. One prominent example within the sensorimotor domain is that human participants are faster to counter a novel rotation following experience with a set of variable visuomotor rotations. This form of learning is thought to occur implicitly through the updating of an internal forward model, which predicts the sensory consequences of motor commands. However, recent work has shown that much of rotation learning occurs through an explicitly accessible process, such as movement re-aiming. We sought to determine if structural learning in a visuomotor rotation task is purely implicit (e.g., driven by an internal model) or explicitly accessible (i.e., re-aiming). We found that participants exhibited structural learning: following training with a variable set of rotations, they more quickly learned a novel rotation. This benefit was entirely conferred by the explicit re-aiming of movements. Implicit learning offered little to no contribution. Next, we investigated the specificity of this learning benefit by exposing participants to a novel perturbation drawn from a statistical structure either congruent or incongruent with their prior experience. We found that participants who experienced congruent training and test phase structure (i.e., rotations to rotation) learned more quickly than participants exposed to incongruent training and test phase structure (i.e., gains to rotation) and a control group. These results suggest that structural learning in a visuomotor rotation task is specific to previously experienced statistical structure and expressed via explicit re-aiming of movements.

Distinct coordinate systems for adaptations of movement direction and extent

Learned compensations for perturbed visual feedback of movement extent and direction generalize differently to unpracticed movement directions, which suggests different underlying neural mechanisms. Here we investigated whether gain and rotation adaptations are consistent with representation in different coordinate systems. Subjects performed a force-aiming task with the wrist and learned different gains or rotations for different force directions. Generalization was tested without visual feedback for the same extrinsic directions but with the forearm in a different pronation-supination orientation. When the change in forearm orientation caused the adapted visuomotor map to conflict in extrinsic and joint-based coordinates, rotation generalization occurred in extrinsic coordinates but with reduced magnitude. In contrast, gain generalization appeared reduced and phase shifted. When the forearm was rotated further, such that all imposed perturbations aligned in both joint-based and extrinsic coordinates in both postures, rotation generalization was further reduced, whereas there was neither reduction nor phase shift in the pattern of extent generalization. These results show that rotation generalization was expressed in extrinsic coordinates, and that generalization magnitude was modulated by posture. In contrast, gain generalization appeared to depend on target direction defined by an integrated combination of extrinsic and joint-based coordinates and was not reduced substantially by posture changes alone. Although the quality of the model fit underlying our interpretation prevents us from making strong conclusions, the data suggest that adaptations of movement direction and extent are represented according to distinct coordinate systems.NEW & NOTEWORTHY Visuomotor gain and rotation adaptations generalize differently to novel movement directions, which suggests different neural mechanisms. When extrinsic and joint-based coordinates are effectively dissociated in an isometric aiming task, we find that they also generalize in different coordinate systems. Specifically, rotation generalized in extrinsic coordinates and decayed as posture departed from that adopted during adaptation. In contrast, gain generalization was expressed according to mixed extrinsic/joint-based coordinates and was not substantially reduced by postural changes.

The temporal stability of visuomotor adaptation generalization

Movement adaptation in response to systematic motor perturbations exhibits distinct spatial and temporal properties. These characteristics are typically studied in isolation, leaving the interaction largely unknown. Here we examined how the temporal decay of visuomotor adaptation influences the spatial generalization of the motor recalibration. First, we quantified the extent to which adaptation decayed over time. Subjects reached to a peripheral target, and a rotation was applied to the visual feedback of the unseen motion. The retention of this adaptation over different delays (0-120 s) 1) decreased by 29.0 ± 6.8% at the longest delay and 2) was represented by a simple exponential, with a time constant of 22.5 ± 5.6 s. On the basis of this relationship we simulated how the spatial generalization of adaptation would change with delay. To test this directly, we trained additional subjects with the same perturbation and assessed transfer to 19 different locations (spaced 15° apart, symmetric around the trained location) and examined three delays (~4, 12, and 25 s). Consistent with the simulation, we found that generalization around the trained direction (±15°) significantly decreased with delay and distance, while locations >60° displayed near-constant spatiotemporal transfer. Intermediate distances (30° and 45°) showed a difference in transfer across space, but this amount was approximately constant across time. Interestingly, the decay at the trained direction was faster than that based purely on time, suggesting that the spatial transfer of adaptation is modified by concurrent passive (time dependent) and active (movement dependent) processes.NEW & NOTEWORTHY Short-term motor adaptation exhibits distinct spatial and temporal characteristics. Here we investigated the interaction of these features, utilizing a simple motor adaptation paradigm (recalibration of reaching arm movements in response to rotated visual feedback). We examined the changes in the spatial generalization of motor adaptation for different temporal manipulations and report that the spatiotemporal generalization of motor adaptation is generally local and is influenced by both passive (time dependent) and active (movement dependent) learning processes.

Cerebellar anodal tDCS increases implicit learning when strategic re-aiming is suppressed in sensorimotor adaptation

Neurophysiological and neuroimaging work suggests that the cerebellum is critically involved in sensorimotor adaptation. Changes in cerebellar function alter behaviour when compensating for sensorimotor perturbations, as shown by non-invasive stimulation of the cerebellum and studies involving patients with cerebellar degeneration. It is known, however, that behavioural responses to sensorimotor perturbations reflect both explicit processes (such as volitional aiming to one side of a target to counteract a rotation of visual feedback) and implicit, error-driven updating of sensorimotor maps. The contribution of the cerebellum to these explicit and implicit processes remains unclear. Here, we examined the role of the cerebellum in sensorimotor adaptation to a 30° rotation of visual feedback of hand position during target-reaching, when the capacity to use explicit processes was manipulated by controlling movement preparation times. Explicit re-aiming was suppressed in one condition by requiring subjects to initiate their movements within 300ms of target presentation, and permitted in another condition by requiring subjects to wait approximately 1050ms after target presentation before movement initiation. Similar to previous work, applying anodal transcranial direct current stimulation (tDCS; 1.5mA) to the right cerebellum during adaptation resulted in faster compensation for errors imposed by the rotation. After exposure to the rotation, we evaluated implicit remapping in no-feedback trials after providing participants with explicit knowledge that the rotation had been removed. Crucially, movements were more adapted in these no-feedback trials following cerebellar anodal tDCS than after sham stimulation in both long and short preparation groups. Thus, cerebellar anodal tDCS increased implicit remapping during sensorimotor adaptation, irrespective of preparation time constraints. The results are consistent with the possibility that the cerebellum contributes to the formation of new visuomotor maps that correct perturbations in sensory feedback, even when explicit processes are suppressed during sensorimotor adaptation.

The decay of motor adaptation to novel movement dynamics reveals an asymmetry in the stability of motion state-dependent learning

Motor adaptation paradigms provide a quantitative method to study short-term modification of motor commands. Despite the growing understanding of the role motion states (e.g., velocity) play in this form of motor learning, there is little information on the relative stability of memories based on these movement characteristics, especially in comparison to the initial adaptation. Here, we trained subjects to make reaching movements perturbed by force patterns dependent upon either limb position or velocity. Following training, subjects were exposed to a series of error-clamp trials to measure the temporal characteristics of the feedforward motor output during the decay of learning. The compensatory force patterns were largely based on the perturbation kinematic (e.g., velocity), but also showed a small contribution from the other motion kinematic (e.g., position). However, the velocity contribution in response to the position-based perturbation decayed at a slower rate than the position contribution to velocity-based training, suggesting a difference in stability. Next, we modified a previous model of motor adaptation to reflect this difference and simulated the behavior for different learning goals. We were interested in the stability of learning when the perturbations were based on different combinations of limb position or velocity that subsequently resulted in biased amounts of motion-based learning. We trained additional subjects on these combined motion-state perturbations and confirmed the predictions of the model. Specifically, we show that (1) there is a significant separation between the observed gain-space trajectories for the learning and decay of adaptation and (2) for combined motion-state perturbations, the gain associated to changes in limb position decayed at a faster rate than the velocity-dependent gain, even when the position-dependent gain at the end of training was significantly greater. Collectively, these results suggest that the state-dependent adaptation associated with movement velocity is relatively more stable than that based on position.

Human motor adaptation of limb movement in response to force perturbations has been shown to be motion-state dependent. That is, the compensatory response to these disturbances is correlated and proportional to the temporal changes in the position, velocity, and acceleration during the motion. Despite a growing understanding of this adaptation process, there is little information on the relative stability of this learning when based on these different temporal features of movement. Here we modified a previous computational model of motor adaptation to predict the decay of the compensatory response associated to different motion states, specifically learning based on temporal variations in limb position and velocity. We confirmed the simulated behavior by examining the decay of the temporal force output after subjects were trained to compensate for movement disturbances based on different combinations and magnitudes of these two motion states. Both simulation and behavioral results show that velocity-based learning decays at a slower rate than position-based, even when learning is significantly biased towards the latter at the end of training. Collectively, these results suggest that motion-state learning based on movement velocity is more stable than that based on limb position.

Cerebellar patients do not benefit from cerebellar or M1 transcranial direct current stimulation during force-field reaching adaptation

Several studies have identified transcranial direct current stimulation (tDCS) as a potential tool in the rehabilitation of cerebellar disease. Here, we tested whether tDCS could alleviate motor impairments of subjects with cerebellar degeneration. Three groups took part in this study: 20 individuals with cerebellar degeneration, 20 age-matched controls, and 30 young controls. A standard reaching task with force-field perturbations was used to compare motor adaptation among groups and to measure the effect of stimulation of the cerebellum or primary motor cortex (M1). Cerebellar subjects and age-matched controls were tested during each stimulation type (cerebellum, M1, and sham) with a break of 1 wk among each of the three sessions. Young controls were tested during one session under one of three stimulation types (anodal cerebellum, cathodal cerebellum, or sham). As expected, individuals with cerebellar degeneration had a reduced ability to adapt to motor perturbations. Importantly, cerebellar patients did not benefit from anodal stimulation of the cerebellum or M1. Furthermore, no stimulation effects could be detected in aging and young controls. The present null results cannot exclude more subtle tDCS effects in larger subject populations and between-subject designs. Moreover, it is still possible that tDCS affects motor adaptation in cerebellar subjects and control subjects under a different task or with alternative stimulation parameters. However, for tDCS to become a valuable tool in the neurorehabilitation of cerebellar disease, stimulation effects should be present in group sizes commonly used in this rare patient population and be more consistent and predictable across subjects and tasks.NEW & NOTEWORTHY Transcranial direct current stimulation (tDCS) has been identified as a potential tool in the rehabilitation of cerebellar disease. We investigated whether tDCS of the cerebellum and primary motor cortex could alleviate motor impairments of subjects with cerebellar degeneration. The present study did not find stimulation effects of tDCS in young controls, aging controls, and individuals with cerebellar degeneration during reach adaptation. Our results require a re-evaluation of the clinical potential of tDCS in cerebellar patients.

Effect of coordinate frame compatibility on the transfer of implicit and explicit learning across limbs

Insights into the neural representation of motor learning can be obtained by investigating how learning transfers to novel task conditions. We recently demonstrated that visuomotor rotation learning transferred strongly between left and right limbs when the task was performed in a sagittal workspace, which afforded a consistent remapping for the two limbs in both extrinsic and joint-based coordinates. In contrast, transfer was absent when performed in horizontal workspace, where the extrinsically defined perturbation required conflicting joint-based remapping for the left and right limbs. Because visuomotor learning is thought to be supported by both implicit and explicit forms of learning, however, it is unclear to what extent these distinct forms of learning contribute to interlimb transfer. In this study, we assessed the degree to which interlimb transfer, following visuomotor rotation training, reflects explicit vs. implicit learning by obtaining verbal reports of participants' aiming direction before each movement. We also determined the extent to which these distinct components of learning are constrained by the compatibility of coordinate systems by comparing transfer between groups of participants who reached to targets arranged in the horizontal and sagittal planes. Both sagittal and horizontal conditions displayed complete transfer of explicit learning to the untrained limb. In contrast, transfer of implicit learning was incomplete, but the sagittal condition showed greater transfer than the horizontal condition. These findings suggest that explicit strategies developed with one limb can be fully implemented in the opposite limb, whereas implicit transfer depends on the degree to which new sensorimotor maps are spatially compatible for the two limbs.

Motor learning in childhood reveals distinct mechanisms for memory retention and re-learning

Adults can easily learn and access multiple versions of the same motor skill adapted for different conditions (e.g., walking in water, sand, snow). Following even a single session of adaptation, adults exhibit clear day-to-day retention and faster re-learning of the adapted pattern. Here, we studied the retention and re-learning of an adapted walking pattern in children aged 6–17 yr. We found that all children, regardless of age, showed adult-like patterns of retention of the adapted walking pattern. In contrast, children under 12 yr of age did not re-learn faster on the next day after washout had occurred—they behaved as if they had never adapted their walking before. Re-learning could be improved in younger children when the adaptation time on day 1 was increased to allow more practice at the plateau of the adapted pattern, but never to adult-like levels. These results show that the ability to store a separate, adapted version of the same general motor pattern does not fully develop until adolescence, and furthermore, that the mechanisms underlying the retention and rapid re-learning of adapted motor patterns are distinct.