Persistence of motor adaptation during constrained, multi-joint, arm movements

The impact of dwell time on the contextual effect of visual and passive lead-in movements

Contextual cues arising from distinct movements are crucial in shaping control strategies for human movement. Here, we examine the impact of visual and passive lead-in movement cues on unimanual motor learning, focusing on the influence of "dwell time," where two-part movements are separated by the interval between the end of the first movement and the start of the second. We used a robotic manipulandum to implement a point-to-point interference task with switching opposing viscous curl fields in male and female human participants. Consistent with prior research, in both visual and passive lead-in conditions, participants showed significant adaptation to opposing dynamics with short dwell times. As dwell time increased for both visual and passive signals, past movement information had less contextual influence. However, the efficacy of visual movement cues declined more rapidly as dwell times increased. At dwell times greater than 800 ms, the contextual influence of prior visual movement was small, whereas the effectiveness of passive lead-in movement was found to be significantly greater. This indicates that the effectiveness of sensory movement cues in motor learning is modality dependent. We hypothesize that such differences may arise because proprioceptive signals directly relate to arm movements, whereas visual inputs exhibit longer latency and, in addition, can relate to many aspects of movement in the environment and not just to our own arm movements. Therefore, the motor system may not always find visual movement cues as relevant for predictive control of dynamics.NEW & NOTEWORTHY This research uncovers, for the first time, how visual and proprioceptive sensory cues affect motor learning as a function of the pause or "dwell time" in two-part movements. The study has shown that visual lead-in movement cues lose their effectiveness sooner than passive lead-in movement cues as dwell time increases. By revealing the modality-dependent nature of sensory information, this study enhances our understanding of motor control and opens new possibilities for improving therapeutic interventions.

Not fleeting but lasting: limited influence of aging on implicit adaptative motor learning and its short-term retention

In motor adaptation, learning is thought to rely on a combination of several processes. Two of these are implicit learning (incidental updating of the movement due to sensory prediction error) and explicit learning (intentional adjustment to reduce target error). The explicit component is thought to be fast adapting, whereas the implicit one is slow. The dynamic integration of such fast and slow components can lead to spontaneous recovery. That is, after prolonged adaptation of movement to a given perturbation, the learning is extinguished by presenting a perturbation in the opposite direction for a few trials. After such extinction, the learned adaptation can reappear in the absence of any further training, a phenomenon called spontaneous recovery. Trewartha et al. (Trewartha KM, Garcia A, Wolpert DM, Flanagan JR. J Neurosci 34: 13411-13421, 2014) found that older adults show less spontaneous recovery than their younger controls, indicating impairments in short-term retention of force-field adaptation. This disagrees with evidence suggesting that the implicit component and its retention do not decline with aging. To clarify this discrepancy, we performed a conceptual replication of that result. Twenty-eight healthy young and 20 healthy older adults learned to adapt to a forcefield perturbation in a paradigm known to elicit spontaneous recovery. Both groups adapted equally well to the perturbation. Implicit adaptation of the older subjects was indistinguishable from that of their younger counterparts. In addition, our conceptual replication failed to reproduce the result of Trewartha et al. (Trewartha KM, Garcia A, Wolpert DM, Flanagan JR. J Neurosci 34: 13411-13421, 2014) and found that the spontaneous recovery was also similar across groups. Our results reconcile previous studies by showing that both spontaneous recovery and implicit adaptation are unaffected by aging.NEW & NOTEWORTHY In this study, we tested whether aging influences the ability to learn to counteract a perturbation during reaching movements and to recall previously learned motor memories. In contrast to a previously published paper, we found that the ability of older participants to adapt to a perturbation and to recall motor memories remains unimpaired.

Applied Motor Noise Affects Specific Learning Mechanisms during Short-Term Adaptation to Novel Movement Dynamics

Short-term motor adaptation to novel movement dynamics has been shown to involve at least two concurrent learning processes: a slow process that responds weakly to error but retains information well and a fast process that responds strongly to error but has poor retention. This modeling framework can explain several properties of motion-dependent motor adaptation (e.g., 24 h retention). An important assumption of this computational framework is that learning is only based on the experienced movement error, and the effect of noise (either internally generated or externally applied) is not considered. We examined the respective error sensitivity by quantifying adaptation in three subject groups distinguished by the noise added to the motion-dependent perturbation. We assessed the feedforward adaptive changes in motor output and examined the adaptation rate, retention, and decay of learning. Applying a two-state modeling framework showed that the applied noise during training mainly affected the fast learning process, with the slow process largely unaffected; participants in the higher noise groups demonstrated a reduced force profile following training, but the decay rate across groups was similar, suggesting that the slow process was unimpaired across conditions. Collectively, our results provide evidence that noise significantly decreases motor adaptation, but this reduction may be due to its influence over specific learning mechanisms. Importantly, this may have implications for how the motor system compensates for random fluctuations, especially when affected by brain disorders that result in movement tremor (e.g., essential tremor).

Kernels of Motor Memory Formation: Temporal Generalization in Bimanual Adaptation

In daily life, we coordinate both simultaneous and sequential bimanual movements to manipulate objects. Our ability to rapidly account for different object dynamics suggests there are neural mechanisms to quickly deal with them. Here we investigate how actions of one arm can serve as a contextual cue for the other arm and facilitate adaptation. Specifically, we examine the temporal characteristics that underlie motor memory formation and recall, by testing the contextual effects of prior, simultaneous, and post contralateral arm movements in both male and female human participants. To do so, we measure their temporal generalization in three bimanual interference tasks. Importantly, the timing context of the learned action plays a pivotal role in the temporal generalization. While motor memories trained with post adaptation contextual movements generalize broadly, motor memories trained with prior contextual movements exhibit limited generalization, and motor memories trained with simultaneous contextual movements do not generalize to prior or post contextual timings. This highlights temporal tuning in sensorimotor plasticity: different training conditions yield substantially different temporal generalization characteristics. Since these generalizations extend far beyond any variability in training times, we suggest that the observed differences may stem from inherent differences in the use of prior, current, and post adaptation contextual information in the generation of natural behavior. This would imply differences in the underlying neural circuitry involved in learning and executing the corresponding coordinated bimanual movements.

Effects of motor imagery training on generalization and retention for different task difficulties

Although previous studies have suggested that motor adaptation through motor imagery training of similar tasks can improve retention and generalization of motor learning, the benefits of mental and physical training remain unclear for different task difficulties. Two experiments were conducted in this study. The first experiment aimed to determine whether there were differences in movement time (MT) when drawing circles based on three conditions in accordance with Fitts' law. The results showed significant differences in MT among the three conditions (p < 0.001), with MT becoming long as the width of the circle line (which indicated different difficulty level) narrowed. The second experiment aimed to determine whether the task difficulty influenced immediate generalization and retention at 24 h after mental vs. physical training. Participants in both training groups practiced the task with the medium-sized circle, which indicated medium difficulty. The posttest results revealed that mental training leads to considerable performance improvement than physical training, as demonstrated by a shorter MT regardless of the task difficulty level. Meanwhile, the retention test results showed no difference in generalization between mental and physical training. However, generalization of an easier task was more effectively retained than more difficult tasks. These results suggest that mental training can improve performance during the adaptation phase and that difficulty level can influence the degree of retention.

Decision uncertainty as a context for motor memory

The current view of perceptual decision-making suggests that once a decision is made, only a single motor programme associated with the decision is carried out, irrespective of the uncertainty involved in decision making. In contrast, we show that multiple motor programmes can be acquired on the basis of the preceding uncertainty of the decision, indicating that decision uncertainty functions as a contextual cue for motor memory. The actions learned after making certain (uncertain) decisions are only partially transferred to uncertain (certain) decisions. Participants were able to form distinct motor memories for the same movement on the basis of the preceding decision uncertainty. Crucially, this contextual effect generalizes to novel stimuli with matched uncertainty levels, demonstrating that decision uncertainty is itself a contextual cue. These findings broaden the understanding of contextual inference in motor memory, emphasizing that it extends beyond direct motor control cues to encompass the decision-making process.

Bidirectional locomotion induces unilateral limb adaptations

Humans can acquire and maintain motor skills throughout their lives through motor learning. Motor learning and skill acquisition are essential for rehabilitation following neurological disease or injury. Adaptation, the initial stage of motor learning, involves short-term changes in motor performance in response to a new demand in the person's environment. Repeated adaptation can improve skill performance and result in long-term skill retention. Locomotor adaptation is extensively studied using split-belt treadmill paradigms. In this study we explored whether bidirectional walking (BDW) on a split-belt treadmill can induce short-term gait adaptations. Twelve healthy volunteers participated in our single session, starting with 2 minutes of normal walking (NW), followed by four 5-minute blocks of BDW with a 1-minute passive rest in between blocks, and ending with another 2-minute of NW. We recorded body kinematics and ground reaction forces throughout the experiment. Participants quickly adapted to BDW with both legs showing decreased step lengths. However, only the backward-walking leg exhibited aftereffects upon returning to NW, indicating short-term adaptation. Notable kinematic changes were observed, particularly in hip extension and pelvis tilt, though these varied among participants. Our findings suggest that BDW induces unilateral adaptations despite bilateral changes in gait, offering new insights into locomotor control and spinal CPG organization.

Reward actively engages both implicit and explicit components in dual force field adaptation

Motor learning occurs through multiple mechanisms, including unsupervised, supervised (error based), and reinforcement (reward based) learning. Although studies have shown that reward leads to an overall better motor adaptation, the specific processes by which reward influences adaptation are still unclear. Here, we examine how the presence of reward affects dual adaptation to novel dynamics and distinguish its influence on implicit and explicit learning. Participants adapted to two opposing force fields in an adaptation/deadaptation/error-clamp paradigm, where five levels of reward (a score and a digital face) were provided as participants reduced their lateral error. Both reward and control (no reward provided) groups simultaneously adapted to both opposing force fields, exhibiting a similar final level of adaptation, which was primarily implicit. Triple-rate models fit to the adaptation process found higher learning rates in the fast and slow processes and a slightly increased fast retention rate for the reward group. Whereas differences in the slow learning rate were only driven by implicit learning, the large difference in the fast learning rate was mainly explicit. Overall, we confirm previous work showing that reward increases learning rates, extending this to dual-adaptation experiments and demonstrating that reward influences both implicit and explicit adaptation. Specifically, we show that reward acts primarily explicitly on the fast learning rate and implicitly on the slow learning rates.NEW & NOTEWORTHY Here we show that rewarding participants' performance during dual force field adaptation primarily affects the initial rate of learning and the early timescales of adaptation, with little effect on the final adaptation level. However, reward affects both explicit and implicit components of adaptation. Whereas the learning rate of the slow process is increased implicitly, the fast learning and retention rates are increased through both implicit components and the use of explicit strategies.

Spatio-temporal modulation of cortical activity during motor deadaptation depends on the feedback of task-related error

Motor adaptations are responsible for recalibrating actions and facilitating the achievement of goals in a constantly changing environment. Once consolidated, the decay of motor adaptation is a process affected by available sensory information during deadaptation. However, the cortical response to task error feedback during the deadaptation phase has received little attention. Here, we explored changes in brain cortical responses due to feedback of task-related error during deadaptation. Twelve healthy volunteers were recruited for the study. Right hand movement and EEG were recorded during repetitive trials of a hand reaching movement. A visuomotor rotation of 30° was introduced to induce motor adaptation. Volunteers participated in two experimental sessions organized in baseline, adaptation, and deadaptation blocks. In the deadaptation block, the visuomotor rotation was removed, and visual feedback was only provided in one session. Performance was quantified using angle end-point error, averaged speed, and movement onset time. A non-parametric spatiotemporal cluster-level permutation test was used to analyze the EEG recordings. During deadaptation, participants experienced a greater error reduction when feedback of the cursor was provided. The EEG responses showed larger activity in the left centro-frontal parietal areas during the deadaptation block when participants received feedback, as opposed to when they did not receive feedback. Centrally distributed clusters were found for the adaptation and deadaptation blocks in the absence of visual feedback. The results suggest that visual feedback of the task-related error activates cortical areas related to performance monitoring, depending on the accessible sensory information.

Dissociating the Influence of Limb Posture and Visual Feedback Shifts on the Adaptation to Novel Movement Dynamics

Accurate movements of the upper limb require the integration of various forms of sensory feedback (e.g., visual and postural information). The influence of these different sensory modalities on reaching movements has been largely studied by assessing endpoint errors after selectively perturbing sensory estimates of hand location. These studies have demonstrated that both vision and proprioception make key contributions in determining the reach endpoint. However, their influence on motor output throughout movement remains unclear. Here we used separate perturbations of posture and visual information to dissociate their effects on reaching dynamics and temporal force profiles during point-to-point reaching movements. We tested human subjects (N = 32) and found that vision and posture modulate select aspects of reaching dynamics. Specifically, altering arm posture influences the relationship between temporal force patterns and the motion-state variables of hand position and acceleration, whereas dissociating visual feedback influences the relationship between force patterns and the motion-state variables of velocity and acceleration. Next, we examined the extent these baseline motion-state relationships influence motor adaptation based on perturbations of movement dynamics. We trained subjects using a velocity-dependent force-field to probe the extent arm posture-dependent influences persisted after exposure to a motion-state dependent perturbation. Changes in the temporal force profiles due to variations in arm posture were not reduced by adaptation to novel movement dynamics, but persisted throughout learning. These results suggest that vision and posture differentially influence the internal estimation of limb state throughout movement and play distinct roles in forming the response to external perturbations during movement.

Influence of error-augmentation on the dynamics of visuomotor skill acquisition: insights from proxy-process models

Our study addresses the critical question of how learners acquire skills without the constant crutch of feedback, using a specialized training approach with intermittent feedback. Despite recognized benefits in skill retention, the underlying mechanisms of intermittent feedback in motor control neuroscience remain elusive. Leveraging a previously published dataset from visuomotor learning experiments with intermittent feedback, we tested a wide range of proxy-process models that posit the presence of an inferred error signal even when an explicit sensory performance is not present. The model structures encompassed a spectrum from first-order to higher-order variants, incorporating both constant and error-dependent rates of change in error. Furthermore, these proxy-process models investigated the impact of error-augmentation (EA) training on visuomotor learning dynamics. Rigorous cross-validation consistently identified a second-order proxy-process model structure accurately predicting motor learning across subjects and learning tasks. Model parameters elucidated the varying influences of EA settings on the rates of change in error, inter-trial variability, and steady-state performance. We then introduced a dynamic-Proxy support Multi-Rate Motor Learning (dPxMRML) model, which shed light on EA's effects on the fast and slow learning dynamics. The dPxMRML model accurately predicted subjects' performance during and beyond training phases, highlighting EA settings conducive to long-term retention. This research yields crucial insights for personalized training program design, applicable in neuro-rehabilitation, sports, and performance training.NEW & NOTEWORTHY Breaking new ground in motor learning, our research unveils the intricacies of skill acquisition without continuous feedback. By using a specialized training approach with intermittent feedback, our study reveals the previously elusive mechanisms behind this process. The introduction of innovative proxy-process models, particularly the dynamic-Proxy support Multi-Rate Motor Learning (dPxMRML) model, brings a fresh perspective to understanding the impact of error-augmentation (EA) training on learning and retention of motor skills.

Divisively normalized neuronal processing of uncertain visual feedback for visuomotor learning

When encountering a visual error during a reaching movement, the motor system improves the motor command for the subsequent trial. This improvement is impaired by visual error uncertainty, which is considered evidence that the motor system optimally estimates the error. However, how such statistical computation is accomplished remains unclear. Here, we propose an alternative scheme implemented with a divisive normalization (DN): the responses of neuronal elements are normalized by the summed activity of the population. This scheme assumes that when an uncertain visual error is provided by multiple cursors, the motor system processes the error conveyed by each cursor and integrates the information using DN. The DN model reproduced the patterns of learning response to 1-3 cursor errors and the impairment of learning response with visual error uncertainty. This study provides a new perspective on how the motor system updates motor commands according to uncertain visual error information.

Learning context shapes bimanual control strategy and generalization of novel dynamics

Bimanual movements are fundamental components of everyday actions, yet the underlying mechanisms coordinating adaptation of the two hands remain unclear. Although previous studies highlighted the contextual effect of kinematics of both arms on internal model formation, we do not know how the sensorimotor control system associates the learned memory with the experienced states in bimanual movements. More specifically, can, and if so, how, does the sensorimotor control system combine multiple states from different effectors to create and adapt a motor memory? Here, we tested motor memory formation in two groups with a novel paradigm requiring the encoding of the kinematics of the right hand to produce the appropriate predictive force on the left hand. While one group was provided with training movements in which this association was evident, the other group was trained on conditions in which this association was ambiguous. After adaptation, we tested the encoding of the learned motor memory by measuring the generalization to new movement combinations. While both groups adapted to the novel dynamics, the evident group showed a weighted encoding of the learned motor memory based on movements of the other (right) hand, whereas the ambiguous group exhibited mainly same (left) hand encoding in bimanual trials. Despite these differences, both groups demonstrated partial generalization to unimanual movements of the left hand. Our results show that motor memories can be encoded depending on the motion of other limbs, but that the training conditions strongly shape the encoding of the motor memory formation and determine the generalization to novel contexts.

Contribution of implicit memory to adaptation of movement extent during reaching against unpredictable spring-like loads: insensitivity to intentional suppression of kinematic performance

We examined the extent to which intentionally underperforming a goal-directed reaching task impacts how memories of recent performance contribute to sensorimotor adaptation. Healthy human subjects performed computerized cognition testing and an assessment of sensorimotor adaptation, wherein they grasped the handle of a horizontal planar robot while making goal-directed out-and-back reaching movements. The robot exerted forces that resisted hand motion with a spring-like load that changed unpredictably between movements. The robotic test assessed how implicit and explicit memories of sensorimotor performance contribute to the compensation for the unpredictable changes in the hand-held load. After each movement, subjects were to recall and report how far the hand moved on the previous trial (peak extent of the out-and-back movement). Subjects performed the tests under two counter-balanced conditions: one where they performed with their best effort, and one where they intentionally sabotaged (i.e., suppressed) kinematic performance. Results from the computerized cognition tests confirmed that subjects understood and complied with task instructions. When suppressing performance during the robotic assessment, subjects demonstrated marked changes in reach precision, time to capture the target, and reaction time. We fit a set of limited memory models to the data to identify how subjects used implicit and explicit memories of recent performance to compensate for the changing loads. In both sessions, subjects used implicit, but not explicit, memories from the most recent trial to adapt reaches to unpredictable spring-like loads. Subjects did not "give up" on large errors, nor did they discount small errors deemed "good enough". Although subjects clearly suppressed kinematic performance (response timing, movement variability, and self-reporting of reach error), the relative contributions of sensorimotor memories to trial-by-trial variations in task performance did not differ significantly between the two testing conditions. We conclude that intentional performance suppression had minimal impact on how implicit sensorimotor memories contribute to adaptation of unpredictable mechanical loads applied to the hand.

The effects of probabilistic context inference on motor adaptation

Humans have been shown to adapt their movements when a sudden or gradual change to the dynamics of the environment are introduced, a phenomenon called motor adaptation. If the change is reverted, the adaptation is also quickly reverted. Humans are also able to adapt to multiple changes in dynamics presented separately, and to be able to switch between adapted movements on the fly. Such switching relies on contextual information which is often noisy or misleading, affecting the switch between known adaptations. Recently, computational models for motor adaptation and context inference have been introduced, which contain components for context inference and Bayesian motor adaptation. These models were used to show the effects of context inference on learning rates across different experiments. We expanded on these works by using a simplified version of the recently-introduced COIN model to show that the effects of context inference on motor adaptation and control go even further than previously shown. Here, we used this model to simulate classical motor adaptation experiments from previous works and showed that context inference, and how it is affected by the presence and reliability of feedback, effect a host of behavioral phenomena that had so far required multiple hypothesized mechanisms, lacking a unified explanation. Concretely, we show that the reliability of direct contextual information, as well as noisy sensory feedback, typical of many experiments, effect measurable changes in switching-task behavior, as well as in action selection, that stem directly from probabilistic context inference.

A novel video game for remote studies of motor adaptation in children

Here we designed a motor adaptation video game that could be played remotely (at home) through a web browser. This required the child to adapt to a visuomotor rotation between their hand movement and a ball displayed in the game. The task had several novel features, specifically designed to allow the study of the developmental trajectory of adaptation across a wide range of ages. We test the concurrent validity by comparing children's performance on our remote task to the same task performed in the laboratory. All participants remained engaged and completed the task. We quantified feedforward and feedback control during this task. Feedforward control, a key measure of adaptation, was similar at home and in the laboratory. All children could successfully use feedback control to guide the ball to a target. Traditionally, motor learning studies are performed in a laboratory to obtain high quality kinematic data. However, here we demonstrate concurrent validity of kinematic behavior when conducted at home. Our online platform provides the flexibility and ease of collecting data that will enable future studies with large sample sizes, longitudinal experiments, and the study of children with rare diseases.

Changes in Resting State Functional Connectivity Associated with Dynamic Adaptation of Wrist Movements

Dynamic adaptation is an error-driven process of adjusting planned motor actions to changes in task dynamics (Shadmehr, 2017). Adapted motor plans are consolidated into memories that contribute to better performance on re-exposure. Consolidation begins within 15 min following training (Criscimagna-Hemminger and Shadmehr, 2008), and can be measured via changes in resting state functional connectivity (rsFC). For dynamic adaptation, rsFC has not been quantified on this timescale, nor has its relationship to adaptative behavior been established. We used a functional magnetic resonance imaging (fMRI)-compatible robot, the MR-SoftWrist (Erwin et al., 2017), to quantify rsFC specific to dynamic adaptation of wrist movements and subsequent memory formation in a mixed-sex cohort of human participants. We acquired fMRI during a motor execution and a dynamic adaptation task to localize brain networks of interest, and quantified rsFC within these networks in three 10-min windows occurring immediately before and after each task. The next day, we assessed behavioral retention. We used a mixed model of rsFC measured in each time window to identify changes in rsFC with task performance, and linear regression to identify the relationship between rsFC and behavior. Following the dynamic adaptation task, rsFC increased within the cortico-cerebellar network and decreased interhemispherically within the cortical sensorimotor network. Increases within the cortico-cerebellar network were specific to dynamic adaptation, as they were associated with behavioral measures of adaptation and retention, indicating that this network has a functional role in consolidation. Instead, decreases in rsFC within the cortical sensorimotor network were associated with motor control processes independent from adaptation and retention.SIGNIFICANCE STATEMENT Motor memory consolidation processes have been studied via functional magnetic resonance imaging (fMRI) by analyzing changes in resting state functional connectivity (rsFC) occurring more than 30 min after adaptation. However, it is unknown whether consolidation processes are detectable immediately (<15 min) following dynamic adaptation. We used an fMRI-compatible wrist robot to localize brain regions involved in dynamic adaptation in the cortico-thalamic-cerebellar (CTC) and cortical sensorimotor networks and quantified changes in rsFC within each network immediately after adaptation. Different patterns of change in rsFC were observed compared with studies conducted at longer latencies. Increases in rsFC in the cortico-cerebellar network were specific to adaptation and retention, while interhemispheric decreases in the cortical sensorimotor network were associated with alternate motor control processes but not with memory formation.

Modulation of Arm Swing Frequency and Gait Using Rhythmic Tactile Feedback

Due to the neural coupling between upper and lower limbs and the importance of interlimb coordination in human gait, focusing on appropriate arm swing should be a part of gait rehabilitation in individuals with walking impairments. Despite its vital importance, there is a lack of effective methods to exploit the potential of arm swing inclusion for gait rehabilitation. In this work, we present a lightweight and wireless haptic feedback system that provides highly synchronized vibrotactile cues to the arms to manipulate arm swing and investigate the effects of this manipulation on the subjects' gait in a study with 12 participants (20-44 years). We found the developed system effectively adjusted the subjects' arm swing and stride cycle times by significantly reducing and increasing those parameters by up to 20% and 35%, respectively, compared to their baseline values during normal walking with no feedback. Particularly, the reduction of arms' and legs' cycle times translated into a substantial increase of up to 19.3% (on average) in walking speed. The response of the subjects to the feedback was also quantified in both transient and steady-state walking. The analysis of settling times from the transient responses revealed a fast and similar adaptation of both arms' and legs' movements to the feedback for reducing cycle times (i.e., increasing speed). Conversely, larger settling times and time differences between arms' and legs' responses were observed during feedback for increasing cycle times (i.e., reducing speed). The results clearly demonstrate the potential of the developed system to induce different arm-swing patterns as well as the ability of the proposed method to modulate key gait parameters through leveraging the interlimb neural coupling, with implications for gait training.

Concurrent Contribution of Co-Contraction to Error Reduction During Dynamic Adaptation of the Wrist

MRI-compatible robots provide a means of studying brain function involved in complex sensorimotor learning processes, such as adaptation. To properly interpret the neural correlates of behavior measured using MRI-compatible robots, it is critical to validate the measurements of motor performance obtained via such devices. Previously, we characterized adaptation of the wrist in response to a force field applied via an MRI-compatible robot, the MR-SoftWrist. Compared to arm reaching tasks, we observed lower end magnitude of adaptation, and reductions in trajectory errors beyond those explained by adaptation. Thus, we formed two hypotheses: that the observed differences were due to measurement errors of the MR-SoftWrist; or that impedance control plays a significant role in control of wrist movements during dynamic perturbations. To test both hypotheses, we performed a two-session counterbalanced crossover study. In both sessions, participants performed wrist pointing in three force field conditions (zero force, constant, random). Participants used either the MR-SoftWrist or the UDiffWrist, a non-MRI-compatible wrist robot, for task execution in session one, and the other device in session two. To measure anticipatory co-contraction associated with impedance control, we collected surface EMG of four forearm muscles. We found no significant effect of device on behavior, validating the measurements of adaptation obtained with the MR-SoftWrist. EMG measures of co-contraction explained a significant portion of the variance in excess error reduction not attributable to adaptation. These results support the hypothesis that for the wrist, impedance control significantly contributes to reductions in trajectory errors in excess of those explained by adaptation.

Distinct adaptation processes underlie multidigit force coordination for dexterous manipulation

The human sensorimotor system can adapt to various changes in the environmental dynamics by updating motor commands to improve performance after repeated exposure to the same task. However, the characteristics and mechanisms of the adaptation process remain unknown for dexterous manipulation, a unique motor task in which the body physically interacts with the environment with multiple effectors, i.e., digits, in parallel. We addressed this gap by using robotic manipulanda to investigate the changes in the digit force coordination following mechanical perturbation of an object held by tripod grasps. As the participants gradually adapted to lifting the object under perturbations, we quantified two components of digit force coordination. One is the direction-specific manipulation moment that directly counteracts the perturbation, whereas the other one is the direction-independent internal moment that supports the stability and stiffness of the grasp. We found that trial-to-trial improvement of task performance was associated with increased manipulation moment and a gradual decrease of the internal moment. These two moments were characterized by different rates of adaptation. We also examined how these two force coordination components respond to changes in perturbation directions. Importantly, we found that the manipulation moment was sensitive to the extent of repetitive exposure to the previous context that has an opposite perturbation direction, whereas the internal moment did not. However, the internal moment was sensitive to whether the postchange perturbation direction was previously experienced. Our results reveal, for the first time, that two distinct processes underlie the adaptation of multidigit force coordination for dexterous manipulation.NEW & NOTEWORTHY Changes in digit force coordination in multidigit object manipulation were quantified with a novel experimental design in which human participants adapted to mechanical perturbations applied to the object. Our results show that the adaptation of digit force coordination can be characterized by two distinct components that operate at different timescales. We further show that these two components respond to changes in perturbation direction differently.

Pupil diameter tracked during motor adaptation in humans

Pupil diameter, under constant illumination, is known to reflect individuals' internal states, such as surprise about observation and environmental uncertainty. Despite the growing use of pupillometry in cognitive learning studies as an additional measure for examining internal states, few studies have used pupillometry in human motor learning studies. Here, we provide the first detailed characterization of pupil diameter changes in a short-term reach adaptation paradigm. We measured pupil changes in 121 human participants while they adapted to abrupt, gradual, or switching force field conditions. Sudden increases in movement error caused by the introduction/reversal of the force field resulted in strong phasic pupil dilation during movement accompanied by a transient increase in tonic premovement baseline pupil diameter in subsequent trials. In contrast, pupil responses were reduced when the force field was gradually introduced, indicating that large, unexpected errors drove the changes in pupil responses. Interestingly, however, error-induced pupil responses gradually became insensitive after experiencing multiple force field reversals. We also found an association between baseline pupil diameter and incidental knowledge of the gradually introduced perturbation. Finally, in all experiments, we found a strong co-occurrence of larger baseline pupil diameter with slower reaction and movement times after each rest break. Collectively, these results suggest that tonic baseline pupil diameter reflects one's belief about environmental uncertainty, whereas phasic pupil dilation during movement reflects surprise about a sensory outcome (i.e., movement error), and both effects are modulated by novelty. Our results provide a new approach for nonverbally assessing participants' internal states during motor learning.NEW & NOTEWORTHY Pupil diameter is known as a noninvasive window into individuals' internal states. Despite the growing use of pupillometry in cognitive learning studies, it receives little attention in motor learning studies. Here, we characterized the pupil responses in a short-term reach adaptation paradigm by measuring pupil diameter of human participants while they adapted to abrupt, gradual, or switching force field conditions. Our results demonstrate how surprise and uncertainty reflected in pupil diameter develop during motor adaptation.

Exploration of sensory-motor tradeoff behavior in Parkinson's disease

While slowness of movement is an obligatory characteristic of Parkinson's disease (PD), there are conditions in which patients move uncharacteristically fast, attributed to deficient motor inhibition. Here we investigate deficient inhibition in an optimal sensory-motor integration framework, using a game in which subjects used a paddle to catch a virtual ball. Display of the ball was extinguished as soon as the catching movement started, segregating the task into a sensing and acting phase. We analyzed the behavior of 9 PD patients (ON medication) and 10 age-matched controls (HC). The switching times (between sensing and acting phase) were compared to the predicted optimal switching time, based on the individual estimates of sensory and motor uncertainties. The comparison showed that deviation from predicted optimal switching times were similar between groups. However, PD patients showed a weaker correlation between variability in switching time and sensory-motor uncertainty, indicating a reduced propensity to generate exploratory behavior for optimizing goal-directed movements. Analysis of the movement kinematics revealed that PD patients, compared to controls, used a lower peak velocity of the paddle and intercepted the ball with greater velocity. Adjusting the trial duration to the time for the paddle to stop moving, we found that PD patients spent a smaller proportion of the trial duration for observing the ball. Altogether, the results do not show the premature movement initiation and truncated sensory processing that we predicted to ensue from deficient inhibition in PD.

Contextual cues are not unique for motor learning: Task-dependant switching of feedback controllers

The separation of distinct motor memories by contextual cues is a well known and well studied phenomenon of feedforward human motor control. However, there is no clear evidence of such context-induced separation in feedback control. Here we test both experimentally and computationally if context-dependent switching of feedback controllers is possible in the human motor system. Specifically, we probe visuomotor feedback responses of our human participants in two different tasks—stop and hit—and under two different schedules. The first, blocked schedule, is used to measure the behaviour of stop and hit controllers in isolation, showing that it can only be described by two independent controllers with two different sets of control gains. The second, mixed schedule, is then used to compare how such behaviour evolves when participants regularly switch from one task to the other. Our results support our hypothesis that there is contextual switching of feedback controllers, further extending the accumulating evidence of shared features between feedforward and feedback control.

Extensive evidence has demonstrated that humans can learn distinct motor memories (i.e. independent feedforward controllers) using contextual cues. However, there is little evidence that such contextual cues produce similar separation of feedback controllers. As accumulating evidence highlights the connection between feedforward and feedback control, we propose that context may be used to separate feedback controllers as well. It has not been trivial to test experimentally whether a change in context also modulates the feedback control, as the controller output is affected by other non-contextual factors such as movement kinematics, time-to-target or the properties of the perturbation used to probe the control. Here we present a computational approach based on normative modelling where we separate the effects of the context from other non-contextual effects on the visuomotor feedback system. We then show experimentally that task context independently modulates the feedback control in a particular manner that can be reliably predicted using optimal feedback control.

Reach adaption to a visuomotor gain with terminal error feedback involves reinforcement learning

Motor adaptation can be achieved through error-based learning, driven by sensory prediction errors, or reinforcement learning, driven by reward prediction errors. Recent work on visuomotor adaptation has shown that reinforcement learning leads to more persistent adaptation when visual feedback is removed, compared to error-based learning in which continuous visual feedback of the movement is provided. However, there is evidence that error-based learning with terminal visual feedback of the movement (provided at the end of movement) may be driven by both sensory and reward prediction errors. Here we examined the influence of feedback on learning using a visuomotor adaptation task in which participants moved a cursor to a single target while the gain between hand and cursor movement displacement was gradually altered. Different groups received either continuous error feedback (EC), terminal error feedback (ET), or binary reinforcement feedback (success/fail) at the end of the movement (R). Following adaptation we tested generalization to targets located in different directions and found that generalization in the ET group was intermediate between the EC and R groups. We then examined the persistence of adaptation in the EC and ET groups when the cursor was extinguished and only binary reward feedback was provided. Whereas performance was maintained in the ET group, it quickly deteriorated in the EC group. These results suggest that terminal error feedback leads to a more robust form of learning than continuous error feedback. In addition our findings are consistent with the view that error-based learning with terminal feedback involves both error-based and reinforcement learning.

Random Practice Enhances Retention and Spatial Transfer in Force Field Adaptation

The contextual-interference effect is a frequently examined phenomenon in motor skill learning but has not been extensively investigated in motor adaptation. Here, we first tested experimentally if the contextual-interference effect is detectable in force field adaptation regarding retention and spatial transfer, and then fitted state-space models to the data to relate the findings to the “forgetting-and-reconstruction hypothesis”. Thirty-two participants were divided into two groups with either a random or a blocked practice schedule. They practiced reaching to four targets and were tested 10 min and 24 h afterward for motor retention and spatial transfer on an interpolation and an extrapolation target, and on targets which were shifted 10 cm away. The adaptation progress was participant-specifically fitted with 4-slow-1-fast state-space models accounting for generalization and set breaks. The blocked group adapted faster (p = 0.007) but did not reach a better adaptation at practice end. We found better retention (10 min), interpolation transfer (10 min), and transfer to shifted targets (10 min and 24 h) for the random group (each p < 0.05). However, no differences were found for retention or for the interpolation target after 24 h. Neither group showed transfer to the extrapolation target. The extended state-space model could replicate the behavioral results with some exceptions. The study shows that the contextual-interference effect is partially detectable in practice, short-term retention, and spatial transfer in force field adaptation; and that state-space models provide explanatory descriptions for the contextual-interference effect in force field adaptation.

The decay and consolidation of effector-independent motor memories

Learning a motor adaptation task produces intrinsically unstable or transient motor memories. Despite the presence of effector-independent motor memories following the learning of novel environmental dynamics, it remains largely unknown how those memory traces decay in different contexts and whether an "offline" consolidation period protects memories against decay. Here, we exploit inter-effector transfer to address these questions. We found that newly acquired motor memories formed with one effector could be partially retrieved by the untrained effector to enhance its performance when the decay occurred with the passage of time or "washout" trials on which error feedback was provided. The decay of motor memories was slower following "error-free" trials, on which errors were artificially clamped to zero or removed, compared with "washout" trials. However, effector-independent memory components were abolished following movements made in the absence of task errors, resulting in no transfer gains. The brain can stabilize motor memories during daytime wakefulness. We found that 6 h of wakeful resting increased the resistance of effector-independent memories to decay. Collectively, our results suggest that the decay of effector-independent motor memories is context-dependent, and offline processing preserves those memories against decay, leading to improvements of the subsequent inter-effector transfer.

Individual Differences in Sensorimotor Adaptation Are Conserved Over Time and Across Force-Field Tasks

Sensorimotor adaptation enables the nervous system to modify actions for different conditions and environments. Many studies have investigated factors that influence adaptation at the group level. There is growing recognition that individuals vary in their ability to adapt motor skills and that a better understanding of individual differences in adaptation may inform how motor skills are taught and rehabilitated. Here we examined individual differences in the adaptation of upper-limb reaching movements. We quantified the extent to which participants adapted their movements to a velocity-dependent force field during an initial session, at 24 h, and again 1-week later. Participants (n = 28) displayed savings, which was expressed as greater initial adaptation when re-exposed to the force field. Individual differences in adaptation across various stages of the experiment displayed weak-strong reliability, such that individuals who adapted to a greater extent in the initial session tended to do so when re-exposed to the force field. Our second experiment investigated if individual differences in adaptation are also present when participants adapt to different force fields or a force field and visuomotor rotation. Separate groups of participants adapted to position- and velocity-dependent force fields (Experiment 2a; n = 20) or a velocity-dependent force field and visuomotor rotation in a single session (Experiment 2b; n = 20). Participants who adapted to a greater extent to velocity-dependent forces tended to show a greater extent of adaptation when exposed to position-dependent forces. In contrast, correlations were weak between various stages of adaptation to the force-field and visuomotor rotation. Collectively, our study reveals individual differences in adaptation that are reliable across repeated exposure to the same force field and present when adapting to different force fields.

Contextual inference underlies the learning of sensorimotor repertoires

ASBTRACT

Humans spend a lifetime learning, storing and refining a repertoire of motor memories. For example, through experience, we become proficient at manipulating a large range of objects with distinct dynamical properties. However, it is unknown what principle underlies how our continuous stream of sensorimotor experience is segmented into separate memories and how we adapt and use this growing repertoire. Here we develop a theory of motor learning based on the key principle that memory creation, updating and expression are all controlled by a single computation-contextual inference. Our theory reveals that adaptation can arise both by creating and updating memories (proper learning) and by changing how existing memories are differentially expressed (apparent learning). This insight enables us to account for key features of motor learning that had no unified explanation: spontaneous recovery¹, savings², anterograde interference³, how environmental consistency affects learning rate^4,5 and the distinction between explicit and implicit learning⁶. Critically, our theory also predicts new phenomena-evoked recovery and context-dependent single-trial learning-which we confirm experimentally. These results suggest that contextual inference, rather than classical single-context mechanisms^1,4,7-9, is the key principle underlying how a diverse set of experiences is reflected in our motor behaviour.

Direct and indirect cues can enable dual adaptation, but through different learning processes

Switching between motor tasks requires accurate adjustments for changes in dynamics (grasping a cup) or sensorimotor transformations (moving a computer mouse). Dual-adaptation studies have investigated how learning of context-dependent dynamics or transformations is enabled by sensory cues. However, certain cues, such as color, have shown mixed results. We propose that these mixed results may arise from two major classes of cues: "direct" cues, which are part of the dynamic state and "indirect" cues, which are not. We hypothesized that explicit strategies would primarily account for the adaptation of an indirect color cue but would be limited to simple tasks, whereas a direct visual separation cue would allow implicit adaptation regardless of task complexity. To test this idea, we investigated the relative contribution of implicit and explicit learning in relation to contextual cue type (colored or visually shifted workspace) and task complexity (1 or 8 targets) in a dual-adaptation task. We found that the visual workspace location cue enabled adaptation across conditions primarily through implicit adaptation. In contrast, we found that the color cue was largely ineffective for dual adaptation, except in a small subset of participants who appeared to use explicit strategies. Our study suggests that the previously inconclusive role of color cues in dual adaptation may be explained by differential contribution of explicit strategies across conditions.NEW & NOTEWORTHY We present evidence that learning of context-dependent dynamics proceeds via different processes depending on the type of sensory cue used to signal the context. Visual workspace location enabled learning different dynamics implicitly, presumably because it directly enters the dynamic state estimate. In contrast, a color cue was only successful where learners were apparently able to leverage explicit strategies to account for changed dynamics. This suggests a unification for the previously inconclusive role of color cues.

Direction-Specific Iterative Tuning of Motor Commands With Local Generalization During Randomized Reaching Practice Across Movement Directions

During motor learning, people often practice reaching in variety of movement directions in a randomized sequence. Such training has been shown to enhance retention and transfer capability of the acquired skill compared to the blocked repetition of the same movement direction. The learning system must accommodate such randomized order either by having a memory for each movement direction, or by being able to generalize what was learned in one movement direction to the controls of nearby directions. While our preliminary study used a comprehensive dataset from visuomotor learning experiments and evaluated the first-order model candidates that considered the memory of error and generalization across movement directions, here we expanded our list of candidate models that considered the higher-order effects and error-dependent learning rates. We also employed cross-validation to select the leading models. We found that the first-order model with a constant learning rate was the best at predicting learning curves. This model revealed an interaction between the learning and forgetting processes using the direction-specific memory of error. As expected, learning effects were observed at the practiced movement direction on a given trial. Forgetting effects (error increasing) were observed at the unpracticed movement directions with learning effects from generalization from the practiced movement direction. Our study provides insights that guide optimal training using the machine-learning algorithms in areas such as sports coaching, neurorehabilitation, and human-machine interactions.

Moving objects by imagination? Amount of finger movement and pendulum length determine success in the Chevreul pendulum illusion

Hand-held pendulums can seemingly oscillate on their own, without perceived conscious control. This illusion, named after Chevreul, is likely a result of ideomotor movements. While this phenomenon was originally assumed to have a supernatural basis, it has been accepted for over 150 years that the movements are self-generated. However, until now, recordings of the small movements that create these oscillations have not been performed. In this study, we examined how participants produce these unconscious oscillations using a motion capture system. As expected, the Chevreul pendulum illusion was produced when the fingers holding the pendulum generated an oscillating frequency close to the resonant frequency of the pendulum, where very small driving movements of the arm are sufficient to produce relatively large pendulum motion. We found that pendulum length significantly affected the ability to produce the illusion - participants were much more successful with a 40 cm compared to an 80 cm pendulum. Further, we found that participants that tended to move their fingers more were more successful in producing the illusion but did not find a connection between inter-joint coordination and ability to generate the illusion.

Whole body adaptation to novel dynamics does not transfer between effectors

How does the brain coordinate concurrent adaptation of arm movements and standing posture? From previous studies, the postural control system can use information about previously adapted arm movement dynamics to plan appropriate postural control; however, it is unclear whether postural control can be adapted and controlled independently of arm control. The present study addresses that question. Subjects practiced planar reaching movements while standing and grasping the handle of a robotic arm, which generated a force field to create novel perturbations. Subjects were divided into two groups, for which perturbations were introduced in either an abrupt or a gradual manner. All subjects adapted to the perturbations while reaching with their dominant (right) arm and then switched to reaching with their nondominant (left) arm. Previous studies of seated reaching movements showed that abrupt perturbation introduction led to transfer of learning between arms, but gradual introduction did not. Interestingly, in this study neither group showed evidence of transferring adapted control of arm or posture between arms. These results suggest primarily that adapted postural control cannot be transferred independently of arm control in this task paradigm. In other words, whole body postural movement planning related to a concurrent arm task is dependent on information about arm dynamics. Finally, we found that subjects were able to adapt to the gradual perturbation while experiencing very small errors, suggesting that both error size and consistency play a role in driving motor adaptation.NEW & NOTEWORTHY This study examined adaptation of arm and postural control to novel dynamics while standing and reaching and subsequent transfer between reaching arms. Neither arm nor postural control was transferred between arms, suggesting that postural planning is highly dependent on the concurrent arm movement.

Motor planning under uncertainty

Actions often require the selection of a specific goal amongst a range of possibilities, like when a softball player must precisely position her glove to field a fast-approaching ground ball. Previous studies have suggested that during goal uncertainty the brain prepares for all potential goals in parallel and averages the corresponding motor plans to command an intermediate movement that is progressively refined as additional information becomes available. Although intermediate movements are widely observed, they could instead reflect a neural decision about the single best action choice given the uncertainty present. Here we systematically dissociate these possibilities using novel experimental manipulations and find that when confronted with uncertainty, humans generate a motor plan that optimizes task performance rather than averaging potential motor plans. In addition to accurate predictions of population-averaged changes in motor output, a novel computational model based on this performance-optimization theory accounted for a majority of the variance in individual differences between participants. Our findings resolve a long-standing question about how the brain selects an action to execute during goal uncertainty, providing fundamental insight into motor planning in the nervous system.

An implicit memory of errors limits human sensorimotor adaptation

During extended motor adaptation, learning appears to saturate despite persistence of residual errors. This adaptation limit is not fixed but varies with perturbation variance; when variance is high, residual errors become larger. These changes in total adaptation could relate to either implicit or explicit learning systems. Here, we found that when adaptation relied solely on the explicit system, residual errors disappeared and learning was unaltered by perturbation variability. In contrast, when learning depended entirely, or in part, on implicit learning, residual errors reappeared. Total implicit adaptation decreased in the high-variance environment due to changes in error sensitivity, not in forgetting. These observations suggest a model in which the implicit system becomes more sensitive to errors when they occur in a consistent direction. Thus, residual errors in motor adaptation are at least in part caused by an implicit learning system that modulates its error sensitivity in response to the consistency of past errors.

Contributions of implicit and explicit memories to sensorimotor adaptation of movement extent during goal-directed reaching

We examined how implicit and explicit memories contribute to sensorimotor adaptation of movement extent during goal-directed reaching. Twenty subjects grasped the handle of a horizontal planar robot that rendered spring-like resistance to movement. Subjects made rapid “out-and-back” reaches to capture a remembered visual target at the point of maximal reach extent. The robot’s resistance changed unpredictably between reaches, inducing target capture errors that subjects attempted to correct from one trial to the next. Each subject performed over 400 goal-directed reaching trials. Some trials were performed without concurrent visual cursor feedback of hand motion. Some trials required self-assessment of performance between trials, whereby subjects reported peak reach extent on the most recent trial. This was done by either moving a cursor on a horizontal display (visual self-assessment), or by moving the robot’s handle back to the recalled location (proprioceptive self-assessment). Control condition trials performed either without or with concurrent visual cursor feedback of hand motion did not require self-assessments. We used step-wise linear regression analyses to quantify the extent to which prior reach errors and explicit memories of reach extent contribute to subsequent reach performance. Consistent with prior reports, providing concurrent visual feedback of hand motion increased reach accuracy and reduced the impact of past performance errors on future performance, relative to the corresponding no-vision control condition. By contrast, we found no impact of interposed self-assessment on subsequent reach performance or on how prior target capture errors influence subsequent reach performance. Self-assessments were biased toward the remembered target location and they spanned a compressed range of values relative to actual reach extents, demonstrating that declarative memories of reach performance systematically differed from actual performances. We found that multilinear regression could best account for observed data variability when the regression model included only implicit memories of prior reach performance; including explicit memories (self-assessments) in the model did not improve its predictive accuracy. We conclude therefore that explicit memories of prior reach performance do not contribute to implicit sensorimotor adaptation of movement extent during goal-directed reaching under conditions of environmental uncertainty.

On the encoding capacity of human motor adaptation

Primitive-based models of motor learning suggest that adaptation occurs by tuning the responses of motor primitives. Based on this idea, we consider motor learning as an information encoding procedure, that is, a procedure of encoding a motor skill into primitives. The capacity of encoding is determined by the number of recruited primitives, which depends on how many primitives are "visited" by the movement, and this leads to a rather counterintuitive prediction that faster movement, where a larger number of motor primitives are involved, allows learning more complicated motor skills. Here, we provide a set of experimental results that support this hypothesis. First, we show that learning occurs only with movement, that is, only with nonzero encoding capacity. When participants were asked to counteract a rotating force applied to a robotic handle, they were unable to do so when maintaining a static posture but were able to adapt when making small circular movements. Our second experiment further investigated how adaptation is affected by movement speed. When adapting to a simple (low-information-content) force field, fast (high-capacity) movement did not have an advantage over slow (low-capacity) movement. However, for a complex (high-information-content) force field, the fast movement showed a significant advantage over slow movement. Our final experiment confirmed that the observed benefit of high-speed movement is only weakly affected by mechanical factors. Taken together, our results suggest that the encoding capacity is a genuine limiting factor of human motor adaptation.NEW & NOTEWORTHY We propose a novel concept called "encoding capacity" of motor adaptation, which describes an inherent limiting-factor of our brain's ability to learn new motor skills, just like any other storage system. By reinterpreting the existing primitive-based models of motor learning, we hypothesize that the encoding capacity is determined by the size of the movement, and present a set of experimental evidence suggesting that such limiting effect of encoding capacity does exist in human motor adaptation.

Hierarchical motor adaptations negotiate failures during force field learning

Humans have the amazing ability to learn the dynamics of the body and environment to develop motor skills. Traditional motor studies using arm reaching paradigms have viewed this ability as the process of ‘internal model adaptation’. However, the behaviors have not been fully explored in the case when reaches fail to attain the intended target. Here we examined human reaching under two force fields types; one that induces failures (i.e., target errors), and the other that does not. Our results show the presence of a distinct failure-driven adaptation process that enables quick task success after failures, and before completion of internal model adaptation, but that can result in persistent changes to the undisturbed trajectory. These behaviors can be explained by considering a hierarchical interaction between internal model adaptation and the failure-driven adaptation of reach direction. Our findings suggest that movement failure is negotiated using hierarchical motor adaptations by humans.

How do we improve actions after a movement failure? Although negotiating movement failures is obviously crucial, previous motor-control studies have predominantly examined human movement adaptations in the absence of failures, and it remains unclear how failures affect subsequent movement adaptations. Here we examined this issue by developing a novel force field adaptation task where the hand movement during an arm reaching is perturbed by novel forces that induce a large target error, that is a failure. Our experimental observation and computational modeling show that, in addition to the popular ‘internal model learning’ process of motor adaptations, humans also utilize a ‘failure-negotiating’ process, that enables them to quickly improve movements in the presence of failure, even at the expense of increased arm trajectory deflections, which are subsequently reduced gradually with training after the achievement of the task success. Our results suggest that a hierarchical interaction between these two processes is a key for humans to negotiate movement failures.

Experience of After-Effect of Memory Update Reduces Sensitivity to Errors During Sensory-Motor Adaptation Task

Motor learning is the process of updating motor commands in response to a trajectory error induced by a perturbation to the body or vision. The brain has a great capability to accelerate learning by increasing the sensitivity of the memory update to the perceived trajectory errors. Conventional theory suggests that the statistics of perturbations or the statistics of the experienced errors induced by the external perturbations determine the learning speeds. However, the potential effect of another type of error perception, a self-generated error as a result of motor command updates (i.e., an aftereffect), on the learning speeds has not been examined yet. In this study, we dissociated the two kinds of errors by controlling the perception of the aftereffect using a channel-force environment. One group experienced errors due to the aftereffect of the learning process, while the other did not. We found that the participants who perceived the aftereffect of the memory updates exhibited a significant decrease in error-sensitivity, whereas the participants who did not perceive the aftereffect did not show an increase or decrease in error-sensitivity. This suggests that the perception of the aftereffect of learning attenuated updating the motor commands from the perceived errors. Thus, both self-generated and externally induced errors may modulate learning speeds.

Computational reproductions of external force field adaption without assuming desired trajectories

Optimal feedback control is an established framework that is used to characterize human movement. However, it is not fully understood how the brain computes optimal gains through interactions with the environment. In the past study, we proposed a model of motor learning that identifies a set of feedback and feedforward controllers and a state predictor of the arm musculoskeletal system to control free reaching movements. In this study, we applied the model to force field adaptation tasks where normal reaching movements are disturbed by an external force imposed on the hand. Without a priori knowledge about the arm and environment, the model was able to adapt to the force field by generating counteracting forces to overcome it in a manner similar to what is reported in the behavioral literature. The kinematics of the movements generated by our model share characteristic features of human movements observed before and after force field adaptation. In addition, we demonstrate that the structure and learning algorithm introduced in our model induced a shift in the end-point's equilibrium position and a static force modulation, accompanied by a fast and a slow learning process. Importantly, our model does not require desired trajectories, yields movements without specifying movement duration, and predicts force generation patterns by exploring the environment. Our model demonstrates a possible mechanism through which the central nervous system may control and adapt a point-to-point reaching movement without specifying a desired trajectory by continuously updating the body's musculoskeletal model.

Using asymmetry to your advantage: learning to acquire and accept external assistance during prolonged split-belt walking

People can learn to exploit external assistance during walking to reduce energetic cost. For example, walking on a split-belt treadmill affords the opportunity for people to redistribute the mechanical work performed by the legs to gain assistance from the difference in belts' speed and reduce energetic cost. Though we know what people should do to acquire this assistance, this strategy is not observed during typical adaptation studies. We hypothesized that extending the time allotted for adaptation would result in participants adopting asymmetric step lengths to increase the assistance they can acquire from the treadmill. Here, participants walked on a split-belt treadmill for 45 min while we measured spatiotemporal gait variables, metabolic cost, and mechanical work. We show that when people are given sufficient time to adapt, they naturally learn to step further forward on the fast belt, acquire positive mechanical work from the treadmill, and reduce the positive work performed by the legs. We also show that spatiotemporal adaptation and energy optimization operate over different timescales: people continue to reduce energetic cost even after spatiotemporal changes have plateaued. Our findings support the idea that walking with symmetric step lengths, which is traditionally thought of as the endpoint of adaptation, is only a point in the process by which people learn to take advantage of the assistance provided by the treadmill. These results provide further evidence that reducing energetic cost is central in shaping adaptive locomotion, but this process occurs over more extended timescales than those used in typical studies.NEW & NOTEWORTHY Split-belt treadmill adaptation can be seen as a process where people learn to acquire positive work from the treadmill to reduce energetic cost. Though we know what people should do to reduce energetic cost, this strategy is not observed during adaptation studies. We extended the duration of adaptation and show that people continuously adapt their gait to acquire positive work from the treadmill to reduce energetic cost. This process requires longer exposure than traditionally allotted.

Timescales of motor memory formation in dual-adaptation

The timescales of adaptation to novel dynamics are well explained by a dual-rate model with slow and fast states. This model can predict interference, savings and spontaneous recovery, but cannot account for adaptation to multiple tasks, as each new task drives unlearning of the previously learned task. Nevertheless, in the presence of appropriate contextual cues, humans are able to adapt simultaneously to opposing dynamics. Consequently this model was expanded, suggesting that dual-adaptation occurs through a single fast process and multiple slow processes. However, such a model does not predict spontaneous recovery within dual-adaptation. Here we assess the existence of multiple fast processes by examining the presence of spontaneous recovery in two experimental variations of an adaptation-de-adaptation-error-clamp paradigm within dual-task adaptation in humans. In both experiments, evidence for spontaneous recovery towards the initially learned dynamics (A) was found in the error-clamp phase, invalidating the one-fast-two-slow dual-rate model. However, as adaptation is not only constrained to two timescales, we fit twelve multi-rate models to the experimental data. BIC model comparison again supported the existence of two fast processes, but extended the timescales to include a third rate: the ultraslow process. Even within our single day experiment, we found little evidence for decay of the learned memory over several hundred error-clamp trials. Overall, we show that dual-adaptation can be best explained by a two-fast-triple-rate model over the timescales of adaptation studied here. Longer term learning may require even slower timescales, explaining why we never forget how to ride a bicycle.

Retaining motor skills is crucial to perform basic daily life tasks. However we still have limited understanding of the computational structure of these motor memories, an understanding that is critical for designing rehabilitation. Here we demonstrate that learning any task involves adaptation of independent fast, slow and ultraslow processes to build a motor memory. The selection of the appropriate motor memory is gated through a contextual cue. Together this work extends our understanding of the architecture of motor memories, by merging disparate computational theories to propose a new model.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

Motor memories in manipulation tasks are linked to contact goals between objects

Skillful manipulation requires forming memories of object dynamics, linking applied force to motion. Although it has been assumed that such memories are linked to objects, a recent study showed that people can form separate memories when these are linked to different controlled points on an object (Heald JB, Ingram JN, Flanagan JR, Wolpert DM. Nat Hum Behav 2: 300-311, 2018). In that study, participants controlled the handle of a robotic device to move a virtual bar with circles (control points) on the left and right sides. Participants were instructed to move either the left or right control point to a target on the left or right, respectively, such that the required movement was constant. When these control points were paired with opposing force fields, adaptation was observed. In this previous study, both the controlled point and the target changed between contexts. To assess which of these factors is critical for learning, here, we used a similar paradigm but with a bar that automatically rotated as it was moved. In the first experiment, the bar rotated, such that the left and right control points moved to a common target. In the second experiment, the bar rotated such that a single control point moved to a target located on either the left or right. In both experiments, participants were able to learn opposing force fields applied in the two contexts. We conclude that separate memories of dynamics can be formed for different "contact goals," involving a unique combination of the controlled point on an object and the target location this point "contacts."NEW & NOTEWORTHY Skilled manipulation requires forming memories of object dynamics, previously assumed to be associated with entire objects. However, we recently demonstrated that people can form multiple motor memories when explicitly instructed to move different locations on an object to different targets. Here, we show that separate motor memories can be learned for different contact goals, which involve a unique combination of a control point and target.

Time course of changes in the long-latency feedback response parallels the fast process of short-term motor adaptation

Adapting to novel dynamics involves modifying both feedforward and feedback control. We investigated whether the motor system alters feedback responses during adaptation to a novel force field in a manner similar to adjustments in feedforward control. We simultaneously tracked the time course of both feedforward and feedback systems via independent probes during a force field adaptation task. Participants (n = 35) grasped the handle of a robotic manipulandum and performed reaches to a visual target while the hand and arm were occluded. We introduced an abrupt counterclockwise velocity-dependent force field during a block of reaching trials. We measured movement kinematics and shoulder and elbow muscle activity with surface EMG electrodes. We tracked the feedback stretch response throughout the task. Using force channel trials, we measured overall learning, which was later decomposed into a fast and slow process. We found that the long-latency feedback response (LLFR) was upregulated in the early stages of learning and was correlated with the fast component of feedforward adaptation. The change in feedback response was specific to the long-latency epoch (50-100 ms after muscle stretch) and was observed only in the triceps muscle, which was the muscle required to counter the force field during adaptation. The similarity in time course for the LLFR and the estimated time course of the fast process suggests both are supported by common neural circuits. While some propose that the fast process reflects an explicit strategy, we argue instead that it may be a proxy for the feedback controller.NEW & NOTEWORTHY We investigated whether changes in the feedback stretch response were related to the proposed fast and slow processes of motor adaptation. We found that the long-latency component of the feedback stretch response was upregulated in the early stages of learning and the time course was correlated with the fast process. While some propose that the fast process reflects an explicit strategy, we argue instead that it may be a proxy for the feedback controller.

A Survey on the Use of Haptic Feedback for Brain-Computer Interfaces and Neurofeedback

Neurofeedback (NF) and brain-computer interface (BCI) applications rely on the registration and real-time feedback of individual patterns of brain activity with the aim of achieving self-regulation of specific neural substrates or control of external devices. These approaches have historically employed visual stimuli. However, in some cases vision is unsuitable or inadequately engaging. Other sensory modalities, such as auditory or haptic feedback have been explored, and multisensory stimulation is expected to improve the quality of the interaction loop. Moreover, for motor imagery tasks, closing the sensorimotor loop through haptic feedback may be relevant for motor rehabilitation applications, as it can promote plasticity mechanisms. This survey reviews the various haptic technologies and describes their application to BCIs and NF. We identify major trends in the use of haptic interfaces for BCI and NF systems and discuss crucial aspects that could motivate further studies.

Principles of operation of a cerebellar learning circuit

We provide behavioral evidence using monkey smooth pursuit eye movements for four principles of cerebellar learning. Using a circuit-level model of the cerebellum, we link behavioral data to learning's neural implementation. The four principles are: (1) early, fast, acquisition driven by climbing fiber inputs to the cerebellar cortex, with poor retention; (2) learned responses of Purkinje cells guide transfer of learning from the cerebellar cortex to the deep cerebellar nucleus, with excellent retention; (3) functionally different neural signals are subject to learning in the cerebellar cortex versus the deep cerebellar nuclei; and (4) negative feedback from the cerebellum to the inferior olive reduces the magnitude of the teaching signal in climbing fibers and limits learning. Our circuit-level model, based on these four principles, explains behavioral data obtained by strategically manipulating the signals responsible for acquisition and recall of direction learning in smooth pursuit eye movements across multiple timescales.

Time-to-Target Simplifies Optimal Control of Visuomotor Feedback Responses

Visuomotor feedback responses vary in intensity throughout a reach, commonly explained by optimal control. Here, we show that the optimal control for a range of movements with the same goal can be simplified to a time-to-target dependent control scheme. We measure our human participants’ visuomotor responses in five reaching conditions, each with different hand or cursor kinematics. Participants only produced different feedback responses when these kinematic changes resulted in different times-to-target. We complement our experimental data with a range of finite and non-finite horizon optimal feedback control (OFC) models, finding that the model with time-to-target as one of the input parameters best replicates the experimental data. Overall, this suggests that time-to-target is a critical control parameter in online feedback control. Moreover, we propose that for a specific task and known dynamics, humans can instantly produce a control signal without any additional online computation allowing rapid response onset and close to optimal control.

Assessing explicit strategies in force field adaptation

In recent years, it has become increasingly clear that a number of learning processes are at play in visuomotor adaptation tasks. In addition to implicitly adapting to a perturbation, learners can develop explicit knowledge allowing them to select better actions in responding to it. Advances in visuomotor rotation experiments have underscored the important role of such "explicit learning" in shaping adaptation to kinematic perturbations. Yet, in adaptation to dynamic perturbations, its contribution has been largely overlooked. We therefore sought to approach the assessment of explicit learning in adaptation to dynamic perturbations, by developing two novel modifications of a force field experiment. First, we asked learners to abandon any cognitive strategy before selected force channel trials to expose consciously accessible parts of overall learning. Here, learners indeed reduced compensatory force compared with standard Catch channels. Second, we instructed a group of learners to mimic their right hand's adaptation by moving with their naïve left hand. While a control group displayed negligible left hand force compensation, the mimicking group reported forces that approximated right hand adaptation but appeared to under-report the velocity component of the force field in favor of a more position-based component. Our results highlight the viability of explicit learning as a potential contributor to force field adaptation, though the fraction of learning under participants' deliberate control on average remained considerably smaller than that of implicit learning, despite task conditions favoring explicit learning. The methods we employed provide a starting point for investigating the contribution of explicit strategies to force field adaptation.NEW & NOTEWORTHY While the contribution of explicit learning has been increasingly studied in visuomotor adaptation, its contribution to force field adaptation has not been studied extensively. We employed two novel methods to assay explicit learning in a force field adaptation task and found that learners can voluntarily control aspects of compensatory force production and manually report it with their untrained limb. This supports the general viability of the contribution of explicit learning also in force field adaptation.

The effect of tactile augmentation on manipulation and grip force control during force-field adaptation

Background

When exposed to a novel dynamic perturbation, participants adapt by changing their movements’ dynamics. This adaptation is achieved by constructing an internal representation of the perturbation, which allows for applying forces that compensate for the novel external conditions. To form an internal representation, the sensorimotor system gathers and integrates sensory inputs, including kinesthetic and tactile information about the external load. The relative contribution of the kinesthetic and tactile information in force-field adaptation is poorly understood.

Methods

In this study, we set out to establish the effect of augmented tactile information on adaptation to force-field. Two groups of participants received a velocity-dependent tangential skin deformation from a custom-built skin-stretch device together with a velocity-dependent force-field from a kinesthetic haptic device. One group experienced a skin deformation in the same direction of the force, and the other in the opposite direction. A third group received only the velocity-dependent force-field.

Results

We found that adding a skin deformation did not affect the kinematics of the movement during adaptation. However, participants who received skin deformation in the opposite direction adapted their manipulation forces faster and to a greater extent than those who received skin deformation in the same direction of the force. In addition, we found that skin deformation in the same direction to the force-field caused an increase in the applied grip-force per amount of load force, both in response and in anticipation of the stretch, compared to the other two groups.

Conclusions

Augmented tactile information affects the internal representations for the control of manipulation and grip forces, and these internal representations are likely updated via distinct mechanisms. We discuss the implications of these results for assistive and rehabilitation devices.

Postural control of arm and fingers through integration of movement commands

Every movement ends in a period of stillness. Current models assume that commands that hold the limb at a target location do not depend on the commands that moved the limb to that location. Here, we report a surprising relationship between movement and posture in primates: on a within-trial basis, the commands that hold the arm and finger at a target location depend on the mathematical integration of the commands that moved the limb to that location. Following damage to the corticospinal tract, both the move and hold period commands become more variable. However, the hold period commands retain their dependence on the integral of the move period commands. Thus, our data suggest that the postural controller possesses a feedforward module that uses move commands to calculate a component of hold commands. This computation may arise within an unknown subcortical system that integrates cortical commands to stabilize limb posture.