Sensitivity to prediction error in reach adaptation

Influence of error-augmentation on the dynamics of visuomotor skill acquisition: insights from proxy-process models

Our study addresses the critical question of how learners acquire skills without the constant crutch of feedback, using a specialized training approach with intermittent feedback. Despite recognized benefits in skill retention, the underlying mechanisms of intermittent feedback in motor control neuroscience remain elusive. Leveraging a previously published dataset from visuomotor learning experiments with intermittent feedback, we tested a wide range of proxy-process models that posit the presence of an inferred error signal even when an explicit sensory performance is not present. The model structures encompassed a spectrum from first-order to higher-order variants, incorporating both constant and error-dependent rates of change in error. Furthermore, these proxy-process models investigated the impact of error-augmentation (EA) training on visuomotor learning dynamics. Rigorous cross-validation consistently identified a second-order proxy-process model structure accurately predicting motor learning across subjects and learning tasks. Model parameters elucidated the varying influences of EA settings on the rates of change in error, inter-trial variability, and steady-state performance. We then introduced a dynamic-Proxy support Multi-Rate Motor Learning (dPxMRML) model, which shed light on EA's effects on the fast and slow learning dynamics. The dPxMRML model accurately predicted subjects' performance during and beyond training phases, highlighting EA settings conducive to long-term retention. This research yields crucial insights for personalized training program design, applicable in neuro-rehabilitation, sports, and performance training.NEW & NOTEWORTHY Breaking new ground in motor learning, our research unveils the intricacies of skill acquisition without continuous feedback. By using a specialized training approach with intermittent feedback, our study reveals the previously elusive mechanisms behind this process. The introduction of innovative proxy-process models, particularly the dynamic-Proxy support Multi-Rate Motor Learning (dPxMRML) model, brings a fresh perspective to understanding the impact of error-augmentation (EA) training on learning and retention of motor skills.

Abnormalities in motor adaptation to different types of perturbations in schizophreniaperturbations in schizophrenia

Schizophrenia is a mental health disorder that often includes psychomotor disturbances, impacting how individuals adjust their motor output based on the cause of motor errors. While previous motor adaptation studies on individuals with schizophrenia have largely focused on large and consistent perturbations induced by abrupt experimental manipulations, such as donning prism goggles, the adaptation process to random perturbations, either caused by intrinsic motor noise or external disturbances, has not been examined - despite its ecological relevance. Here, we used a unified behavioral task paradigm to examine motor adaptation to perturbations of three causal structures among individuals in the remission stage of schizophrenia, youth with ultra-high risk of psychosis, adults with active symptoms, and age-matched controls. Results showed that individuals with schizophrenia had reduced trial-by-trial adaptation and large error variance when adapting to their own motor noise. When adapting to random but salient perturbations, they showed intact adaptation and normal causal inference of errors. This contrasted with reduced adaptation to large yet consistent perturbations, which could reflect difficulties in forming cognitive strategies rather than the often-assumed impairments in procedural learning or sense of agency. Furthermore, the observed adaptation effects were correlated with the severity of positive symptoms across the diagnosis groups. Our findings suggest that individuals with schizophrenia face challenges in accommodating intrinsic perturbations when motor errors are ambiguous but adapt with intact causal attribution when errors are salient.

Divisively normalized neuronal processing of uncertain visual feedback for visuomotor learning

When encountering a visual error during a reaching movement, the motor system improves the motor command for the subsequent trial. This improvement is impaired by visual error uncertainty, which is considered evidence that the motor system optimally estimates the error. However, how such statistical computation is accomplished remains unclear. Here, we propose an alternative scheme implemented with a divisive normalization (DN): the responses of neuronal elements are normalized by the summed activity of the population. This scheme assumes that when an uncertain visual error is provided by multiple cursors, the motor system processes the error conveyed by each cursor and integrates the information using DN. The DN model reproduced the patterns of learning response to 1-3 cursor errors and the impairment of learning response with visual error uncertainty. This study provides a new perspective on how the motor system updates motor commands according to uncertain visual error information.

Age-related impairments and influence of visual feedback when learning to stand with unexpected sensorimotor delays

Background

While standing upright, the brain must accurately accommodate for delays between sensory feedback and self-generated motor commands. Natural aging may limit adaptation to sensorimotor delays due to age-related decline in sensory acuity, neuromuscular capacity and cognitive function. This study examined balance learning in young and older adults as they stood with robot-induced sensorimotor delays.

Methods

A cohort of community dwelling young (mean = 23.6 years, N = 20) and older adults (mean = 70.1 years, N = 20) participated in this balance learning study. Participants stood on a robotic balance simulator which was used to artificially impose a 250 ms delay into their control of standing. Young and older adults practiced to balance with the imposed delay either with or without visual feedback (i.e., eyes open or closed), resulting in four training groups. We assessed their balance behavior and performance (i.e., variability in postural sway and ability to maintain upright posture) before, during and after training. We further evaluated whether training benefits gained in one visual condition transferred to the untrained condition.

Results

All participants, regardless of age or visual training condition, improved their balance performance through training to stand with the imposed delay. Compared to young adults, however, older adults had larger postural oscillations at all stages of the experiments, exhibited less relative learning to balance with the delay and had slower rates of balance improvement. Visual feedback was not required to learn to stand with the imposed delay, but it had a modest effect on the amount of time participants could remain upright. For all groups, balance improvements gained from training in one visual condition transferred to the untrained visual condition.

Conclusion

Our study reveals that while advanced age partially impairs balance learning, the older nervous system maintains the ability to recalibrate motor control to stand with initially destabilizing sensorimotor delays under differing visual feedback conditions.

Task Instructions and the Need for Feedback Correction Influence the Contribution of Visual Errors to Reach Adaptation

Previous research has questioned whether motor adaptation is shaped by an optimal combination of multisensory error signals. Here, we expanded on this work by investigating how the use of visual and somatosensory error signals during online correction influences single-trial adaptation. To this end, we exposed participants to a random sequence of force-field perturbations and recorded their corrective responses as well as the after-effects exhibited during the subsequent unperturbed movement. In addition to the force perturbation, we artificially decreased or increased visual errors by multiplying hand deviations by a gain smaller or larger than one. Corrective responses to the force perturbation clearly scaled with the size of the visual error, but this scaling did not transfer one-to-one to motor adaptation and we observed no consistent interaction between limb and visual errors on adaptation. However, reducing visual errors during perturbation led to a small reduction of after-effects and this residual influence of visual feedback was eliminated when we instructed participants to control their hidden hand instead of the visual hand cursor. Taken together, our results demonstrate that task instructions and the need to correct for errors during perturbation are important factors to consider if we want to understand how the sensorimotor system uses and combines multimodal error signals to adapt movements.

The effects of probabilistic context inference on motor adaptation

Humans have been shown to adapt their movements when a sudden or gradual change to the dynamics of the environment are introduced, a phenomenon called motor adaptation. If the change is reverted, the adaptation is also quickly reverted. Humans are also able to adapt to multiple changes in dynamics presented separately, and to be able to switch between adapted movements on the fly. Such switching relies on contextual information which is often noisy or misleading, affecting the switch between known adaptations. Recently, computational models for motor adaptation and context inference have been introduced, which contain components for context inference and Bayesian motor adaptation. These models were used to show the effects of context inference on learning rates across different experiments. We expanded on these works by using a simplified version of the recently-introduced COIN model to show that the effects of context inference on motor adaptation and control go even further than previously shown. Here, we used this model to simulate classical motor adaptation experiments from previous works and showed that context inference, and how it is affected by the presence and reliability of feedback, effect a host of behavioral phenomena that had so far required multiple hypothesized mechanisms, lacking a unified explanation. Concretely, we show that the reliability of direct contextual information, as well as noisy sensory feedback, typical of many experiments, effect measurable changes in switching-task behavior, as well as in action selection, that stem directly from probabilistic context inference.

Low Vision Impairs Implicit Sensorimotor Adaptation in Response to Small Errors, But Not Large Errors

Successful goal-directed actions require constant fine-tuning of the motor system. This fine-tuning is thought to rely on an implicit adaptation process that is driven by sensory prediction errors (e.g., where you see your hand after reaching vs. where you expected it to be). Individuals with low vision experience challenges with visuomotor control, but whether low vision disrupts motor adaptation is unknown. To explore this question, we assessed individuals with low vision and matched controls with normal vision on a visuomotor task designed to isolate implicit adaptation. We found that low vision was associated with attenuated implicit adaptation only for small visual errors, but not for large visual errors. This result highlights important constraints underlying how low-fidelity visual information is processed by the sensorimotor system to enable successful implicit adaptation.

Error Size Shape Relationships between Motor Variability and Implicit Motor Adaptation

Previous studies have demonstrated the effects of motor variability on motor adaptation. However, their findings have been inconsistent, suggesting that various factors affect the relationship between motor variability and adaptation. This study focused on the size of errors driving motor adaptation as one of the factors and examined the relationship between different error sizes. Thirty-one healthy young adults participated in a visuomotor task in which they made fast-reaching movements toward a target. Motor variability was measured in the baseline phase when a veridical feedback cursor was presented. In the adaptation phase, the feedback cursor was sometimes not reflected in the hand position and deviated from the target by 0°, 3°, 6°, or 12° counterclockwise or clockwise (i.e., error-clamp feedback). Movements during trials following trials with error-clamp feedback were measured to quantify implicit adaptation. Implicit adaptation was driven by errors presented through error-clamp feedback. Moreover, motor variability significantly correlated with implicit adaptation driven by a 12° error. The results suggested that motor variability accelerates implicit adaptation when a larger error occurs. As such a trend was not observed when smaller errors occurred, the relationship between motor variability and motor adaptation might have been affected by the error size driving implicit adaptation.

Short-term effects of visuomotor discrepancies on multisensory integration, proprioceptive recalibration, and motor adaptation

Information about the position of our hand is provided by multisensory signals that are often not perfectly aligned. Discrepancies between the seen and felt hand position or its movement trajectory engage the processes of 1) multisensory integration, 2) sensory recalibration, and 3) motor adaptation, which adjust perception and behavioral responses to apparently discrepant signals. To foster our understanding of the coemergence of these three processes, we probed their short-term dependence on multisensory discrepancies in a visuomotor task that has served as a model for multisensory perception and motor control previously. We found that the well-established integration of discrepant visual and proprioceptive signals is tied to the immediate discrepancy and independent of the outcome of the integration of discrepant signals in immediately preceding trials. However, the strength of integration was context dependent, being stronger in an experiment featuring stimuli that covered a smaller range of visuomotor discrepancies (±15°) compared with one covering a larger range (±30°). Both sensory recalibration and motor adaptation for nonrepeated movement directions were absent after two bimodal trials with same or opposite visuomotor discrepancies. Hence our results suggest that short-term sensory recalibration and motor adaptation are not an obligatory consequence of the integration of preceding discrepant multisensory signals.NEW & NOTEWORTHY The functional relation between multisensory integration and recalibration remains debated. We here refute the notion that they coemerge in an obligatory manner and support the hypothesis that they serve distinct goals of perception.

Implicit sensorimotor adaptation is preserved in Parkinson's disease

Our ability to enact successful goal-directed actions involves multiple learning processes. Among these processes, implicit motor adaptation ensures that the sensorimotor system remains finely tuned in response to changes in the body and environment. Whether Parkinson's disease impacts implicit motor adaptation remains a contentious area of research: whereas multiple reports show impaired performance in this population, many others show intact performance. While there is a range of methodological differences across studies, one critical issue is that performance in many of the studies may reflect a combination of implicit adaptation and strategic re-aiming. Here, we revisited this controversy using a visuomotor task designed to isolate implicit adaptation. In two experiments, we found that adaptation in response to a wide range of visual perturbations was similar in Parkinson's disease and matched control participants. Moreover, in a meta-analysis of previously published and unpublished work, we found that the mean effect size contrasting Parkinson's disease and controls across 16 experiments involving over 200 participants was not significant. Together, these analyses indicate that implicit adaptation is preserved in Parkinson's disease, offering a fresh perspective on the role of the basal ganglia in sensorimotor learning.

Changes in Error-Correction Behavior According to Visuomotor Maps in Goal-Directed Projection Tasks

Humans can move objects to target positions, out of their reach with certain accuracy by throwing or hitting them with tools. However, the outcome - the final object position - after the same movement varies due to various internal and external factors. Therefore, to improve outcome accuracy, humans correct their movements in the following trial as necessary by estimating the relationship between movement and visual outcome (visuomotor map). In the present study, we compared participants' error-correction behaviors to visual errors under three conditions, wherein the relationship between joystick movement direction and cursor projection direction on the monitor covertly differed. This allowed us to examine whether the error-correction behavior changed depending on the visuomotor map. Moreover, to determine whether participants maintain the visuomotor map regardless of the visual error size (cursor projection) and proprioceptive errors (joystick movement), we for the first time focused on whether temporary visual errors deviating from the conventional relationship between joystick movement direction and cursor projection direction (i.e., visual perturbation) are ignored. The visual information was occasionally perturbed in two ways to create a situation wherein the visual error was larger or smaller than the proprioceptive error. We found that participants changed their error-correction behaviors according to the conditions and could ignore visual perturbations. This suggests that humans can be implicitly aware of differences in visuomotor maps and adapt accordingly to visual errors.

Using Artificial Intelligence for Assistance Systems to Bring Motor Learning Principles into Real World Motor Tasks

Humans learn movements naturally, but it takes a lot of time and training to achieve expert performance in motor skills. In this review, we show how modern technologies can support people in learning new motor skills. First, we introduce important concepts in motor control, motor learning and motor skill learning. We also give an overview about the rapid expansion of machine learning algorithms and sensor technologies for human motion analysis. The integration between motor learning principles, machine learning algorithms and recent sensor technologies has the potential to develop AI-guided assistance systems for motor skill training. We give our perspective on this integration of different fields to transition from motor learning research in laboratory settings to real world environments and real world motor tasks and propose a stepwise approach to facilitate this transition.

Competition between parallel sensorimotor learning systems

Sensorimotor learning is supported by at least two parallel systems: a strategic process that benefits from explicit knowledge and an implicit process that adapts subconsciously. How do these systems interact? Does one system's contributions suppress the other, or do they operate independently? Here, we illustrate that during reaching, implicit and explicit systems both learn from visual target errors. This shared error leads to competition such that an increase in the explicit system's response siphons away resources that are needed for implicit adaptation, thus reducing its learning. As a result, steady-state implicit learning can vary across experimental conditions, due to changes in strategy. Furthermore, strategies can mask changes in implicit learning properties, such as its error sensitivity. These ideas, however, become more complex in conditions where subjects adapt using multiple visual landmarks, a situation which introduces learning from sensory prediction errors in addition to target errors. These two types of implicit errors can oppose each other, leading to another type of competition. Thus, during sensorimotor adaptation, implicit and explicit learning systems compete for a common resource: error.

Using EEG to study sensorimotor adaptation

Sensorimotor adaptation, or the capacity to flexibly adapt movements to changes in the body or the environment, is crucial to our ability to move efficiently in a dynamic world. The field of sensorimotor adaptation is replete with rigorous behavioural and computational methods, which support strong conceptual frameworks. An increasing number of studies have combined these methods with electroencephalography (EEG) to unveil insights into the neural mechanisms of adaptation. We review these studies: discussing EEG markers of adaptation in the frequency and the temporal domain, EEG predictors for successful adaptation and how EEG can be used to unmask latent processes resulting from adaptation, such as the modulation of spatial attention. With its high temporal resolution, EEG can be further exploited to deepen our understanding of sensorimotor adaptation.

Understanding implicit sensorimotor adaptation as a process of proprioceptive re-alignment

Multiple learning processes contribute to successful goal-directed actions in the face of changing physiological states, biomechanical constraints, and environmental contexts. Amongst these processes, implicit sensorimotor adaptation is of primary importance, ensuring that movements remain well-calibrated and accurate. A large body of work on reaching movements has emphasized how adaptation centers on an iterative process designed to minimize visual errors. The role of proprioception has been largely neglected, thought to play a passive role in which proprioception is affected by the visual error but does not directly contribute to adaptation. Here, we present an alternative to this visuo-centric framework, outlining a model in which implicit adaptation acts to minimize a proprioceptive error, the distance between the perceived hand position and its intended goal. This proprioceptive re-alignment model (PReMo) is consistent with many phenomena that have previously been interpreted in terms of learning from visual errors, and offers a parsimonious account of numerous unexplained phenomena. Cognizant that the evidence for PReMo rests on correlational studies, we highlight core predictions to be tested in future experiments, as well as note potential challenges for a proprioceptive-based perspective on implicit adaptation.

The role of motor memory dynamics in structuring bodily self-consciousness

Bodily self-consciousness has been considered a sensorimotor root of self-consciousness. If this is the case, how does sensorimotor memory, which is important for the prediction of sensory consequences of volitional actions, influence awareness of bodily self-consciousness? This question is essential for understanding the effective acquisition and recovery of self-consciousness following its impairment, but it has remained unexamined. Here, we investigated how body ownership and agency recovered following body schema distortion in a virtual reality environment along with two kinds of motor memories: memories that were rapidly updated and memories that were gradually updated. We found that, although agency and body ownership recovered in parallel, the recovery of body ownership was predicted by fast memories and that of agency was predicted by slow memories. Thus, the bodily self was represented in multiple motor memories with different dynamics. This finding demystifies the controversy about the causal relationship between body ownership and agency.

Direction-Specific Iterative Tuning of Motor Commands With Local Generalization During Randomized Reaching Practice Across Movement Directions

During motor learning, people often practice reaching in variety of movement directions in a randomized sequence. Such training has been shown to enhance retention and transfer capability of the acquired skill compared to the blocked repetition of the same movement direction. The learning system must accommodate such randomized order either by having a memory for each movement direction, or by being able to generalize what was learned in one movement direction to the controls of nearby directions. While our preliminary study used a comprehensive dataset from visuomotor learning experiments and evaluated the first-order model candidates that considered the memory of error and generalization across movement directions, here we expanded our list of candidate models that considered the higher-order effects and error-dependent learning rates. We also employed cross-validation to select the leading models. We found that the first-order model with a constant learning rate was the best at predicting learning curves. This model revealed an interaction between the learning and forgetting processes using the direction-specific memory of error. As expected, learning effects were observed at the practiced movement direction on a given trial. Forgetting effects (error increasing) were observed at the unpracticed movement directions with learning effects from generalization from the practiced movement direction. Our study provides insights that guide optimal training using the machine-learning algorithms in areas such as sports coaching, neurorehabilitation, and human-machine interactions.

The cost of correcting for error during sensorimotor adaptation

Learning from error is often a slow process. In machine learning, the learning rate depends on a loss function that specifies a cost for error. Here, we hypothesized that during motor learning, error carries an implicit cost for the brain because the act of correcting for error consumes time and energy. Thus, if this implicit cost could be increased, it may robustly alter how the brain learns from error. To vary the implicit cost of error, we designed a task that combined saccade adaptation with motion discrimination: movement errors resulted in corrective saccades, but those corrections took time away from acquiring information in the discrimination task. We then modulated error cost using coherence of the discrimination task and found that when error cost was large, pupil diameter increased and the brain learned more from error. However, when error cost was small, the pupil constricted and the brain learned less from the same error. Thus, during sensorimotor adaptation, the act of correcting for error carries an implicit cost for the brain. Modulating this cost affects how much the brain learns from error.

Whole body adaptation to novel dynamics does not transfer between effectors

How does the brain coordinate concurrent adaptation of arm movements and standing posture? From previous studies, the postural control system can use information about previously adapted arm movement dynamics to plan appropriate postural control; however, it is unclear whether postural control can be adapted and controlled independently of arm control. The present study addresses that question. Subjects practiced planar reaching movements while standing and grasping the handle of a robotic arm, which generated a force field to create novel perturbations. Subjects were divided into two groups, for which perturbations were introduced in either an abrupt or a gradual manner. All subjects adapted to the perturbations while reaching with their dominant (right) arm and then switched to reaching with their nondominant (left) arm. Previous studies of seated reaching movements showed that abrupt perturbation introduction led to transfer of learning between arms, but gradual introduction did not. Interestingly, in this study neither group showed evidence of transferring adapted control of arm or posture between arms. These results suggest primarily that adapted postural control cannot be transferred independently of arm control in this task paradigm. In other words, whole body postural movement planning related to a concurrent arm task is dependent on information about arm dynamics. Finally, we found that subjects were able to adapt to the gradual perturbation while experiencing very small errors, suggesting that both error size and consistency play a role in driving motor adaptation.NEW & NOTEWORTHY This study examined adaptation of arm and postural control to novel dynamics while standing and reaching and subsequent transfer between reaching arms. Neither arm nor postural control was transferred between arms, suggesting that postural planning is highly dependent on the concurrent arm movement.

Sensitivity to error during visuomotor adaptation is similarly modulated by abrupt, gradual and random perturbation schedules

It has been suggested that sensorimotor adaptation involves at least two processes (i.e., fast and slow) that differ in retention and error sensitivity. Previous work has shown that repeated exposure to an abrupt force field perturbation results in greater error sensitivity for both the fast and slow processes. While this implies that the faster relearning is associated with increased error sensitivity, it remains unclear what aspects of prior experience modulate error sensitivity. In the present study, we manipulated the initial training using different perturbation schedules, thought to differentially affect fast and slow learning processes based on error magnitude, and then observed what effect prior learning had on subsequent adaptation. During initial training of a visuomotor rotation task, we exposed three groups of participants to either an abrupt, a gradual, or a random perturbation schedule. During a testing session, all three groups were subsequently exposed to an abrupt perturbation schedule. Comparing the two sessions of the control group who experienced repetition of the same perturbation, we found an increased error sensitivity for both processes. We found that the error sensitivity was increased for both the fast and slow processes, with no reliable changes in the retention, for both the gradual and structural learning groups when compared to the first session of the control group. We discuss the findings in the context of how fast and slow learning processes respond to a history of errors.

Does proprioceptive acuity influence the extent of implicit sensorimotor adaptation in young and older adults?

The ability to adjust movements to changes in the environment declines with aging. This age-related decline is caused by the decline of explicit adjustments. However, implicit adaptation remains intact and might even be increased with aging. Since proprioceptive information has been linked to implicit adaptation, it might well be that an age-related decline in proprioceptive acuity might be linked to the performance of older adults in implicit adaptation tasks. Indeed, age-related proprioceptive deficits could lead to altered sensory integration with an increased weighting of the visual sensory-prediction error. Another possibility is that reduced proprioceptive acuity results in an increased reliance on predicted sensory consequences of the movement. Both these explanations led to our preregistered hypothesis: we expected a relation between the decline of proprioception and the amount of implicit adaptation across ages. However, we failed to support this hypothesis. Our results question the existence of reliability-based integration of visual and proprioceptive signals during motor adaptation.

An implicit memory of errors limits human sensorimotor adaptation

During extended motor adaptation, learning appears to saturate despite persistence of residual errors. This adaptation limit is not fixed but varies with perturbation variance; when variance is high, residual errors become larger. These changes in total adaptation could relate to either implicit or explicit learning systems. Here, we found that when adaptation relied solely on the explicit system, residual errors disappeared and learning was unaltered by perturbation variability. In contrast, when learning depended entirely, or in part, on implicit learning, residual errors reappeared. Total implicit adaptation decreased in the high-variance environment due to changes in error sensitivity, not in forgetting. These observations suggest a model in which the implicit system becomes more sensitive to errors when they occur in a consistent direction. Thus, residual errors in motor adaptation are at least in part caused by an implicit learning system that modulates its error sensitivity in response to the consistency of past errors.

Taking aim at the perceptual side of motor learning: exploring how explicit and implicit learning encode perceptual error information through depth vision

Motor learning in visuomotor adaptation tasks results from both explicit and implicit processes, each responding differently to an error signal. Although the motor output side of these processes has been extensively studied, the visual input side is relatively unknown. We investigated if and how depth perception affects the computation of error information by explicit and implicit motor learning. Two groups of participants made reaching movements to bring a virtual cursor to a target in the frontoparallel plane. The Delayed group was allowed to reaim and their feedback was delayed to emphasize explicit learning, whereas the camped group received task-irrelevant clamped cursor feedback and continued to aim straight at the target to emphasize implicit adaptation. Both groups played this game in a highly detailed virtual environment (depth condition), leveraging a cover task of playing darts in a virtual tavern, and in an empty environment (no-depth condition). The delayed group showed an increase in error sensitivity under depth relative to no-depth. In contrast, the clamped group adapted to the same degree under both conditions. The movement kinematics of the delayed participants also changed under the depth condition, consistent with the target appearing more distant, unlike the Clamped group. A comparison of the delayed behavioral data with a perceptual task from the same individuals showed that the greater reaiming in the depth condition was consistent with an increase in the scaling of the error distance and size. These findings suggest that explicit and implicit learning processes may rely on different sources of perceptual information.NEW & NOTEWORTHY We leveraged a classic sensorimotor adaptation task to perform a first systematic assessment of the role of perceptual cues in the estimation of an error signal in the 3-D space during motor learning. We crossed two conditions presenting different amounts of depth information, with two manipulations emphasizing explicit and implicit learning processes. Explicit learning responded to the visual conditions, consistent with perceptual reports, whereas implicit learning appeared to be independent of them.

Did We Get Sensorimotor Adaptation Wrong? Implicit Adaptation as Direct Policy Updating Rather than Forward-Model-Based Learning

The human motor system can rapidly adapt its motor output in response to errors. The prevailing theory of this process posits that the motor system adapts an internal forward model that predicts the consequences of outgoing motor commands and uses this forward model to plan future movements. However, despite clear evidence that adaptive forward models exist and are used to help track the state of the body, there is no definitive evidence that such models are used in movement planning. An alternative to the forward-model-based theory of adaptation is that movements are generated based on a learned policy that is adjusted over time by movement errors directly ("direct policy learning"). This learning mechanism could act in parallel with, but independent of, any updates to a predictive forward model. Forward-model-based learning and direct policy learning generate very similar predictions about behavior in conventional adaptation paradigms. However, across three experiments with human participants (N = 47, 26 female), we show that these mechanisms can be dissociated based on the properties of implicit adaptation under mirror-reversed visual feedback. Although mirror reversal is an extreme perturbation, it still elicits implicit adaptation; however, this adaptation acts to amplify rather than to reduce errors. We show that the pattern of this adaptation over time and across targets is consistent with direct policy learning but not forward-model-based learning. Our findings suggest that the forward-model-based theory of adaptation needs to be re-examined and that direct policy learning provides a more plausible explanation of implicit adaptation.SIGNIFICANCE STATEMENT The ability of our brain to adapt movements in response to error is one of the most widely studied phenomena in motor learning. Yet, we still do not know the process by which errors eventually result in adaptation. It is known that the brain maintains and updates an internal forward model, which predicts the consequences of motor commands, and the prevailing theory of motor adaptation posits that this updated forward model is responsible for trial-by-trial adaptive changes. Here, we question this view and show instead that adaptation is better explained by a simpler process whereby motor output is directly adjusted by task errors. Our findings cast doubt on long-held beliefs about adaptation.

Reexposure to a sensorimotor perturbation produces opposite effects on explicit and implicit learning processes

The motor system demonstrates an exquisite ability to adapt to changes in the environment and to quickly reset when these changes prove transient. If similar environmental changes are encountered in the future, learning may be faster, a phenomenon known as savings. In studies of sensorimotor learning, a central component of savings is attributed to the explicit recall of the task structure and appropriate compensatory strategies. Whether implicit adaptation also contributes to savings remains subject to debate. We tackled this question by measuring, in parallel, explicit and implicit adaptive responses in a visuomotor rotation task, employing a protocol that typically elicits savings. While the initial rate of learning was faster in the second exposure to the perturbation, an analysis decomposing the 2 processes showed the benefit to be solely associated with explicit re-aiming. Surprisingly, we found a significant decrease after relearning in aftereffect magnitudes during no-feedback trials, a direct measure of implicit adaptation. In a second experiment, we isolated implicit adaptation using clamped visual feedback, a method known to eliminate the contribution of explicit learning processes. Consistent with the results of the first experiment, participants exhibited a marked reduction in the adaptation function, as well as an attenuated aftereffect when relearning from the clamped feedback. Motivated by these results, we reanalyzed data from prior studies and observed a consistent, yet unappreciated pattern of attenuation of implicit adaptation during relearning. These results indicate that explicit and implicit sensorimotor processes exhibit opposite effects upon relearning: Explicit learning shows savings, while implicit adaptation becomes attenuated.

The effect of visual uncertainty on implicit motor adaptation

Sensorimotor adaptation is influenced by both the size and variance of error information. In the present study, we varied visual uncertainty and error size in a factorial manner and evaluated their joint effect on adaptation, using a feedback method that avoids inherent limitations with standard visuomotor tasks. Uncertainty attenuated adaptation, but only when the error was small. This striking interaction highlights a novel constraint for models of sensorimotor adaptation. Sensorimotor adaptation is driven by sensory prediction errors, the difference between the predicted and actual feedback. When the position of the feedback is made uncertain, motor adaptation is attenuated. This effect, in the context of optimal sensory integration models, has been attributed to the motor system discounting noisy feedback and thus reducing the learning rate. In its simplest form, optimal integration predicts that uncertainty would result in reduced learning for all error sizes. However, these predictions remain untested since manipulations of error size in standard visuomotor tasks introduce confounds in the degree to which performance is influenced by other learning processes such as strategy use. Here, we used a novel visuomotor task that isolates the contribution of implicit adaptation, independent of error size. In two experiments, we varied feedback uncertainty and error size in a factorial manner. At odds with the basic predictions derived from the optimal integration theory, the results show that uncertainty attenuated learning only when the error size was small but had no effect when the error size was large. We discuss possible mechanisms that may account for this interaction, considering how uncertainty may interact with the relevance assigned to the error signal or how the output of the adaptation system in terms of recalibrating the sensorimotor map may be modified by uncertainty.NEW & NOTEWORTHY Sensorimotor adaptation is influenced by both the size and variance of error information. In the present study, we varied visual uncertainty and error size in a factorial manner and evaluated their joint effect on adaptation, using a feedback method that avoids inherent limitations with standard visuomotor tasks. Uncertainty attenuated adaptation but only when the error was small. This striking interaction highlights a novel constraint for models of sensorimotor adaptation.

Task Feedback Processing Differs Between Young and Older Adults in Visuomotor Rotation Learning Despite Similar Initial Adaptation and Savings

Ageing has been suggested to affect sensorimotor adaptation by impairing explicit strategy use. Here we recorded electrophysiological (EEG) responses during visuomotor rotation in both young (n = 24) and older adults (n = 25), to investigate the neural processes that underpin putative age-related effects on adaptation. We measured the feedback related negativity (FRN) and the P3 in response to task-feedback, as electrophysiological markers of task error processing and outcome evaluation. The two age groups adapted similarly and showed comparable after effects and savings when re-exposed to the same perturbation several days after the initial session. Older adults, however, had less distinct EEG responses (i.e., reduced FRN amplitudes) to negative and positive task feedback. The P3 did not differ between age groups. Both young and older adults also showed a sustained late positivity following task feedback. Measured at the frontal electrode Fz, this sustained activity was negatively associated with both the amount of voluntary disengagement of explicit strategy and savings. In conclusion, despite preserved task performance, we find clear differences in neural responses to errors in older people, which suggests that there is a fundamental decline in this aspect of sensorimotor brain function with age.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

Punishment Feedback Impairs Memory and Changes Cortical Feedback-Related Potentials During Motor Learning

Reward and punishment have demonstrated dissociable effects on motor learning and memory, which suggests that these reinforcers are differently processed by the brain. To test this possibility, we use electroencephalography to record cortical neural activity after the presentation of reward and punishment feedback during a visuomotor rotation task. Participants were randomly placed into Reward, Punishment, or Control groups and performed the task under different conditions to assess the adaptation (learning) and retention (memory) of the motor task. These conditions featured an incongruent position between the cursor and the target, with the cursor trajectory, rotated 30° counterclockwise, requiring the participant to adapt their movement to hit the target. Feedback based on error magnitude was provided during the Adaptation condition in the form of a positive number (Reward) or negative number (Punishment), each representing a monetary gain or loss, respectively. No reinforcement or visual feedback was provided during the No Vision condition (retention). Performance error and event-related potentials (ERPs) time-locked to feedback presentation were calculated for each participant during both conditions. Punishment feedback reduced performance error and promoted faster learning during the Adaptation condition. In contrast, punishment feedback increased performance error during the No Vision condition compared to Control and Reward groups, which suggests a diminished motor memory. Moreover, the Punishment group showed a significant decrease in the amplitude of ERPs during the No Vision condition compared to the Adaptation condition. The amplitude of ERPs did not change in the other two groups. These results suggest that punishment feedback impairs motor retention by altering the neural processing involved in memory encoding. This study provides a neurophysiological underpinning for the dissociative effects of punishment feedback on motor learning.

Principles of operation of a cerebellar learning circuit

We provide behavioral evidence using monkey smooth pursuit eye movements for four principles of cerebellar learning. Using a circuit-level model of the cerebellum, we link behavioral data to learning's neural implementation. The four principles are: (1) early, fast, acquisition driven by climbing fiber inputs to the cerebellar cortex, with poor retention; (2) learned responses of Purkinje cells guide transfer of learning from the cerebellar cortex to the deep cerebellar nucleus, with excellent retention; (3) functionally different neural signals are subject to learning in the cerebellar cortex versus the deep cerebellar nuclei; and (4) negative feedback from the cerebellum to the inferior olive reduces the magnitude of the teaching signal in climbing fibers and limits learning. Our circuit-level model, based on these four principles, explains behavioral data obtained by strategically manipulating the signals responsible for acquisition and recall of direction learning in smooth pursuit eye movements across multiple timescales.

The Origins of Anterograde Interference in Visuomotor Adaptation

Anterograde interference refers to the negative impact of prior learning on the propensity for future learning. There is currently no consensus on whether this phenomenon is transient or long lasting, with studies pointing to an effect in the time scale of hours to days. These inconsistencies might be caused by the method employed to quantify performance, which often confounds changes in learning rate and retention. Here, we aimed to unveil the time course of anterograde interference by tracking its impact on visuomotor adaptation at different intervals throughout a 24-h period. Our empirical and model-based approaches allowed us to measure the capacity for new learning separately from the influence of a previous memory. In agreement with previous reports, we found that prior learning persistently impaired the initial level of performance upon revisiting the task. However, despite this strong initial bias, learning capacity was impaired only when conflicting information was learned up to 1 h apart, recovering thereafter with passage of time. These findings suggest that when adapting to conflicting perturbations, impairments in performance are driven by two distinct mechanisms: a long-lasting bias that acts as a prior and hinders initial performance and a short-lasting anterograde interference that originates from a reduction in error sensitivity.

Divisively Normalized Integration of Multisensory Error Information Develops Motor Memories Specific to Vision and Proprioception

Both visual and proprioceptive information contribute to the accuracy of limb movement, but the mechanism of integration of these different modality signals for movement control and learning remains controversial. We aimed to elucidate the mechanism of multisensory integration for motor adaptation by evaluating single-trial adaptation (i.e., aftereffect) induced by visual and proprioceptive perturbations while male and female human participants performed reaching movements. The force-channel method was used to precisely impose several combinations of visual and proprioceptive perturbations (i.e., error), including an instance when the directions of perturbation in both stimuli opposed each another. In the subsequent probe force-channel trial, the lateral force against the channel was quantified as the aftereffect to clarify the mechanism by which the motor adaptation system corrects movement in the event of visual and proprioceptive errors. We observed that the aftereffects had complex dependence on the visual and proprioceptive errors. Although this pattern could not be explained by previously proposed computational models based on the reliability of sensory information, we found that it could be reasonably explained by a mechanism known as divisive normalization, which was the reported mechanism underlying the integration of multisensory signals in neurons. Furthermore, we discovered evidence that the motor memory for each sensory modality developed separately in accordance with a divisive normalization mechanism and that the outputs of both memories were integrated. These results provide a novel view of the utilization and integration of different sensory modality signals in motor adaptation.SIGNIFICANCE STATEMENT The mechanism of utilization of multimodal sensory information by the motor control system to perform limb movements with accuracy is a fundamental question. However, the mechanism of integration of these different sensory modalities for movement control and learning remains highly debatable. Herein, we demonstrate that multisensory integration in the motor learning system can be reasonably explained by divisive normalization, a canonical computation, ubiquitously observed in the brain (Carandini and Heeger, 2011). Moreover, we provide evidence of a novel idea that integration does not occur at the sensory information processing level, but at the motor execution level, after the motor memory for each sensory modality is separately created.

Environmental consistency modulation of error sensitivity during motor adaptation is explicitly controlled

Motor adaptation, the adjustment of a motor output in face of changes in the environment, may operate at different rates. When human participants encounter repeated or consistent perturbations, their corrections for the experienced errors are larger compared with when the perturbations are new or inconsistent. Such modulations of error sensitivity were traditionally considered to be an implicit process that does not require attentional resources. In recent years, the implicit view of motor adaptation has been challenged by evidence showing a contribution of explicit strategies to learning. These findings raise a fundamental question regarding the nature of the error sensitivity modulation processes. We tested the effect of explicit control on error sensitivity in a series of experiments, in which participants controlled a screen cursor to virtual targets. We manipulated environmental consistency by presenting rotations in random (low consistency) or random walk (high consistency) sequences and illustrated that perturbation consistency affects the rate of adaptation, corroborating previous studies. When participants were instructed to ignore the cursor and move directly to the target, thus eliminating the contribution of explicit strategies, consistency-driven error sensitivity modulation was not detected. In addition, delaying the visual feedback, a manipulation that affects implicit learning, did not influence error sensitivity under consistent perturbations. These results suggest that increases of learning rate in consistent environments are attributable to an explicit rather than implicit process in sensorimotor adaptation.NEW & NOTEWORTHY The consistency of an external perturbation modulates error sensitivity and the motor response. The roles of explicit and implicit processes in this modulation are unknown. We show that when humans are asked to ignore the perturbation, they do not show increased error sensitivity in consistent environments. When the implicit system is manipulated by delaying feedback, sensitivity to a consistent perturbation does not change. Overall, our results suggest that consistency affects adaptation mainly through explicit control.

Bile Duct Injury Repairs after Laparoscopic Cholecystectomy: A Five-Year Experience in a Highly Specialized Community Hospital

Bile duct injury represents a complication after laparoscopic cholecystectomy, impairing quality of life and resulting in subsequent litigations. A five-year experience of bile duct injury repairs in 52 patients at a community hospital was reviewed. Twenty-nine were female, and the median age was 51 years (range, 20–83 years). Strasberg classification identified injuries as Type A (23), B (1), C (1), D (5), E1 (5), E2 (6), E3 (4), E4 (6), and E5 (1). Resolution of the bile duct injury and clinical improvement represent main postoperative outcome measures in our study. The referral time for treatment was within 4 to 14 days of the injury. Type A injury was treated with endobiliary stent placement. The remaining patients required T-tube placement (5), hepaticojejunostomy (20), and primary anastomosis (4). Two patients experienced bile leak after hepaticojejunostomy and were treated and resolved with percutaneous transhepatic drainage. At a median follow-up of 36 months, two patients (Class E4) required percutaneous balloon dilation and endobiliary stent placement for anastomotic stricture. The success of biliary reconstruction after complicated laparoscopic cholecystectomy can be achieved by experienced biliary surgeons with a team approach in a community hospital setting.

Effect of Sensory Loss on Improvements of Upper-Limb Paralysis Through Robot-Assisted Training: A Preliminary Case Series Study

Sensory disorder is a factor preventing recovery from motor paralysis after stroke. Although several robot-assisted exercises for the hemiplegic upper limb of stroke patients have been proposed, few studies have examined improvement in function in stroke patients with sensory disorder using robot-assisted training. In this study, the efficacies of robot training for the hemiplegic upper limb of three stroke patients with complete sensory loss were compared with those of 19 patients without complete sensory loss. Robot training to assist reach motion was performed in 10 sessions over a 2-week period for 5 days per week at 1 h per day. Before and after the training, the total Fugl–Meyer Assessment score excluding coordination and tendon reflex (FMA-total) and the FMA shoulder and elbow score excluding tendon reflex (FMA-S/E) were evaluated. Reach and path errors (RE and PE) during the reach motion were also evaluated by the arm-training robot. In most cases, both the FMA-total and the FMA-S/E scores improved. Cases with complete sensory loss showed worse RE and PE scores. Our results suggest that motor paralysis is improved by robot training. However, improvement may be varied according to the presence or absence of somatic sensory feedback.

Better grip force control by attending to the controlled object: Evidence for direct force estimation from visual motion

Estimating forces acting between our hand and objects is essential for dexterous motor control. An earlier study suggested that vision contributes to the estimation by demonstrating changes in grip force pattern caused by delayed visual feedback. However, two possible vision-based force estimation processes, one based on hand position and another based on object motion, were both able to explain the effect. Here, to test each process, we examined how visual feedback of hand and object each contribute to grip force control during moving an object (mass) connected to the grip by a damped-spring. Although force applied to the hand could be estimated from its displacement, we did not find any improvements by the hand feedback. In contrast, we found that visual feedback of object motion significantly improved the synchrony between grip and load forces. Furthermore, when both feedback sources were provided, the improvement was observed only when participants were instructed to direct their attention to the object. Our results suggest that visual feedback of object motion contributes to estimation of dynamic forces involved in our actions by means of inverse dynamics computation, i.e., the estimation of force from motion, and that visual attention directed towards the object facilitates this effect.

Sparse Identification Of Motor Learning Using Proxy Process Models

Enhanced neurorehabilitation using robotic and virtual-reality technologies requires a computational framework that can readily assess the time course of motor learning in order to recommend optimal training conditions. Error-feedback plays an important role in the acquisition of motor skills for goal-directed movements by facilitating the learning of internal models. In this study, we investigated changes in movement errors during sparse and intermittent "catch" (no-vision) trials, which served as a "proxy" of the underlying process of internal model formations. We trained 15 healthy subjects to reach for visual targets under eight distinct visuomotor distortions, and we removed visual feedback (novision) intermittently. We tested their learning data from novision trials against our so-called proxy process models, which assumed linear, affine, and second-order model structures. In order to handle sparse (no-vision) observations, we allowed the proxy process models to either update trial-to-trial, predicting across voids of sparse samples or update sample-to-sample, disregarding the trial gaps. We exhaustively cross-validated our models across subjects and across learning tasks. The results revealed that the second-order model with trial-to-trial update best predicted the proxy process of visuomotor learning.

Both fast and slow learning processes contribute to savings following sensorimotor adaptation

Recent work suggests that the rate of learning in sensorimotor adaptation is likely not fixed, but rather can change based on previous experience. One example is savings, a commonly observed phenomenon whereby the relearning of a motor skill is faster than the initial learning. Sensorimotor adaptation is thought to be driven by sensory prediction errors, which are the result of a mismatch between predicted and actual sensory consequences. It has been proposed that during motor adaptation the generation of sensory prediction errors engages two processes (fast and slow) that differ in learning and retention rates. We tested the idea that a history of errors would influence both the fast and slow processes during savings. Participants were asked to perform the same force field adaptation task twice in succession. We found that adaptation to the force field a second time led to increases in estimated learning rates for both fast and slow processes. While it has been proposed that savings is explained by an increase in learning rate for the fast process, here we observed that the slow process also contributes to savings. Our work suggests that fast and slow adaptation processes are both responsive to a history of error and both contribute to savings. NEW & NOTEWORTHY We studied the underlying mechanisms of savings during motor adaptation. Using a two-state model to represent fast and slow processes that contribute to motor adaptation, we found that a history of error modulates performance in both processes. While previous research has attributed savings to only changes in the fast process, we demonstrated that an increase in both processes is needed to account for the measured behavioral data.

Neural signatures of reward and sensory error feedback processing in motor learning

At least two distinct processes have been identified by which motor commands are adapted according to movement-related feedback: reward-based learning and sensory error-based learning. In sensory error-based learning, mappings between sensory targets and motor commands are recalibrated according to sensory error feedback. In reward-based learning, motor commands are associated with subjective value, such that successful actions are reinforced. We designed two tasks to isolate reward- and sensory error-based motor adaptation, and we used electroencephalography in humans to identify and dissociate the neural correlates of reward and sensory error feedback processing. We designed a visuomotor rotation task to isolate sensory error-based learning that was induced by altered visual feedback of hand position. In a reward learning task, we isolated reward-based learning induced by binary reward feedback that was decoupled from the visual target. A fronto-central event-related potential called the feedback-related negativity (FRN) was elicited specifically by binary reward feedback but not sensory error feedback. A more posterior component called the P300 was evoked by feedback in both tasks. In the visuomotor rotation task, P300 amplitude was increased by sensory error induced by perturbed visual feedback and was correlated with learning rate. In the reward learning task, P300 amplitude was increased by reward relative to nonreward and by surprise regardless of feedback valence. We propose that during motor adaptation the FRN specifically reflects a reward-based learning signal whereas the P300 reflects feedback processing that is related to adaptation more generally. NEW & NOTEWORTHY We studied the event-related potentials evoked by feedback stimuli during motor adaptation tasks that isolate reward- and sensory error-based learning mechanisms. We found that the feedback-related negativity was specifically elicited by binary reward feedback, whereas the P300 was observed in both tasks. These results reveal neural processes associated with different learning mechanisms and elucidate which classes of errors, from a computational standpoint, elicit the feedback-related negativity and P300.

Increasing muscle co-contraction speeds up internal model acquisition during dynamic motor learning

During reaching movements in the presence of novel dynamics, participants initially co-contract their muscles to reduce kinematic errors and improve task performance. As learning proceeds, muscle co-contraction decreases as an accurate internal model develops. The initial co-contraction could affect the learning of the internal model in several ways. By ensuring the limb remains close to the target state, co-contraction could speed up learning. Conversely, by reducing kinematic errors, a key training signal, it could slow down learning. Alternatively, given that the effects of muscle co-contraction on kinematic errors are predictable and could be discounted when assessing the internal model error, it could have no effect on learning. Using a sequence of force pulses, we pretrained two groups to either co-contract (stiff group) or relax (relaxed group) their arm muscles in the presence of dynamic perturbations. A third group (control group) was not pretrained. All groups performed reaching movements in a velocity-dependent curl field. We measured adaptation using channel trials and found greater adaptation in the stiff group during early learning. We also found a positive correlation between muscle co-contraction, as measured by surface electromyography, and adaptation. These results show that muscle co-contraction accelerates the rate of dynamic motor learning.

Relative sensitivity of explicit reaiming and implicit motor adaptation

It has become increasingly clear that learning in visuomotor rotation tasks, which induce an angular mismatch between movements of the hand and visual feedback, largely results from the combined effort of two distinct processes: implicit motor adaptation and explicit reaiming. However, it remains unclear how these two processes work together to produce trial-by-trial learning. Previous work has found that implicit motor adaptation operates automatically, regardless of task relevance, and saturates for large errors. In contrast, little is known about the automaticity of explicit reaiming and its sensitivity to error magnitude. Here we sought to characterize the automaticity and sensitivity function of these two processes to determine how they work together to facilitate performance in a visuomotor rotation task. We found that implicit adaptation scales relative to the visual error but only for small perturbations-replicating prior work. In contrast, explicit reaiming scales linearly for all tested perturbation sizes. Furthermore, the consistency of the perturbation appears to diminish both implicit adaptation and explicit reaiming, but to different degrees. Whereas implicit adaptation always displayed a response to the error, explicit reaiming was only engaged when errors displayed a minimal degree of consistency. This comports with the idea that implicit adaptation is obligatory and less flexible, whereas explicit reaiming is volitional and flexible. NEW & NOTEWORTHY This paper provides the first psychometric sensitivity function for explicit reaiming. Additionally, we show that the sensitivities of both implicit adaptation and explicit reaiming are influenced by consistency of errors. The pattern of results across two experiments further supports the idea that implicit adaptation is largely inflexible, whereas explicit reaiming is flexible and can be suppressed when unnecessary.

Different adaptation rates to abrupt and gradual changes in environmental dynamics

Adaptation to an abrupt change in the dynamics of the interaction between the arm and the physical environment has been reported as occurring more rapidly but with less retention than adaptation to a gradual change in interaction dynamics. Faster adaptation to an abrupt change in interaction dynamics appears inconsistent with kinematic error sensitivity which has been shown to be greater for small errors than large errors. However, the comparison of adaptation rates was based on incomplete adaptation. Furthermore, the metric which was used as a proxy of the changing internal state, namely the linear regression between the force disturbance and the compensatory force (the adaptation index), does not distinguish between internal state inaccuracy resulting from amplitude or temporal errors. To resolve the apparent inconsistency, we compared the evolution of the internal state during complete adaptation to an abrupt and gradual change in interaction dynamics. We found no difference in the rate at which the adaptation index increased during adaptation to a gradual compared to an abrupt change in interaction dynamics. In addition, we separately examined amplitude and temporal errors using different metrics, and found that amplitude error was reduced more rapidly under the gradual than the abrupt condition, whereas temporal error (quantified by smoothness) was reduced more rapidly under the abrupt condition. We did not find any significant change in phase lag during adaptation under either condition. Our results also demonstrate that even after adaptation is complete, online feedback correction still plays a significant role in the control of reaching.

Greater neural responses to trajectory errors are associated with superior force field adaptation in older adults

Although age-related declines in cognitive, sensory and motor capacities are well documented, current evidence is mixed as to whether or not aging impairs sensorimotor adaptation to a novel dynamic environment. More importantly, the extent to which any deficits in sensorimotor adaptation are due to general impairments in neural plasticity, or impairments in the specific processes that drive adaptation is unclear. Here we investigated whether there are age-related differences in electrophysiological responses to reaching endpoint and trajectory errors caused by a novel force field, and whether markers of error processing relate to the ability of older adults to adapt their movements. Older and young adults (N = 24/group, both sexes) performed 600 reaches to visual targets, and received audio-visual feedback about task success or failure after each trial. A velocity-dependent curl field pushed the hand to one side during each reach. We extracted ERPs time-locked to movement onset [kinematic error-related negativity (kERN)], and the presentation of success/failure feedback [feedback error-related negativity (fERN)]. At a group level, older adults did not differ from young adults in the rate or extent of sensorimotor adaptation, but EEG responses to both trajectory errors and task errors were reduced in the older group. Most interestingly, the amplitude of the kERN correlated with the rate and extent of sensorimotor adaptation in older adults. Thus, older adults with an impaired capacity for encoding kinematic trajectory errors also have compromised abilities to adapt their movements in a novel dynamic environment.

Invariant errors reveal limitations in motor correction rather than constraints on error sensitivity

Implicit sensorimotor adaptation is traditionally described as a process of error reduction, whereby a fraction of the error is corrected for with each movement. Here, in our study of healthy human participants, we characterize two constraints on this learning process: the size of adaptive corrections is only related to error size when errors are smaller than 6°, and learning functions converge to a similar level of asymptotic learning over a wide range of error sizes. These findings are problematic for current models of sensorimotor adaptation, and point to a new theoretical perspective in which learning is constrained by the size of the error correction, rather than sensitivity to error.

Changes in motor performance and mental workload during practice of reaching movements: a team dynamics perspective

Few investigations have examined mental workload during motor practice or learning in a context of team dynamics. This study examines the underlying cognitive-motor processes of motor practice by assessing the changes in motor performance and mental workload during practice of reaching movements. Individuals moved a robotic arm to reach targets as fast and as straight as possible while satisfying the task requirement of avoiding a collision between the end-effector and the workspace limits. Individuals practiced the task either alone (HA group) or with a synthetic teammate (HRT group), which regulated the effector velocity to help satisfy the task requirements. The findings revealed that the performance of both groups improved similarly throughout practice. However, when compared to the individuals of the HA group, those in the HRT group (1) had a lower risk of collisions, (2) exhibited higher performance consistency, and (3) revealed a higher level of mental workload while generally perceiving the robotic teammate as interfering with their performance. As the synthetic teammate changed the effector velocity in specific regions near the workspace boundaries, individuals may have been constrained to learn a piecewise visuomotor map. This piecewise map made the task more challenging, which increased mental workload and perception of the synthetic teammate as a burden. The examination of both motor performance and mental workload revealed a combination of both adaptive and maladaptive team dynamics. This work is a first step to examine the human cognitive-motor processes underlying motor practice in a context of team dynamics and contributes to inform human-robot applications.

Change in sensitivity to visual error in superior colliculus during saccade adaptation

Saccadic eye movements provide a valuable model to study the brain mechanisms underlying motor learning. If a target is displaced surreptitiously while a saccade is underway, the saccade appears to be in error. If the error persists gradual neuronal adjustments cause the eye movement again to land near the target. This saccade adaptation typically follows an exponential time course, i.e., adaptation speed slows as adaptation progresses, indicating that the sensitivity to error decreases during adaptation. Previous studies suggested that the superior colliculus (SC) sends error signals to drive saccade adaptation. The objective of this study is to test whether the SC error signal is related to the decrease in the error sensitivity during adaptation. We show here that the visual activity of SC neurons, which is induced by a constant visual error that drives adaptation, decreases during saccade adaptation. This decrease of sensitivity to visual error was not correlated with the changes of primary saccade amplitude. Therefore, a possible interpretation of this result is that the reduction of visual sensitivity of SC neurons contributes an error sensitivity signal that could help control the saccade adaptation process.

The absence or temporal offset of visual feedback does not influence adaptation to novel movement dynamics

Delays in transmitting and processing sensory information require correctly associating delayed feedback to issued motor commands for accurate error compensation. The flexibility of this alignment between motor signals and feedback has been demonstrated for movement recalibration to visual manipulations, but the alignment dependence for adapting movement dynamics is largely unknown. Here we examined the effect of visual feedback manipulations on force-field adaptation. Three subject groups used a manipulandum while experiencing a lag in the corresponding cursor motion (0, 75, or 150 ms). When the offset was applied at the start of the session (continuous condition), adaptation was not significantly different between groups. However, these similarities may be due to acclimation to the offset before motor adaptation. We tested additional subjects who experienced the same delays concurrent with the introduction of the perturbation (abrupt condition). In this case adaptation was statistically indistinguishable from the continuous condition, indicating that acclimation to feedback delay was not a factor. In addition, end-point errors were not significantly different across the delay or onset conditions, but end-point correction (e.g., deceleration duration) was influenced by the temporal offset. As an additional control, we tested a group of subjects who performed without visual feedback and found comparable movement adaptation results. These results suggest that visual feedback manipulation (absence or temporal misalignment) does not affect adaptation to novel dynamics, independent of both acclimation and perceptual awareness. These findings could have implications for modeling how the motor system adjusts to errors despite concurrent delays in sensory feedback information.NEW & NOTEWORTHY A temporal offset between movement and distorted visual feedback (e.g., visuomotor rotation) influences the subsequent motor recalibration, but the effects of this offset for altered movement dynamics are largely unknown. Here we examined the influence of 1) delayed and 2) removed visual feedback on the adaptation to novel movement dynamics. These results contribute to understanding of the control strategies that compensate for movement errors when there is a temporal separation between motion state and sensory information.

Dissociating error-based and reinforcement-based loss functions during sensorimotor learning

It has been proposed that the sensorimotor system uses a loss (cost) function to evaluate potential movements in the presence of random noise. Here we test this idea in the context of both error-based and reinforcement-based learning. In a reaching task, we laterally shifted a cursor relative to true hand position using a skewed probability distribution. This skewed probability distribution had its mean and mode separated, allowing us to dissociate the optimal predictions of an error-based loss function (corresponding to the mean of the lateral shifts) and a reinforcement-based loss function (corresponding to the mode). We then examined how the sensorimotor system uses error feedback and reinforcement feedback, in isolation and combination, when deciding where to aim the hand during a reach. We found that participants compensated differently to the same skewed lateral shift distribution depending on the form of feedback they received. When provided with error feedback, participants compensated based on the mean of the skewed noise. When provided with reinforcement feedback, participants compensated based on the mode. Participants receiving both error and reinforcement feedback continued to compensate based on the mean while repeatedly missing the target, despite receiving auditory, visual and monetary reinforcement feedback that rewarded hitting the target. Our work shows that reinforcement-based and error-based learning are separable and can occur independently. Further, when error and reinforcement feedback are in conflict, the sensorimotor system heavily weights error feedback over reinforcement feedback.

Whether serving a tennis ball on a gusty day or walking over an unpredictable surface, the human nervous system has a remarkable ability to account for uncertainty when performing goal-directed actions. Here we address how different types of feedback, error and reinforcement, are used to guide such behavior during sensorimotor learning. Using a task that dissociates the optimal predictions of error-based and reinforcement-based learning, we show that the human sensorimotor system uses two distinct loss functions when deciding where to aim the hand during a reach—one that minimizes error and another that maximizes success. Interestingly, when both of these forms of feedback are available our nervous system heavily weights error feedback over reinforcement feedback.