Learning not to generalize: modular adaptation of visuomotor gain

Bilateral Transfer of a Visuomotor Task in Different Workspace Configurations

Bilateral transfer occurs when a learned behavior transfers from one (group of) effectors(s) to another. Researchers investigating bilateral transfer of a visuomotor adaptation task between limbs used across workspaces have observed divergent results. This study assessed whether bilateral transfer of a visuomotor adaptation task changes with workspace configuration manipulation. Ninety-six right-handed young adults were assigned to one of three workspace locations, i.e., ipsilateral, contralateral, and central. Within each workspace were two retention groups (RRR/LLL) and two bilateral transfer groups (RLR/LRL). Performance before and after training was collected to determine direct and after-effects. We observed an asymmetric transfer of pathlength (left to right) but no ensuing after-effect. However, the transfer of movement time and normalized jerk was symmetric in the contralateral workspace. These findings showed differences in the pattern of bilateral transfer asymmetry in the different workspace configurations, which was parameter specific.

Detecting task-relevant spatiotemporal modules and their relation to motor adaptation

How does the central nervous system (CNS) control our bodies, including hundreds of degrees of freedom (DoFs)? A hypothesis to reduce the number of DoFs posits that the CNS controls groups of joints or muscles (i.e., modules) rather than each joint or muscle independently. Another hypothesis posits that the CNS primarily controls motion components relevant to task achievements (i.e., task-relevant components). Although the two hypotheses are examined intensively, the relationship between the two concepts remains unknown, e.g., unimportant modules may possess task-relevant information. Here, we propose a framework of task-relevant modules, i.e., modules relevant to task achievements, while combining the two concepts mentioned above in a data-driven manner. To examine the possible role of the task-relevant modules, we examined the modulation of the task-relevant modules in a motor adaptation paradigm in which trial-to-trial modifications of motor output are observable. The task-relevant modules, rather than conventional modules, showed adaptation-dependent modulations, indicating the relevance of task-relevant modules to trial-to-trial updates of motor output. Our method provides insight into motor control and adaptation via an integrated framework of modules and task-relevant components.

Composition and decomposition of visuomotor maps during manual tracking

Adapting hand movements to changes in our body or the environment is essential for skilled motor behavior, as is the ability to flexibly combine experience gathered in separate contexts. However, it has been shown that when adapting hand movements to two different visuomotor perturbations in succession, interference effects can occur. Here, we investigate whether these interference effects compromise our ability to adapt to the superposition of the two perturbations. Participants tracked with a joystick, a visual target that followed a smooth but an unpredictable trajectory. Four separate groups of participants (total n = 83) completed one block of 50 trials under each of three mappings: one in which the cursor was rotated by 90° (ROTATION), one in which the cursor mimicked the behavior of a mass-spring system (SPRING), and one in which the SPRING and ROTATION mappings were superimposed (SPROT). The order of the blocks differed across groups. Although interference effects were found when switching between SPRING and ROTATION, participants who performed these blocks first performed better in SPROT than participants who had no prior experience with SPRING and ROTATION (i.e., composition). Moreover, participants who started with SPROT exhibited better performance under SPRING and ROTATION than participants who had no prior experience with each of these mappings (i.e., decomposition). Additional analyses confirmed that these effects resulted from components of learning that were specific to the rotational and spring perturbations. These results show that interference effects do not preclude the ability to compose/decompose various forms of visuomotor adaptation.NEW & NOTEWORTHY The ability to compose/decompose task representations is critical for both cognitive and behavioral flexibility. Here, we show that this ability extends to two forms of visuomotor adaptation in which humans have to perform visually guided hand movements. Despite the presence of interference effects when switching between visuomotor maps, we show that participants are able to flexibly compose or decompose knowledge acquired in previous sessions. These results further demonstrate the flexibility of sensorimotor adaptation in humans.

Motor planning under uncertainty

Actions often require the selection of a specific goal amongst a range of possibilities, like when a softball player must precisely position her glove to field a fast-approaching ground ball. Previous studies have suggested that during goal uncertainty the brain prepares for all potential goals in parallel and averages the corresponding motor plans to command an intermediate movement that is progressively refined as additional information becomes available. Although intermediate movements are widely observed, they could instead reflect a neural decision about the single best action choice given the uncertainty present. Here we systematically dissociate these possibilities using novel experimental manipulations and find that when confronted with uncertainty, humans generate a motor plan that optimizes task performance rather than averaging potential motor plans. In addition to accurate predictions of population-averaged changes in motor output, a novel computational model based on this performance-optimization theory accounted for a majority of the variance in individual differences between participants. Our findings resolve a long-standing question about how the brain selects an action to execute during goal uncertainty, providing fundamental insight into motor planning in the nervous system.

The Psychology of Reaching: Action Selection, Movement Implementation, and Sensorimotor Learning

The study of motor planning and learning in humans has undergone a dramatic transformation in the 20 years since this journal's last review of this topic. The behavioral analysis of movement, the foundational approach for psychology, has been complemented by ideas from control theory, computer science, statistics, and, most notably, neuroscience. The result of this interdisciplinary approach has been a focus on the computational level of analysis, leading to the development of mechanistic models at the psychological level to explain how humans plan, execute, and consolidate skilled reaching movements. This review emphasizes new perspectives on action selection and motor planning, research that stands in contrast to the previously dominant representation-based perspective of motor programming, as well as an emerging literature highlighting the convergent operation of multiple processes in sensorimotor learning.

Generalizing movement patterns following shoulder fixation

Generalizing newly learned movement patterns beyond the training context is challenging for most motor learning situations. Here we tested whether learning of a new physical property of the arm during self-initiated reaching generalizes to new arm configurations. Human participants performed a single-joint elbow reaching task and/or countered mechanical perturbations that created pure elbow motion with the shoulder joint free to rotate or locked by the manipulandum. With the shoulder free, we found activation of shoulder extensor muscles for pure elbow extension trials, appropriate for countering torques that arise at the shoulder due to forearm rotation. After locking the shoulder joint, we found a partial reduction in shoulder muscle activity, appropriate because locking the shoulder joint cancels the torques that arise at the shoulder due to forearm rotation. In our first three experiments, we tested whether and to what extent this partial reduction in shoulder muscle activity generalizes when reaching in different situations: 1) different initial shoulder orientation, 2) different initial elbow orientation, and 3) different reach distance/speed. We found generalization for the different shoulder orientation and reach distance/speed as measured by a reliable reduction in shoulder activity in these situations but no generalization for the different elbow orientation. In our fourth experiment, we found that generalization is also transferred to feedback control by applying mechanical perturbations and observing reflex responses in a distinct shoulder orientation. These results indicate that partial learning of new intersegmental dynamics is not sufficient for modifying a general internal model of arm dynamics.NEW & NOTEWORTHY Here we show that partially learning to reduce shoulder muscle activity following shoulder fixation generalizes to other movement conditions, but it does not generalize globally. These findings suggest that the partial learning of new intersegmental dynamics is not sufficient for modifying a general internal model of the arm's dynamics.

Generalization via superposition: combined effects of mixed reference frame representations for explicit and implicit learning in a visuomotor adaptation task

Studies on generalization of learned visuomotor perturbations have generally focused on whether learning is coded in extrinsic or intrinsic reference frames. This dichotomy, however, is challenged by recent findings showing that learning is represented in a mixed reference frame. Overlooked in this framework is how learning appears to consist of multiple processes, such as explicit reaiming and implicit motor adaptation. Therefore, the proposed mixed representation may simply reflect the superposition of explicit and implicit generalization functions, each represented in different reference frames. Here we characterized the individual generalization functions of explicit and implicit learning in relative isolation to determine whether their combination could predict the overall generalization function when both processes are in operation. We modified the form of feedback in a visuomotor rotation task in an attempt to isolate explicit and implicit learning and tested generalization across new limb postures to dissociate the extrinsic/intrinsic representations. We found that the amplitude of explicit generalization was reduced with postural change and was only marginally shifted, resembling an extrinsic representation. In contrast, implicit generalization maintained its amplitude but was significantly shifted, resembling a mixed representation. A linear combination of individual explicit and implicit generalization functions accounted for nearly 85% of the variance associated with the generalization function in a typical visuomotor rotation task, where both processes are in operation. This suggests that each form of learning results from a mixed representation with distinct extrinsic and intrinsic contributions and the combination of these features shapes the generalization pattern observed at novel limb postures. NEW & NOTEWORTHY Generalization following learning in visuomotor adaptation tasks can reflect how the brain represents what it learns. In this study, we isolated explicit and implicit forms of learning and showed that they are derived from a mixed reference frame representation with distinct extrinsic and intrinsic contributions. Furthermore, we showed that the overall generalization pattern at novel workspaces is due to the superposition of independent generalization effects developed by explicit and implicit learning processes.

Adaptation and spatial generalization to a triaxial visuomotor perturbation in a virtual reality environment

We explored visuomotor adaptation and spatial generalization of three-dimensional reaching movements performed in a virtual reality environment. We used a multiphase learning paradigm. First, subjects performed reaching movements to six targets without visual feedback (VF) (pre-exposure phase). Next, participants aimed at one target with veridical VF (baseline phase). Immediately after, they were required to adapt their movements to a triaxial visuomotor perturbation (horizontal, vertical, and sagittal translations) between actual hand motion and VF of hand motion in the virtual environment (learning phase). Finally, subjects aimed at the same targets as in the baseline (aftereffect) and pre-exposure phases (generalization) without VF (post-exposure phase). The results revealed spatial axis-dependent visuomotor adaptation capacities. First, subjects showed smaller intertrial variability along the horizontal compared to the sagittal and vertical axes during the baseline and learning phases. Second, although subjects were unaware of the visual distortion, they adapted their movements to each component of the triaxial perturbation. However, they showed reduced learning rate and less persistent adaptation (aftereffect) along the vertical than the horizontal and sagittal axes. Similarly, subjects transferred the newly learned visuomotor association to untrained regions of the workspace, but their average level of generalization was smaller along the vertical than the horizontal and sagittal axes. Collectively, our results suggest that adapting three-dimensional movements to a visual distortion involves distinct processes according to the specific sensorimotor integration demands of moving along each spatial axis. This finding supports the idea that the brain employs a modular decomposition strategy to simplify complex multidimensional visuomotor tasks.

Plan-based generalization shapes local implicit adaptation to opposing visuomotor transformations

The human ability to use different tools demonstrates our capability of forming and maintaining multiple, context-specific motor memories. Experimentally, this has been investigated in dual adaptation, where participants adjust their reaching movements to opposing visuomotor transformations. Adaptation in these paradigms occurs by distinct processes, such as strategies for each transformation or the implicit acquisition of distinct visuomotor mappings. Although distinct, transformation-dependent aftereffects have been interpreted as support for the latter, they could reflect adaptation of a single visuomotor map, which is locally adjusted in different regions of the workspace. Indeed, recent studies suggest that explicit aiming strategies direct where in the workspace implicit adaptation occurs, thus potentially serving as a cue to enable dual adaptation. Disentangling these possibilities is critical to understanding how humans acquire and maintain motor memories for different skills and tools. We therefore investigated generalization of explicit and implicit adaptation to untrained movement directions after participants practiced two opposing cursor rotations, which were associated with the visual display being presented in the left or right half of the screen. Whereas participants learned to compensate for opposing rotations by explicit strategies specific to this visual workspace cue, aftereffects were not cue sensitive. Instead, aftereffects displayed bimodal generalization patterns that appeared to reflect locally limited learning of both transformations. By varying target arrangements and instructions, we show that these patterns are consistent with implicit adaptation that generalizes locally around movement plans associated with opposing visuomotor transformations. Our findings show that strategies can shape implicit adaptation in a complex manner. NEW & NOTEWORTHY Visuomotor dual adaptation experiments have identified contextual cues that enable learning of separate visuomotor mappings, but the underlying representations of learning are unclear. We report that visual workspace separation as a contextual cue enables the compensation of opposing cursor rotations by a combination of explicit and implicit processes: Learners developed context-dependent explicit aiming strategies, whereas an implicit visuomotor map represented dual adaptation independent from arbitrary context cues by local adaptation around the explicit movement plan.

Sensorimotor Learning during a Marksmanship Task in Immersive Virtual Reality

Sensorimotor learning refers to improvements that occur through practice in the performance of sensory-guided motor behaviors. Leveraging novel technical capabilities of an immersive virtual environment, we probed the component kinematic processes that mediate sensorimotor learning. Twenty naïve subjects performed a simulated marksmanship task modeled after Olympic Trap Shooting standards. We measured movement kinematics and shooting performance as participants practiced 350 trials while receiving trial-by-trial feedback about shooting success. Spatiotemporal analysis of motion tracking elucidated the ballistic and refinement phases of hand movements. We found systematic changes in movement kinematics that accompanied improvements in shot accuracy during training, though reaction and response times did not change over blocks. In particular, we observed longer, slower, and more precise ballistic movements that replaced effort spent on corrections and refinement. Collectively, these results leverage developments in immersive virtual reality technology to quantify and compare the kinematics of movement during early learning of full-body sensorimotor orienting.

Distinct coordinate systems for adaptations of movement direction and extent

Learned compensations for perturbed visual feedback of movement extent and direction generalize differently to unpracticed movement directions, which suggests different underlying neural mechanisms. Here we investigated whether gain and rotation adaptations are consistent with representation in different coordinate systems. Subjects performed a force-aiming task with the wrist and learned different gains or rotations for different force directions. Generalization was tested without visual feedback for the same extrinsic directions but with the forearm in a different pronation-supination orientation. When the change in forearm orientation caused the adapted visuomotor map to conflict in extrinsic and joint-based coordinates, rotation generalization occurred in extrinsic coordinates but with reduced magnitude. In contrast, gain generalization appeared reduced and phase shifted. When the forearm was rotated further, such that all imposed perturbations aligned in both joint-based and extrinsic coordinates in both postures, rotation generalization was further reduced, whereas there was neither reduction nor phase shift in the pattern of extent generalization. These results show that rotation generalization was expressed in extrinsic coordinates, and that generalization magnitude was modulated by posture. In contrast, gain generalization appeared to depend on target direction defined by an integrated combination of extrinsic and joint-based coordinates and was not reduced substantially by posture changes alone. Although the quality of the model fit underlying our interpretation prevents us from making strong conclusions, the data suggest that adaptations of movement direction and extent are represented according to distinct coordinate systems.NEW & NOTEWORTHY Visuomotor gain and rotation adaptations generalize differently to novel movement directions, which suggests different neural mechanisms. When extrinsic and joint-based coordinates are effectively dissociated in an isometric aiming task, we find that they also generalize in different coordinate systems. Specifically, rotation generalized in extrinsic coordinates and decayed as posture departed from that adopted during adaptation. In contrast, gain generalization was expressed according to mixed extrinsic/joint-based coordinates and was not substantially reduced by postural changes.

Visuomotor Learning Generalizes Around the Intended Movement

Human motor learning is useful if it generalizes beyond the trained task. Here, we introduce a new idea about how human visuomotor learning generalizes. We show that learned reaching movements generalize around where a person intends to move (i.e., aiming direction) as opposed to where they actually move. We used a visual rotation paradigm that allowed us to disentangle whether generalization is centered on where people aim to move, where they actually move, or where visual feedback indicates they moved. Participants reached to a visual target with their arm occluded from view. The cursor feedback was rotated relative to the position of their unseen hand to induce learning. Participants verbally reported their aiming direction, reached, and then were shown the outcome. We periodically introduced single catch trials with no feedback to measure learning. Results showed that learning was maximal at the participants’ aiming location, and not at the actual hand position or where the cursor was displayed. This demonstrates that visuomotor learning generalizes around where we intend to move rather than where we actually move, and thus introduces a new role for cognitive processes beyond simply reducing movement error.

Savings upon Re-Aiming in Visuomotor Adaptation

Sensorimotor adaptation has traditionally been viewed as a purely error-based process. There is, however, growing appreciation for the idea that performance changes in these tasks can arise from the interplay of error-based adaptation with other learning processes. The challenge is to specify constraints on these different processes, elucidating their respective contributions to performance, as well as the manner in which they interact. We address this question by exploring constraints on savings, the phenomenon in which people show faster performance gains when the same learning task is repeated. In a series of five experiments, we demonstrate that error-based learning associated with sensorimotor adaptation does not contribute to savings. Instead, savings reflects improvements in action selection, rather than motor execution.

SIGNIFICANCE STATEMENT

Savings is the phenomenon in which people show faster relearning of a previously forgotten memory. In the motor learning domain, this phenomenon has been a puzzle for learning models that operate exclusively on error-based learning processes. We demonstrate, in a series of experiments, that savings selectively reflects improvements in action selection: Participants are more adept in invoking an appropriate aiming strategy when presented with a previously experienced perturbation. Indeed, improvements in action selection appear to be the sole source of savings in visuomotor adaptation tasks. We observe no evidence of savings in implicit error-based adaptation.

Major remaining gaps in models of sensorimotor systems

Experimental descriptions of the anatomy and physiology of individual components of sensorimotor systems have revealed substantial complexity, making it difficult to intuit how complete systems might work. This has led to increasing efforts to develop and employ mathematical models to study the emergent properties of such systems. Conversely, the development of such models tends to reveal shortcomings in the experimental database upon which models must be constructed and validated. In both cases models are most useful when they point up discrepancies between what we think we know and possibilities that we may have overlooked. This overview considers those components of complete sensorimotor systems that currently appear to be potentially important but poorly understood. These are generally omitted completely from modeled systems or buried in implicit assumptions that underlie the design of the model.

Generalization patterns for reach adaptation and proprioceptive recalibration differ after visuomotor learning

Visuomotor learning results in changes in both motor and sensory systems (Cressman EK, Henriques DY. J Neurophysiol 102: 3505-3518, 2009), such that reaches are adapted and sense of felt hand position recalibrated after reaching with altered visual feedback of the hand. Moreover, visuomotor learning has been shown to generalize such that reach adaptation achieved at a trained target location can influence reaches to novel target directions (Krakauer JW, Pine ZM, Ghilardi MF, Ghez C. J Neurosci 20: 8916-8924, 2000). We looked to determine whether proprioceptive recalibration also generalizes to novel locations. Moreover, we looked to establish the relationship between reach adaptation and changes in sense of felt hand position by determining whether proprioceptive recalibration generalizes to novel targets in a similar manner as reach adaptation. On training trials, subjects reached to a single target with aligned or misaligned cursor-hand feedback, in which the cursor was either rotated or scaled in extent relative to hand movement. After reach training, subjects reached to the training target and novel targets (including targets from a second start position) without visual feedback to assess generalization of reach adaptation. Subjects then performed a proprioceptive estimation task, in which they indicated the position of their hand relative to visual reference markers placed at similar locations as the trained and novel reach targets. Results indicated that shifts in hand position generalized across novel locations, independent of reach adaptation. Thus these distinct sensory and motor generalization patterns suggest that reach adaptation and proprioceptive recalibration arise from independent error signals and that changes in one system cannot guide adjustments in the other.

The generalization of prior uncertainty during reaching

Bayesian statistics defines how new information, given by a likelihood, should be combined with previously acquired information, given by a prior distribution. Many experiments have shown that humans make use of such priors in cognitive, perceptual, and motor tasks, but where do priors come from? As people never experience the same situation twice, they can only construct priors by generalizing from similar past experiences. Here we examine the generalization of priors over stochastic visuomotor perturbations in reaching experiments. In particular, we look into how the first two moments of the prior--the mean and variance (uncertainty)--generalize. We find that uncertainty appears to generalize differently from the mean of the prior, and an interesting asymmetry arises when the mean and the uncertainty are manipulated simultaneously.

Generalization of reach adaptation and proprioceptive recalibration at different distances in the workspace

Studies have shown that adapting one's reaches in one location in the workspace can generalize to other novel locations. Generalization of this visuomotor adaptation is influenced by the location of novel targets relative to the trained location such that reaches made to novel targets that are located far from the trained target direction (i.e., ~22.5°; Krakauer et al. in J Neurosci 20:8916-8924, 2000) show very little generalization compared to those that are closer to the trained direction. However, generalization is much broader when reaching to novel targets in the same direction but at different distances from the trained target. In this study, we investigated whether changes in hand proprioception (proprioceptive recalibration), like reach adaptation, generalize to different distances of the workspace. Subjects adapted their reaches with a rotated cursor to two target locations at a distance of 13 cm from the home position. We then compared changes in open-loop reaches and felt hand position at these trained locations to novel targets located in the same direction as the trained targets but either at a closer (10 cm) or at a farther distance (15 cm) from the home position. We found reach adaptation generalized to novel closer and farther targets to the same extent as observed at the trained target distance. In contrast, while changes in felt hand position were significant across the two novel distances, this recalibration was smaller for the novel-far locations compared to the trained location. Given that reach adaptation completely generalized across the novel distances but proprioceptive recalibration generalized to a lesser extent for farther distances, we suggest that proprioceptive recalibration may arise independently of motor adaptation and vice versa.

Interference from mere thinking: mental rehearsal temporarily disrupts recall of motor memory

Interference between successively learned tasks is widely investigated to study motor memory. However, how simultaneously learned motor memories interact with each other has been rarely studied despite its prevalence in daily life. Assuming that motor memory shares common neural mechanisms with declarative memory system, we made unintuitive predictions that mental rehearsal, as opposed to further practice, of one motor memory will temporarily impair the recall of another simultaneously learned memory. Subjects simultaneously learned two sensorimotor tasks, i.e., visuomotor rotation and gain. They retrieved one memory by either practice or mental rehearsal and then had their memory evaluated. We found that mental rehearsal, instead of execution, impaired the recall of unretrieved memory. This impairment was content-independent, i.e., retrieving either gain or rotation impaired the other memory. Hence, conscious recollection of one motor memory interferes with the recall of another memory. This is analogous to retrieval-induced forgetting in declarative memory, suggesting a common neural process across memory systems. Our findings indicate that motor imagery is sufficient to induce interference between motor memories. Mental rehearsal, currently widely regarded as beneficial for motor performance, negatively affects memory recall when it is exercised for a subset of memorized items.

Changes in task parameters during walking prism adaptation influence the subsequent generalization pattern

An understanding of the transfer (or generalization) of motor adaptations between legs and across tasks during walking has remained elusive due to limited research and mixed results. Here, we asked whether stepping sequences or task constraints introduced during walking prism-adaptation tasks influence generalization patterns. Forty subjects adapted to prism glasses in precision-walking or obstacle-avoidance tasks that required a specific stepping sequence to the center of two/three targets or laterally over an obstacle. We then tested for generalization, reflected by aftereffects in the nonadapted task. Our previous study using these tasks found that only one leg generalized. Here, we reversed the stepping sequence and found that only the opposite leg generalized in the subject group that adapted in a precision-walking task. The combination of stepping sequence and direction of prism shift caused subjects in two groups to collide with the obstacle early during adaptation, thus making the step prior to going over the obstacle more important. Both legs subsequently generalized. A fourth subject group experienced a three-target, precision-walking task, resulting in a balanced, right-left, left-right stepping sequence, meant to induce bilateral generalization. While only one leg generalized, foot placement aftereffects before stepping over the obstacle would have caused subjects to collide with it. Together with our previous study, the results suggest a contribution of stepping sequence during the adapted task on generalization patterns, likely driven by proprioceptive feedback. The results also support the idea that negative consequences during adaptation and/or perceived threat can influence generalization.

Context-dependent generalization

The pattern of generalization following motor learning can provide a probe on the neural mechanisms underlying learning. For example, the breadth of generalization to untrained regions of space after visuomotor adaptation to targets in a restricted region of space has been attributed to the directional tuning properties of neurons in the motor system. Building on this idea, the effect of different types of perturbations on generalization (e.g., rotation vs. visual translation) have been attributed to the selection of differentially tuned populations. Overlooked in this discussion is consideration of how the context of the training environment may constrain generalization. Here, we explore the role of context by having participants learn a visuomotor rotation or a translational shift in two different contexts, one in which the array of targets were presented in a circular arrangement and the other in which they were presented in a rectilinear arrangement. The perturbation and environments were either consistent (e.g., rotation with circular arrangement) or inconsistent (e.g., rotation with rectilinear arrangement). The pattern of generalization across the workspace was much more dependent on the context of the environment than on the perturbation, with broad generalization for the rectilinear arrangement for both types of perturbations. Moreover, the generalization pattern for this context was evident, even when the perturbation was introduced in a gradual manner, precluding the use of an explicit strategy. We describe how current models of generalization might be modified to incorporate these results, building on the idea that context provides a strong bias for how the motor system infers the nature of the visuomotor perturbation and, in turn, how this information influences the pattern of generalization.

Generalization of unconstrained reaching with hand-weight changes

Studies of motor generalization usually perturb hand reaches by distorting visual feedback with virtual reality or by applying forces with a robotic manipulandum. Whereas such perturbations are useful for studying how the central nervous system adapts and generalizes to novel dynamics, they are rarely encountered in daily life. The most common perturbations that we experience are changes in the weights of objects that we hold. Here, we use a center-out, free-reaching task, in which we can manipulate the weight of a participant's hand to examine adaptation and generalization following naturalistic perturbations. In both trial-by-trial paradigms and block-based paradigms, we find that learning converges rapidly (on a timescale of approximately two trials), and this learning generalizes mostly to movements in nearby directions with a unimodal pattern. However, contrary to studies using more artificial perturbations, we find that the generalization has a strong global component. Furthermore, the generalization is enhanced with repeated exposure of the same perturbation. These results suggest that the familiarity of a perturbation is a major factor in movement generalization and that several theories of the neural control of movement, based on perturbations applied by robots or in virtual reality, may need to be extended by incorporating prior influence that is characterized by the familiarity of the perturbation.

Feedback-dependent generalization

Generalization provides a window into the representational changes that occur during motor learning. Neural network models have been integral in revealing how the neural representation constrains the extent of generalization. Specifically, two key features are thought to define the pattern of generalization. First, generalization is constrained by the properties of the underlying neural units; with directionally tuned units, the extent of generalization is limited by the width of the tuning functions. Second, error signals are used to update a sensorimotor map to align the desired and actual output, with a gradient-descent learning rule ensuring that the error produces changes in those units responsible for the error. In prior studies, task-specific effects in generalization have been attributed to differences in neural tuning functions. Here we ask whether differences in generalization functions may arise from task-specific error signals. We systematically varied visual error information in a visuomotor adaptation task and found that this manipulation led to qualitative differences in generalization. A neural network model suggests that these differences are the result of error feedback processing operating on a homogeneous and invariant set of tuning functions. Consistent with novel predictions derived from the model, increasing the number of training directions led to specific distortions of the generalization function. Taken together, the behavioral and modeling results offer a parsimonious account of generalization that is based on the utilization of feedback information to update a sensorimotor map with stable tuning functions.

Using dual tasks to test immediate transfer of training between naturalistic movements: a proof-of-principle study

Theories of motor learning predict that training a movement reduces the amount of attention needed for its performance (i.e., more automatic). If training one movement transfers, then the amount of attention needed for performing a second movement should also be reduced, as measured under dual task conditions. The authors' purpose was to test whether dual task paradigms are feasible for detecting transfer of training between two naturalistic movements. Immediately following motor training, subjects improved performance of a second untrained movement under single and dual task conditions. Subjects with no training did not. Improved performance in the untrained movement was likely due to transfer, and suggests that dual tasks may be feasible for detecting transfer between naturalistic actions.

Visuomotor discordance in virtual reality: effects on online motor control

Virtual reality (VR) applications are rapidly permeating fields such as medicine, rehabilitation, research, and military training. However, VR-induced effects on human performance remain poorly understood, particularly in relation to fine-grained motor control of the hand and fingers. We designed a novel virtual reality environment suitable for hand-finger interactions and examined the ability to use visual feedback manipulations in VR to affect online motor performance. Ten healthy subjects performed a simple finger flexion movement toward a kinesthetically-defined 45° target angle while receiving one of three types of VR-based visual feedback in real-time: veridical (in which the virtual hand motion corresponded to subjects' actual motion), or scaled-down / scaled-up feedback (in which virtual finger motion was scaled by 25% / 175% relative to actual motion). Scaled down-and scaled-up feedback led to significant online modifications (increases and decreases, respectively) in angular excursion, despite explicit instructions for subjects to maintain constant movements across conditions. The latency of these modifications was similar across conditions. These findings demonstrate that a VR-based platform may be a robust medium for presenting visuomotor discordances to engender a sense of ownership and drive sensorimotor adaptation for (retraining motor skills. This may prove to be particularly important for retraining motor skills in patients with neurologically-based movement disorders.

Concurrent adaptation to four different visual rotations

The human sensorimotor system can concurrently adapt to two different distortions without interference when the distortions are cued by different contexts. We investigated whether this holds with four distortions as well. Subjects were exposed to an interlaced sequence of +30°, −30°, +60°, and −60° visuomotor rotations as the adaptation phase, cued by combinations of workspace location and by the arm used. Adaptation phase was followed by two episodes in each condition without any distortion testing the aftereffects. Results showed that the error at the onset of adaptation gradually decreased during adaptation to all four distortions without any sign of interference between the conditions. Furthermore, aftereffects of adaptation to ±30° rotation were significantly greater than of adaptation to ±60° rotation. We conclude that the human sensorimotor system is able to concurrently adapt to four different visual distortions when they are cued by different contexts. However, the results of aftereffects are ambiguous: Recalibration could be based on at least four parallel modules.

Prism adaptation and generalization during visually guided locomotor tasks

The ability of individuals to adapt locomotion to constraints associated with the complex environments normally encountered in everyday life is paramount for survival. Here, we tested the ability of 24 healthy young adults to adapt to a rightward prism shift (∼11.3°) while either walking and stepping to targets (i.e., precision stepping task) or stepping over an obstacle (i.e., obstacle avoidance task). We subsequently tested for generalization to the other locomotor task. In the precision stepping task, we determined the lateral end-point error of foot placement from the targets. In the obstacle avoidance task, we determined toe clearance and lateral foot placement distance from the obstacle before and after stepping over the obstacle. We found large, rightward deviations in foot placement on initial exposure to prisms in both tasks. The majority of measures demonstrated adaptation over repeated trials, and adaptation rates were dependent mainly on the task. On removal of the prisms, we observed negative aftereffects for measures of both tasks. Additionally, we found a unilateral symmetric generalization pattern in that the left, but not the right, lower limb indicated generalization across the 2 locomotor tasks. These results indicate that the nervous system is capable of rapidly adapting to a visuomotor mismatch during visually demanding locomotor tasks and that the prism-induced adaptation can, at least partially, generalize across these tasks. The results also support the notion that the nervous system utilizes an internal model for the control of visually guided locomotion.

Human sensorimotor learning: adaptation, skill, and beyond

Recent studies of upper limb movements have provided insights into the computations, mechanisms, and taxonomy of human sensorimotor learning. Motor tasks differ with respect to how they weight different learning processes. These include adaptation, an internal-model based process that reduces sensory-prediction errors in order to return performance to pre-perturbation levels, use-dependent plasticity, and operant reinforcement. Visuomotor rotation and force-field tasks impose systematic errors and thereby emphasize adaptation. In skill learning tasks, which for the most part do not involve a perturbation, improved performance is manifest as reduced motor variability and probably depends less on adaptation and more on success-based exploration. Explicit awareness and declarative memory contribute, to varying degrees, to motor learning. The modularity of motor learning processes maps, at least to some extent, onto distinct brain structures.

Visual target separation determines the extent of generalisation between opposing visuomotor rotations

Here we investigated the influence of angular separation between visual and motor targets on concurrent adaptation to two opposing visuomotor rotations. We inferred the extent of generalisation between opposing visuomotor rotations at individual target locations based on whether interference (negative transfer) was present. Our main finding was that dual adaptation occurred to opposing visuomotor rotations when each was associated with different visual targets but shared a common motor target. Dual adaptation could have been achieved either within a single sensorimotor map (i.e. with different mappings associated with different ranges of visual input), or by forming two different internal models (the selection of which would be based on contextual information provided by target location). In the present case, the pattern of generalisation was dependent on the relative position of the visual targets associated with each rotation. Visual targets nearest the workspace of the opposing visuomotor rotation exhibited the most interference (i.e. generalisation). When the minimum angular separation between visual targets was increased, the extent of interference was reduced. These results suggest that the separation in the range of sensory inputs is the critical requirement to support dual adaptation within a single sensorimotor mapping.

Learning from sensory and reward prediction errors during motor adaptation

Voluntary motor commands produce two kinds of consequences. Initially, a sensory consequence is observed in terms of activity in our primary sensory organs (e.g., vision, proprioception). Subsequently, the brain evaluates the sensory feedback and produces a subjective measure of utility or usefulness of the motor commands (e.g., reward). As a result, comparisons between predicted and observed consequences of motor commands produce two forms of prediction error. How do these errors contribute to changes in motor commands? Here, we considered a reach adaptation protocol and found that when high quality sensory feedback was available, adaptation of motor commands was driven almost exclusively by sensory prediction errors. This form of learning had a distinct signature: as motor commands adapted, the subjects altered their predictions regarding sensory consequences of motor commands, and generalized this learning broadly to neighboring motor commands. In contrast, as the quality of the sensory feedback degraded, adaptation of motor commands became more dependent on reward prediction errors. Reward prediction errors produced comparable changes in the motor commands, but produced no change in the predicted sensory consequences of motor commands, and generalized only locally. Because we found that there was a within subject correlation between generalization patterns and sensory remapping, it is plausible that during adaptation an individual's relative reliance on sensory vs. reward prediction errors could be inferred. We suggest that while motor commands change because of sensory and reward prediction errors, only sensory prediction errors produce a change in the neural system that predicts sensory consequences of motor commands.

It is thought that motor adaptation relies on sensory prediction errors to form an estimate of the perturbation. Here, we present evidence that motor adaptation can be driven by both sensory and reward prediction errors. We found that learning from sensory prediction error altered the predicted consequences of motor commands, leaving behind a sensory remapping, whereas learning from reward prediction error produced comparable change in motor commands, but did not produce a sensory remapping. It is possible that the neural basis of learning from sensory and reward prediction errors are distinct because they produce different generalization patterns.

Context-dependent partitioning of motor learning in bimanual movements

Human subjects easily adapt to single dynamic or visuomotor perturbations. In contrast, when two opposing dynamic or visuomotor perturbations are presented sequentially, interference is often observed. We examined the effect of bimanual movement context on interference between opposing perturbations using pairs of contexts, in which the relative direction of movement between the two arms was different across the pair. When each perturbation direction was associated with a different bimanual context, such as movement of the arms in the same direction versus movement in the opposite direction, interference was dramatically reduced. This occurred over a short period of training and was seen for both dynamic and visuomotor perturbations, suggesting a partitioning of motor learning for the different bimanual contexts. Further support for this was found in a series of transfer experiments. Having learned a single dynamic or visuomotor perturbation in one bimanual context, subjects showed incomplete transfer of this learning when the context changed, even though the perturbation remained the same. In addition, we examined a bimanual context in which one arm was moved passively and show that the reduction in interference requires active movement. The sensory consequences of movement are thus insufficient to allow opposing perturbations to be co-represented. Our results suggest different bimanual movement contexts engage at least partially separate representations of dynamics and kinematics in the motor system.