Context-dependent partitioning of motor learning in bimanual movements

Ouvrai opens access to remote virtual reality studies of human behavioural neuroscience

Modern virtual reality (VR) devices record six-degree-of-freedom kinematic data with high spatial and temporal resolution and display high-resolution stereoscopic three-dimensional graphics. These capabilities make VR a powerful tool for many types of behavioural research, including studies of sensorimotor, perceptual and cognitive functions. Here we introduce Ouvrai, an open-source solution that facilitates the design and execution of remote VR studies, capitalizing on the surge in VR headset ownership. This tool allows researchers to develop sophisticated experiments using cutting-edge web technologies such as WebXR to enable browser-based VR, without compromising on experimental design. Ouvrai's features include easy installation, intuitive JavaScript templates, a component library managing front- and backend processes and a streamlined workflow. It integrates with Firebase, Prolific and Amazon Mechanical Turk and provides data processing utilities for analysis. Unlike other tools, Ouvrai remains free, with researchers managing their web hosting and cloud database via personal Firebase accounts. Ouvrai is not limited to VR studies; researchers can also develop and run desktop or touchscreen studies using the same streamlined workflow. Through three distinct motor learning experiments, we confirm Ouvrai's efficiency and viability for conducting remote VR studies.

Learning context shapes bimanual control strategy and generalization of novel dynamics

Bimanual movements are fundamental components of everyday actions, yet the underlying mechanisms coordinating adaptation of the two hands remain unclear. Although previous studies highlighted the contextual effect of kinematics of both arms on internal model formation, we do not know how the sensorimotor control system associates the learned memory with the experienced states in bimanual movements. More specifically, can, and if so, how, does the sensorimotor control system combine multiple states from different effectors to create and adapt a motor memory? Here, we tested motor memory formation in two groups with a novel paradigm requiring the encoding of the kinematics of the right hand to produce the appropriate predictive force on the left hand. While one group was provided with training movements in which this association was evident, the other group was trained on conditions in which this association was ambiguous. After adaptation, we tested the encoding of the learned motor memory by measuring the generalization to new movement combinations. While both groups adapted to the novel dynamics, the evident group showed a weighted encoding of the learned motor memory based on movements of the other (right) hand, whereas the ambiguous group exhibited mainly same (left) hand encoding in bimanual trials. Despite these differences, both groups demonstrated partial generalization to unimanual movements of the left hand. Our results show that motor memories can be encoded depending on the motion of other limbs, but that the training conditions strongly shape the encoding of the motor memory formation and determine the generalization to novel contexts.

The effects of probabilistic context inference on motor adaptation

Humans have been shown to adapt their movements when a sudden or gradual change to the dynamics of the environment are introduced, a phenomenon called motor adaptation. If the change is reverted, the adaptation is also quickly reverted. Humans are also able to adapt to multiple changes in dynamics presented separately, and to be able to switch between adapted movements on the fly. Such switching relies on contextual information which is often noisy or misleading, affecting the switch between known adaptations. Recently, computational models for motor adaptation and context inference have been introduced, which contain components for context inference and Bayesian motor adaptation. These models were used to show the effects of context inference on learning rates across different experiments. We expanded on these works by using a simplified version of the recently-introduced COIN model to show that the effects of context inference on motor adaptation and control go even further than previously shown. Here, we used this model to simulate classical motor adaptation experiments from previous works and showed that context inference, and how it is affected by the presence and reliability of feedback, effect a host of behavioral phenomena that had so far required multiple hypothesized mechanisms, lacking a unified explanation. Concretely, we show that the reliability of direct contextual information, as well as noisy sensory feedback, typical of many experiments, effect measurable changes in switching-task behavior, as well as in action selection, that stem directly from probabilistic context inference.

Protection Induced by Oral Vaccination with a Recombinant Yersinia pseudotuberculosis Delivering Yersinia pestis LcrV and F1 Antigens in Mice and Rats against Pneumonic Plague

A newly attenuated Yersinia pseudotuberculosis strain (designated Yptb1) with triple mutation Δasd ΔyopK ΔyopJ and chromosomal insertion of the Y. pestis caf1R-caf1M-caf1A-caf1 operon was constructed as a live vaccine platform. Yptb1 tailored with an Asd⁺ plasmid (pYA5199) (designated Yptb1[pYA5199]) simultaneously delivers Y. pestis LcrV and F1. The attenuated Yptb1(pYA5199) localized in the Peyer's patches, lung, spleen, and liver for a few weeks after oral immunization without causing any disease symptoms in immunized rodents. An oral prime-boost Yptb1(pYA5199) immunization stimulated potent antibody responses to LcrV, F1, and Y. pestis whole-cell lysate (YPL) in Swiss Webster mice and Brown Norway rats. The prime-boost Yptb1(pYA5199) immunization induced higher antigen-specific humoral and cellular immune responses in mice than a single immunization did, and it provided complete short-term and long-term protection against a high dose of intranasal Y. pestis challenge in mice. Moreover, the prime-boost immunization afforded substantial protection for Brown Norway rats against an aerosolized Y. pestis challenge. Our study highlights that Yptb1(pYA5199) has high potential as an oral vaccine candidate against pneumonic plague.

Bayes, predictive processing, and the cognitive architecture of motor control

Despite their popularity, relatively scant attention has been paid to the upshot of Bayesian and predictive processing models of cognition for views of overall cognitive architecture. Many of these models are hierarchical; they posit generative models at multiple distinct "levels," whose job is to predict the consequences of sensory input at lower levels. I articulate one possible position that could be implied by these models, namely, that there is a continuous hierarchy of perception, cognition, and action control comprising levels of generative models. I argue that this view is not entailed by a general Bayesian/predictive processing outlook. Bayesian approaches are compatible with distinct formats of mental representation. Focusing on Bayesian approaches to motor control, I argue that the junctures between different types of mental representation are places where the transitivity of hierarchical prediction may be broken, and I consider the upshot of this conclusion for broader discussions of cognitive architecture.

Maintained Representations of the Ipsilateral and Contralateral Limbs during Bimanual Control in Primary Motor Cortex

Primary motor cortex (M1) almost exclusively controls the contralateral side of the body. However, M1 activity is also modulated during ipsilateral body movements. Previous work has shown that M1 activity related to the ipsilateral arm is independent of the M1 activity related to the contralateral arm. How do these patterns of activity interact when both arms move simultaneously? We explored this problem by training 2 monkeys (male, Macaca mulatta) in a postural perturbation task while recording from M1. Loads were applied to one arm at a time (unimanual) or both arms simultaneously (bimanual). We found 83% of neurons (n = 236) were responsive to both the unimanual and bimanual loads. We also observed a small reduction in activity magnitude during the bimanual loads for both limbs (25%). Across the unimanual and bimanual loads, neurons largely maintained their preferred load directions. However, there was a larger change in the preferred loads for the ipsilateral limb (∼25%) than the contralateral limb (∼9%). Lastly, we identified the contralateral and ipsilateral subspaces during the unimanual loads and found they captured a significant amount of the variance during the bimanual loads. However, the subspace captured more of the bimanual variance related to the contralateral limb (97%) than the ipsilateral limb (66%). Our results highlight that, even during bimanual motor actions, M1 largely retains its representations of the contralateral and ipsilateral limbs.SIGNIFICANCE STATEMENT Previous work has shown that primary motor cortex (M1) represents information related to the contralateral limb, its downstream target, but also reflects information related to the ipsilateral limb. Can M1 still represent both sources of information when performing simultaneous movements of the limbs? Here we record from M1 during a postural perturbation task. We show that activity related to the contralateral limb is maintained between unimanual and bimanual motor actions, whereas the activity related to the ipsilateral limb undergoes a small change between unimanual and bimanual motor actions. Our results indicate that two independent representations can be maintained and expressed simultaneously in M1.

Elite competitive swimmers exhibit higher motor cortical inhibition and superior sensorimotor skills in a water environment

Motor skill learning leads to task-related contextual behavioral changes that are underpinned by neuroplastic cortical reorganization. Short-term training induces environment-related contextual behavioral changes and neuroplastic changes in the primary motor cortex (M1). However, it is unclear whether environment-related contextual behavioral changes persist after long-term training and how cortical plastic changes are involved in behavior. To address these issues, we examined 14 elite competitive swimmers and 14 novices. We hypothesized that the sensorimotor skills of swimmers would be higher in a water environment than those of novices, and the recruitment of corticospinal and intracortical projections would be different between swimmers and novices. We assessed joint angle modulation performance as a behavioral measure and motor cortical excitation and inhibition using transcranial magnetic stimulation (TMS) at rest and during the tasks that were performed before, during, and after water immersion (WI). Motor cortical inhibition was measured with short-interval intracortical inhibition and long-interval intracortical inhibition by a paired-pulse TMS paradigm. We found that 1) the sensorimotor skills of swimmers who underwent long-term training in a water environment were superior and robustly unchanged compared with those of novices with respect to baseline on land, during WI, on land post-WI and 2) intracortical inhibition in water environments was increased in swimmers but was decreased in non-swimmers at rest compared to that on land; however, the latter alterations in intracortical inhibition in water environment were insufficient to account for the superior sensorimotor skills of swimmers. In conclusion, we demonstrate that environment-related contextual behavioral and neural changes occur even with long-term training experience.

Spontaneous Beta Band Rhythms in the Predictive Coding of Natural Stimuli

The regularity of the physical world and the biomechanics of the human body movements generate distributions of highly probable states that are internalized by the brain in the course of a lifetime. In Bayesian terms, the brain exploits prior knowledge, especially under conditions when sensory input is unavailable or uncertain, to predictively anticipate the most likely outcome of upcoming stimuli and movements. These internal models, formed during development, yet still malleable in adults, continuously adapt through the learning of novel stimuli and movements.

Traditionally, neural beta (β) oscillations are considered essential for maintaining sensorimotor and cognitive representations, and for temporal coding of expectations. However, recent findings show that fluctuations of β band power in the resting state strongly correlate between cortical association regions. Moreover, central (hub) regions form strong interactions over time with different brain regions/networks (dynamic core). β band centrality fluctuations of regions of the dynamic core predict global efficiency peaks suggesting a mechanism for network integration. Furthermore, this temporal architecture is surprisingly stable, both in topology and dynamics, during the observation of ecological natural visual scenes, whereas synthetic temporally scrambled stimuli modify it. We propose that spontaneous β rhythms may function as a long-term “prior” of frequent environmental stimuli and behaviors.

Early stages of sensorimotor map acquisition: learning with free exploration, without active movement or global structure

One of the puzzles of learning to talk or play a musical instrument is how we learn which movement produces a particular sound: an audiomotor map. The initial stages of map acquisition can be studied by having participants learn arm movements to auditory targets. The key question is what mechanism drives this early learning. Three learning processes from previous literature were tested: map learning may rely on active motor outflow (target), on error correction, and on the correspondence between sensory and motor distances (i.e., that similar movements map to similar sounds). Alternatively, we hypothesized that map learning can proceed without these. Participants made movements that were mapped to sounds in a number of different conditions that each precluded one of the potential learning processes. We tested whether map learning relies on assumptions about topological continuity by exposing participants to a permuted map that did not preserve distances in auditory and motor space. Further groups were tested who passively experienced the targets, kinematic trajectories produced by a robot arm, and auditory feedback as a yoked active participant (hence without active motor outflow). Another group made movements without receiving targets (thus without experiencing errors). In each case we observed substantial learning, therefore none of the three hypothesized processes is required for learning. Instead early map acquisition can occur with free exploration without target error correction, is based on sensory-to-sensory correspondences, and possible even for discontinuous maps. The findings are consistent with the idea that early sensorimotor map formation can involve instance-specific learning.NEW & NOTEWORTHY This study tested learning of novel sensorimotor maps in a variety of unusual circumstances, including learning a mapping that was permuted in such as way that it fragmented the sensorimotor workspace into discontinuous parts, thus not preserving sensory and motor topology. Participants could learn this mapping, and they could learn without motor outflow or targets. These results point to a robust learning mechanism building on individual instances, inspired from machine learning literature.

Neglect-Like Effects on Drawing Symmetry Induced by Adaptation to a Laterally Asymmetric Visuomotor Delay

In daily interactions, our sensorimotor system accounts for spatial and temporal discrepancies between the senses. Functional lateralization between hemispheres causes differences in attention and in the control of action across the left and right workspaces. In addition, differences in transmission delays between modalities affect movement control and internal representations. Studies on motor impairments such as hemispatial neglect syndrome suggested a link between lateral spatial biases and temporal processing. To understand this link, we computationally modeled and experimentally validated the effect of laterally asymmetric delay in visual feedback on motor learning and its transfer to the control of drawing movements without visual feedback. In the behavioral experiments, we asked healthy participants to perform lateral reaching movements while adapting to delayed visual feedback in either left, right, or both workspaces. We found that the adaptation transferred to blind drawing and caused movement elongation, which is consistent with a state representation of the delay. However, the pattern of the spatial effect varied between conditions: whereas adaptation to delay in only the left workspace or in the whole workspace caused selective leftward elongation, adaptation to delay in only the right workspace caused drawing elongation in both directions. We simulated arm movements according to different models of perceptual and motor spatial asymmetry in the representation of delay and found that the best model that accounts for our results combines both perceptual and motor asymmetry between the hemispheres. These results provide direct evidence for an asymmetrical processing of delayed visual feedback that is associated with both perceptual and motor biases that are similar to those observed in hemispatial neglect syndrome.

Restricted transfer of learning between unimanual and bimanual finger sequences

When training bimanual skills, such as playing piano, people sometimes practice each hand separately and at a later stage combine the movements of the two hands. This poses the critical question of whether motor skills can be acquired by separately practicing each subcomponent or should be trained as a whole. In the present study, we addressed this question by training human subjects for 4 days in a unimanual or bimanual version of the discrete sequence production task. Both groups were then tested on trained and untrained sequences on both unimanual and bimanual versions of the task. Surprisingly, we found no evidence of transfer from trained unimanual to bimanual or from trained bimanual to unimanual sequences. In half the participants, we also investigated whether cuing the sequences on the left and right hand with unique letters would change transfer. With these cues, untrained sequences that shared some components with the trained sequences were performed more quickly than sequences that did not. However, the amount of this transfer was limited to ∼10% of the overall sequence-specific learning gains. These results suggest that unimanual and bimanual sequences are learned in separate representations. Making participants aware of the interrelationship between sequences can induce some transferrable component, although the main component of the skill remains unique to unimanual or bimanual execution.NEW & NOTEWORTHY Studies in reaching movement demonstrated that approximately half of motor learning can transfer across unimanual and bimanual contexts, suggesting that neural representations for unimanual and bimanual movements are fairly overlapping at the level of elementary movement. In this study, we show that little or no transfer occurred across unimanual and bimanual sequential finger movements. This result suggests that bimanual sequences are represented at a level of the motor hierarchy that integrates movements of both hands.

Motor Planning, Not Execution, Separates Motor Memories

Recent theories of limb control emphasize motor cortex as a dynamical system, with planning setting the initial neural state, and execution arising from the self-limiting evolution of the intrinsic neural dynamics. Therefore, movements that share an initial trajectory but then diverge might have different neural states during the execution of the identical initial trajectories. We hypothesized that motor adaptation maps neural states to changes in motor command. This predicts that two opposing perturbations, which interfere when experienced over the same movement, could be learned if each is associated with a different plan even if not executed. We show that planning, but not executing, different follow-through movements allow opposing perturbations to be learned simultaneously over the same movement. However, no learning occurs if different follow throughs are executed, but not planned prior to movement initiation. Our results suggest neural, rather than physical states, are the critical factor associated with motor adaptation.

Tagging motor memories with transcranial direct current stimulation allows later artificially-controlled retrieval

We demonstrate that human motor memories can be artificially tagged and later retrieved by noninvasive transcranial direct current stimulation (tDCS). Participants learned to adapt reaching movements to two conflicting dynamical environments that were each associated with a different tDCS polarity (anodal or cathodal tDCS) on the sensorimotor cortex. That is, we sought to determine whether divergent background activity levels within the sensorimotor cortex (anodal: higher activity; cathodal: lower activity) give rise to distinct motor memories. After a training session, application of each tDCS polarity automatically resulted in the retrieval of the motor memory corresponding to that polarity. These results reveal that artificial modulation of neural activity in the sensorimotor cortex through tDCS can act as a context for the formation and recollection of motor memories.

DOI:http://dx.doi.org/10.7554/eLife.15378.001

Memory is strongly affected by the context in which a particular memory is formed and remembered. For example, visiting a familiar place can often trigger memories associated or “tagged” with that place. Such tagging also exists for memories related to movement: for instance, distinct motor memories for a limb movement are formed depending on whether the other limb is stationary or moving. However, little is known about how the tagging of such motor memories takes place.

Nozaki et al. have now used a technique known as transcranial direct current stimulation to generate artificial “tags” for motor memories. In the experiments, volunteers tried to move a robotic arm towards a goal while the robot pushed their hand off-course. Sometimes the robot pushed the participant’s hand to the left, and sometimes to the right. This makes the task difficult to learn, even when the cue for the direction is provided, as the motor memories that are made to counteract each push overwrite each other.

Nozaki et al. used transcranial stimulation to alter the background electrical activity in the sensorimotor regions of the participants’ brains as they performed the robotic arm task. Artificially generating a different pattern of background brain electrical activity for each push direction caused the motor memories associated with leftward and rightward pushes to be tagged differently. Once this association had been learnt, applying the artificial brain stimulation pattern associated with one of the pushes resulted in the participants unconsciously compensating for a push in that direction, even when it was not there.

Overall, the results presented by Nozaki et al. suggest that the background electrical activity seen in the brain can influence how a motor memory is created and later recalled. A future challenge is to investigate whether this technique could be used to help athletes improve their performance or to treat people with movement disorders. Further experiments are also needed to test whether the same approach can influence the formation and recollection of other kinds of memories, such as those related to fear.

DOI:http://dx.doi.org/10.7554/eLife.15378.002

Improving a Bimanual Motor Skill Through Unimanual Training

When we learn a bimanual motor skill (e.g., rowing a boat), we often break it down into unimanual practices (e.g., a rowing drill with the left or right arm). Such unimanual practice is thought to be useful for learning bimanual motor skills efficiently because the learner can concentrate on learning to perform a simpler component. However, it is not so straightforward to assume that unimanual training (UT) improves bimanual performance. We have previously demonstrated that motor memories for reaching movements consist of three different parts: unimanual-specific, bimanual-specific, and overlapping parts. According to this scheme, UT appears to be less effective, as its training effect is only partially transferred to the same limb for bimanual movement. In the present study, counter-intuitively, we demonstrate that, even after the bimanual skill is almost fully learned by means of bimanual training (BT), additional UT could further improve bimanual skill. We hypothesized that this effect occurs because UT increases the memory content in the overlapping part, which might contribute to an increase in the memory for bimanual movement. To test this hypothesis, we examined whether the UT performed after sufficient BT could improve the bimanual performance. Participants practiced performing bimanual reaching movements (BM) in the presence of a novel force-field imposed only on their left arm. As an index for the motor performance, we used the error-clamp method (i.e., after-effect of the left arm) to evaluate the force output to compensate for the force-field during the reaching movement. After sufficient BT, the training effect reached a plateau. However, UT performed subsequently improved the bimanual performance significantly. In contrast, when the same amount of BT was continued, the bimanual performance remained unchanged, highlighting the beneficial effect of UT on bimanual performance. Considering memory structure, we also expected that BT could improve unimanual performance, which was confirmed by another experiment. These results provide a new interpretation of why UT was useful for improving a bimanual skill, and propose a practical strategy for enhancing performance by performing training in various contexts.

Oral administration of a recombinant attenuated Yersinia pseudotuberculosis strain elicits protective immunity against plague

A Yersinia pseudotuberculosis PB1+ (Yptb PB1+) mutant strain combined with chromosome insertion of the caf1R-caf1A-caf1M-caf1 operon and deletions of yopJ and yopK, χ10068 [pYV-ω2 (ΔyopJ315 ΔyopK108) ΔlacZ044::caf1R-caf1M-caf1A-caf1] was constructed. Results indicated that gene insertion and deletion did not affect the growth rate of χ10068 compared to wild-type Yptb cultured at 26 °C. In addition, the F1 antigen in χ10068 was synthesized and secreted on the surface of bacteria at 37 °C (mammalian body temperature), not at ambient culture temperature (26 °C). Immunization with χ10068 primed antibody responses and specific T-cell responses to F1 and YpL (Y. pestis whole cell lysate). Oral immunization with a single dose of χ10068 provided 70% protection against a subcutaneous (s.c.) challenge with ∼ 2.6 × 10(5) LD50 of Y. pestis KIM6+ (pCD1Ap) (KIM6+Ap) and 90% protection against an intranasal (i.n.) challenge with ∼ 500 LD50 of KIM6+Ap in mice. Our results suggest that χ10068 can be used as an effective precursor to make a safe vaccine to prevent plague in humans and to eliminate plague circulation among humans and animals.

The influence of proprioceptive state on learning control of reach dynamics

The motor system shows a remarkable capacity to generalize learned behavior to new contexts while simultaneously permitting learning of multiple and sometimes conflicting skills. To examine the influence of proprioceptive state on this capacity, we compared the effectiveness of changes in workspace location and limb orientation (horizontal vs. parasagittal plane posture) in facilitating learning of opposing dynamic force-field perturbations. When opposing fields were encountered in similar workspace positions and limb orientations, subjects failed to learn the two tasks. In contrast, differences in initial limb proprioceptive state were sufficient for significant learning to take place. The extent of learning was similar when the two fields were encountered in different arm orientations in a similar workspace location as compared to when learning took place in spatially separated workspace locations, consistent with the generalization of learning mainly in intrinsic joint coordinates. In keeping with these observations, examination of how trial-to-trial adaptation generalized showed that generalization tended to be greater across similar limb postures. However, when the two fields were encountered in distinct spatial locations, the extent of generalization of adaptation to one field depended on the limb orientation in which the other field was encountered. These results suggest that three-dimensional proprioceptive limb state plays an important role in modulating generalization patterns so as to permit the best compromise between broad generalization and the simultaneous learning of conflicting skills.

Computations in Sensorimotor Learning

Our cognitive abilities can only be expressed on the world through our actions. Here we review the computations underlying the way that the sensorimotor system converts both low-level sensory signals and high-level decisions into action, focusing on the behavioral evidence for the theoretical frameworks. We review recent work that determines how motor memories underlying sensorimotor learning are activated and protected from interference, the role of Bayesian decision theory in sensorimotor control including sources of suboptimality, the role of risk sensitivity in guiding action, and how rapid motor responses may underlie the robustness of the motor system to the vagaries of the world.

The value of the follow-through derives from motor learning depending on future actions

In ball sports, we are taught to follow through, despite the inability of events after contact or release to influence the outcome [1, 2]. Here we show that the specific motor memory active at any given moment critically depends on the movement that will be made in the near future. We demonstrate that associating a different follow-through movement with two motor skills that normally interfere [3–7] allows them to be learned simultaneously, suggesting that distinct future actions activate separate motor memories. This implies that when learning a skill, a variable follow-through would activate multiple motor memories across practice, whereas a consistent follow-through would activate a single motor memory, resulting in faster learning. We confirm this prediction and show that such follow-through effects influence adaptation over time periods associated with real-world skill learning. Overall, our results indicate that movements made in the immediate future influence the current active motor memory. This suggests that there is a critical time period both before [8] and after the current movement that determines motor memory activation and controls learning.

•

Future movements determine which motor memory is currently active and modifiable

•

Skills that otherwise interfere can be learned if each has a unique follow-through

•

A single skill is learned faster if its follow-through is consistent

•

Selection of motor memories depends on both lead-in and follow-through movements

Functional modulation of corticospinal excitability with adaptation of wrist movements to novel dynamical environments

Adaptation of reaching movements to a novel dynamic environment is associated with changes in neuronal activity in the primary motor cortex (M1), suggesting that M1 neurons are part of the internal model. Here, we investigated whether such changes in neuronal activity, resulting from motor adaptation, were also accompanied by changes in human corticospinal excitability, which reflects M1 activity at a macroscopic level. Participants moved a cursor on a display using the right wrist joint from the starting position toward one of eight equally spaced peripheral targets. Motor-evoked potentials (MEPs) were elicited from the wrist muscles by transcranial magnetic stimulation delivered over the left M1 before and after adaptation to a clockwise velocity-dependent force field. We found that the MEP elicited even during the preparatory period exhibited a directional tuning property, and that the preferred direction shifted clockwise after adaptation to the force field. In a subsequent experiment, participants simultaneously adapted an identical wrist movement to two opposing force fields, each of which was associated with unimanual or bimanual contexts, and the MEP during the preparatory period was flexibly modulated, depending on the context. In contrast, such modulation of the MEP was not observed when participants tried to adapt to two opposing force fields that were each associated with a target color. These results suggest that the internal model formed in the M1 is retrieved flexibly even during the preparatory period, and that the MEP could be a very useful probe for evaluating the formation and retrieval of motor memory.

Stabilization strategies for unstable dynamics

The stabilization of the human standing posture was originally attributed to the stiffness of the ankle muscles but direct measurements of the ankle stiffness ruled out this hypothesis, leaving open the possibility for a feedback stabilization strategy driven by proprioceptive signals. This solution, however, could be implemented with two different kinds of control mechanisms, namely continuous or intermittent feedback. The debate is now settled and the latter solution seems to be the most plausible one. Moreover, stabilization of unstable dynamics is not limited to bipedal standing. Indeed many manipulation tasks can be described in the same framework and thus a very general protocol for addressing this kind of problems is the use of haptic virtual reality where instability is generated by some kind of divergent or saddle-like force field. Several studies demonstrated that human subjects can choose to adopt a stiffness or feedback strategy as a combination of biomechanical and task constraints and can learn to switch from one strategy to the other if it is feasible or to use one or the other is infeasible. Understanding such mechanisms is relevant, for example, for the design of novel ergonomic man-machine interfaces in difficult, unstable tasks.

Fast convergence of learning requires plasticity between inferior olive and deep cerebellar nuclei in a manipulation task: a closed-loop robotic simulation

The cerebellum is known to play a critical role in learning relevant patterns of activity for adaptive motor control, but the underlying network mechanisms are only partly understood. The classical long-term synaptic plasticity between parallel fibers (PFs) and Purkinje cells (PCs), which is driven by the inferior olive (IO), can only account for limited aspects of learning. Recently, the role of additional forms of plasticity in the granular layer, molecular layer and deep cerebellar nuclei (DCN) has been considered. In particular, learning at DCN synapses allows for generalization, but convergence to a stable state requires hundreds of repetitions. In this paper we have explored the putative role of the IO-DCN connection by endowing it with adaptable weights and exploring its implications in a closed-loop robotic manipulation task. Our results show that IO-DCN plasticity accelerates convergence of learning by up to two orders of magnitude without conflicting with the generalization properties conferred by DCN plasticity. Thus, this model suggests that multiple distributed learning mechanisms provide a key for explaining the complex properties of procedural learning and open up new experimental questions for synaptic plasticity in the cerebellar network.

Strategy switching in the stabilization of unstable dynamics

In order to understand mechanisms of strategy switching in the stabilization of unstable dynamics, this work investigates how human subjects learn to become skilled users of an underactuated bimanual tool in an unstable environment. The tool, which consists of a mass and two hand-held non-linear springs, is affected by a saddle-like force-field. The non-linearity of the springs allows the users to determine size and orientation of the tool stiffness ellipse, by using different patterns of bimanual coordination: minimal stiffness occurs when the two spring terminals are aligned and stiffness size grows by stretching them apart. Tool parameters were set such that minimal stiffness is insufficient to provide stable equilibrium whereas asymptotic stability can be achieved with sufficient stretching, although at the expense of greater effort. As a consequence, tool users have two possible strategies for stabilizing the mass in different regions of the workspace: 1) high stiffness feedforward strategy, aiming at asymptotic stability and 2) low stiffness positional feedback strategy aiming at bounded stability. The tool was simulated by a bimanual haptic robot with direct torque control of the motors. In a previous study we analyzed the behavior of naïve users and we found that they spontaneously clustered into two groups of approximately equal size. In this study we trained subjects to become expert users of both strategies in a discrete reaching task. Then we tested generalization capabilities and mechanism of strategy-switching by means of stabilization tasks which consist of tracking moving targets in the workspace. The uniqueness of the experimental setup is that it addresses the general problem of strategy-switching in an unstable environment, suggesting that complex behaviors cannot be explained in terms of a global optimization criterion but rather require the ability to switch between different sub-optimal mechanisms.

Vestibular benefits to task savings in motor adaptation

In everyday life, we seamlessly adapt our movements and consolidate them to multiple behavioral contexts. This natural flexibility seems to be contingent on the presence of movement-related sensorimotor cues and cannot be reproduced when static visual or haptic cues are given to signify different behavioral contexts. So far, only sensorimotor cues that dissociate the sensorimotor plans prior to force field exposure have been successful in learning two opposing perturbations. Here we show that vestibular cues, which are only available during the perturbation, improve the formation and recall of multiple control strategies. We exposed subjects to inertial forces by accelerating them laterally on a vestibular platform. The coupling between reaching movement (forward-backward) and acceleration direction (leftward-rightward) switched every 160 trials, resulting in two opposite force environments. When exposed for a second time to the same environment, with the opposite environment in between, subjects showed retention resulting in an ∼3 times faster adaptation rate compared with the first exposure. Our results suggest that vestibular cues provide contextual information throughout the reach, which is used to facilitate independent learning and recall of multiple motor memories. Vestibular cues provide feedback about the underlying cause of reach errors, thereby disambiguating the various task environments and reducing interference of motor memories.

Context-dependent decay of motor memories during skill acquisition

Current models of motor learning posit that skill acquisition involves both the formation and decay of multiple motor memories that can be engaged in different contexts [1–9]. Memory formation is assumed to be context dependent, so that errors most strongly update motor memories associated with the current context. In contrast, memory decay is assumed to be context independent, so that movement in any context leads to uniform decay across all contexts. We demonstrate that for both object manipulation and force-field adaptation, contrary to previous models, memory decay is highly context dependent. We show that the decay of memory associated with a given context is greatest for movements made in that context, with more distant contexts showing markedly reduced decay. Thus, both memory formation and decay are strongest for the current context. We propose that this apparently paradoxical organization provides a mechanism for optimizing performance. While memory decay tends to reduce force output [10, 11], memory formation can correct for any errors that arise, allowing the motor system to regulate force output so as to both minimize errors and avoid unnecessary energy expenditure. The motor commands for any given context thus result from a balance between memory formation and decay, while memories for other contexts are preserved.

•

Motor learning involves the context-dependent formation of motor memories

•

In contrast, memory decay has been assumed to be context independent

•

We show memory decay is context dependent, being greatest for the current context

•

The balance of formation and decay may be optimal for trading off skill and effort

Transfer of training between distinct motor tasks after stroke: implications for task-specific approaches to upper-extremity neurorehabilitation

BACKGROUND

Although task-specific training is emerging as a viable approach for recovering motor function after stroke, there is little evidence for whether the effects of such training transfer to other functional motor tasks not directly practiced in therapy.

OBJECTIVE

The purpose of the current study was to test whether training on one motor task in individuals with chronic hemiparesis poststroke would transfer to untrained tasks that were either spatiotemporally similar or different.

METHODS

In all, 11 participants with chronic mild to moderate hemiparesis following stroke completed 5 days of supervised massed practice of a feeding task with their affected side. Performance on the feeding task, along with 2 other untrained functional upper-extremity motor tasks (sorting, dressing) was assessed before and after training.

RESULTS

Performance of all 3 tasks improved significantly after training exclusively on 1 motor task. The amount of improvement in the untrained tasks was comparable and was not dependent on the degree of similarity to the trained task.

CONCLUSIONS

Because the number and type of tasks that can be practiced are often limited within standard stroke rehabilitation, results from this study will be useful for designing task-specific training plans to maximize therapy benefits.

Substantial generalization of sensorimotor learning from bilateral to unilateral movement conditions

Controversy exists regarding whether bimanual skill learning can generalize to unimanual performance. For example, some investigators showed that dynamic adaptation could only partially generalize between bilateral and unilateral movement conditions, while others demonstrated complete generalization of visuomotor adaptation. Here, we identified three potential factors that might have contributed to the discrepancy between the two sets of findings. In our first experiment, subjects performed reaching movements toward eight targets bilaterally with a novel force field applied to both arms, then unilaterally with the force field applied to one arm. Results showed that the dynamic adaptation generalized completely from bilateral to unilateral movements. In our second experiment, the same force field was only applied to one arm during both bilateral and unilateral movements. Results indicated complete transfer again. Finally, our subjects performed reaching movements toward a single target with the force field or a novel visuomotor rotation applied only to one arm during both bilateral and unilateral movements. The reduced breadth of experience obtained during bilateral movements resulted in incomplete transfer, which explains previous findings of limited generalization. These findings collectively suggest a substantial overlap between the neural processes underlying bilateral and unilateral movements, supporting the idea that bilateral training, often employed in stroke rehabilitation, is a valid method for improving unilateral performance. However, our findings also suggest that while the neural representations developed during bilateral training can generalize to facilitate unilateral performance, the extent of generalization may depend on the breadth of experience obtained during bilateral training.

Motor learning principles for neurorehabilitation

Neurorehabilitation is based on the assumption that motor learning contributes to motor recovery after injury. However, little is known about how learning itself is affected by brain injury, how learning mechanisms interact with spontaneous biological recovery, and how best to incorporate learning principles into rehabilitation training protocols. Here we distinguish between two types of motor learning, adaptation and skill acquisition, and discuss how they relate to neurorehabilitation. Functional recovery can occur through resolution of impairment (reacquisition of premorbid movement patterns) and through compensation (use of alternative movements or effectors to accomplish the same goal); both these forms of recovery respond to training protocols. The emphasis in current neurorehabilitation practice is on the rapid establishment of independence in activities of daily living through compensatory strategies, rather than on the reduction of impairment. Animal models, however, show that after focal ischemic damage there is a brief, approximately 3-4-week, window of heightened plasticity, which in combination with training protocols leads to large gains in motor function. Analogously, almost all recovery from impairment in humans occurs in the first 3 months after stroke, which suggests that targeting impairment in this time-window with intense motor learning protocols could lead to gains in function that are comparable in terms of effect size to those seen in animal models.

Gone in 0.6 seconds: the encoding of motor memories depends on recent sensorimotor states

Real-world tasks often require movements that depend on a previous action or on changes in the state of the world. Here we investigate whether motor memories encode the current action in a manner that depends on previous sensorimotor states. Human subjects performed trials in which they made movements in a randomly selected clockwise or counterclockwise velocity-dependent curl force field. Movements during this adaptation phase were preceded by a contextual phase that determined which of the two fields would be experienced on any given trial. As expected from previous research, when static visual cues were presented in the contextual phase, strong interference (resulting in an inability to learn either field) was observed. In contrast, when the contextual phase involved subjects making a movement that was continuous with the adaptation-phase movement, a substantial reduction in interference was seen. As the time between the contextual and adaptation movement increased, so did the interference, reaching a level similar to that seen for static visual cues for delays >600 ms. This contextual effect generalized to purely visual motion, active movement without vision, passive movement, and isometric force generation. Our results show that sensorimotor states that differ in their recent temporal history can engage distinct representations in motor memory, but this effect decays progressively over time and is abolished by ∼600 ms. This suggests that motor memories are encoded not simply as a mapping from current state to motor command but are encoded in terms of the recent history of sensorimotor states.

Rapid feedback corrections during a bimanual postural task

An important observation in motor physiology is that even the fastest feedback responses can be modified in a task-dependent manner. However, whether or not such responses in one limb can be modulated based on online sensory feedback from other limbs is still unknown. We tested this using a bimanual postural control task, in which the two hands either controlled two separate cursors (double-cursor task) or a single cursor displayed at the spatial average between the hands (single-cursor task). In the first experiment, the two hands were symmetrically perturbed outwards. In the double-cursor task, the participants therefore had to return their hands to the targets, whereas in the single-cursor task no correction was necessary. Within 50 ms, the electromyographic activity showed significantly smaller responses in the single- compared with the double-cursor task. In the second experiment, the perturbation direction of the left hand (inward/outward) was randomized, such that participants could not preplan their response before perturbation onset. Results show that the behavior of the right arm in the one-cursor task depended on online feedback coming from the left arm: the muscular response was modulated within 75 ms based on directionally specific information of the left arm. These results suggest that sensory feedback from one limb can quickly modify the perturbation response of another limb in a task-dependent manner.

Using dual tasks to test immediate transfer of training between naturalistic movements: a proof-of-principle study

Theories of motor learning predict that training a movement reduces the amount of attention needed for its performance (i.e., more automatic). If training one movement transfers, then the amount of attention needed for performing a second movement should also be reduced, as measured under dual task conditions. The authors' purpose was to test whether dual task paradigms are feasible for detecting transfer of training between two naturalistic movements. Immediately following motor training, subjects improved performance of a second untrained movement under single and dual task conditions. Subjects with no training did not. Improved performance in the untrained movement was likely due to transfer, and suggests that dual tasks may be feasible for detecting transfer between naturalistic actions.

Two distinct ipsilateral cortical representations for individuated finger movements

Movements of the upper limb are controlled mostly through the contralateral hemisphere. Although overall activity changes in the ipsilateral motor cortex have been reported, their functional significance remains unclear. Using human functional imaging, we analyzed neural finger representations by studying differences in fine-grained activation patterns for single isometric finger presses. We demonstrate that cortical motor areas encode ipsilateral movements in 2 fundamentally different ways. During unimanual ipsilateral finger presses, primary sensory and motor cortices show, underneath global suppression, finger-specific activity patterns that are nearly identical to those elicited by contralateral mirror-symmetric action. This component vanishes when both motor cortices are functionally engaged during bimanual actions. We suggest that the ipsilateral representation present during unimanual presses arises because otherwise functionally idle circuits are driven by input from the opposite hemisphere. A second type of representation becomes evident in caudal premotor and anterior parietal cortices during bimanual actions. In these regions, ipsilateral actions are represented as nonlinear modulation of activity patterns related to contralateral actions, an encoding scheme that may provide the neural substrate for coordinating bimanual movements. We conclude that ipsilateral cortical representations change their informational content and functional role, depending on the behavioral context.

Distinct motor plans form and retrieve distinct motor memories for physically identical movements

We can adapt movements to a novel dynamic environment (e.g., tool use, microgravity, and perturbation) by acquiring an internal model of the dynamics. Although multiple environments can be learned simultaneously if each environment is experienced with different limb movement kinematics, it is controversial as to whether multiple internal models for a particular movement can be learned and flexibly retrieved according to behavioral contexts. Here, we address this issue by using a novel visuomotor task. While participants reached to each of two targets located at a clockwise or counter-clockwise position, a gradually increasing visual rotation was applied in the clockwise or counter-clockwise direction, respectively, to the on-screen cursor representing the unseen hand position. This procedure implicitly led participants to perform physically identical pointing movements irrespective of their intentions (i.e., movement plans) to move their hand toward two distinct visual targets. Surprisingly, if each identical movement was executed according to a distinct movement plan, participants could readily adapt these movements to two opposing force fields simultaneously. The results demonstrate that multiple motor memories can be learned and flexibly retrieved, even for physically identical movements, according to distinct motor plans in a visual space.

Gain field encoding of the kinematics of both arms in the internal model enables flexible bimanual action

Bimanual action requires the neural controller (internal model) for each arm to predictively compensate for mechanical interactions resulting from movement of both that arm and its counterpart on the opposite side of the body. Here, we demonstrate that the brain may accomplish this by constructing the internal model with primitives multiplicatively encoding information from the kinematics of both arms. We had human participants adapt to a novel force field imposed on one arm while both arms were moving in particular directions and examined the generalization pattern of motor learning when changing the movement directions of both arms. The generalization pattern was consistent with the pattern predicted from the multiplicative encoding scheme. As proposed by previous theoretical studies, the strength of multiplicative encoding was manifested in the observation that participants could adapt reaching movements to complicated force fields depending nonlinearly on the movement directions of both arms. These results indicate that multiplicative neuronal influence of the kinematics of the opposing arm on the internal models enables the brain to control bimanual movement by providing great flexible ability to handle arbitrary dynamical environments resulting from the interactions of both arms.

Principles of sensorimotor learning

The exploits of Martina Navratilova and Roger Federer represent the pinnacle of motor learning. However, when considering the range and complexity of the processes that are involved in motor learning, even the mere mortals among us exhibit abilities that are impressive. We exercise these abilities when taking up new activities - whether it is snowboarding or ballroom dancing - but also engage in substantial motor learning on a daily basis as we adapt to changes in our environment, manipulate new objects and refine existing skills. Here we review recent research in human motor learning with an emphasis on the computational mechanisms that are involved.

A single-rate context-dependent learning process underlies rapid adaptation to familiar object dynamics

Motor learning has been extensively studied using dynamic (force-field) perturbations. These induce movement errors that result in adaptive changes to the motor commands. Several state-space models have been developed to explain how trial-by-trial errors drive the progressive adaptation observed in such studies. These models have been applied to adaptation involving novel dynamics, which typically occurs over tens to hundreds of trials, and which appears to be mediated by a dual-rate adaptation process. In contrast, when manipulating objects with familiar dynamics, subjects adapt rapidly within a few trials. Here, we apply state-space models to familiar dynamics, asking whether adaptation is mediated by a single-rate or dual-rate process. Previously, we reported a task in which subjects rotate an object with known dynamics. By presenting the object at different visual orientations, adaptation was shown to be context-specific, with limited generalization to novel orientations. Here we show that a multiple-context state-space model, with a generalization function tuned to visual object orientation, can reproduce the time-course of adaptation and de-adaptation as well as the observed context-dependent behavior. In contrast to the dual-rate process associated with novel dynamics, we show that a single-rate process mediates adaptation to familiar object dynamics. The model predicts that during exposure to the object across multiple orientations, there will be a degree of independence for adaptation and de-adaptation within each context, and that the states associated with all contexts will slowly de-adapt during exposure in one particular context. We confirm these predictions in two new experiments. Results of the current study thus highlight similarities and differences in the processes engaged during exposure to novel versus familiar dynamics. In both cases, adaptation is mediated by multiple context-specific representations. In the case of familiar object dynamics, however, the representations can be engaged based on visual context, and are updated by a single-rate process.

Skillful object manipulation is an essential feature of human behavior. How humans process and represent information associated with objects is thus a fundamental question in neuroscience. Here, we examine the representation of the mechanical properties of objects which define the mapping between the forces applied to an object and the motion that results. Knowledge of this mapping, which can change depending on the orientation with which an object is grasped, is essential for skillful manipulation. Subjects performed a virtual object manipulation task by grasping the handle of a novel robotic interface which simulated the dynamics of a familiar object which could be presented at different orientations. Using this task, we show that adaptation to the properties of a particular object is extremely rapid, and that such adaptation is confined to the specific orientation at which the object is experienced. Moreover, the pattern of adaptation observed when the orientation of the object and its mechanical properties were changed from trial-to-trial was reproduced by a model which included multiple representations and a generalization function tuned for object orientation. These results suggest that the skillful manipulation of objects with familiar dynamics is mediated by multiple context-specific representations.

Natural error patterns enable transfer of motor learning to novel contexts

Successful behavior demands motor learning to be transferable in some cases (e.g., adjusting walking patterns as we develop and age) and context specific in others (e.g., learning to walk in high heels). Here we investigated differences in motor learning transfer in people learning a new walking pattern on a split-belt treadmill, where the legs move at different speeds. We hypothesized that transfer of the newly acquired walking pattern on the treadmill to natural over ground walking might depend on the pattern of errors experienced during learning. Error patterns within a person's natural range might be experienced as endogenous (i.e., produced by the body), encouraging general adjustments that transfer across contexts. On the other hand, larger errors might be experienced as exogenous (i.e., produced by the environment), indicating unusual conditions requiring context-specific learning. To test this, we manipulated the distribution of errors experienced during learning to lie either within or outside the normal distribution of walking errors. We found that restriction of errors to the natural range produced transfer of the new walking pattern from the treadmill to natural walking off the treadmill, while larger errors prevented transfer. This result helps explain how transfer of motor learning is controlled, and it offers an important strategy for clinical rehabilitation, where transfer of motor learning to other contexts is essential.

Impedance control is selectively tuned to multiple directions of movement

Humans are able to learn tool-handling tasks, such as carving, demonstrating their competency to make movements in unstable environments with varied directions. When faced with a single direction of instability, humans learn to selectively co-contract their arm muscles tuning the mechanical stiffness of the limb end point to stabilize movements. This study examines, for the first time, subjects simultaneously adapting to two distinct directions of instability, a situation that may typically occur when using tools. Subjects learned to perform reaching movements in two directions, each of which had lateral instability requiring control of impedance. The subjects were able to adapt to these unstable interactions and switch between movements in the two directions; they did so by learning to selectively control the end-point stiffness counteracting the environmental instability without superfluous stiffness in other directions. This finding demonstrates that the central nervous system can simultaneously tune the mechanical impedance of the limbs to multiple movements by learning movement-specific solutions. Furthermore, it suggests that the impedance controller learns as a function of the state of the arm rather than a general strategy.

Seeing is believing: effects of visual contextual cues on learning and transfer of locomotor adaptation

Devices such as robots or treadmills are often used to drive motor learning because they can create novel physical environments. However, the learning (i.e., adaptation) acquired on these devices only partially generalizes to natural movements. What determines the specificity of motor learning, and can this be reliably made more general? Here we investigated the effect of visual cues on the specificity of split-belt walking adaptation. We systematically removed vision to eliminate the visual-proprioceptive mismatch that is a salient cue specific to treadmills: vision indicates that we are not moving while leg proprioception indicates that we are. We evaluated the adaptation of temporal and spatial features of gait (i.e., timing and location of foot landing), their transfer to walking over ground, and washout of adaptation when subjects returned to the treadmill. Removing vision during both training (i.e., on the treadmill) and testing (i.e., over ground) strongly improved the transfer of treadmill adaptation to natural walking. Removing vision only during training increased transfer of temporal adaptation, whereas removing vision only during testing increased the transfer of spatial adaptation. This dissociation reveals differences in adaptive mechanisms for temporal and spatial features of walking. Finally training without vision increased the amount that was learned and was linked to the variability in the behavior during adaptation. In conclusion, contextual cues can be manipulated to modulate the magnitude, transfer, and washout of device-induced learning in humans. These results bring us closer to our ultimate goal of developing rehabilitation strategies that improve movements beyond the clinical setting.

Separate representations of dynamics in rhythmic and discrete movements: evidence from motor learning

Rhythmic and discrete arm movements occur ubiquitously in everyday life, and there is a debate as to whether these two classes of movements arise from the same or different underlying neural mechanisms. Here we examine interference in a motor-learning paradigm to test whether rhythmic and discrete movements employ at least partially separate neural representations. Subjects were required to make circular movements of their right hand while they were exposed to a velocity-dependent force field that perturbed the circularity of the movement path. The direction of the force-field perturbation reversed at the end of each block of 20 revolutions. When subjects made only rhythmic or only discrete circular movements, interference was observed when switching between the two opposing force fields. However, when subjects alternated between blocks of rhythmic and discrete movements, such that each was uniquely associated with one of the perturbation directions, interference was significantly reduced. Only in this case did subjects learn to corepresent the two opposing perturbations, suggesting that different neural resources were employed for the two movement types. Our results provide further evidence that rhythmic and discrete movements employ at least partially separate control mechanisms in the motor system.

Naturalistic approaches to sensorimotor control

Human sensorimotor control has been predominantly studied using fixed tasks performed under laboratory conditions. This approach has greatly advanced our understanding of the mechanisms that integrate sensory information and generate motor commands during voluntary movement. However, experimental tasks necessarily restrict the range of behaviors that are studied. Moreover, the processes studied in the laboratory may not be the same processes that subjects call upon during their everyday lives. Naturalistic approaches thus provide an important adjunct to traditional laboratory-based studies. For example, wearable self-contained tracking systems can allow subjects to be monitored outside the laboratory, where they engage spontaneously in natural everyday behavior. Similarly, advances in virtual reality technology allow laboratory-based tasks to be made more naturalistic. Here, we review naturalistic approaches, including perspectives from psychology and visual neuroscience, as well as studies and technological advances in the field of sensorimotor control.