Adaptive coordination and alignment of eye and hand

Temporal visuomotor synchrony induces embodiment towards an avatar with biomechanically impossible arm movements

Visuomotor synchrony in time and space induces a sense of embodiment towards virtual bodies experienced in first-person view using Virtual Reality (VR). Here, we investigated whether temporal visuomotor synchrony affects avatar embodiment even when the movements of the virtual arms are spatially altered from those of the user in a non-human-like manner. In a within-subjects design VR experiment, participants performed a reaching task controlling an avatar whose lower arms bent in inversed and biomechanically impossible directions from the elbow joints. They performed the reaching task using this "unnatural avatar" as well as a "natural avatar," whose arm movements and positions spatially matched the user. The reaching tasks were performed with and without a one second delay between the real and virtual movements. While the senses of body ownership and agency towards the unnatural avatar were significantly lower compared to those towards the natural avatar, temporal visuomotor synchrony did significantly increase the sense of embodiment towards the unnatural avatar as well as the natural avatar. These results suggest that temporal visuomotor synchrony is crucial for inducing embodiment even when the spatial match between the real and virtual limbs is disrupted with movements outside the pre-existing cognitive representations of the human body.

Slower rates of prism adaptation but intact aftereffects in patients with early to mid-stage Parkinson's disease

There is currently mixed evidence on the effect of Parkinson's disease on motor adaptation. Some studies report that patients display adaptation comparable to age-matched controls, while others report a complete inability to adapt to novel sensory perturbations. Here, early to mid-stage Parkinson's patients were recruited to perform a prism adaptation task. When compared to controls, patients showed slower rates of initial adaptation but intact aftereffects. These results support the suggestion that patients with early to mid-stage Parkinson's disease display intact adaptation driven by sensory prediction errors, as shown by the intact aftereffect. But impaired facilitation of performance through cognitive strategies informed by task error, as shown by the impaired initial adaptation. These results support recent studies that suggest that patients with Parkinson's disease retain the ability to perform visuomotor adaptation, but display altered use of cognitive strategies to aid performance and generalises these previous findings to the classical prism adaptation task.

Updating of Implicit Adaptation Processes through Erroneous Numeric Feedback

There is debate about how implicit and explicit processes interact in sensorimotor adaptation, implicating how error signals drive learning. Target error information is thought to primarily influence explicit processes, therefore manipulations to the veracity of this information should impact adaptation but not implicit recalibration (i.e. after-effects). Thirty participants across three groups initially adapted to rotated cursor feedback. Then we manipulated numeric target error through knowledge of results (KR) feedback, where groups practised with correct or incorrect (+/-15°) numeric KR. Participants adapted to erroneous KR, but only the KR + 15 group showed augmented implicit recalibration, evidenced by larger after-effects than before KR exposure. In the presence of sensory prediction errors, target errors modulated after-effects, suggesting an interaction between implicit and explicit processes.

Prism adaptation in patients with unilateral lesion of the parietal or cerebellar cortex: A pilot study on two single cases using a concurrent exposure procedure

Neuroimaging studies showed that prism adaptation (PA), a widely used tool for the rehabilitation of neglect, involves a wide network of brain regions including the parietal cortex and the cerebellum. In particular, the parietal cortex has been suggested to mediate the initial stage of PA through conscious compensatory mechanisms as a reaction to the deviation induced by PA. The cerebellum, on the other side, intervenes in sensory errors prediction to update internal models in later stages. It has been suggested that two mechanisms may underlie PA effects: recalibration, a strategic cognitive process occurring in the initial stages of PA, and realignment, a fully automatic reorganization of spatial maps emerging later and more slowly in time. The parietal lobe has been proposed to be involved mainly in the recalibration whereas the realignment would be carried over by the cerebellum. Previous studies have investigated the effects of a lesion involving either the cerebellum or the parietal lobe in PA taking into account both realignment and recalibration processes. Conversely, no studies have compared the performance of a patient with a cerebellar lesion to that of a patient with a parietal lesion. In the present study, we used a recently developed technique for digital PA to test differences in visuomotor learning after a single session of PA in a patient with parietal and a patient with cerebellar lesions, respectively. The PA procedure, in this case, includes a digital pointing task based on a concurrent exposure technique, which allows patients to fully see their arm during the pointing task. This procedure has been shown to be as effective as the terminal exposure condition in neglect rehabilitation albeit different processes take place during concurrent exposure condition compared to the most used terminal exposure (allowing to see only the final part of the movement). Patients' performances were compared to that of a control group. A single session of PA was administered to 1) a patient (BC) with left parieto-occipital lesion involving SPL and IPL, 2) a patient (TGM) with a stroke in the territory sub-served by the SCA in the cerebellum, and 3) 14 healthy controls (HC). The task included three conditions: before wearing prismatic goggles (pre-exposure), while wearing prisms (exposure) and after removing the goggles (post-exposure). Mean deviations were calculated for the following phases: pre-exposure, early-exposure, late-exposure, post-exposure. The presence of after-effect was calculated as the difference between pre-exposure and post-exposure conditions. For each of these conditions, patients' performance was compared to that of the control group by using a modified Crawford t-test. We found that the patient with the parietal lesion had a significantly different performance in the late-exposure and in the post-exposure compared to both HC and the patient with the cerebellar lesion. Conversely, no differences were observed between TGM and HC across all the conditions. Our results show an increase in the magnitude of the adaptation during the late stage of PA in the patient with the parietal lesion whereas no differences in the performance between the cerebellar patient and the controls were found. These results confirm previous studies suggesting that the parietal cortex is an important node of a wider network involved in PA effect. Furthermore, results in the cerebellar patient suggest that visuomotor learning is not affected by lesions of the SCA territory when a concurrent exposure is used as, in such case, it less relies on sensory errors prediction to update internal models. Results are discussed considering the novelty of the applied PA technique.

Quantification and Rehabilitation of Unilateral Spatial Neglect in Immersive Virtual Reality: A Validation Study in Healthy Subjects

Unilateral spatial neglect is a common sensorimotor disorder following the occurrence of a stroke, for which prismatic adaptation is a promising rehabilitation method. However, the use of prisms for rehabilitation often requires the use of specific equipment that may not be available in clinics. To address this limitation, we developed a new software package that allows for the quantification and rehabilitation of unilateral spatial neglect using immersive virtual reality. In this study, we compared the effects of virtual and real prisms in healthy subjects and evaluated the performance of our virtual reality tool (HTC Vive) against a validated motion capture tool. Ten healthy subjects were randomly exposed to virtual and real prisms, and measurements were taken before and after exposure. Our findings indicate that virtual prisms are at least as effective as real prisms in inducing aftereffects (4.39° ± 2.91° with the virtual prisms compared to 4.30° ± 3.49° with the real prisms), but that these effects were not sustained beyond 2 h regardless of exposure modality. The virtual measurements obtained with our software showed excellent metrological qualities (ICC = 0.95, error = 0.52° ± 1.18°), demonstrating its validity and reliability for quantifying deviation during pointing movements. Overall, our results suggest that our virtual reality software (Virtualis, Montpellier, France) could provide an easy and reliable means of quantifying and rehabilitating spatial neglect. Further validation of these results is required in individuals with unilateral spatial neglect.

Implicit Adaptation Processes Promoted by Immediate Offline Visual and Numeric Feedback

In adaptation learning, visual feedback impacts how adaptation proceeds. With concurrent feedback, a more implicit/feedforward process is thought to be engaged, compared to feedback after movement, which promotes more explicit processes. Due to discrepancies across studies, related to timing and type of visual feedback, we isolated these conditions here. Four groups (N = 52) practiced aiming under rotated feedback conditions; feedback was provided concurrently, immediately after movement (visually or numerically), or visually after a 3 s delay. All groups adapted and only delayed feedback attenuated implicit adaptation as evidenced by post-practice after-effects. Contrary to some suggestions, immediately presented offline and numeric feedback resulted in implicit after-effects, potentially due to comparisons between feedforward information and seen or imagined feedback.

Human Variation in Error-Based and Reinforcement Motor Learning Is Associated With Entorhinal Volume

Error-based and reward-based processes are critical for motor learning and are thought to be mediated via distinct neural pathways. However, recent behavioral work in humans suggests that both learning processes can be bolstered by the use of cognitive strategies, which may mediate individual differences in motor learning ability. It has been speculated that medial temporal lobe regions, which have been shown to support motor sequence learning, also support the use of cognitive strategies in error-based and reinforcement motor learning. However, direct evidence in support of this idea remains sparse. Here we first show that better overall learning during error-based visuomotor adaptation is associated with better overall learning during the reward-based shaping of reaching movements. Given the cognitive contribution to learning in both of these tasks, these results support the notion that strategic processes, associated with better performance, drive intersubject variation in both error-based and reinforcement motor learning. Furthermore, we show that entorhinal cortex volume is larger in better learning individuals-characterized across both motor learning tasks-compared with their poorer learning counterparts. These results suggest that individual differences in learning performance during error and reinforcement learning are related to neuroanatomical differences in entorhinal cortex.

De novo learning versus adaptation of continuous control in a manual tracking task

How do people learn to perform tasks that require continuous adjustments of motor output, like riding a bicycle? People rely heavily on cognitive strategies when learning discrete movement tasks, but such time-consuming strategies are infeasible in continuous control tasks that demand rapid responses to ongoing sensory feedback. To understand how people can learn to perform such tasks without the benefit of cognitive strategies, we imposed a rotation/mirror reversal of visual feedback while participants performed a continuous tracking task. We analyzed behavior using a system identification approach, which revealed two qualitatively different components of learning: adaptation of a baseline controller and formation of a new, task-specific continuous controller. These components exhibited different signatures in the frequency domain and were differentially engaged under the rotation/mirror reversal. Our results demonstrate that people can rapidly build a new continuous controller de novo and can simultaneously deploy this process with adaptation of an existing controller.

Patients with lesions to the intraparietal cortex show greater proprioceptive realignment after prism adaptation: Evidence from open-loop pointing and manual straight ahead

Reaching toward a target viewed through laterally refracting prisms results in adaptation of both visual and (limb) proprioceptive spatial representations. Common ways to measure adaptation after-effect are to ask a person to point straight ahead with their eyes closed ("manual straight ahead", MSA), or to a seen target using their unseen hand ("open-loop pointing", OLP). MSA measures changes in proprioception only, whereas OLP measures the combined visual and proprioceptive shift. The behavioural and neurological mechanisms of prism adaptation have come under scrutiny following reports of reduced hemispatial neglect in patients following this procedure. We present evidence suggesting that shifts in proprioceptive spatial representations induced by prism adaptation are larger following lesions to the intraparietal cortex - a brain region that integrates retinotopic visual signals with signals of eye position in the orbit and that is activated during prism adaptation. Six healthy participants and six patients with unilateral intraparietal cortex lesions underwent prism adaptation. After-effects were measured with OLP and MSA. After-effects of control participants were larger when measured with OLP than with MSA, consistent with previous research and with the additional contribution of visual shift to OLP after-effects. However, patients' OLP shifts were not significantly different to their MSA shifts. We conclude that, for the patients, correction of pointing errors during prism adaptation involved proportionally more changes to arm proprioception than for controls. Since lesions to intraparietal cortex led to enhanced realignment of arm proprioceptive representations, our results indirectly suggest that the intraparietal cortex could be key for visual realignment.

Combining Observation and Physical Practice: Benefits of an Interleaved Schedule for Visuomotor Adaptation and Motor Memory Consolidation

Visuomotor adaptation to novel environments can occur via non-physical means, such as observation. Observation does not appear to activate the same implicit learning processes as physical practice, rather it appears to be more strategic in nature. However, there is evidence that interspersing observational practice with physical practice can benefit performance and memory consolidation either through the combined benefits of separate processes or through a change in processes activated during observation trials. To test these ideas, we asked people to practice aiming to targets with visually rotated cursor feedback or engage in a combined practice schedule comprising physical practice and observation of projected videos showing successful aiming. Ninety-three participants were randomly assigned to one of five groups: massed physical practice (Act), distributed physical practice (Act+Rest), or one of 3 types of combined practice: alternating blocks (Obs_During), or all observation before (Obs_Pre) or after (Obs_Post) blocked physical practice. Participants received 100 practice trials (all or half were physical practice). All groups improved in adaptation trials and showed savings across the 24-h retention interval relative to initial practice. There was some forgetting for all groups, but the magnitudes were larger for physical practice groups. The Act and Obs_During groups were most accurate in retention and did not differ, suggesting that observation can serve as a replacement for physical practice if supplied intermittently and offers advantages above just resting. However, after-effects associated with combined practice were smaller than those for physical practice control groups, suggesting that beneficial learning effects as a result of observation were not due to activation of implicit learning processes. Reaction time, variable error, and post-test rotation drawings supported this conclusion that adaptation for observation groups was promoted by explicit/strategic processes.

Functional Use of Eye Movements for an Acting System

Movements of the eyes assist vision and support hand and body movements in a cooperative way. Despite their strong functional coupling, different types of movements are usually studied independently. We integrate knowledge from behavioral, neurophysiological, and clinical studies on how eye movements are coordinated with goal-directed hand movements and how they facilitate motor learning. Understanding the coordinated control of eye and hand movements can provide important insights into brain functions that are essential for performing or learning daily tasks in health and disease. This knowledge can also inform applications such as robotic manipulation and clinical rehabilitation.

The role of the right posterior parietal cortex in prism adaptation and its aftereffects

Adaptation to optical prisms (Prismatic Adaptation, PA) displacing the visual scene laterally, on one side of visual space, is both a procedure for investigating visuo-motor plasticity and a powerful tool for the rehabilitation of Unilateral Spatial Neglect (USN). Two processes are involved in PA: i) recalibration (the reduction of the error of manual pointings toward the direction of the prism-induced displacement of the visual scene); ii) the successive realignment after prisms' removal, indexed by the Aftereffects (AEs, in egocentric straight-ahead pointing tasks, the deviation in a direction opposite to the visual displacement previously induced by prisms). This study investigated the role of the posterior parietal cortex (PPC) of the right hemisphere in PA and AEs, by means of low frequency repetitive Transcranial Magnetic Stimulation (rTMS). Proprioceptive and Visuo-proprioceptive egocentric straight-ahead pointing tasks were used to assess the presence and magnitude of AEs. The primary right visual cortex (V1) was also stimulated, to assess the selectivity of the PPC effects on the two processes of PA (recalibration and realignment) in comparison with a cortical region involved in visual processing. Results showed a slower adaptation to prisms when rTMS was delivered before PA, regardless of target site (right PPC or V1). AEs were reduced only by PPC rTMS applied before or after PA, as compared to a sham stimulation. These findings suggest a functional and neural dissociation between realignment and recalibration. Indeed, PA interference was induced by rTMS to both the PPC and V1, indicating that recalibration is supported by a parieto-occipital network. Conversely, AEs were disrupted only by rTMS delivered to the PPC, thus unveiling a relevant role of this region in the development and maintenance of the realignment.

Visual Feedback Modulates Aftereffects and Electrophysiological Markers of Prism Adaptation

Prism adaptation (PA) is both a model for visuomotor learning and a promising treatment for visuospatial neglect after stroke. The task involves reaching for targets while prism glasses horizontally displace the visual field. Adaptation is hypothesized to occur through two processes: strategic recalibration, a rapid self-correction of pointing errors; and spatial realignment, a more gradual adjustment of visuomotor reference frames that produce prism aftereffects (i.e., reaching errors upon glasses removal in the direction opposite to the visual shift). While aftereffects can ameliorate neglect, not all patients respond to PA, and the neural mechanisms underlying successful adaptation are unclear. We investigated the feedback-related negativity (FRN) and the P300 event-related potential (ERP) components as candidate markers of strategic recalibration and spatial realignment, respectively. Healthy young adults wore prism glasses and performed memory-guided reaching toward vertical-line targets. ERPs were recorded in response to three different between-subject error feedback conditions at screen-touch: view of hand and target (Experiment 1), view of hand only (Experiment 2), or view of lines to mark target and hand position (view of hand occluded; Experiment 3). Conditions involving a direct view of the hand-produced stronger aftereffects than indirect hand feedback, and also evoked a P300 that decreased in amplitude as adaptation proceeded. Conversely, the FRN was only seen in conditions involving target feedback, even when aftereffects were smaller. Since conditions producing stronger aftereffects were associated with a phase-sensitive P300, this component may index a “context-updating” realignment process critical for strong aftereffects, whereas the FRN may reflect an error monitoring process related to strategic recalibration.

Savings in sensorimotor adaptation without an explicit strategy

The hallmark of long-term retention of sensorimotor adaptation is a faster relearning when similar perturbations are encountered again. However, what processes underlie this saving effect is in debate. Though motor adaptation is traditionally viewed as a type of procedural learning, its savings has been recently shown to be solely based on a quick recall of explicit adaptation strategy. Here, we showed that adaptation to a novel error-invariant perturbation without an explicit strategy could enable subsequent savings. We further showed that adaptation to gradual perturbations could enable savings, which was supported by enhanced implicit learning. Our study provides supporting evidence that long-term retention of motor adaptation is possible without forming or recalling a cognitive strategy, and the interplay between implicit and explicit learning critically depends on the specifics of learning protocol and available sensory feedback.

NEW & NOTEWORTHY Savings in motor learning sometimes refers to faster learning when one encounters the same perturbation again. Previous studies assert that forming a cognitive strategy for countering perturbations is necessary for savings. We used novel experimental techniques to prevent the formation of a cognitive strategy during initial adaptation and found that savings still existed during relearning. Our findings suggest that savings in sensorimotor adaptation do not exclusively depend on forming and recalling an explicit strategy.

Neuropsychological Changes in Complex Regional Pain Syndrome (CRPS)

Complex Regional Pain Syndrome (CRPS) is a poorly understood chronic pain condition of multifactorial origin. CRPS involves sensory, motor, and autonomic symptoms primarily affecting one extremity. Patients can also present with neuropsychological changes such as reduced attention to the CRPS-affected extremity, reminiscent of hemispatial neglect, yet in the absence of any brain lesions. However, this "neglect-like" framework is not sufficient to characterise the range of higher cognitive functions that can be altered in CRPS. This comprehensive literature review synthesises evidence of neuropsychological changes in CRPS in the context of potential central mechanisms of the disorder. The affected neuropsychological functions constitute three distinct but not independent groups: distorted body representation, deficits in lateralised spatial cognition, and impairment of non-spatially-lateralised higher cognitive functions. We suggest that many of these symptoms appear to be consistent with a broader disruption to parietal function beyond merely what could be considered "neglect-like." Moreover, the extent of neuropsychological symptoms might be related to the clinical signs of CRPS, and rehabilitation methods that target the neuropsychological changes can improve clinical outcomes in CRPS and other chronic pain conditions. Based on the limitations and gaps in the reviewed literature, we provide several suggestions to improve further research on neuropsychological changes in chronic pain.

Simulated prism exposure in immersed virtual reality produces larger prismatic after-effects than standard prism exposure in healthy subjects

Previous studies have shown that the size of the leftward bias after exposure to rightward prism-deviation (the prismatic after-effect) depends on the degree of rightward prism-deviation as well as the type of visual feedback receives during exposure to prism-deviation.

In this study, we tested if it was possible to obtain a leftward bias in pointing precision using two different methods of creating diverted visual input by simulating a rightward prism diversion of visual input in immersive virtual reality. We compared the results to the leftward bias in pointing precision obtained after exposure to standard prism goggles deviating visual input 10 degrees to the right. Twenty healthy participants were subjected to one session of standard prism adaptation therapy under three different conditions of deviated visual input: 1) created by imitating a 10 degree leftward rotation of the head (VRR), 2) created by imitating a 2D leftward horizontal displacement of 10 degrees (VRS) and 3) a control condition using real right-deviating prisms (PCP). The study showed that the simulated prisms in the VRR and VRS conditions produced deviations in pointing precision of a similar size. However, exposure to the VRS and VRR conditions both produced larger prismatic after-effects than the exposure to real prism goggles. This research is important for the development and use of virtual reality systems in the rehabilitation of neglect after brain injury as it emphasizes that the adjustment to deviated visual input may be affected positively by the use of immersive virtual reality technology.

Using gaze behavior to parcellate the explicit and implicit contributions to visuomotor learning

Successful motor performance relies on our ability to adapt to changes in the environment by learning novel mappings between motor commands and sensory outcomes. Such adaptation is thought to involve two distinct mechanisms: an implicit, error-based component linked to slow learning and an explicit, strategic component linked to fast learning and savings (i.e., faster relearning). Because behavior, at any given moment, is the resultant combination of these two processes, it has remained a challenge to parcellate their relative contributions to performance. The explicit component to visuomotor rotation (VMR) learning has recently been measured by having participants verbally report their aiming strategy used to counteract the rotation. However, this procedure has been shown to magnify the explicit component. Here we tested whether task-specific eye movements, a natural component of reach planning, but poorly studied in motor learning tasks, can provide a direct readout of the state of the explicit component during VMR learning. We show, by placing targets on a visible ring and including a delay between target presentation and reach onset, that individual differences in gaze patterns during sensorimotor learning are linked to participants' rates of learning and their expression of savings. Specifically, we find that participants who, during reach planning, naturally fixate an aimpoint rotated away from the target location, show faster initial adaptation and readaptation 24 h later. Our results demonstrate that gaze behavior cannot only uniquely identify individuals who implement cognitive strategies during learning but also how their implementation is linked to differences in learning. NEW & NOTEWORTHY Although it is increasingly well appreciated that sensorimotor learning is driven by two separate components, an error-based process and a strategic process, it has remained a challenge to identify their relative contributions to performance. Here we demonstrate that task-specific eye movements provide a direct read-out of explicit strategies during sensorimotor learning in the presence of visual landmarks. We further show that individual differences in gaze behavior are linked to learning rate and savings.

Influence of Visual Prism Adaptation on Auditory Space Representation

Prisms shifting the visual input sideways produce a mismatch between the visual versus felt position of one’s hand. Prism adaptation eliminates this mismatch, realigning hand proprioception with visual input. Whether this realignment concerns exclusively the visuo-(hand)motor system or it generalizes to acoustic inputs is controversial. We here show that there is indeed a slight influence of visual adaptation on the perceived direction of acoustic sources. However, this shift in perceived auditory direction can be fully explained by a subconscious head rotation during prism exposure and by changes in arm proprioception. Hence, prism adaptation does only indirectly generalize to auditory space perception.

On the Mechanics of Immediate Corrections and Aftereffects in Prism Adaptation

Prisms laterally shifting the perceived visual world cause arm movements to deviate from intended targets. The resulting error—the direct effect—both for pointing and throwing movements, usually corresponds to only around half of the prism’s optical power due to an “immediate correction effect”. We investigated the mechanisms of this immediate correction effect. In three experiments with 73 healthy subjects we find that the immediate correction effect is associated with a head and/or eye rotation. Since these rotations are subconscious they are not taken into account by the participants. These subconscious rotations compensate for a large portion of the prism’s optical effect and change the subjective straight ahead. These movements seem to be induced only in a rich visual environment and hence do not take place in the dark. They correspond to the difference between the direct effect and the optical power of the prisms and seem to cause the immediate correction effect. Hence, eye-hand adaptation only adapts to the prism’s optical power minus unconscious head rotation and hence is much smaller than the optical power of the prisms.

Towards a neuro-computational account of prism adaptation

Prism adaptation has a long history as an experimental paradigm used to investigate the functional and neural processes that underlie sensorimotor control. In the neuropsychology literature, prism adaptation behaviour is typically explained by reference to a traditional cognitive psychology framework that distinguishes putative functions, such as 'strategic control' versus 'spatial realignment'. This theoretical framework lacks conceptual clarity, quantitative precision and explanatory power. Here, we advocate for an alternative computational framework that offers several advantages: 1) an algorithmic explanatory account of the computations and operations that drive behaviour; 2) expressed in quantitative mathematical terms; 3) embedded within a principled theoretical framework (Bayesian decision theory, state-space modelling); 4) that offers a means to generate and test quantitative behavioural predictions. This computational framework offers a route towards mechanistic neurocognitive explanations of prism adaptation behaviour. Thus it constitutes a conceptual advance compared to the traditional theoretical framework. In this paper, we illustrate how Bayesian decision theory and state-space models offer principled explanations for a range of behavioural phenomena in the field of prism adaptation (e.g. visual capture, magnitude of visual versus proprioceptive realignment, spontaneous recovery and dynamics of adaptation memory). We argue that this explanatory framework can advance understanding of the functional and neural mechanisms that implement prism adaptation behaviour, by enabling quantitative tests of hypotheses that go beyond merely descriptive mapping claims that ‘brain area X is (somehow) involved in psychological process Y’.

•

Traditional neuropsychological models of prism adaptation lack precision.

•

Computational models improve explanatory and predictive power.

•

A range of adaptation phenomena can be explained quantitatively.

•

Mathematics offers a bridge between neural mechanisms and behaviour.

•

A neuro-computational approach will advance neuropsychology.

Adaptation to proprioceptive targets following visuomotor adaptation

In the following study, we asked if reaches to proprioceptive targets are updated following reach training with a gradually introduced visuomotor perturbation. Subjects trained to reach with distorted hand-cursor feedback, such that they saw a cursor that was rotated or translated relative to their actual hand movement. Following reach training trials with the cursor, subjects reached to Visual (V), Proprioceptive (P) and Visual + Proprioceptive (VP) targets with no visual feedback of their hand. Comparison of reach endpoints revealed that reaches to VP targets followed similar trends as reaches to P targets, regardless of the training distortion introduced. After reaching with a rotated cursor, subjects adapted their reaches to all target types in a similar manner. However, after reaching with a translated cursor, subjects adapted their reach to V targets only. Taken together, these results show that following training with a visuomotor distortion, subjects primarily rely on proprioceptive information when reaching to VP targets. Furthermore, results indicate that reach adaptation to P targets depends on the distortion presented. Training with a rotation distortion leads to changes in reaches to both V and P targets, while a translation distortion, which introduces a constant discrepancy between visual and proprioceptive estimates of hand position throughout the reach, affects changes to V but not P targets.

Brain aerobic glycolysis and motor adaptation learning

Ten percent to 15% of glucose used by the brain is metabolized nonoxidatively despite adequate tissue oxygenation, a process termed aerobic glycolysis (AG). Because of the known role of glycolysis in biosynthesis, we tested whether learning-induced synaptic plasticity would lead to regionally appropriate, learning-dependent changes in AG. Functional MRI (fMRI) before, during, and after performance of a visual-motor adaptation task demonstrated that left Brodmann area 44 (BA44) played a key role in adaptation, with learning-related changes to activity during the task and altered resting-state, functional connectivity after the task. PET scans before and after task performance indicated a sustained increase in AG in left BA 44 accompanied by decreased oxygen consumption. Intersubject variability in behavioral adaptation rate correlated strongly with changes in AG in this region, as well as functional connectivity, which is consistent with a role for AG in synaptic plasticity.

Savings upon Re-Aiming in Visuomotor Adaptation

Sensorimotor adaptation has traditionally been viewed as a purely error-based process. There is, however, growing appreciation for the idea that performance changes in these tasks can arise from the interplay of error-based adaptation with other learning processes. The challenge is to specify constraints on these different processes, elucidating their respective contributions to performance, as well as the manner in which they interact. We address this question by exploring constraints on savings, the phenomenon in which people show faster performance gains when the same learning task is repeated. In a series of five experiments, we demonstrate that error-based learning associated with sensorimotor adaptation does not contribute to savings. Instead, savings reflects improvements in action selection, rather than motor execution.

SIGNIFICANCE STATEMENT

Savings is the phenomenon in which people show faster relearning of a previously forgotten memory. In the motor learning domain, this phenomenon has been a puzzle for learning models that operate exclusively on error-based learning processes. We demonstrate, in a series of experiments, that savings selectively reflects improvements in action selection: Participants are more adept in invoking an appropriate aiming strategy when presented with a previously experienced perturbation. Indeed, improvements in action selection appear to be the sole source of savings in visuomotor adaptation tasks. We observe no evidence of savings in implicit error-based adaptation.

How to Get the Full Prism Effect

We investigate how the immediate correction effect decreases mispointing under prisms. Subjects performed rhythmic pointing movements under different conditions with horizontally shifting prisms. Even the first (initial) pointing error is much smaller than the prismatic shift, a phenomenon called the immediate correction effect. Knowledge about the structure of the room and of objects in the room obtained before the prisms were worn may limit the amount of the prismatic displacement perceived. We therefore compared the direct prism effect as well as prismatic adaptation with room illumination switched on versus switched off. Our 44 subjects participated in two experiments, with varying amounts of information about room structure available. The results show a direct effect corresponding to the optical power of the prisms in the dark condition, when in addition body position was slightly rotated in direction of the prismatic shift. But even in the dark, a significant immediate correction effect arises with the fixed body position. The largest immediate correction amounting to almost half of optical displacement arose in the standard condition of bright light and fixed body position.

Using brain potentials to understand prism adaptation: the error-related negativity and the P300

Prism adaptation (PA) is both a perceptual-motor learning task as well as a promising rehabilitation tool for visuo-spatial neglect (VSN)—a spatial attention disorder often experienced after stroke resulting in slowed and/or inaccurate motor responses to contralesional targets. During PA, individuals are exposed to prism-induced shifts of the visual-field while performing a visuo-guided reaching task. After adaptation, with goggles removed, visuomotor responding is shifted to the opposite direction of that initially induced by the prisms. This visuomotor aftereffect has been used to study visuomotor learning and adaptation and has been applied clinically to reduce VSN severity by improving motor responding to stimuli in contralesional (usually left-sided) space. In order to optimize PA's use for VSN patients, it is important to elucidate the neural and cognitive processes that alter visuomotor function during PA. In the present study, healthy young adults underwent PA while event-related potentials (ERPs) were recorded at the termination of each reach (screen-touch), then binned according to accuracy (hit vs. miss) and phase of exposure block (early, middle, late). Results show that two ERP components were evoked by screen-touch: an error-related negativity (ERN), and a P300. The ERN was consistently evoked on miss trials during adaptation, while the P300 amplitude was largest during the early phase of adaptation for both hit and miss trials. This study provides evidence of two neural signals sensitive to visual feedback during PA that may sub-serve changes in visuomotor responding. Prior ERP research suggests that the ERN reflects an error processing system in medial-frontal cortex, while the P300 is suggested to reflect a system for context updating and learning. Future research is needed to elucidate the role of these ERP components in improving visuomotor responses among individuals with VSN.

Prismatic adaptation changes visuospatial representation in the inferior parietal lobule

Prismatic adaptation has been shown to induce a realignment of visuoproprioceptive representations and to involve parietocerebellar networks. We have investigated in humans how far other types of functions known to involve the parietal cortex are influenced by a brief exposure to prismatic adaptation. Normal subjects underwent an fMRI evaluation before and after a brief session of prismatic adaptation using rightward deviating prisms for one group or after an equivalent session using plain glasses for the other group. Activation patterns to three tasks were analyzed: (1) visual detection; (2) visuospatial short-term memory; and (3) verbal short-term memory. The prismatic adaptation-related changes were found bilaterally in the inferior parietal lobule when prisms, but not plain glasses, were used. This effect was driven by selective changes during the visual detection task: an increase in neural activity was induced on the left and a decrease on the right parietal side after prismatic adaptation. Comparison of activation patterns after prismatic adaptation on the visual detection task demonstrated a significant increase of the ipsilateral field representation in the left inferior parietal lobule and a significant decrease in the right inferior parietal lobule. In conclusion, a brief exposure to prismatic adaptation modulates differently left and right parietal activation during visual detection but not during short-term memory. Furthermore, the visuospatial representation within the inferior parietal lobule changes, with a decrease of the ipsilateral hemifield representation on the right and increase on the left side, suggesting thus a left hemispheric dominance.

A comparison of sensorimotor adaptation in the visual and in the auditory modality

We compared sensorimotor adaptation in the visual and the auditory modality. Subjects pointed to visual targets while receiving direct spatial information about fingertip position in the visual modality, or they pointed to visual targets while receiving indirect information about fingertip position in the visual modality, or they pointed to auditory targets while receiving indirect information about fingertip position in the auditory modality. Feedback was laterally shifted to induce adaptation, and aftereffects were tested with both target modalities and both hands. We found that aftereffects of adaptation were smaller when tested with the non-adapted hand, i.e., intermanual transfer was incomplete. Furthermore, aftereffects were smaller when tested in the non-adapted target modality, i.e., intermodal transfer was incomplete. Aftereffects were smaller following adaptation with indirect rather than direct feedback, but they were not smaller following adaptation with auditory rather than visual targets. From this we conclude that the magnitude of adaptive recalibration rather depends on the method of feedback delivery (indirect versus direct) than on the modality of feedback (visual versus auditory).

Age-related variations of visuo-motor adaptation beyond explicit knowledge

Visuo-motor adaptation suffers at older working age. The age-related decline of behavioral adjustments is accompanied by reduced explicit knowledge of the visuo-motor transformation. It disappears when explicit knowledge is kept constant across the age range, except for particularly high levels of explicit knowledge. According to these findings, at older adult age both the acquisition of explicit knowledge and its application for strategic corrections become poorer. Recently it has been posited that visuo-motor adaptation can involve model-free reinforcement mechanisms of learning in addition to model-based mechanisms. We tested whether age-related declines of reinforcement learning can also contribute to the age-related changes of visuo-motor adaptation. Therefore we enhanced the contribution of reinforcement learning to visuo-motor adaptation by way of introducing salient markers of success and failure during practice. With such modified practice conditions, there were residual age-related variations of behavioral adjustments at all levels of explicit knowledge, even when explicit knowledge was absent. The residual age-related variations were observed for practiced target directions only, but not for new target directions. These findings are consistent with an age-related decline of model-free reinforcement learning as a third factor in the age-related decline of visuo-motor adaptation. Under practice conditions, which spur model-free reward-based learning, this factor adds to the decrements of the acquisition of explicit knowledge and its use for strategic corrections.

Visuo-proprioceptive interactions during adaptation of the human reach

We examined whether visual and proprioceptive estimates of transient (midreach) target capture errors contribute to motor adaptation according to the probabilistic rules of information integration used for perception. Healthy adult humans grasped and moved a robotic handle between targets in the horizontal plane while the robot generated springlike loads that varied unpredictably from trial to trial. For some trials, a visual cursor faithfully tracked hand motion. In others, the handle's position was locked and subjects viewed motion of a point-mass cursor driven by hand forces. In yet other trials, cursor feedback was dissociated from hand motion or altogether eliminated. We used time- and frequency-domain analyses to characterize how sensorimotor memories influence performance on subsequent reaches. When the senses were used separately, subjects were better at rejecting physical disturbances applied to the hand than virtual disturbances applied to the cursor. In part, this observation reflected differences in how participants used sensorimotor memories to adapt to perturbations when performance feedback was limited to only proprioceptive or visual information channels. When both vision and proprioception were available to guide movement, subjects processed memories in a manner indistinguishable from the vision-only condition, regardless of whether the cursor tracked the hand faithfully or whether we experimentally dissociated motions of the hand and cursor. This was true even though, on average, perceptual uncertainty in the proprioceptive estimation of movement extent exceeded that of visual estimation by just 47%. In contrast to perceptual tasks wherein vision and proprioception both contribute to an optimal estimate of limb state, our findings support a switched-input, multisensory model of predictive load compensation wherein visual feedback of transient performance errors overwhelmingly dominates proprioception in determining adaptive reach performance.

The role of movement synchronization with an auditory signal in producing prism adaptation

The prism adaptation procedure is often used to study the plasticity of eye-hand coordination to misalignment of the visual and proprioceptive spatial maps. Misalignment can be resolved by adaptive change in spatial maps of either the eyes or hand or both. In this procedure, pacing pointing movements with a rhythmic auditory signal is usually employed to control movement speed, but the role of the auditory signal itself in producing adaptation has not been examined. The present experiment addressed this issue by testing three conditions: (i) exposure pointing was self-paced without an auditory signal; (ii) exposure pointing was paced by an auditory signal without synchronization; and (iii) exposure pointing was synchronized with the auditory signal. The first condition produced primarily proprioceptive adaptation. The second condition also produced primarily proprioceptive adaptation, but visual adaptation was also present. The third condition produced primarily visual adaptation. Results are discussed in terms of two possible roles for the auditory signal: (i) a rhythmic auditory signal may enhance overall activation of the adaptive neural network; and (ii) movement synchronization with a rhythmic auditory signal may enable multisensory integration, including auditory spatial information that selects the more reliable proprioceptive signal for movement control. Consequently, detection of the misalignment is localized and realignment occurs in the visual system.

Motor-sensory recalibration modulates perceived simultaneity of cross-modal events at different distances

A popular model for the representation of time in the brain posits the existence of a single, central-clock. In that framework, temporal distortions in perception are explained by contracting or expanding time over a given interval. We here present evidence for an alternative account, one which proposes multiple independent timelines coexisting within the brain and stresses the importance of motor predictions and causal inferences in constructing our temporal representation of the world. Participants judged the simultaneity of a beep and flash coming from a single source at different distances. The beep was always presented at a constant delay after a motor action, while the flash occurred at a variable delay. Independent shifts in the implied timing of the auditory stimulus toward the motor action (but not the visual stimulus) provided evidence against a central-clock model. Additionally, the hypothesis that the time between action and delayed effect is compressed (known as intentional binding) seems unable to explain our results: firstly, because actions and effects can perceptually reverse, and secondly because the recalibration of simultaneity remains even after the participant's intentional actions are no longer present. Contrary to previous reports, we also find that participants are unable to use distance cues to compensate for the relatively slower speed of sound when audio-visual events are presented in depth. When a motor act is used to control the distal event, however, adaptation to the delayed auditory signal occurs and subjective cross-sensory synchrony is maintained. These results support the hypothesis that perceptual timing derives from and is calibrated by our motor interactions with the world.

Rehabilitation of spatial neglect by prism adaptation: a peculiar expansion of sensorimotor after-effects to spatial cognition

Unilateral neglect is a neurological condition responsible for many debilitating effects on everyday life, poor functional recovery, and decreased ability to benefit from treatment. Prism adaptation (PA) to a right lateral displacement of the visual field is classically known to directionally bias visuo-motor and sensory-motor correspondences. One longstanding issue about this visuo-motor plasticity is about its specificity to the exposure condition. In contrast to very poor transfer to unexposed effectors classically described in healthy subjects, therapeutic results obtained in neglect patients suggested that PA can generate unexpected "expansion". Prism adaptation affects numerous levels of neglect symptomatology, suggesting that its effects somehow expand to unexposed sensory, motor and cognitive systems. The available body of evidence in support for this expansion raises important questions about the mechanisms involved in producing unexpected cognitive effects following a simple and moderate visuo-motor adaptation. We further develop here the idea that prism adaptation expansion to spatial cognition involves a cerebello-cortical network and review support for this model. Building on the basic, therapeutical and pathophysiological knowledge accumulated over the last 15 years, we also provide guidelines for the optimal use of prism adaptation in the clinic. Although further research and clinical trials are required to precisely define the ideal regime for routine applications, the current state of the art allows us to outline practical recommendations for therapeutical use of prisms.

Exploring the effects of ecological activities during exposure to optical prisms in healthy individuals

Prism adaptation improves a wide range of manifestations of left spatial neglect in right-brain-damaged patients. The typical paradigm consists in repeated pointing movements to visual targets, while patients wear prism goggles that displace the visual scene rightwards. Recently, we demonstrated the efficacy of a novel adaptation procedure, involving a variety of every-day visuo-motor activities. This "ecological" procedure proved to be as effective as the repetitive pointing adaptation task in ameliorating symptoms of spatial neglect, and was better tolerated by patients. However, the absence of adaptation and aftereffects measures for the ecological treatment did not allow for a full comparison of the two procedures. This is important in the light of recent findings showing that the magnitude of prism-induced aftereffects may predict recovery from spatial neglect. Here, we investigated prism-induced adaptation and aftereffects after ecological and pointing adaptation procedures. Forty-eight neurologically healthy participants (young and aged groups) were exposed to rightward shifting prisms while they performed the ecological or the pointing procedures, in separate days. Before and after prism exposure, participants performed proprioceptive, visual, and visual-proprioceptive tasks to assess prism-induced aftereffects. Participants adapted to the prisms during both procedures. Importantly, the ecological procedure induced greater aftereffects in the proprioceptive task (for both the young and the aged groups) and in the visual-proprioceptive task (young group). A similar trend was found for the visual task in both groups. Finally, participants rated the ecological procedure as more pleasant, less monotonous, and more sustainable than the pointing procedure. These results qualify ecological visuo-motor activities as an effective prism-adaptation procedure, suitable for the rehabilitation of spatial neglect.

Watch and learn: seeing is better than doing when acquiring consecutive motor tasks

During motor adaptation learning, consecutive physical practice of two different tasks compromises the retention of the first. However, there is evidence that observational practice, while still effectively aiding acquisition, will not lead to interference and hence prove to be a better practice method. Observers and Actors practised in a clockwise (Task A) followed by a counterclockwise (Task B) visually rotated environment, and retention was immediately assessed. An Observe-all and Act-all group were compared to two groups who both physically practised Task A, but then only observed (ObsB) or did not see or practice Task B (NoB). The two observer groups and the NoB control group better retained Task A than Actors, although importantly only the observer groups learnt Task B. RT data and explicit awareness of the rotation suggested that the observers had acquired their respective tasks in a more strategic manner than Actor and Control groups. We conclude that observational practice benefits learning of multiple tasks more than physical practice due to the lack of updating of implicit, internal models for aiming in the former.

Prisms and neglect: what have we learned?

Since Rossetti et al. (1998) reported that prism adaptation (PA) can lead to a substantial reduction of neglect symptoms PA has become a hot topic in neglect-research. More than 280 articles have been published in this area. Not all of those studies investigated the therapeutic potential of this technique, many studies examined the responsiveness to PA as a way to subdivide neglect into separate subsyndromes, other studies focussed on the process of PA itself in an effort to illuminate its underlying neurobiological mechanisms. In this article we will review research in all of these three areas to determine whether and to what extent research on PA in neglect patients has fulfilled its promise as a new way to improve the treatment of neglect, enhance our understanding of this complex syndrome and provide new insights into the neurobiology of sensorimotor learning.

In the absence of physical practice, observation and imagery do not result in updating of internal models for aiming

The presence of after-effects in adaptation tasks implies that an existing internal model has been updated. Previously, we showed that although observers adapted to a visuomotor perturbation, they did not show after-effects. In this experiment, we tested 2 further observer groups and an actor group. Observers were now actively engaged in watching (encouraged through imagery and movement estimation), with one group physically practising for 25% of the trials (mixed). Participants estimated the hand movements that produced various cursor trajectories and/or their own hand movement from a preceding trial. These trials also allowed us to assess the development of explicit knowledge as a function of the three practice conditions. The pure observation group did not show after-effects, whereas the actor and mixed groups did. The pure observation group improved their ability to estimate hand movement of the video model. Although the actor and mixed groups improved in actual reaching accuracy, they did not improve in explicit estimation. The mixed group was more accurate in reaching during adaptation and showed larger after-effects than the actors. We suggest that observation encourages an explicit mode of learning, enabling performance benefits without corresponding changes to an internal model of the mapping between output and sensory input. However, some physical practice interspersed with observation can change the manner with which learning is achieved, encouraging implicit learning and the updating of an existing internal model.

Adaptation of hand movements to double-step targets and to distorted visual feedback: evidence for shared mechanisms

Visuomotor adaptation of hand movements has been studied with two paradigms: double-step targets and distorted visual feedback. Here we investigate whether both procedures are based on a common adaptive mechanism. Subjects adapted either to double-step targets or to distorted feedback, each requiring a change of response angle by -15°. The magnitude of adaptation was larger with rotated feedback but magnitude of aftereffects was comparable, suggesting that the difference was due to strategic effects rather than visuomotor recalibration. Most importantly, subjects who adapted to double-step targets and were then exposed to rotated feedback performed as well as subjects who had fully adapted to rotated feedback, i.e., there was nearly 100% transfer from double-steps to rotations; likewise, the transfer from rotations to double-steps was almost 100%. From this we conclude that both types of adaptation share a common mechanism for recalibration.

Seeing your error alters my pointing: observing systematic pointing errors induces sensori-motor after-effects

During the procedure of prism adaptation, subjects execute pointing movements to visual targets under a lateral optical displacement: As consequence of the discrepancy between visual and proprioceptive inputs, their visuo-motor activity is characterized by pointing errors. The perception of such final errors triggers error-correction processes that eventually result into sensori-motor compensation, opposite to the prismatic displacement (i.e., after-effects). Here we tested whether the mere observation of erroneous pointing movements, similar to those executed during prism adaptation, is sufficient to produce adaptation-like after-effects. Neurotypical participants observed, from a first-person perspective, the examiner's arm making incorrect pointing movements that systematically overshot visual targets location to the right, thus simulating a rightward optical deviation. Three classical after-effect measures (proprioceptive, visual and visual-proprioceptive shift) were recorded before and after first-person's perspective observation of pointing errors. Results showed that mere visual exposure to an arm that systematically points on the right-side of a target (i.e., without error correction) produces a leftward after-effect, which mostly affects the observer's proprioceptive estimation of her body midline. In addition, being exposed to such a constant visual error induced in the observer the illusion “to feel” the seen movement. These findings indicate that it is possible to elicit sensori-motor after-effects by mere observation of movement errors.