Visuomotor transformations for eye-hand coordination

The role of binocular vision in the control and development of visually guided upper limb movements

Vision provides a key sensory input for the performance of fine motor skills, which are fundamentally important to daily life activities, as well as skilled occupational and recreational performance. Binocular visual function is a crucial aspect of vision that requires the ability to combine inputs from both eyes into a unified percept. Summation and fusion are two aspects of binocular processing associated with performance advantages, including more efficient visuomotor control of upper limb movements. This paper uses the multiple processes model of limb control to explore how binocular viewing could facilitate the planning and execution of prehension movements in adults and typically developing children. Insight into the contribution of binocularity to visuomotor control also comes from examining motor performance in individuals with amblyopia, a condition characterized by reduced visual acuity and poor binocular function. Overall, research in this field has advanced our understanding of the role of binocular vision in the development and performance of visuomotor skills, the first step towards developing assessment tools and targeted rehabilitation for children with neurodevelopment disorders at risk of poor visuomotor outcomes. This article is part of a discussion meeting issue 'New approaches to 3D vision'.

Training-Associated Superior Visuomotor Integration Performance in Elite Badminton Players after Adjusting for Cardiovascular Fitness

Badminton is recognized as the fastest racket sport in the world based on the speed of the birdie which can travel up to 426 km per hour. On the badminton court, players are not only required to track the moving badminton birdie (visual tracking and information integration) but also must anticipate the exact timing to hit it back (temporal estimation). However, the association of training experience related to visuomotor integration or temporal prediction ability remains unclear. In this study, we tested this hypothesis by examining the association between training experience and visuomotor performances after adjusting for age, education, and cardiovascular fitness levels. Twenty-eight professional badminton players were asked to perform a compensatory tracking task and a time/movement estimation task for measuring visuomotor integration and temporal prediction, respectively. Correlation analysis revealed a strong association between training experience and performance on visuomotor integration, indicating badminton training may be promoted to develop visuomotor integration ability. Furthermore, the regression model suggests training experience explains 32% of visuomotor integration performances. These behavioral findings suggest badminton training may facilitate the perceptual-cognitive performance related to visuomotor integration. Our findings highlight the potential training in visuomotor integration may apply to eye-hand coordination performance in badminton sport.

Older adults rely on somatosensory information from the effector limb in the planning of discrete movements to somatosensory cues

While younger and older adults can perform upper-limb reaches to spatial targets with comparable endpoint accuracy (i.e., Helsen et al., 2016; Goodman et al., 2020), movement planning (i.e., reaction time) is significantly longer in older versus younger adults (e.g., Pohl et al., 1996; Goodman et al., 2020). Critically relevant to the current study, age-related differences in reaction time are even greater when older adults plan movement towards somatosensory versus visual or bimodal targets in the absence of vision of the moving limb (e.g., Goodman et al., 2020). One proposed explanation of these lengthened reaction times to somatosensory targets is that older adults may be experiencing challenges in implementing sensorimotor transformations when planning discrete movements of their unseen limb. To test this idea and assess the contributions of somatosensory information to these motor planning processes, tendon vibration was applied to the muscles of the effector limb between reaching movements made towards visual, somatosensory, or bimodal targets. The results revealed that older adults show the greatest increases in reaction times when vibration was applied during the preparation of movements to somatosensory targets. Further, both older and younger adults exhibited decreased movement endpoint precision when tendon vibration was applied. However, only older adults showed significantly lower movement endpoint precision due to tendon vibration when making movements to somatosensory targets, versus both visual and bimodal targets. These results corroborate previous evidence that older adults have difficulties planning upper-limb movements to somatosensory targets. As well, these results yielded novel evidence that such motor planning processes in older adult rely on somatosensory cues from the effector limb.

Tactile Cues for Improving Target Localization in Subjects with Tunnel Vision

The loss of peripheral vision is experienced by millions of people with glaucoma or retinitis pigmentosa, and has a major impact in everyday life, specifically to locate visual targets in the environment. In this study, we designed a wearable interface to render the location of specific targets with private and non-intrusive tactile cues. Three experimental studies were completed to design and evaluate the tactile code and the device. In the first study, four different tactile codes (single stimuli or trains of pulses rendered either in a Cartesian or a Polar coordinate system) were evaluated with a head pointing task. In the following studies, the most efficient code, trains of pulses with Cartesian coordinates, was used on a bracelet located on the wrist, and evaluated during a visual search task in a complex virtual environment. The second study included ten subjects with a simulated restrictive field of view (10°). The last study consisted of proof of a concept with one visually impaired subject with restricted peripheral vision due to glaucoma. The results show that the device significantly improved the visual search efficiency with a factor of three. Including object recognition algorithm to smart glass, the device could help to detect targets of interest either on demand or suggested by the device itself (e.g., potential obstacles), facilitating visual search, and more generally spatial awareness of the environment.

Visuomotor feedback gains are modulated by gaze position

During goal-directed reaching, people typically direct their gaze to the target before the start of the hand movement and maintain fixation until the hand arrives. This gaze strategy improves reach accuracy in two ways. It enables the use of central vision at the end of movement, and it allows the use of extraretinal information in guiding the hand to the target. Here we tested whether fixating the reach target further facilitates reach accuracy by optimizing the use of peripheral vision in detecting, and rapidly responding to, reach errors during the ongoing movement. We examined automatic visuomotor corrections in response to displacements of the cursor representing the hand position as a function of gaze fixation location during unimanual goal-directed reaching. Eight fixation targets were positioned either in line with, or at different angles relative to, the straight-ahead movement direction (manipulation of fixation angle), and at different distances from the location of the visual perturbation (manipulation of fixation distance). We found that corrections were fastest and strongest when gaze was directed at the reach target compared with when gaze was directed to a different location in the workspace. We found that the gain of the visuomotor response was strongly affected by fixation angle, and to a smaller extent by fixation distance, with lower gains as the angle or distance increased. We submit that fixating the reach target improves reach accuracy by facilitating rapid visuomotor responses to reach errors viewed in peripheral vision. NEW & NOTEWORTHY It is well known that directing gaze to the reach target allows the use of foveal visual feedback and extraretinal information to improve the accuracy of reaching movements. Here we demonstrate that target fixation also optimizes rapid visuomotor corrections to reach errors viewed in peripheral vision, with the angle of gaze relative to the hand movement being a critical determinant in the gain of the visuomotor response.

Changes to online control and eye-hand coordination with healthy ageing

Goal directed movements are typically accompanied by a saccade to the target location. Online control plays an important part in correction of a reach, especially if the target or goal of the reach moves during the reach. While there are notable changes to visual processing and motor control with healthy ageing, there is limited evidence about how eye-hand coordination during online updating changes with healthy ageing. We sought to quantify differences between older and younger people for eye-hand coordination during online updating. Participants completed a double step reaching task implemented under time pressure. The target perturbation could occur 200, 400 and 600 ms into a reach. We measured eye position and hand position throughout the trials to investigate changes to saccade latency, movement latency, movement time, reach characteristics and eye-hand latency and accuracy. Both groups were able to update their reach in response to a target perturbation that occurred at 200 or 400 ms into the reach. All participants demonstrated incomplete online updating for the 600 ms perturbation time. Saccade latencies, measured from the first target presentation, were generally longer for older participants. Older participants had significantly increased movement times but there was no significant difference between groups for touch accuracy. We speculate that the longer movement times enable the use of new visual information about the target location for online updating towards the end of the movement. Interestingly, older participants also produced a greater proportion of secondary saccades within the target perturbation condition and had generally shorter eye-hand latencies. This is perhaps a compensatory mechanism as there was no significant group effect on final saccade accuracy. Overall, the pattern of results suggests that online control of movements may be qualitatively different in older participants.

Multiple spatial representations interact to increase reach accuracy when coordinating a saccade with a reach

Reaching is an essential behavior that allows primates to interact with the environment. Precise reaching to visual targets depends on our ability to localize and foveate the target. Despite this, how the saccade system contributes to improvements in reach accuracy remains poorly understood. To assess spatial contributions of eye movements to reach accuracy, we performed a series of behavioral psychophysics experiments in nonhuman primates (Macaca mulatta). We found that a coordinated saccade with a reach to a remembered target location increases reach accuracy without target foveation. The improvement in reach accuracy was similar to that obtained when the subject had visual information about the location of the current target in the visual periphery and executed the reach while maintaining central fixation. Moreover, we found that the increase in reach accuracy elicited by a coordinated movement involved a spatial coupling mechanism between the saccade and reach movements. We observed significant correlations between the saccade and reach errors for coordinated movements. In contrast, when the eye and arm movements were made to targets in different spatial locations, the magnitude of the error and the degree of correlation between the saccade and reach direction were determined by the spatial location of the eye and the hand targets. Hence, we propose that coordinated movements improve reach accuracy without target foveation due to spatial coupling between the reach and saccade systems. Spatial coupling could arise from a neural mechanism for coordinated visual behavior that involves interacting spatial representations.NEW & NOTEWORTHY How visual spatial representations guiding reach movements involve coordinated saccadic eye movements is unknown. Temporal coupling between the reach and saccade system during coordinated movements improves reach performance. However, the role of spatial coupling is unclear. Using behavioral psychophysics, we found that spatial coupling increases reach accuracy in addition to temporal coupling and visual acuity. These results suggest that a spatial mechanism to couple the reach and saccade systems increases the accuracy of coordinated movements.

Gaze-centered coding of proprioceptive reach targets after effector movement: Testing the impact of online information, time of movement, and target distance

In previous research, we demonstrated that spatial coding of proprioceptive reach targets depends on the presence of an effector movement (Mueller & Fiehler, Neuropsychologia, 2014, 2016). In these studies, participants were asked to reach in darkness with their right hand to a proprioceptive target (tactile stimulation on the finger tip) while their gaze was varied. They either moved their left, stimulated hand towards a target location or kept it stationary at this location where they received a touch on the fingertip to which they reached with their right hand. When the stimulated hand was moved, reach errors varied as a function of gaze relative to target whereas reach errors were independent of gaze when the hand was kept stationary. The present study further examines whether (a) the availability of proprioceptive online information, i.e. reaching to an online versus a remembered target, (b) the time of the effector movement, i.e. before or after target presentation, or (c) the target distance from the body influences gaze-centered coding of proprioceptive reach targets. We found gaze-dependent reach errors in the conditions which included a movement of the stimulated hand irrespective of whether proprioceptive information was available online or remembered. This suggests that an effector movement leads to gaze-centered coding for both online and remembered proprioceptive reach targets. Moreover, moving the stimulated hand before or after target presentation did not affect gaze-dependent reach errors, thus, indicating a continuous spatial update of positional signals of the stimulated hand rather than the target location per se. However, reaching to a location close to the body rather than farther away (but still within reachable space) generally decreased the influence of a gaze-centered reference frame.

The impact of aging on the spatial accuracy of quick corrective arm movements in response to sudden target displacement during reaching

Age-related declines in visuomotor processing speed can have a large impact on motor performance in elderly individuals. Contrary to previous findings, however, recent studies revealed that elderly individuals are able to quickly react to displacement of a visual target during reaching. Here, we investigated the influence of aging on quick, corrective responses to perturbations during reaching in the terms of their functional contribution to accuracy. Elderly and young adults performed reaching movements to a visual target that could be displaced during reaching, and they were requested to move their hand to reach the final target location as quickly as possible. Results showed that, for the younger group, the variance in the directional error of the corrective response correlated with the variance in the reaching trajectory at the halfway point of the reach, but the correlation decreased at the end of the reaching. On the other hand, such correlations were not significant in elderly participants, although the variance of the directional error did not show a significant difference between age groups. Thus, the quick, corrective response seems to play an important role in decreasing variability, especially before the end of reaching, and aging can impair this process.

Quantifying effects of stochasticity in reference frame transformations on posterior distributions

Reference frame transformations are usually considered to be deterministic. However, translations, scaling or rotation angles could be stochastic. Indeed, variability of these entities often originates from noisy estimation processes. The impact of transformation noise on the statistics of the transformed signals is unknown and a quantification of these effects is the goal of this study. We first quantify analytically and numerically how stochastic reference frame transformations (SRFT) alter the posterior distribution of the transformed signals. We then propose an new empirical measure to quantify deviations from a given distribution when only limited data is available. We apply this empirical measure to an example in sensory-motor neuroscience to quantify how different head roll angles change the distribution of reach endpoints away from the normal distribution.

Visual targets aren't irreversibly converted to motor coordinates: eye-centered updating of visuospatial memory in online reach control

Counter to current and widely accepted hypotheses that sensorimotor transformations involve converting target locations in spatial memory from an eye-fixed reference frame into a more stable motor-based reference frame, we show that this is not strictly the case. Eye-centered representations continue to dominate reach control even during movement execution; the eye-centered target representation persists after conversion to a motor-based frame and is continuously updated as the eyes move during reach, and is used to modify the reach plan accordingly during online control. While reaches are known to be adjusted online when targets physically shift, our results are the first to show that similar adjustments occur in response to changes in representations of remembered target locations. Specifically, we find that shifts in gaze direction, which produce predictable changes in the internal (specifically eye-centered) representation of remembered target locations also produce mid-transport changes in reach kinematics. This indicates that representations of remembered reach targets (and visuospatial memory in general) continue to be updated relative to gaze even after reach onset. Thus, online motor control is influenced dynamically by both the external and internal updating mechanisms.

Behavioral investigation on the frames of reference involved in visuomotor transformations during peripheral arm reaching

BACKGROUND

Several psychophysical experiments found evidence for the involvement of gaze-centered and/or body-centered coordinates in arm-movement planning and execution. Here we aimed at investigating the frames of reference involved in the visuomotor transformations for reaching towards visual targets in space by taking target eccentricity and performing hand into account.

METHODOLOGY/PRINCIPAL FINDINGS

We examined several performance measures while subjects reached, in complete darkness, memorized targets situated at different locations relative to the gaze and/or to the body, thus distinguishing between an eye-centered and a body-centered frame of reference involved in the computation of the movement vector. The errors seem to be mainly affected by the visual hemifield of the target, independently from its location relative to the body, with an overestimation error in the horizontal reaching dimension (retinal exaggeration effect). The use of several target locations within the perifoveal visual field allowed us to reveal a novel finding, that is, a positive linear correlation between horizontal overestimation errors and target retinal eccentricity. In addition, we found an independent influence of the performing hand on the visuomotor transformation process, with each hand misreaching towards the ipsilateral side.

CONCLUSIONS

While supporting the existence of an internal mechanism of target-effector integration in multiple frames of reference, the present data, especially the linear overshoot at small target eccentricities, clearly indicate the primary role of gaze-centered coding of target location in the visuomotor transformation for reaching.

Gaze modulates non-propositional reasoning: further evidence for spatial representation of reasoning premises

Human and animals are able to decide that A>C after having learnt that A>B and B>C. This basic property of logical thinking has been studied by transitive inference (TI) tasks. It has been hypothesized that subjects displace the premises of the inference on a mental line to solve the task. An evidence in favor of this interpretation is the observation of the symbolic distance effect, that is the improvement of the performance as the distance between items increases. This effect has been interpreted as support to the hypothesis that ability to perform TI tasks follows the same rules and is mediated by the same brain circuits involved in the performance of spatial tasks. We tested ten subjects performing a TI on an ordered list of Japanese characters while they were fixating either leftwards or rightwards, to evaluate whether the eye position modulated the performance in making TI as it does in spatial tasks. Our results show a significant linear decrease of the reaction time with the increase of the symbolic distance and a shift of this trend towards lower reaction times when subjects were fixating to the left. We interpret this eye position effect as a further evidence that spatial and reasoning tasks share the same underlying mechanisms and neural substrates. The eye position effect also points to a parietal cortex involvement in the neural circuit involved in transitive reasoning.

The influence of target sensory modality on motor planning may reflect errors in sensori-motor transformations

Multi-sensory integration studies have shown that combining heterogeneous signals can optimize motor performance by reducing errors inherent to any single modality. However, it has also been suggested that errors could arise from erroneous transformations between heterogeneous coordinate systems. Here we investigated the effect of visuo-proprioceptive integration on the control of multi-joint arm movements by manipulating target modality. When the target was visual, movement control required the integration of visual target signals with proprioceptive signals about limb configuration. In contrast, when the target was the unseen fingertip, movement control relied solely on proprioceptive signals since visual feedback of hand position was precluded. We hypothesized that a faulty integration of visual target signals with proprioceptive arm signals would result in a less accurate planning of visually-targeted movements with respect to proprioceptively-targeted movements. Different inter-joint coordinations patterns were tested by varying starting hand position. Results showed larger initial trajectory deviations from target direction for visually-targeted movements involving substantial shoulder and elbow motions. Inverse dynamic analysis revealed that these deviations were associated with less efficient intersegmental coordination. The control of visually-targeted movements thus appeared sub-optimal compared to proprioceptively-targeted movements when considering theoretical models of motor planning assuming kinematic or dynamic optimizations. Additional experiments further highlighted the effect of target position, and visual feedback of starting hand position, on motor planning for proprioceptively- and visually-targeted movements. Our findings suggest that the integration of heterogeneous sensory signals related to hand and target positions introduces errors in motor planning.

Effectiveness of prism adaptation in neglect rehabilitation: a controlled trial study

BACKGROUND AND PURPOSE

This study was conducted to investigate the effectiveness on neglect recovery of a 2-week treatment based on prism adaptation (PA) in comparison to an analogous visuomotor training performed without prisms, ie, neutral pointing (NP).

METHODS

Twenty neglect patients were divided into 2 matched groups, one was submitted to PA (PA group) and the other to NP (NP group) for 10 daily sessions over a period of 2 weeks. After the end of NP treatment, the patients in the NP group were also submitted to PA treatment. Neglect was assessed before and after each treatment and 1 month after the end of the PA treatment.

RESULTS

Visuospatial abilities improved after both PA and NP treatment; however, the improvement was significantly higher in the patients in the PA group than in the patients in the NP group. Moreover, when the patients in the NP group were submitted to PA, they further improved up to the level reached by patients in the PA group, ie, to nonpathological scores. Long-lasting beneficial effects of PA were confirmed 1 month from the end of treatment.

CONCLUSIONS

The leftward recalibration of sensorimotor reference frames induced by PA is effective to obtain proper neglect recovery, although visuomotor training based on pointing might partially improve neglect symptoms.

Monovision: a review

In presbyopia, patients can no longer obtain clear vision at distance and near. Monovision is a method of correcting presbyopia where one eye is focussed for distance vision and the other for near. Monovision is a fairly common method of correcting presbyopia with contact lenses and has received renewed interest with the increase in refractive surgery. The present paper is a review of the literature on monovision. The success rate of monovision in adapted contact lens wearers is 59-67%. The main limitations are problems with suppressing the blurred image when driving at night and the need for a third focal length, for example with computer screens at intermediate distances. Stereopsis is impaired in monovision, but most patients do not seem to notice this. These limitations highlight the need to take account of occupational factors. Monovision could cause a binocular vision anomaly to decompensate, so the pre-fitting screening should include an assessment of orthoptic function. Various methods have been used to determine which eye should be given the distance vision contact lens and the literature on tests of ocular dominance is reviewed. It is concluded that tests of blur suppression are most likely to be relevant, but that ocular dominance is not fixed but is rather a fluid, adaptive, phenomenon in most patients. Suitable patients can often be given trial lenses that allow them to experiment with monovision in real world situations and this can be a useful way of revealing the preferred eye for each distance. Of course, no patient should drive or operate machinery until successfully adapted to monovision. Surgically induced monovision is less easily reversed than contact lens-induced monovision, and is only appropriate after a successful trial of monovision with contact lenses.

Gaze-Dependent Deviation in Pointing Induced by Transcranial Magnetic Stimulation Over the Human Posterior Parietal Cortex

Signals arising from the saccadic system influence the planning and generation of pointing movements, and the posterior parietal cortex (PPC) appears to play a vital role in that interaction. The authors demonstrate in the present study that during visual fixation, eye-position signals can dominate pointing responses when the activity in the PPC contralateral to the moving limb is disrupted with transcranial magnetic stimulation (TMS). In particular, when presented with targets in peripheral vision, participants (N=5) exposed to TMS over the PPC failed to show the normal pattern of responses in which pointing movements end up farther away from the goal target. Instead, they tended to point more toward the current point of visual fixation. Those results suggest that the PPC is involved in integrating eye-position and visual information to affect reaching in the contralateral arm.

Dual routes to action: contributions of the dorsal and ventral streams to adaptive behavior

More than a decade ago, Goodale and Milner proposed that our perceptual experience of the world depends on visual processing that is fundamentally distinct from that mediating the moment-to-moment visual control of our actions. They mapped this distinction between vision-for-perception and vision-for-action onto the two prominent visual pathways that arise from early visual areas in the primate cerebral cortex: a ventral "perception" pathway projecting to inferotemporal cortex and a dorsal "action" pathway projecting to posterior parietal cortex. In the years since these ideas were first put forward, visual neuroscience has advanced rapidly on several fronts. In this chapter, we examine the perception-action distinction in the light of some of these developments, giving particular emphasis to the differences in the way the two streams process visual information and the way they interact in the production of adaptive behavior.

An evolving view of duplex vision: separate but interacting cortical pathways for perception and action

In 1992, Goodale and Milner proposed a division of labour in the visual pathways of the primate cerebral cortex between a dorsal stream specialised for the visual control of action and a ventral stream dedicated to the perception of the visual world. In the years since this original proposal, support for the perception-action hypothesis has come from neuroimaging experiments, human neuropsychology, monkey neurophysiology, and human psychophysical experiments. Indeed, some of the strongest support for this hypothesis has come from behavioural experiments showing that visually guided actions are largely refractory to perceptual illusions. Although controversial, the findings from this literature both support the original hypothesis and suggest important modifications. The ongoing challenge for neurobiologists is to map these behavioural findings onto their corresponding neural substrates.

Two distinct modes of control for object-directed action

There are multiple routes from vision to action that play a role in the production of visually guided reaching and grasping. What remain to be resolved, however, are the conditions under which these various routes are recruited in the generation of actions and the nature of the information they convey. We argue in this chapter that the production of real-time actions to visible targets depends on pathways that are separate from those mediating memory-driven actions. Furthermore, the transition from real-time to memory-driven control occurs as soon as the intended target is no longer visible. Real-time movements depend on pathways from the early visual areas through to relatively encapsulated visuomotor mechanisms in the dorsal stream. These dedicated visuomotor mechanisms, together with motor centers in the premotor cortex and brainstem, compute the absolute metrics of the target object and its position in the egocentric coordinates of the effector used to perform the action. Such real-time programming is essential for the production of accurate and efficient movements in a world where the location and disposition of a goal object with respect to the observer can change quickly and often unpredictably. In contrast, we argue that memory-driven actions make use of a perceptual representation of the target object generated by the ventral stream. Unlike the real-time visuomotor mechanisms, perception-based movement planning makes use of relational metrics and scene-based coordinates. Such computations make it possible, however, to plan and execute actions upon objects long after they have vanished from view.