Spatial Transformations for Eye–Hand Coordination

Eye-hand coordination all the way: from discrete to continuous hand movements

The differentiation between continuous and discrete actions is key for behavioral neuroscience. Although many studies have characterized eye-hand coordination during discrete (e.g., reaching) and continuous (e.g., pursuit tracking) actions, all these studies were conducted separately, using different setups and participants. In addition, how eye-hand coordination might operate at the frontier between discrete and continuous movements remains unexplored. Here we filled these gaps by means of a task that could elicit different movement dynamics. Twenty-eight participants were asked to simultaneously track with their eyes and a joystick a visual target that followed an unpredictable trajectory and whose position was updated at different rates (from 1.5 to 240 Hz). This procedure allowed us to examine actions ranging from discrete point-to-point movements (low refresh rate) to continuous pursuit (high refresh rate). For comparison, we also tested a manual tracking condition with the eyes fixed and a pure eye tracking condition (hand fixed). The results showed an abrupt transition between discrete and continuous hand movements around 3 Hz contrasting with a smooth trade-off between fixations and smooth pursuit. Nevertheless, hand and eye tracking accuracy remained strongly correlated, with each of these depending on whether the other effector was recruited. Moreover, gaze-cursor distance and lag were smaller when eye and hand performed the task conjointly than separately. Altogether, despite some dissimilarities in eye and hand dynamics when transitioning between discrete and continuous movements, our results emphasize that eye-hand coordination continues to smoothly operate and support the notion of synergies across eye movement types.NEW & NOTEWORTHY The differentiation between continuous and discrete actions is key for behavioral neuroscience. By using a visuomotor task in which we manipulate the target refresh rate to trigger different movement dynamics, we explored eye-hand coordination all the way from discrete to continuous actions. Despite abrupt changes in hand dynamics, eye-hand coordination continues to operate via a gradual trade-off between fixations and smooth pursuit, an observation confirming the notion of synergies across eye movement types.

Visual guidance fine-tunes probing movements of an insect appendage

Visually guided reaching, a regular feature of human life, comprises an intricate neural control task. It includes identifying the target's position in 3D space, passing the representation to the motor system that controls the respective appendages, and adjusting ongoing movements using visual and proprioceptive feedback. Given the complexity of the neural control task, invertebrates, with their numerically constrained central nervous systems, are often considered incapable of this level of visuomotor guidance. Here, we provide mechanistic insights into visual appendage guidance in insects by studying the probing movements of the hummingbird hawkmoth's proboscis as they search for a flower's nectary. We show that visually guided proboscis movements fine-tune the coarse control provided by body movements in flight. By impairing the animals' view of their proboscis, we demonstrate that continuous visual feedback is required and actively sought out to guide this appendage. In doing so, we establish an insect model for the study of neural strategies underlying eye-appendage control in a simple nervous system.

Coming to grips with reality: Real grasps, but not pantomimed grasps, resist a simultaneous tilt illusion

Investigations of grasping real, 3D objects subjected to illusory effects from a pictorial background often choose in-flight grasp aperture as the primary variable to test the hypothesis that the visuomotor system resists the illusion. Here we test an equally important feature of grasps that has received less attention: in-flight grasp orientation. The current study tested a variant of the simultaneous tilt illusion using a mirror-apparatus to manipulate the availability of haptic feedback. Participants performed grasps with haptic feedback (real grasps) and without it (pantomime grasps), reaching for the reflection of a real, 3D bar atop a background grating that induced a 1.1° bias in the perceived orientation of the bar in a separate sample of participants. Analysis of the hand's in-flight grasp orientation at early, late, and end stages of the reach showed that at no point were the real grasps biased by the illusion. In contrast, pantomimed grasps were affected by the illusion at the late and end stages of the reach. At each stage, the effect on the real grasps was significantly weaker than the effect of the illusion as measured by the mean point of subjective equality (PSE) in a two-alternative forced-choice task. In contrast, the effect on the pantomime grasps was statistically indistinguishable from the mean PSE at all three stages of the reach. These findings reinforce the idea that in-flight grasp orientation, like grasp aperture to pictorial illusions of target size, is refractory to pictorial backgrounds that bias perceived orientation.

Human motor augmentation with an extra robotic arm without functional interference

Extra robotic arms (XRAs) are gaining interest in neuroscience and robotics, offering potential tools for daily activities. However, this compelling opportunity poses new challenges for sensorimotor control strategies and human-machine interfaces (HMIs). A key unsolved challenge is allowing users to proficiently control XRAs without hindering their existing functions. To address this, we propose a pipeline to identify suitable HMIs given a defined task to accomplish with the XRA. Following such a scheme, we assessed a multimodal motor HMI based on gaze detection and diaphragmatic respiration in a purposely designed modular neurorobotic platform integrating virtual reality and a bilateral upper limb exoskeleton. Our results show that the proposed HMI does not interfere with speaking or visual exploration and that it can be used to control an extra virtual arm independently from the biological ones or in coordination with them. Participants showed significant improvements in performance with daily training and retention of learning, with no further improvements when artificial haptic feedback was provided. As a final proof of concept, naïve and experienced participants used a simplified version of the HMI to control a wearable XRA. Our analysis indicates how the presented HMI can be effectively used to control XRAs. The observation that experienced users achieved a success rate 22.2% higher than that of naïve users, combined with the result that naïve users showed average success rates of 74% when they first engaged with the system, endorses the viability of both the virtual reality-based testing and training and the proposed pipeline.

Perceptual-Cognitive Integration for Goal-Directed Action in Naturalistic Environments

Real-world actions require one to simultaneously perceive, think, and act on the surrounding world, requiring the integration of (bottom-up) sensory information and (top-down) cognitive and motor signals. Studying these processes involves the intellectual challenge of cutting across traditional neuroscience silos, and the technical challenge of recording data in uncontrolled natural environments. However, recent advances in techniques, such as neuroimaging, virtual reality, and motion tracking, allow one to address these issues in naturalistic environments for both healthy participants and clinical populations. In this review, we survey six topics in which naturalistic approaches have advanced both our fundamental understanding of brain function and how neurologic deficits influence goal-directed, coordinated action in naturalistic environments. The first part conveys fundamental neuroscience mechanisms related to visuospatial coding for action, adaptive eye-hand coordination, and visuomotor integration for manual interception. The second part discusses applications of such knowledge to neurologic deficits, specifically, steering in the presence of cortical blindness, impact of stroke on visual-proprioceptive integration, and impact of visual search and working memory deficits. This translational approach-extending knowledge from lab to rehab-provides new insights into the complex interplay between perceptual, motor, and cognitive control in naturalistic tasks that are relevant for both basic and clinical research.

The "Little Circles Test" (LCT): a dusted-off tool for assessing fine visuomotor function

BACKGROUND

The fine visuomotor function is commonly impaired in several neurological conditions. However, there is a scarcity of reliable neuropsychological tools to assess such a critical domain.

AIMS

The aim of this study is to explore the psychometric properties and provide normative data for the Visual-Motor Speed and Precision Test (VMSPT).

RESULTS

Our normative sample included 220 participants (130 females) aged 18-86 years (mean education = 15.24 years, SD = 3.98). Results showed that raw VMSPT scores were affected by higher age and lower education. No effect of sex or handedness was shown. Age- and education-based norms were provided. VMSPT exhibited weak-to-strong correlations with well-known neuropsychological tests, encompassing a wide range of cognitive domains of clinical relevance. By gradually intensifying the cognitive demands, the test becomes an indirect, performance-oriented measure of executive functioning. Finally, VMSPT seems proficient in capturing the speed-accuracy trade-off typically observed in the aging population.

CONCLUSIONS

This study proposes the initial standardization of a versatile, time-efficient, and cost-effective neuropsychological tool for assessing fine visuomotor coordination. We propose renaming the VMSPT as the more approachable "Little Circles Test" (LCT).

Higher cognitive load interferes with head-hand coordination: virtual reality-based study

Daily life activities often involve decision-based reaching movements in different contexts and circumstances. These activities span a wide array of cognitive load types we face while executing motor functions. Here we use a virtual reality-based neurocognitive testing platform to assess cognitive-induced changes in motor behavior as reflected by modulations in head-hand coordination. Our paradigm is based on the Color Trails Test (CTT), which is designed to assess two types of cognitive functions: Trails A-sustained visual attention (SVA), and Trails B-divided attention (DA). The virtual reality CTT adaptation (VR-CTT) requires execution of large multi-directional hand movements and head rotations. We employed a cross-correlation analysis on hand and head kinematics data collected from 122 healthy participants (ages: 20-90 years; divided as follows: young, middle-aged, and older adults) who completed the VR-CTT. The level of spatial coherence of head-hand movements was found to be high (R ≥ 0.76) in both Trails A and B, in all age groups. However, assessing head-hand phase shifts revealed longer time lags (i.e., in which head leads hand) in Trails B versus Trails A, in all age groups. We conclude that allocating cognitive resources to DA task reduces head-hand synchrony as compared to SVA conditions.

Training and proficiency level in endoscopic sinus surgery change residents' eye movements

Nose surgery is challenging and needs a lot of training for safe and efficient treatments. Eye tracking can provide an objective assessment to measure residents' learning curve. The aim of the current study was to assess residents' fixation duration and other dependent variables over the course of a dedicated training in functional endoscopic sinus surgery (FESS). Sixteen residents performed a FESS training over 18 sessions, split into three surgical steps. Eye movements in terms of percent fixation on the screen and average fixation duration were measured, in addition to residents' completion time, cognitive load, and surgical performance. Results indicated performance improvements in terms of completion time and surgical performance. Cognitive load and average fixation duration showed a significant change within the last step of training. Percent fixation on screen increased within the first step, and then stagnated. Results showed that eye movements and cognitive load differed between residents of different proficiency levels. In conclusion, eye tracking is a helpful objective measuring tool in FESS. It provides additional insights of the training level and changes with increasing performance. Expert-like gaze was obtained after half of the training sessions and increased proficiency in FESS was associated with increased fixation duration.

Mediating effect of sequential memory on the relationship between visual-motor integration and self-care performance in young children with autism spectrum disorder

Objective

Visual perception is a skill that contributes to the performance of self-care and important development tasks in early childhood. The relationship between self-care and visual perception is especially significant for young children with autism spectrum disorder (ASD), who have been described as visual learners. However, this relationship is not clearly understood among young children with ASD. We investigated the role of motor-free visual perception on the relationship between self-care and visual-motor integration in young children with ASD.

Methods

A sample of 66 children with ASD aged 48 to 83 months were recruited. Measurements included the Assessment of Motor and Process Skills, the Developmental Test of Visual Perception—Third Edition, and Test of Visual-Perceptual Skills—Third Edition.

Results

The results indicated that self-care performance had significant positive correlations with visual-motor integration, visual discrimination, visual memory, visual spatial relationships, and visual sequential memory. Of these, visual sequential memory and visual spatial relationships were the main factors related to self-care performance. Sequential memory was a mediator of the relationship between visual-motor integration and self-care performance.

Conclusion

This study establishes a deeper understanding of self-care and motor-free visual perception among young children with ASD. Understanding the relationship between visual perception and self-care in young children with ASD may aid professionals in providing self-care interventions for this population.

The Impact of Limb Velocity Variability on Mallet Accuracy in Marimba Performance

The present study examined spatial accuracy of mallet endpoints in a marimba performance context. Trained percussionists performed two- (i.e., Experiment 1) and four-mallet (i.e., Experiment 2) excerpts in three tempo conditions including slow, intermediate, and fast. Motion capture was utilized to gather data of upper-limb and mallet movements, as well as to compute velocities of the upper-limb joints. Mallet spatial accuracy was assessed by comparing mallet endpoints to a visual target positioned on the marimba. It was hypothesized that mallet spatial accuracy would be reduced as tempo condition increased, with effects on joint kinematics potentially revealing sensorimotor mechanisms underlying optimal sound production in marimba. Across both experiments, mallet accuracy was reduced as tempo condition increased. Interestingly, velocity variability in the elbows, wrists, and hands increased as mallet accuracy decreased. Such a pattern of effects suggested that sound production in marimba is suboptimal at fast relative to slow tempi. In addition, the velocity variability effects highlight the impact of motor planning mechanisms on sound production. Overall, the results shed new light on sensorimotor control in percussion which can be leveraged to enhance the training of percussionists.

Training-Associated Superior Visuomotor Integration Performance in Elite Badminton Players after Adjusting for Cardiovascular Fitness

Badminton is recognized as the fastest racket sport in the world based on the speed of the birdie which can travel up to 426 km per hour. On the badminton court, players are not only required to track the moving badminton birdie (visual tracking and information integration) but also must anticipate the exact timing to hit it back (temporal estimation). However, the association of training experience related to visuomotor integration or temporal prediction ability remains unclear. In this study, we tested this hypothesis by examining the association between training experience and visuomotor performances after adjusting for age, education, and cardiovascular fitness levels. Twenty-eight professional badminton players were asked to perform a compensatory tracking task and a time/movement estimation task for measuring visuomotor integration and temporal prediction, respectively. Correlation analysis revealed a strong association between training experience and performance on visuomotor integration, indicating badminton training may be promoted to develop visuomotor integration ability. Furthermore, the regression model suggests training experience explains 32% of visuomotor integration performances. These behavioral findings suggest badminton training may facilitate the perceptual-cognitive performance related to visuomotor integration. Our findings highlight the potential training in visuomotor integration may apply to eye-hand coordination performance in badminton sport.

Automated tool detection with deep learning for monitoring kinematics and eye-hand coordination in microsurgery

In microsurgical procedures, surgeons use micro-instruments under high magnifications to handle delicate tissues. These procedures require highly skilled attentional and motor control for planning and implementing eye-hand coordination strategies. Eye-hand coordination in surgery has mostly been studied in open, laparoscopic, and robot-assisted surgeries, as there are no available tools to perform automatic tool detection in microsurgery. We introduce and investigate a method for simultaneous detection and processing of micro-instruments and gaze during microsurgery. We train and evaluate a convolutional neural network for detecting 17 microsurgical tools with a dataset of 7500 frames from 20 videos of simulated and real surgical procedures. Model evaluations result in mean average precision at the 0.5 threshold of 89.5-91.4% for validation and 69.7-73.2% for testing over partially unseen surgical settings, and the average inference time of 39.90 ± 1.2 frames/second. While prior research has mostly evaluated surgical tool detection on homogeneous datasets with limited number of tools, we demonstrate the feasibility of transfer learning, and conclude that detectors that generalize reliably to new settings require data from several different surgical procedures. In a case study, we apply the detector with a microscope eye tracker to investigate tool use and eye-hand coordination during an intracranial vessel dissection task. The results show that tool kinematics differentiate microsurgical actions. The gaze-to-microscissors distances are also smaller during dissection than other actions when the surgeon has more space to maneuver. The presented detection pipeline provides the clinical and research communities with a valuable resource for automatic content extraction and objective skill assessment in various microsurgical environments.

Gaze control during reaching is flexibly modulated to optimize task outcome

When reaching for an object with the hand, the gaze is usually directed at the target. In a laboratory setting, fixation is strongly maintained at the reach target until the reaching is completed, a phenomenon known as "gaze anchoring." While conventional accounts of such tight eye-hand coordination have often emphasized the internal synergetic linkage between both motor systems, more recent optimal control theories regard motor coordination as the adaptive solution to task requirements. We here investigated to what degree gaze control during reaching is modulated by task demands. We adopted a gaze-anchoring paradigm in which participants had to reach for a target location. During the reach, they additionally had to make a saccadic eye movement to a salient visual cue presented at locations other than the target. We manipulated the task demands by independently changing reward contingencies for saccade reaction time (RT) and reaching accuracy. On average, both saccade RTs and reach error varied systematically with reward condition, with reach accuracy improving when the saccade was delayed. The distribution of the saccade RTs showed two types of eye movements: fast saccades with short RTs, and voluntary saccade with longer RTs. Increased reward for high reach accuracy reduced the probability of fast saccades but left their latency unchanged. The results suggest that gaze anchoring acts through a suppression of fast saccades, a mechanism that can be adaptively adjusted to the current task demands.NEW & NOTEWORTHY During visually guided reaching, our eyes usually fixate the target and saccades elsewhere are delayed ("gaze anchoring"). We here show that the degree of gaze anchoring is flexibly modulated by the reward contingencies of saccade latency and reach accuracy. Reach error became larger when saccades occurred earlier. These results suggest that early saccades are costly for reaching and the brain modulates inhibitory online coordination from the hand to the eye system depending on task requirements.

Review: Head and Eye Movements and Gaze Tracking in Baseball Batting

SIGNIFICANCE

After a 30-year gap, several studies on head and eye movements and gaze tracking in baseball batting have been performed in the last decade. These baseball studies may lead to training protocols for batting. Here we review these studies and compare the tracking behaviors with those in other sports.Baseball batters are often instructed to "keep your eye on the ball." Until recently, the evidence regarding whether batters follow this instruction and if there are benefits to following this instruction was limited. Baseball batting studies demonstrate that batters tend to move the head more than the eyes in the direction of the ball at least until a saccade occurs. Foveal gaze tracking is often maintained on the ball through the early portion of the pitch, so it can be said that baseball batters do keep the eyes on the ball. While batters place gaze at or near the point of bat-ball contact, the way this is accomplished varies. In some studies, foveal gaze tracking continues late in the pitch trajectory, whereas in other studies, anticipatory saccades occur. The relative advantages of these discrepant gaze strategies on perceptual processing and motor planning speed and accuracy are discussed, and other variables that may influence anticipatory saccades including the predictability of the pitch and the level of batter expertise are described. Further studies involving larger groups with different levels of expertise under game conditions are required to determine which gaze tracking strategies are most beneficial for baseball batting.

Effects of Horticultural Activities on Attitudes toward Aging, Sense of Hope and Hand-Eye Coordination in Older Adults in Residential Care Facilities

This study investigated the effects of an 8-week horticultural activity intervention on attitudes toward aging, sense of hope, and hand-eye coordination in 88 older adults in residential care facilities. In the experimental group, the mean score for "attitudes toward aging" increased from 3.81 before the intervention to 4.74 points after the intervention (standard deviation SD = 0.24 and 0.27, respectively), and the control group dropped from 3.75 to 3.70 (standard deviations, respectively SD = 0.27 and 0.28). The mean score for "sense of hope" increased from 3.28 before the intervention to 3.81 points after the intervention (SD = 0.49 and 0.26, respectively). In contrast to the control group, the mean score gradually declined from 3.26 to 3.16 points (standard deviation SD = 0.54 and 0.48, respectively). In the test of hand-eye coordination, the time required to complete the cup stacking test significantly decreased from 33.56 to 25.38 s in the experimental group but did not significantly change in the control group. Generalized estimating equation analysis revealed a significant interaction between group and time (p < 0.001). The data trends revealed significant differences in outcomes between the experimental group and the control group. At 3 months after the end of the study, the effect size in the experimental group remained higher than that in the control group.

Eye movement influences on coupled and decoupled eye-hand coordination tasks

Visually guided reaching precision and accuracy depend on the level of coupling between movements of the eyes and hand. In the present study, participants performed central fixations and either saccadic or smooth pursuit eye movements during fast and accurate reaching tasks involving eye-hand coupling and decoupling to better understand type of eye movement influence over upper limb control. Some eye-hand coupling and decoupling tasks also included hand reversals, where the hand moves away from the target to direct a cursor toward the target to account for various levels of hand-cursor and eye-cursor coupling. Regardless of eye-movement type, eye-hand-cursor coupling produced an endpoint accuracy advantage over decoupling. Use of hand reversal decreased peak speed and increased response time of the hand, whether considering fixation or a given eye movement. Use of smooth pursuit slowed hand movements relative to saccades, yet improved endpoint accuracy. Compared to central fixations, using smooth pursuit also slowed hand movements, while using saccades decreased, thus improved, hand reaction times. Data suggest an advantage, when using smooth pursuit to track the hand movement for the greatest endpoint accuracy, an advantage when using saccades for the fastest movements, and an eye-hand coupling advantage when using saccades for the shortest reactions. Researchers should provide clear eye-movement instructions for participants and/or monitor the eyes when assessing similar upper limb control to account for possible differences in eye movements used. Moreover, the type of eye movement chosen for participants should correspond to the primary goal of the task.

Investigating the Performance of Gesture-Based Input for Mid-Air Text Entry in a Virtual Environment: A Comparison of Hand-Up versus Hand-Down Postures

Although the interaction technology for virtual reality (VR) systems has evolved significantly over the past years, the text input efficiency in the virtual environment is still an ongoing problem. We deployed a word-gesture text entry technology based on gesture recognition in the virtual environment. This study aimed to investigate the performance of the word-gesture text entry technology with different input postures and VR experiences in the virtual environment. The study revealed that the VR experience (how long or how often using VR) had little effect on input performance. The hand-up posture has a better input performance when using word-gesture text entry technology in a virtual environment. In addition, the study found that the perceived exertion to complete the text input with word-gesture text entry technology was relatively high. Furthermore, the typing accuracy and perceived usability for using the hand-up posture were obviously higher than that for the hand-down posture. The hand-up posture also had less task workload than the hand-down posture. This paper supports that the word-gesture text entry technology with hand-up posture has greater application potential than hand-down posture.

Reduced Facilitation of Parietal-Motor Functional Connections in Older Adults

Age-related changes in cortico-cortical connectivity in the human motor network in older adults are associated with declines in hand dexterity. Posterior parietal cortex (PPC) is strongly interconnected with motor areas and plays a critical role in many aspects of motor planning. Functional connectivity measures derived from dual-site transcranial magnetic stimulation (dsTMS) studies have found facilitatory inputs from PPC to ipsilateral primary motor cortex (M1) in younger adults. In this study, we investigated whether facilitatory inputs from PPC to M1 are altered by age. We used dsTMS in a conditioning-test paradigm to characterize patterns of functional connectivity between the left PPC and ipsilateral M1 and a standard pegboard test to assess skilled hand motor function in 13 young and 13 older adults. We found a PPC-M1 facilitation in young adults but not older adults. Older adults also showed a decline in motor performance compared to young adults. We conclude that the reduced PPC-M1 facilitation in older adults may be an early marker of age-related decline in the neural control of movement.

The Effects of Low-Intensity Multimodal Proprioceptive Exercise on Cognitive Function in Older Adults

BACKGROUND

Physical activity provides a number of physical and psychological benefits. Multimodal proprioceptive exercise represents a useful balance-based exercise with the potential to reduce falls in older adults. Previous research has also indicated cognitive benefits following multimodal proprioceptive exercise in young and older adults. This study aimed to assess cognition and mood following 2 types of physical activity (multimodal proprioception vs yoga) compared with control (classroom-based) in healthy older adults.

METHOD

Nineteen older adults (Mage = 65, sex = 9 males) participated in this randomized controlled crossover trial. Participants completed a 20-minute multimodal proprioceptive exercise class, 20-minute yoga session, and 20-minute classroom-based control. Numeric working memory and mood were assessed before and immediately following each of the interventions.

RESULTS

The multimodal proprioceptive intervention significantly reduced numeric working memory reaction time versus the yoga (P = .043) and control (P = .023) group. There were no differences found for accuracy or mood.

CONCLUSIONS

These results indicate that multimodal proprioceptive exercise is worthy of further investigation as an alternative mode of exercise alongside the more traditional aerobic and strength-based exercise for healthy older adults.

Slower reaction and response times and impaired hand-eye coordination in individuals with neck pain

BACKGROUND

Neck pain is associated with sensorimotor dysfunction. Research is sparse of the effect of neck pain on reaction and response times and hand-eye coordination.

OBJECTIVES

To investigate hand and foot reaction and response times and hand-eye coordination in individuals with neck pain and to determine any relationships with clinical features of neck pain.

METHODS

Sixty individuals with neck pain and 60 controls of similar age and gender were recruited. Tests of simple reaction and response time were measured on the dominant hand and foot. Hand-eye coordination was measured by tracing a variety of coordination patterns with different levels of difficulty. Clinical features measured were intensity and duration of pain, and neck disability.

RESULTS

Hand and foot reaction and response times were significantly slower in the neck pain group compared to controls (all p < 0.001). The neck pain group took longer to trace the hand-eye coordination task at the hardest level (p = 0.03). Neck disability scores correlated with hand reaction time (r = 0.4, p = 0.005) and time taken in hand-eye coordination tasks (r = 0.2 for all levels, p < 0.05). Reaction and response times were correlated with time taken in the hand-eye coordination test (r = 0.2-0.4, p < 0.01).

CONCLUSIONS

Individuals with neck pain had slower hand and foot reaction and response times and impaired hand-eye coordination, suggesting deficits in sensorimotor function. Training speed, as a function of acuity, and hand-eye coordination might be considered in clinical assessment. Further research is needed to identify potential underlying mechanisms of the slower and less well coordinated movement.

Test-retest repeatability reveals a temporal kinematic signature for an upper limb precision grasping task in adults

Hand-eye coordination skills, such as reaching and grasping, are fundamentally important for the performance of most daily activities. Upper limb kinematics recorded by motion tracking systems provide detailed insight into the central nervous system control of movement planning and execution. For example, kinematic metrics can reveal deficits in control, and compensatory neuromotor strategies in individuals with neuropathologies. However, the clinical utility of kinematic metrics is currently limited because their psychometric properties, such as test-retest repeatability, have not been well characterized. Therefore, the purpose of this study was to examine the degree of repeatability of spatiotemporal kinematic metrics and determine which, if any, measures form a kinematic signature for a precision grasping task. Healthy adults (n = 40) were tested on two occasions separated by 5-10 days on a bead threading task consisting of reaching and precision grasping. Results showed good test-retest repeatability for reach peak velocity, reach and grasp durations, whereas poor to moderate reliability was observed for measures of spatial precision and maximum grip aperture. In addition, analysis showed that reliable estimates of kinematic metrics can be obtained using 10 trials. Overall, our results indicate that reach peak velocity and temporal metrics form a stable characteristic, or a kinematic signature, of individual performance on a standardized bead threading task. These findings suggest potential utility in applying kinematic metrics for clinical assessment of upper limb reaching tasks.

Reversal of Visual Feedback Modulates Somatosensory Plasticity

Reversed visual feedback during unimanual training increases transfer of skills to the opposite untrained hand and modulates plasticity in motor areas of the brain. However, it is unclear if unimanual training with reversed visual feedback also affects somatosensory areas. Here we manipulated visual input during unimanual training using left-right optical reversing spectacles and tested whether unimanual training with reversed vision modulates somatosensory cortical excitability to facilitate motor performance. Thirty participants practiced a unimanual ball-rotation task using the right hand with either left-right reversed vision (incongruent visual and somatosensory feedback) or direct vision (congruent feedback) of the moving hand. We estimated cortical excitability in primary somatosensory cortex (S1) before and after unimanual training by measuring somatosensory evoked potentials (SEPs). This was done by electrically stimulating the median nerve in the wrist while participants rested, and recording potentials over both hemispheres using electroencephalography. Performance of the ball-rotation task improved for both the right (trained) and left (untrained) hand after training across both direct and reversed vision conditions. Participants with direct vision of the right hand during training showed SEPs amplitudes increased bilaterally. In contrast, participants in the reversed visual condition showed attenuated SEPs following training. The results suggest that cortical suppression of S1 activity supports skilled motor performance after unimanual training with reversed vision, presumably by sensory gating of afferent signals from the movement. This finding provides insight into the mechanisms by which visual input interacts with the sensorimotor system and induces neuroplastic changes in S1 to support skilled motor performance.

The complexity of eye-hand coordination: a perspective on cortico-cerebellar cooperation

Background

Eye–hand coordination (EHC) is a sophisticated act that requires interconnected processes governing synchronization of ocular and manual motor systems. Precise, timely and skillful movements such as reaching for and grasping small objects depend on the acquisition of high-quality visual information about the environment and simultaneous eye and hand control. Multiple areas in the brainstem and cerebellum, as well as some frontal and parietal structures, have critical roles in the control of eye movements and their coordination with the head. Although both cortex and cerebellum contribute critical elements to normal eye-hand function, differences in these contributions suggest that there may be separable deficits following injury.

Method

As a preliminary assessment for this perspective, we compared eye and hand-movement control in a patient with cortical stroke relative to a patient with cerebellar stroke.

Result

We found the onset of eye and hand movements to be temporally decoupled, with significant decoupling variance in the patient with cerebellar stroke. In contrast, the patient with cortical stroke displayed increased hand spatial errors and less significant temporal decoupling variance. Increased decoupling variance in the patient with cerebellar stroke was primarily due to unstable timing of rapid eye movements, saccades.

Conclusion

These findings highlight a perspective in which facets of eye-hand dyscoordination are dependent on lesion location and may or may not cooperate to varying degrees. Broadly speaking, the results corroborate the general notion that the cerebellum is instrumental to the process of temporal prediction for eye and hand movements, while the cortex is instrumental to the process of spatial prediction, both of which are critical aspects of functional movement control.

More precise tracking of horizontal than vertical target motion with both the eyes and hand

When tracking targets moving in various directions with one's eyes, horizontal components of pursuit are more precise than vertical ones. Is this because horizontal target motion is predicted better or because horizontal movements of the eyes are controlled more precisely? When tracking a visual target with the hand, the eyes also track the target. We investigated whether the directional asymmetries that have been found during isolated eye movements are also present during such manual tracking, and if so, whether individual participants' asymmetry in eye movements is accompanied by a similar asymmetry in hand movements. We examined the data of 62 participants who used a joystick to track a visual target with a cursor. The target followed a smooth but unpredictable trajectory in two dimensions. Both the mean gaze-target distance and the mean cursor-target distance were about 20% larger in the vertical direction than in the horizontal direction. Gaze and cursor both followed the target with a slightly longer delay in the vertical than in the horizontal direction, irrespective of the target's trajectory. The delays of gaze and cursor were correlated, as were their errors in tracking the target. Gaze clearly followed the target rather than the cursor, so the asymmetry in both eye and hand movements presumably results from better predictions of the target's horizontal than of its vertical motion. Altogether this study speaks for the presence of anisotropic predictive processes that are shared across effectors.

The Effects of Mild Traumatic Brain Injury on Cognitive-Motor Integration for Skilled Performance

Adults exposed to blast and blunt impact often experience mild traumatic brain injury, affecting neural functions related to sensory, cognitive, and motor function. In this perspective article, we will review the effects of impact and blast exposure on functional performance that requires the integration of these sensory, cognitive, and motor control systems. We describe cognitive-motor integration and how it relates to successfully navigating skilled activities crucial for work, duty, sport, and even daily life. We review our research on the behavioral effects of traumatic impact and blast exposure on cognitive-motor integration in both younger and older adults, and the neural networks that are involved in these types of skills. Overall, we have observed impairments in rule-based skilled performance as a function of both physical impact and blast exposure. The extent of these impairments depended on the age at injury and the sex of the individual. It appears, however, that cognitive-motor integration deficits can be mitigated by the level of skill expertise of the affected individual, suggesting that such experience imparts resiliency in the brain networks that underly the control of complex visuomotor performance. Finally, we discuss the next steps needed to comprehensively understand the impact of trauma and blast exposure on functional movement control.

Bimanual skills and symmetry of upper limb movement in a group of drummers

Introduction: Hand-eye coordination is essential to carry out daily activities or take part in sports. Developing strong visual-motor coordination is especially important for athletes or musicians who rely on it for their careers. Goal: This study aimed to evaluate visual-motor coordination in drummers’ upper limbs. Materials and methods: The study group consisted of 60 men, aged 20 to 30 years (average 24.62 ±2.48). The respondents were divided into two groups, group P consisted of 30 experienced drummers and group N of 30 non-drummers. Standardized tests were employed: Relative Hand Skill test (RHS test) and a plate tapping test. Results: The RHS test conducted on an original sample demonstrated no significant difference between the P and N group for the dominant limb (p=0.7272) or the non-dominant limb (p=0.3274). A significant difference was observed between the P and N group in the plate tapping test. The difference in the plate tapping test results between the dominant and non-dominant hands was significantly smaller in the P group than in the N group (p< 0.0001).

Sex differences in visuomotor tracking

There is a growing interest in sex differences in human and animal cognition. However, empirical evidences supporting behavioral and neural sex differences in humans remain sparse. Visuomotor behaviors offer a robust and naturalistic empirical framework to seek for the computational mechanisms underlying sex biases in cognition. In a large group of human participants (N = 127), we investigated sex differences in a visuo-oculo-manual motor task that consists of tracking with the hand a target moving unpredictably. We report a clear male advantage in hand tracking accuracy. We tested whether men and women employ different gaze strategy or hand movement kinematics. Results show no key difference in these distinct visuomotor components. However, highly consistent differences in eye-hand coordination were evidenced by a larger temporal lag between hand motion and target motion in women. This observation echoes with other studies showing a male advantage in manual reaction time to visual stimuli. We propose that the male advantage for visuomotor tracking does not reside in a more reliable gaze strategy, or in more sophisticated hand movements, but rather in a faster decisional process linking visual information about target motion with forthcoming hand, but not eye, actions.

Effects of auditovisual feedback on eye-hand coordination in children with cerebral palsy

BACKGROUND

Children with spastic hemiplegic cerebral palsy have deficits in eye-hand coordination. This limits manual actions performed with the affected hand, especially fine motor skills such as grasping and manipulation. Visual-motor integration, grasping skills, and visual perception are collectively involved in eye-hand coordination.

AIMS

We investigated the effects of augmented biofeedback training on eye-hand coordination in children with spastic hemiplegic cerebral palsy.

METHODS AND PROCEDURES

Forty-five spastic hemiplegic cerebral palsy children (5-8 years old) were included. Children were assigned randomly into three equal groups. One group received traditional physical therapy to facilitate visual-motor integration and grasping skills for 3 months. The second group received augmented biofeedback training. The third group received a combination of augmented biofeedback training and traditional physical therapy. Children were evaluated with the Peabody Developmental Motor Scale (2nd edition) (PDMS-2). Treatment sessions were conducted for 60 min, three times a week, for 3 consecutive months.

OUTCOMES AND RESULTS

Children that received augmented biofeedback training alongside traditional physical therapy had significantly improved scores in the Visual-Motor Integration and grasping subtests compared to children that received only one intervention.

CONCLUSIONS AND IMPLICATIONS

Augmented biofeedback training alongside physical therapy improved eye-hand coordination in children with spastic hemiplegic cerebral palsy.

Parietal Cortex Integrates Saccade and Object Orientation Signals to Update Grasp Plans

Coordinated reach-to-grasp movements are often accompanied by rapid eye movements (saccades) that displace the desired object image relative to the retina. Parietal cortex compensates for this by updating reach goals relative to current gaze direction, but its role in the integration of oculomotor and visual orientation signals for updating grasp plans is unknown. Based on a recent perceptual experiment, we hypothesized that inferior parietal cortex (specifically supramarginal gyrus [SMG]) integrates saccade and visual signals to update grasp plans in additional intraparietal/superior parietal regions. To test this hypothesis in humans (7 females, 6 males), we used a functional magnetic resonance paradigm, where saccades sometimes interrupted grasp preparation toward a briefly presented object that later reappeared (with the same/different orientation) just before movement. Right SMG and several parietal grasp regions, namely, left anterior intraparietal sulcus and bilateral superior parietal lobule, met our criteria for transsaccadic orientation integration: they showed task-dependent saccade modulations and, during grasp execution, they were specifically sensitive to changes in object orientation that followed saccades. Finally, SMG showed enhanced functional connectivity with both prefrontal saccade regions (consistent with oculomotor input) and anterior intraparietal sulcus/superior parietal lobule (consistent with sensorimotor output). These results support the general role of parietal cortex for the integration of visuospatial perturbations, and provide specific cortical modules for the integration of oculomotor and visual signals for grasp updating.SIGNIFICANCE STATEMENT How does the brain simultaneously compensate for both external and internally driven changes in visual input? For example, how do we grasp an unstable object while eye movements are simultaneously changing its retinal location? Here, we used fMRI to identify a group of inferior parietal (supramarginal gyrus) and superior parietal (intraparietal and superior parietal) regions that show saccade-specific modulations during unexpected changes in object/grasp orientation, and functional connectivity with frontal cortex saccade centers. This provides a network, complementary to the reach goal updater, that integrates visuospatial updating into grasp plans, and may help to explain some of the more complex symptoms associated with parietal damage, such as constructional ataxia.

Modulation of vestibular-evoked responses prior to simple and complex arm movements

During destabilizing, voluntary arm movements, the vestibular system provides sensory cues related to head motion that are necessary to preserve upright balance. Although sensorimotor processing increases in accordance with task complexity during the preparation phase of reaching, it is unclear whether vestibular signals are also enhanced when maintaining postural control prior to the execution of a voluntary movement. To probe whether vestibular cues are a component of complexity-related increases in sensorimotor processing during movement preparation, vestibular-evoked responses to stochastic (0-25 Hz; root mean square = 1 mA) binaural, bipolar electrical vestibular stimulation (EVS) were examined. These responses were assessed using cumulant density function estimates in the upper and lower limbs prior to ballistic arm movements of varying complexity in both standing (experiment 1) and seated (experiment 2) conditions. In experiment 1, EVS-electromyography (EMG) cumulant density estimates surpassed 95% confidence intervals for biceps and triceps brachii, as well as the left and right medial gastrocnemius. For the latter two muscles, the responses were enhanced 10-18% with increased movement complexity. In experiment 2, the EVS-EMG cumulant density estimates also surpassed 95% confidence intervals in the upper limb, confirming the presence of vestibular-evoked responses while seated; however, the amplitude was significantly less than standing. This study demonstrates the vestibular system contributes to postural stability during the preparation phase of reaching. As such, vestibular-driven signals may be used to update an internal model for upcoming reaching tasks or to prepare for imminent postural disturbances.

Eye movements as a readout of sensorimotor decision processes

Real-world tasks, such as avoiding obstacles, require a sequence of interdependent choices to reach accurate motor actions. Yet, most studies on primate decision making involve simple one-step choices. Here we analyze motor actions to investigate how sensorimotor decisions develop over time. In a go/no-go interception task human observers (n = 42) judged whether a briefly presented moving target would pass (interceptive hand movement required) or miss (no hand movement required) a strike box while their eye and hand movements were recorded. Go/no-go decision formation had to occur within the first few hundred milliseconds to allow time-critical interception. We found that the earliest time point at which eye movements started to differentiate actions (go versus no-go) preceded hand movement onset. Moreover, eye movements were related to different stages of decision making. Whereas higher eye velocity during smooth pursuit initiation was related to more accurate interception decisions (whether or not to act), faster pursuit maintenance was associated with more accurate timing decisions (when to act). These results indicate that pursuit initiation and maintenance are continuously linked to ongoing sensorimotor decision formation.NEW & NOTEWORTHY Here we show that eye movements are a continuous indicator of decision processes underlying go/no-go actions. We link different stages of decision formation to distinct oculomotor events during open- and closed-loop smooth pursuit. Critically, the earliest time point at which eye movements differentiate actions preceded hand movement onset, suggesting shared sensorimotor processing for eye and hand movements. These results emphasize the potential of studying eye movements as a readout of cognitive processes.

Visual processing speed in hemianopia patients secondary to acquired brain injury: a new assessment methodology

Background

There is a clinical need to identify diagnostic parameters that objectively quantify and monitor the effective visual ability of patients with homonymous visual field defects (HVFDs). Visual processing speed (VPS) is an objective measure of visual ability. It is the reaction time (RT) needed to correctly search and/or reach for a visual stimulus. VPS depends on six main brain processing systems: auditory-cognitive, attentional, working memory, visuocognitive, visuomotor, and executive. We designed a new assessment methodology capable of activating these six systems and measuring RTs to determine the VPS of patients with HVFDs.

Methods

New software was designed for assessing subject visual stimulus search and reach times (S-RT and R-RT respectively), measured in seconds. Thirty-two different everyday visual stimuli were divided in four complexity groups that were presented along 8 radial visual field positions at three different eccentricities (10^o, 20^o, and 30^o). Thus, for each HVFD and control subject, 96 S- and R-RT measures related to VPS were registered. Three additional variables were measured to gather objective data on the validity of the test: eye-hand coordination mistakes (ehcM), eye-hand coordination accuracy (ehcA), and degrees of head movement (dHM, measured by a head-tracker system). HVFD patients and healthy controls (30 each) matched by age and gender were included. Each subject was assessed in a single visit. VPS measurements for HFVD patients and control subjects were compared for the complete test, for each stimulus complexity group, and for each eccentricity.

Results

VPS was significantly slower (p < 0.0001) in the HVFD group for the complete test, each stimulus complexity group, and each eccentricity. For the complete test, the VPS of the HVFD patients was 73.0% slower than controls. They also had 335.6% more ehcMs, 41.3% worse ehcA, and 189.0% more dHMs than the controls.

Conclusions

Measurement of VPS by this new assessment methodology could be an effective tool for objectively quantifying the visual ability of HVFD patients. Future research should evaluate the effectiveness of this novel method for measuring the impact that any specific neurovisual rehabilitation program has for these patients.

The spatial and temporal properties of attentional selectivity for saccades and reaches

The preparation and execution of saccades and goal-directed movements elicits an accompanying shift in attention at the locus of the impending movement. However, some key aspects of the spatiotemporal profile of this attentional shift between eye and hand movements are not resolved. While there is evidence that attention is improved at the target location when making a reach, it is not clear how attention shifts over space and time around the movement target as a saccade and a reach are made to that target. Determining this spread of attention is an important aspect in understanding how attentional resources are used in relation to movement planning and guidance in real world tasks. We compared performance on a perceptual discrimination paradigm during a saccade-alone task, reach-alone task, and a saccade-plus-reach task to map the temporal profile of the premotor attentional shift at the goal of the movement and at three surrounding locations. We measured performance relative to a valid baseline level to determine whether motor planning induces additional attentional facilitation compared to mere covert attention. Sensitivity increased relative to movement onset at the target and at the surrounding locations, for both the saccade-alone and saccade-plus-reach conditions. The results suggest that the temporal profile of the attentional shift is similar for the two tasks involving saccades (saccade-alone and saccade-plus-reach tasks), but is very different when the influence of the saccade is removed. In this case, performance in the saccade-plus-reach task reflects the lower sensitivity observed when a reach-alone task is being conducted. In addition, the spatial profile of this spread of attention is not symmetrical around the target. This suggests that when a saccade and reach are being planned together, the saccade drives the attentional shift, and the reach-alone carries little attentional weight.

Eye and Head Movements of Elite Baseball Players in Real Batting

In baseball, batters swing in response to a ball moving at high speed within a limited amount of time—about 0. 5 s. In order to make such movement possible, quick and accurate trajectory prediction followed by accurate swing motion with optimal body-eye coordination is considered essential, but the mechanisms involved are not clearly understood. The present study aims to clarify the strategies of eye and head movements adopted by elite baseball batters in actual game situations. In our experiment, six current professional baseball batters faced former professional baseball pitchers in a scenario close to a real game (i.e., without the batters informed about pitch type in advance). We measured eye movements with a wearable eye-tracker and head movements and bat trajectories with an optical motion capture system while the batters hit. In the eye movement measurements, contrary to previous studies, we found distinctive predictive saccades directed toward the predicted trajectory, of which the first saccades were initiated approximately 80–220 ms before impact for all participants. Predictive saccades were initiated significantly later when batters knew the types of pitch in advance compared to when they did not. We also found that the best three batters started predictive saccades significantly later and tended to have fewer gaze-ball errors than the other three batters. This result suggests that top batters spend slightly more time obtaining visual information by delaying the initiation of saccades. Furthermore, although all batters showed positive correlations between bat location and head direction at the time of impact, the better batters showed no correlation between bat location and gaze direction at that time. These results raise the possibility of differences in the coding process for the location of bat-ball contact; namely, that top batters might utilize head direction to encode impact locations.

Gaze behavior during visuomotor tracking with complex hand-cursor dynamics

The ability to track a moving target with the hand has been extensively studied, but few studies have characterized gaze behavior during this task. Here we investigate gaze behavior when participants learn a new mapping between hand and cursor motion, such that the cursor represented the position of a virtual mass attached to the grasped handle via a virtual spring. Depending on the experimental condition, haptic feedback consistent with mass-spring dynamics could also be provided. For comparison a simple one-to-one hand-cursor mapping was also tested. We hypothesized that gaze would be drawn, at times, to the cursor in the mass-spring conditions, especially in the absence of haptic feedback. As expected hand tracking performance was less accurate under the spring mapping, but gaze behavior was virtually unaffected by the spring mapping, regardless of whether haptic feedback was provided. Specifically, relative gaze position between target and cursor, rate of saccades, and gain of smooth pursuit were similar under both mappings and both haptic feedback conditions. We conclude that even when participants are exposed to a challenging hand-cursor mapping, gaze is primarily concerned about ongoing target motion suggesting that peripheral vision is sufficient to monitor cursor position and to update hand movement control.

Eye-Hand Coordination Impairment in Glaucoma Patients

This study examined whether patients with glaucoma exhibit differences in eye–hand coordination tasks compared to age-matched normal-sighted control subjects. Twenty-eight patients with moderate-to-advanced stages of glaucoma and 28 subjects with no ocular disease participated in the study. The Motor Performance Series (MLS) of the Vienna Test System including aiming, linear tracking, tremor, and tapping tests were used to assess eye–hand coordination. Monocular Humphrey Visual Field and binocular Humphrey Esterman Visual Field tests were used to estimate visual field (VF) defect severity. Correlation between MLS scores and VF defects, visual acuity, and patient age were assessed. Glaucoma patients performed slower aiming at targets, committed more errors, and took longer to complete linear tracking and tremor tasks compared to the normal-sighted control group. Furthermore, tapping test scores indicated reduced hand movements at maximum frequency. The presence of asymmetrical monocular VF defects were associated with longer error durations in linear tracking tasks. Furthermore, MLS scores decline with advancing age and reduced visual acuity. Glaucoma patients had lower values for most MLS parameters compared to controls. However, monocular and binocular VF defects cannot fully explain the impartments in eye–hand coordination associated with glaucoma.

The resonant brain: How attentive conscious seeing regulates action sequences that interact with attentive cognitive learning, recognition, and prediction

This article describes mechanistic links that exist in advanced brains between processes that regulate conscious attention, seeing, and knowing, and those that regulate looking and reaching. These mechanistic links arise from basic properties of brain design principles such as complementary computing, hierarchical resolution of uncertainty, and adaptive resonance. These principles require conscious states to mark perceptual and cognitive representations that are complete, context sensitive, and stable enough to control effective actions. Surface-shroud resonances support conscious seeing and action, whereas feature-category resonances support learning, recognition, and prediction of invariant object categories. Feedback interactions between cortical areas such as peristriate visual cortical areas V2, V3A, and V4, and the lateral intraparietal area (LIP) and inferior parietal sulcus (IPS) of the posterior parietal cortex (PPC) control sequences of saccadic eye movements that foveate salient features of attended objects and thereby drive invariant object category learning. Learned categories can, in turn, prime the objects and features that are attended and searched. These interactions coordinate processes of spatial and object attention, figure-ground separation, predictive remapping, invariant object category learning, and visual search. They create a foundation for learning to control motor-equivalent arm movement sequences, and for storing these sequences in cognitive working memories that can trigger the learning of cognitive plans with which to read out skilled movement sequences. Cognitive-emotional interactions that are regulated by reinforcement learning can then help to select the plans that control actions most likely to acquire valued goal objects in different situations. Many interdisciplinary psychological and neurobiological data about conscious and unconscious behaviors in normal individuals and clinical patients have been explained in terms of these concepts and mechanisms.

Populations Norms for "SLURP"-An iPad App for Quantification of Visuomotor Coordination Testing

Currently the integrity of brain function that drives behavior is predominantly measured in terms of pure motor function, yet most human behavior is visually driven. A means of easily quantifying such visually-driven brain function for comparison against population norms is lacking. Analysis of eye-hand coordination (EHC) using a digital game-like situation with downloadable spatio-temporal details has potential for clinicians and researchers. A simplified protocol for the Lee-Ryan EHC (Slurp) Test app for iPad® has been developed to monitor EHC. The two subtests selected, each of six quickly completed items with appeal to all ages, were found equivalent in terms of total errors/time and sensitive to developmental and aging milestones known to affect EHC. The sensitivity of outcomes due to the type of stylus being used during testing was also explored. Populations norms on 221 participants aged 5 to 80⁺years are presented for each test item according to two commonly used stylus types. The Slurp app uses two-dimensional space and is suited to clinicians for pre/post-intervention testing and to researchers in psychological, medical, and educational domains who are interested in understanding brain function.

The function of "looking-at-nothing" for sequential sensorimotor tasks: Eye movements to remembered action-target locations

When performing manual actions, eye movements precede hand movements to target locations: Before we grasp an object, we look at it. Eye-hand guidance is even preserved when visual targets are unavailable, e.g., grasping behind an occlusion. This "looking-atnothing" behavior might be functional, e.g., as "deictic pointer" for manual control or as memory-retrieval cue, or a by-product of automatization. Here, it is studied if looking at empty locations before acting on them is beneficial for sensorimotor performance. In five experiments, participants completed a click sequence on eight visual targets for 0-100 trials while they had either to fixate on the screen center or could move their eyes freely. During 50-100 consecutive trials, participants clicked the same sequence on a blank screen with free or fixed gaze. During both phases, participants looked at target locations when gaze shifts were allowed. With visual targets, target fixations led to faster, more precise clicking, fewer errors, and sparser cursor-paths than central fixation. Without visual information, a tiny free-gaze benefit could sometimes be observed and was rather a memory than a motor-calculation benefit. Interestingly, central fixation during learning forced early explicit encoding causing a strong benefit for acting on remembered targets later, independent of whether eyes moved then.

Visuomotor Behaviour in Amblyopia: Deficits and Compensatory Adaptations

Amblyopia is a neurodevelopmental visual disorder arising from decorrelated binocular experience during the critical periods of development. The hallmark of amblyopia is reduced visual acuity and impairment in binocular vision. The consequences of amblyopia on various sensory and perceptual functions have been studied extensively over the past 50 years. Historically, relatively fewer studies examined the impact of amblyopia on visuomotor behaviours; however, research in this area has flourished over the past 10 years. Therefore, the aim of this review paper is to provide a comprehensive review of current knowledge about the effects of amblyopia on eye movements, upper limb reaching and grasping movements, as well as balance and gait. Accumulating evidence indicates that amblyopia is associated with considerable deficits in visuomotor behaviour during amblyopic eye viewing, as well as adaptations in behaviour during binocular and fellow eye viewing in adults and children. Importantly, due to amblyopia heterogeneity, visuomotor development in children and motor skill performance in adults may be significantly influenced by the etiology and clinical features, such as visual acuity and stereoacuity. Studies with larger cohorts of children and adults are needed to disentangle the unique contribution of these clinical characteristics to the development and performance of visuomotor behaviours.

Handedness Matters for Motor Control But Not for Prediction

Skilled motor behavior relies on the ability to control the body and to predict the sensory consequences of this control. Although there is ample evidence that manual dexterity depends on handedness, it remains unclear whether control and prediction are similarly impacted. To address this issue, right-handed human participants performed two tasks with either the right or the left hand. In the first task, participants had to move a cursor with their hand so as to track a target that followed a quasi-random trajectory. This hand-tracking task allowed testing the ability to control the hand along an imposed trajectory. In the second task, participants had to track with their eyes a target that was self-moved through voluntary hand motion. This eye-tracking task allowed testing the ability to predict the visual consequences of hand movements. As expected, results showed that hand tracking was more accurate with the right hand than with the left hand. In contrast, eye tracking was similar in terms of spatial and temporal gaze attributes whether the target was moved by the right or the left hand. Although these results extend previous evidence for different levels of control by the two hands, they show that the ability to predict the visual consequences of self-generated actions does not depend on handedness. We propose that the greater dexterity exhibited by the dominant hand in many motor tasks stems from advantages in control, not in prediction. Finally, these findings support the notion that prediction and control are distinct processes.

Auditory cues for somatosensory targets invoke visuomotor transformations: Behavioral and electrophysiological evidence

Prior to goal-directed actions, somatosensory target positions can be localized using either an exteroceptive or an interoceptive body representation. The goal of the present study was to investigate if the body representation selected to plan reaches to somatosensory targets is influenced by the sensory modality of the cue indicating the target’s location. In the first experiment, participants reached to somatosensory targets prompted by either an auditory or a vibrotactile cue. As a baseline condition, participants also performed reaches to visual targets prompted by an auditory cue. Gaze-dependent reaching errors were measured to determine the contribution of the exteroceptive representation to motor planning processes. The results showed that reaches to both auditory-cued somatosensory targets and auditory-cued visual targets exhibited larger gaze-dependent reaching errors than reaches to vibrotactile-cued somatosensory targets. Thus, an exteroceptive body representation was likely used to plan reaches to auditory-cued somatosensory targets but not to vibrotactile-cued somatosensory targets. The second experiment examined the influence of using an exteroceptive body representation to plan movements to somatosensory targets on pre-movement neural activations. Cortical responses to a task-irrelevant visual flash were measured as participants planned movements to either auditory-cued somatosensory or auditory-cued visual targets. Larger responses (i.e., visual-evoked potentials) were found when participants planned movements to somatosensory vs. visual targets, and source analyses revealed that these activities were localized to the left occipital and left posterior parietal areas. These results suggest that visual and visuomotor processing networks were more engaged when using the exteroceptive body representation to plan movements to somatosensory targets, than when planning movements to external visual targets.

Eye movements do not play an important role in the adaptation of hand tracking to a visuomotor rotation

Adapting hand movements to changes in our body or the environment is essential for skilled motor behavior. Although eye movements are known to assist hand movement control, how eye movements might contribute to the adaptation of hand movements remains largely unexplored. To determine to what extent eye movements contribute to visuomotor adaptation of hand tracking, participants were asked to track a visual target that followed an unpredictable trajectory with a cursor using a joystick. During blocks of trials, participants were either allowed to look wherever they liked or required to fixate a cross at the center of the screen. Eye movements were tracked to ensure gaze fixation as well as to examine free gaze behavior. The cursor initially responded normally to the joystick, but after several trials, the direction in which it responded was rotated by 90°. Although fixating the eyes had a detrimental influence on hand tracking performance, participants exhibited a rather similar time course of adaptation to rotated visual feedback in the gaze-fixed and gaze-free conditions. More importantly, there was extensive transfer of adaptation between the gaze-fixed and gaze-free conditions. We conclude that although eye movements are relevant for the online control of hand tracking, they do not play an important role in the visuomotor adaptation of such tracking. These results suggest that participants do not adapt by changing the mapping between eye and hand movements, but rather by changing the mapping between hand movements and the cursor’s motion independently of eye movements.

NEW & NOTEWORTHY Eye movements assist hand movements in everyday activities, but their contribution to visuomotor adaptation remains largely unknown. We compared adaptation of hand tracking under free gaze and fixed gaze. Although our results confirm that following the target with the eyes increases the accuracy of hand movements, they unexpectedly demonstrate that gaze fixation does not hinder adaptation. These results suggest that eye movements have distinct contributions for online control and visuomotor adaptation of hand movements.

Gaze Augmented Hand-Based Kinesthetic Interaction: What You See is What You Feel

Kinesthetic interaction between the user and the computer mainly utilizes the hand-based input with force-feedback devices. There are two major shortcomings in hand-based kinesthetic interaction: physical fatigue associated with continuous hand movements and the limited workspace of current force-feedback devices for accurately exploring a large environment. To address these shortcomings, we developed two interaction techniques that use eye gaze as an additional input modality: HandGazeTouch and GazeTouch. Hand GazeTouch combines eye gaze and hand motion as the input for kinesthetic interaction, i.e., it uses eye gaze to point and hand motion to touch. GazeTouch replaces all hand motions in touch behavior with eye gaze, i.e., it uses eye gaze to point and gaze dwell time to trigger the touch. In both interaction techniques, the user feels the haptic feedback through the force-feedback device. The gaze-based techniques were evaluated in a softness discrimination experiment by comparing them to the traditional kinesthetic interface, HandTouch, which only uses the hand-based input. The results indicate that the HandGazeTouch technique is not only as accurate, natural, and pleasant as the traditional interface but also more efficient.

Effect of interactive cognitive-motor training on eye-hand coordination and cognitive function in older adults

Background

Poor eye–hand coordination is associated with the symptoms of the early stage of cognitive decline. However, previous research on the eye–hand coordination of older adults without cognitive impairment is scant. Therefore, this study examined the effects of interactive cognitive-motor training on the visual-motor integration, visual perception, and motor coordination sub-abilities of the eye–hand coordination and cognitive function in older adults.

Methods

A double-blind randomized controlled trial was conducted with older adults. Sixty-two older adults were randomly assigned to the experimental (interactive cognitive-motor training) or active control (passive information activity) group, and both groups received 30 min of training each week, three times a week for 8 weeks. The primary outcome was eye–hand coordination, which was further divided into the sub-abilities of visual–motor integration, visual perception, and motor coordination. The secondary outcome was cognitive function. The generalized estimating equation was used to examine differences in immediate posttest, 3-month posttest, and 6-month posttest results between the two groups. Additionally, the baseline effect sizes were compared with the effect sizes of the immediate posttest, 3-month posttest, and 6-month posttests for the experimental group.

Results

There were no statistically significant differences between the intervention and control groups. The only statistically significant difference between the groups was in the attention dimension of cognitive function (p = 0.04). The visual–motor integration results showed a small to moderate effect size for pre post comparisons.

Conclusions

The 24 sessions of interactive cognitive-motor training showed no difference to an active control intervention. In the future, this intervention could be further investigated to establish whether it can be superior to an active control group in other populations.

Trial registration

The study protocol has been published on Chinese Clinical Trial Registry (ChiCTR) (registry no.: ChiCTR-IOR-14005490).

Electronic supplementary material

The online version of this article (10.1186/s12877-019-1029-y) contains supplementary material, which is available to authorized users.