The effect of the Müller-Lyer illusion on the planning and control of manual aiming movements

Adapting to Altered Sensory Input: Effects of Induced Paresthesia on Goal-Directed Movement Planning and Execution

The current study investigated how temporarily induced paresthesia in the moving limb affects the performance of a goal-directed target aiming task. Three-dimensional displacement data of 14 neurotypical participants were recorded while they pointed to a target on a computer monitor in four conditions: (i) paresthesia-full-vision; (ii) paresthesia-without-target vision; (iii) no-paresthesia-full-vision; (iv) no paresthesia-without-target vision. The four conditions were blocked and counterbalanced such that participants performed the paresthesia and no-paresthesia conditions on two separate days. To assess how aiming performance changed in the presence of paresthesia, we compared early versus late performance (first and last 20% of trials). We found that endpoint accuracy and movement speed were reduced in the presence of paresthesia, but only without target vision. With repetition, participants adjusted their movement performance strategy, such that with induced paresthesia, they used a movement strategy that included more pre-planned movements that depended less on online control.

Optimization in Manual Aiming: Relating Inherent Variability and Target Size, and Its Influence on Tendency

For manual aiming, the optimized submovement model predicts a tendency toward target-center of primary movement endpoints (probabilistic strategy), while the minimization model predicts target undershooting ("play-it-safe" strategy). The spatial variability of primary movement endpoints directed toward a cross-hair (400-500 ms) (Session 1) were scaled by a multiplicative factor (x1 - 4) to form circular targets of different sizes (Session 2). In recognition of both models, it was predicted that the more that inherent variability exceeded the target size, the greater the tendency to shift from target-center aiming to target undershooting. The central tendency of primary movement endpoints was not influenced by the targets, while it neared target-center. These findings concur with a probabilistic strategy, although we speculate on factors that might otherwise foster a "play-it-safe" strategy.

A review of grasping as the movements of digits in space

It is tempting to describe human reach-to-grasp movements in terms of two, more or less independent visuomotor channels, one relating hand transport to the object’s location and the other relating grip aperture to the object’s size. Our review of experimental work questions this framework for reasons that go beyond noting the dependence between the two channels. Both the lack of effect of size illusions on grip aperture and the finding that the variability in grip aperture does not depend on the object’s size indicate that size information is not used to control grip aperture. An alternative is to describe grip formation as emerging from controlling the movements of the digits in space. Each digit’s trajectory when grasping an object is remarkably similar to its trajectory when moving to tap the same position on its own. The similarity is also evident in the fast responses when the object is displaced. This review develops a new description of the speed-accuracy trade-off for multiple effectors that is applied to grasping. The most direct support for the digit-in-space framework is that prism-induced adaptation of each digit’s tapping movements transfers to that digit’s movements when grasping, leading to changes in grip aperture for adaptation in opposite directions for the two digits. We conclude that although grip aperture and hand transport are convenient variables to describe grasping, treating grasping as movements of the digits in space is a more suitable basis for understanding the neural control of grasping.

Examining the equivalence between imagery and execution - Do imagined and executed movements code relative environmental features?

Imagined actions engage some of the same neural substrates and related sensorimotor codes as executed actions. The equivalency between imagined and executed actions has been frequently demonstrated by the mental and physical chronometry of movements; namely, the imagination and execution of aiming movements in a Fitts paradigm. The present study aimed to examine the nature or extent of this equivalence, and more specifically, whether imagined movements encompass the relative environmental features as do executed movements. In two separate studies, participants completed a series of imagined or executed reciprocal aiming movements between standard control targets (no annuli), perceptually small targets (large annuli) and perceptually large targets (small annuli) (Ebbinghaus illusions). The findings of both studies replicated the standard positive relation between movement time and index of difficulty for imagined and executed movements. Furthermore, movement times were longer for targets with surrounding annuli compared to the movement times without the annuli suggesting a general interference effect. Hence, the surrounding annuli caused a longer time, independent of the illusory target size, most likely to avoid a potential collision and more precisely locate the endpoint. Most importantly, this feature could not be discriminated as a function of the task (imagined vs. executed). These findings lend support to the view of a common domain for imagined and executed actions, while elaborating on the precision of their equivalence.

Going offline: differences in the contributions of movement control processes when reaching in a typical versus novel environment

Human movements are remarkably adaptive. We are capable of completing movements in a novel visuomotor environment with similar accuracy to those performed in a typical environment. In the current study, we examined if the control processes underlying movements under typical conditions were different from those underlying novel visuomotor conditions. 16 participants were divided into two groups, one receiving continuous visual feedback during all reaches (CF), and the other receiving terminal feedback regarding movement endpoint (TF). Participants trained in a virtual environment by completing 150 reaches to three targets when (1) a cursor accurately represented their hand motion (i.e., typical environment) and (2) a cursor was rotated 45° clockwise relative to their hand motion (i.e., novel environment). Analyses of within-trial measures across 150 reaching trials revealed that participants were able to demonstrate similar movement outcomes (i.e., movement time and angular errors) regardless of visual feedback or reaching environment by the end of reach training. Furthermore, a reduction in variability across several measures (i.e., reaction time, movement time, time after peak velocity, and jerk score) over time showed that participants improved the consistency of their movements in both reaching environments. However, participants took more time and were less consistent in the timing of initiating their movements when reaching in a novel environment compared to reaching in a typical environment, even at the end of training. As well, angular error variability at different proportions of the movement trajectory was consistently greater when reaching in a novel environment across trials and within a trial. Together, the results suggest a greater contribution of offline control processes and less effective online corrective processes when reaching in a novel environment compared to when reaching in a typical environment.

Effects of wrist tendon vibration and eye movements on manual aiming

In the present study, we investigated whether visual information mediates a proprioceptive illusion effect induced by muscle tendon vibration in manual aiming. Visual information was gradually degraded from a situation in which the targets were present and participants (n = 20; 22.3 ± 2.7 years) were permitted to make saccadic eye movements to designated target positions, to a condition in which the targets were not visible and participants were required to perform cyclical aiming while fixating a point between the two target positions. Local tendon vibration applied to the right wrist extensor muscles induced an illusory reduction of 15% in hand movement amplitude. This effect was greater in the fixation than in the saccade condition. Both anticipatory control and proprioceptive feedback are proposed to contribute to the observed effects. The primary saccade amplitude was also reduced by almost 4% when muscle tendon vibration was locally applied to the wrist. These results confirm a tight link between eye movements and manual perception and action. Moreover, the impact of the proprioceptive illusion on the ocular system indicates that the interaction between systems is bidirectional.

The Impact of Strategic Trajectory Optimization on Illusory Target Biases During Goal-Directed Aiming

During rapid aiming, movements are planned and executed to avoid worst-case outcomes that require time and energy to correct. As such, downward movements initially undershoot the target to avoid corrections against gravity. Illusory target context can also impact aiming bias. Here, the authors sought to determine how strategic biases mediate illusory biases. Participants aimed to Müller-Lyer figures in different directions (forward, backward, up, down). Downward biases emerged late in the movement and illusory biases emerged from peak velocity. The illusory effects were greater for downward movements at terminal endpoint. These results indicate that strategic biases interact with the limb-target control processes associated with illusory biases. Thus, multiple control processes during rapid aiming may combine and later affect endpoint accuracy (D. Elliott et al., 2010 ).

Other ways of seeing: From behavior to neural mechanisms in the online "visual" control of action with sensory substitution

Vision is the dominant sense for perception-for-action in humans and other higher primates. Advances in sight restoration now utilize the other intact senses to provide information that is normally sensed visually through sensory substitution to replace missing visual information. Sensory substitution devices translate visual information from a sensor, such as a camera or ultrasound device, into a format that the auditory or tactile systems can detect and process, so the visually impaired can see through hearing or touch. Online control of action is essential for many daily tasks such as pointing, grasping and navigating, and adapting to a sensory substitution device successfully requires extensive learning. Here we review the research on sensory substitution for vision restoration in the context of providing the means of online control for action in the blind or blindfolded. It appears that the use of sensory substitution devices utilizes the neural visual system; this suggests the hypothesis that sensory substitution draws on the same underlying mechanisms as unimpaired visual control of action. Here we review the current state of the art for sensory substitution approaches to object recognition, localization, and navigation, and the potential these approaches have for revealing a metamodal behavioral and neural basis for the online control of action.

The violation of Fitts' Law: an examination of displacement biases and corrective submovements

Fitts' Law holds that, to maintain accuracy, movement times of aiming movements must change as a result of varying degrees of movement difficulty. Recent evidence has emerged that aiming to a target located last in an array of placeholders results in a shorter movement time than would be expected by the Fitts' equation-a violation of Fitts' Law. It has been suggested that the violation emerges because the performer adopts an optimized movement strategy in which they partially pre-plan an action to the closest placeholder (undershoot the last placeholder) and rely on a secondary acceleration to propel the limb toward the last location when it is selected as the target (Glazebrook et al. in Hum Mov Sci 39:163-176, 2015). In the current study, we examine this proposal and further elucidate the processes underlying the violation by examining limb displacement and corrective submovements that occur when performers aim to different target locations. For our Main Study, participants executed discrete aiming movements in a five-placeholder array. We also reanalyzed data from a previously reported study in which participants aimed in placeholder and no-placeholder conditions (Blinch et al. in Exp Brain Res 223:505-515, 2012). The results showed the violation of Fitts' Law unfolded following peak velocity (online control). Further, the analysis showed that movements to the last target tended to overshoot and had a higher proportion of secondary submovements featuring a reversal than other categories of submovement (secondary accelerations, discontinuities). These findings indicate that the violation of Fitts' Law may, in fact, result from a strategic bias toward planning farther initial displacements of the limb which accommodates a shorter time in online control.

Lack of motor prediction, rather than perceptual conflict, evokes an odd sensation upon stepping onto a stopped escalator

When stepping onto a stopped escalator, we often perceive an "odd sensation" that is never felt when stepping onto stairs. The sight of an escalator provides a strong contextual cue that, in expectation of the backward acceleration when stepping on, triggers an anticipatory forward postural adjustment driven by a habitual and implicit motor process. Here we contrast two theories about why this postural change leads to an odd sensation. The first theory links the odd sensation to a lack of sensorimotor prediction from all low-level implicit motor processes. The second theory links the odd sensation to the high-level conflict between the conscious awareness that the escalator is stopped and the implicit perception that evokes an endogenous motor program specific to a moving escalator. We show very similar postural changes can also arise from reflexive responses to visual stimuli, such as contracting/expanding optic flow fields, and that these reflexive responses produce similar odd sensations to the stopped escalator. We conclude that the high-level conflict is not necessary for such sensations. In contrast, the implicitly driven behavioral change itself essentially leads to the odd sensation in motor perception since the unintentional change may be less attributable to self-generated action because of a lack of motor predictions.

Does the size-illusion effect on prehensile movements depend on preview duration for visuomotor process?

Given that visual estimation of an object's size is affected by an illusory figure, the present study investigates the Ebbinghaus size-illusion effect on visuomotor performance within different preview durations for viewing an object (no preview, 300, 700, 1500, and 3000 ms) before initiating the movement. Twenty participants performed the following actions: (a) grasping the object and (b) matching the perceived object size with the finger aperture configuration as in the grasping task. The illusion affected the grasping aperture size only in the no- and 300-ms preview durations, while the matching aperture was affected across all preview conditions. These results suggest that the preview duration influences the size illusion to affect the grasping performance, and subjects adopt different visuomotor processes, depending on preview duration.

Cognition, action, and object manipulation

Although psychology is the science of mental life and behavior, little attention has been paid to the means by which mental life is translated into behavior. One domain in which links between cognition and action have been explored is the manipulation of objects. This article reviews psychological research on this topic, with special emphasis on the tendency to grasp objects differently depending on what one plans to do with the objects. Such differential grasping has been demonstrated in a wide range of object manipulation tasks, including grasping an object in a way that reveals anticipation of the object's future orientation, height, and required placement precision. Differential grasping has also been demonstrated in a wide range of behaviors, including 1-hand grasps, 2-hand grasps, walking, and transferring objects from place to place as well as from person to person. The populations in which the tendency has been shown are also diverse, including nonhuman primates as well as human adults, children, and babies. The tendency is compromised in a variety of clinical populations and in children of a surprisingly advanced age. Verbal working memory is compromised as well if words are memorized while object manipulation tasks are performed; the recency portion of the serial position curve is reduced in this circumstance. In general, the research reviewed here points to rich connections between cognition and action as revealed through the study of object manipulation. Other implications concern affordances, Donders' law, naturalistic observation, and the teaching of psychology.

The planning and control model (PCM) of motorvisual priming: reconciling motorvisual impairment and facilitation effects

Previous research on dual-tasks has shown that, under some circumstances, actions impair the perception of action-consistent stimuli, whereas, under other conditions, actions facilitate the perception of action-consistent stimuli. We propose a new model to reconcile these contrasting findings. The planning and control model (PCM) of motorvisual priming proposes that action planning binds categorical representations of action features so that their availability for perceptual processing is inhibited. Thus, the perception of categorically action-consistent stimuli is impaired during action planning. Movement control processes, on the other hand, integrate multi-sensory spatial information about the movement and, therefore, facilitate perceptual processing of spatially movement-consistent stimuli. We show that the PCM is consistent with a wider range of empirical data than previous models on motorvisual priming. Furthermore, the model yields previously untested empirical predictions. We also discuss how the PCM relates to motorvisual research paradigms other than dual-tasks.

Visual regulation of manual aiming: a comparison of methods

Visual regulation of upper limb movements occurs throughout the trajectory and is not confined to discrete control in the target area. Early control is based on the dynamic relationship between the limb, the target, and the environment. Despite robust outcome differences between protocols involving visual manipulations, it remains difficult to identify the kinematic events that characterize these differences. In this study, participants performed manual aiming movements with and without vision. We compared several traditional approaches to movement analysis with two new methods of quantifying online limb regulation. As expected, participants undershot the target and their movement endpoints were more variable when vision was not available. Although traditional measures such as reaction time, time after peak velocity, and the presence of discontinuities in acceleration were sensitive to the visual manipulation, measures quantifying the trial-to-trial spatial variability throughout the trajectory were the most effective in isolating the time course of online regulation.

Optimising speed and energy expenditure in accurate visually directed upper limb movements

Traditional models of speed-accuracy relations and limb control are steady-state models that fail to consider the learning history and strategic approach of the performer. Work from this laboratory indicates that a performer adjusts his/her behaviour from trial-to-trial to optimise not only the speed and accuracy of performance, but also energy expenditure. Because some errors have greater temporal and energy costs than others, most performers execute movements that are prepared such that potential errors are of minimal expense. The trajectories and subsequent endpoint distributions of rapid aiming movements depend on advance knowledge about the availability of afferent information for online control, as well as the costs associated with undershooting or overshooting the target position with the initial impulse. With practice, a performer is able to reduce the trial-to-trial variability associated with goal-directed movement through more consistent movement planning processes and more rapid online control. Part of the optimisation process is related to the development of an internal model of performance against which early afferent feedback can be evaluated. This framework for examining speed, accuracy and energy expenditure in goal-directed reaching can be used to help understand the breakdown of efficient limb control due to fatigue, ageing and pathology.

Online corrections can produce illusory bias during closed-loop pointing

This experiment examined whether the impact of pictorial illusions during the execution of goal-directed reaching movements is attributable to ocular motor signaling. We analyzed eye and hand movements directed toward both the vertex of the Müller-Lyer (ML) figure in a closed-loop procedure. Participants pointed to the right vertex of a visual stimulus in two conditions: a control condition wherein the figure (in-ML, neutral, out-ML) presented at response planning remained unchanged throughout the movement, and an experimental condition wherein a neutral figure presented at response planning was perturbed to an illusory figure (in-ML, out-ML) at movement onset. Consistent with previous work from our group (Heath et al. in Exp Brain Res 158:378-384, 2004; Heath et al. in J Mot Behav 37:179-185, 2005b), action-bias present in both conditions; thus illusory bias was introduced into during online control. Although primary saccades were influenced by illusory configurations (control conditions; see Binsted and Elliott in Hum Mov Sci 18:103-117, 1999a), illusory bias developed within the secondary "corrective" saccades during experimental trials (i.e., following a veridical primary saccade). These results support the position that a unitary spatial representation underlies both action and perception and this representation is common to both the manual and oculomotor systems.

The effect of the "rod-and-frame" illusion on grip planning in a sequential object manipulation task

We investigated the effect of visual context (i.e., a visual illusion) on the planning of a sequential object manipulation task. Participants (n = 13) had to grasp a rod embedded in a “rod-and-frame” illusion and insert the rod-end into a tight hole in a pre-defined way. The grip type (defined by start posture, either pronated or supinated; and end posture, either comfortable or uncomfortable) used to grasp the rod was registered as a macroscopic variable of motor planning. Different rod orientations forced the participants to switch between grip types. As expected, most participants switched between pronated and supinated start postures, such that they ended the movement with a comfortable end posture. As it has been argued that planning is dependent on visual context information, we hypothesized that the visual illusion would affect the specific rod orientation at which participants would switch into a different grip type. This hypothesis was confirmed. More specifically, the illusion affected the critical spatial information that is used for action planning. Collectively, these findings are the first to show an effect of an illusion on motor planning in a sequential object manipulation task.

The effect of response uncertainty on illusory biases of perception and action

When task requirements were known in advance, Glazebrook et al. [C.M. Glazebrook, V.P. Dhillon, K.M. Keetch, J. Lyons, E. Amazeen, D.J. Weeks, D. Elliott, Perception-action and the Müller-Lyer illusion: amplitude or endpoint bias?, Exp. Brain Res. 160 (2005) 71-78.] demonstrated that perceptual biases associated with the Müller-Lyer illusion resulted from a misperception of figure extent, while manual aiming biases resulted from a misperception of vertex position. In this study, we examined the degree to which prior knowledge of task requirements influenced how participants coded visual-spatial information associated with Müller-Lyer configurations. Specifically, we investigated how illusory biases are affected when uncertainty exists as to whether participants will be required to make a perceptual-cognitive decision about the length of a figure or complete a rapid aiming movement to a figure vertex. Although aiming movements were completed in a similar manner regardless of the prior knowledge condition, perceptual biases were associated with a misperception of extent when the task was known and a misperception of both extent and position when the task was unknown. These findings indicate that people are flexible in the manner in which they code visual-spatial information.

Visual illusions affect both movement planning and on-line control: A multiple cue position on bias and goal-directed action

Over the last decade, there has been an interest in the impact of visual illusions on the control of action. Much of this work has been motivated by Milner and Goodale's two visual system model of visual processing. This model is based on a hypothesized dissociation between cognitive judgments and the visual control of action. It holds that action is immune to the visual context that provides the basis for the illusion-induced bias associated with cognitive judgments. Recently, Glover has challenged this position and has suggested that movement planning, but not movement execution is susceptible to visual illusions. Research from our lab is inconsistent with both models of visual-motor processing. With respect to the planning and control model, kinematic evidence shows that the impact of an illusion on manual aiming increases as the limb approaches the target. For the Ebbinghaus illusion, this involved a decrease in the time after peak velocity to accommodate the 'perceived' size of the target. For the Müller-Lyer illusion, the influence of the figure's tails increased from peak velocity to the end of the movement. Although our findings contradict a strong version of the two visual systems hypothesis, we did find dissociations between perception and action in another experiment. In this Müller-Lyer study, perceptual decisions were influenced by misjudgment of extent, while action was influenced by misjudgment of target position. Overall, our findings are consistent with the idea that it is often necessary to use visual context to make adjustments to ongoing movements.