Distortions in definite distance and shape perception as measured by reaching without and with haptic feedback

Taking aim at the perceptual side of motor learning: exploring how explicit and implicit learning encode perceptual error information through depth vision

Motor learning in visuomotor adaptation tasks results from both explicit and implicit processes, each responding differently to an error signal. Although the motor output side of these processes has been extensively studied, the visual input side is relatively unknown. We investigated if and how depth perception affects the computation of error information by explicit and implicit motor learning. Two groups of participants made reaching movements to bring a virtual cursor to a target in the frontoparallel plane. The Delayed group was allowed to reaim and their feedback was delayed to emphasize explicit learning, whereas the camped group received task-irrelevant clamped cursor feedback and continued to aim straight at the target to emphasize implicit adaptation. Both groups played this game in a highly detailed virtual environment (depth condition), leveraging a cover task of playing darts in a virtual tavern, and in an empty environment (no-depth condition). The delayed group showed an increase in error sensitivity under depth relative to no-depth. In contrast, the clamped group adapted to the same degree under both conditions. The movement kinematics of the delayed participants also changed under the depth condition, consistent with the target appearing more distant, unlike the Clamped group. A comparison of the delayed behavioral data with a perceptual task from the same individuals showed that the greater reaiming in the depth condition was consistent with an increase in the scaling of the error distance and size. These findings suggest that explicit and implicit learning processes may rely on different sources of perceptual information.NEW & NOTEWORTHY We leveraged a classic sensorimotor adaptation task to perform a first systematic assessment of the role of perceptual cues in the estimation of an error signal in the 3-D space during motor learning. We crossed two conditions presenting different amounts of depth information, with two manipulations emphasizing explicit and implicit learning processes. Explicit learning responded to the visual conditions, consistent with perceptual reports, whereas implicit learning appeared to be independent of them.

Some binocular advantages for planning reach, but not grasp, components of prehension

Proficient (fast, accurate, precise) hand actions for reaching-to-grasp 3D objects are known to benefit significantly from the use of binocular vision compared to one eye alone. We examined whether these binocular advantages derive from increased reliability in encoding the goal object’s properties for feedforward planning of prehension movements or from enhanced feedback mediating their online control. Adult participants reached for, precision grasped and lifted cylindrical table-top objects (two sizes, 2 distances) using binocular vision or only their dominant/sighting eye or their non-dominant eye to program and fully execute their movements or using each of the three viewing conditions only to plan their reach-to-grasp during a 1 s preview, with vision occluded just before movement onset. Various kinematic measures of reaching and grasping proficiency, including corrective error rates, were quantified and compared by view, feedback and object type. Some significant benefits of binocular over monocular vision when they were just available for pre-movement planning were retained for the reach regardless of target distance, including higher peak velocities, straighter paths and shorter low velocity approach times, although these latter were contaminated by more velocity corrections and by poorer coordination with object contact. By contrast, virtually all binocular advantages for grasping, including improvements in peak grip aperture scaling, the accuracy and precision of digit placements at object contact and shorter grip application times preceding the lift, were eliminated with no feedback available, outcomes that were influenced by the object’s size. We argue that vergence cues can improve the reliability of binocular internal representations of object distance for the feedforward programming of hand transport, whereas the major benefits of binocular vision for enhancing grasping performance derive exclusively from its continuous presence online.

A Binocular Information Source for Size Perception

For too long, size perception research has been guided by the size distance invariance hypothesis. Although research to validate this hypothesis has been largely inconclusive, the hypothesis has endured, perhaps in part because alternative information sources for size perception were lacking. Here, I propose a binocular information source for size perception. The model, drawing on the binocular geometry of viewing a physical extent, is expressed solely in terms of four angular measures and interocular distance, with the explicit exclusion of egocentric distance information. Thus, the proposed information source, if utilized by the binocular system, should be able to augment the few existing sources of information for size perception (e.g., familiar size, texture gradient, and horizon ratio).

Haptic feedback helps bipedal coordination

The present study investigated whether special haptic or visual feedback would facilitate the coordination of in-phase, cyclical feet movements of different amplitudes. Seventeen healthy participants sat with their feet on sliding panels that were moved externally over the same or different amplitudes. The participants were asked to generate simultaneous knee flexion-extension movements, or to let their feet be dragged, resulting in reference foot displacements of 150 mm and experimental foot displacements of 150, 120, or 90 mm. Four types of feedback were given: (1) special haptic feedback, involving actively following the motions of the sliders manipulated by two confederates, (2) haptic feedback resulting from passive motion, (3) veridical visual feedback, and (4) enhanced visual feedback. Both with respect to amplitude assimilation effects, correlations and standard deviation of relative phase, the results showed that enhanced visual feedback did not facilitate bipedal independence, but haptic feedback with active movement did. Implications of the findings for movement rehabilitation contexts are discussed.

Biases in Visual, Auditory, and Audiovisual Perception of Space

Localization of objects and events in the environment is critical for survival, as many perceptual and motor tasks rely on estimation of spatial location. Therefore, it seems reasonable to assume that spatial localizations should generally be accurate. Curiously, some previous studies have reported biases in visual and auditory localizations, but these studies have used small sample sizes and the results have been mixed. Therefore, it is not clear (1) if the reported biases in localization responses are real (or due to outliers, sampling bias, or other factors), and (2) whether these putative biases reflect a bias in sensory representations of space or a priori expectations (which may be due to the experimental setup, instructions, or distribution of stimuli). Here, to address these questions, a dataset of unprecedented size (obtained from 384 observers) was analyzed to examine presence, direction, and magnitude of sensory biases, and quantitative computational modeling was used to probe the underlying mechanism(s) driving these effects. Data revealed that, on average, observers were biased towards the center when localizing visual stimuli, and biased towards the periphery when localizing auditory stimuli. Moreover, quantitative analysis using a Bayesian Causal Inference framework suggests that while pre-existing spatial biases for central locations exert some influence, biases in the sensory representations of both visual and auditory space are necessary to fully explain the behavioral data. How are these opposing visual and auditory biases reconciled in conditions in which both auditory and visual stimuli are produced by a single event? Potentially, the bias in one modality could dominate, or the biases could interact/cancel out. The data revealed that when integration occurred in these conditions, the visual bias dominated, but the magnitude of this bias was reduced compared to unisensory conditions. Therefore, multisensory integration not only improves the precision of perceptual estimates, but also the accuracy.

Lack of depth constancy for grasping movements in both virtual and real environments

Recent studies on visuomotor processes using virtual setups have suggested that actions are affected by similar biases as perceptual tasks. In particular, a strong lack of depth constancy is revealed, resembling biases in perceptual estimates of relative depth. With this study we aim to understand whether these findings are mostly caused by a lack of metric accuracy of the visuomotor system or by the limited cues provided by the use of virtual reality. We addressed this issue by comparing grasping movements towards a spherical object located at four distances (420, 450, 480, and 510 mm) performed in three conditions: 1) virtual, in which the target was a virtual object defined by binocular cues, 2) glow-in-the-dark, in which the object was painted with luminous paint but no other cue was provided, and 3) full-cue, in which the movement was performed with the lights on and all the environmental information was available. Results revealed a striking effect of object distance on grip aperture equally in all three conditions. Specifically, grip aperture gradually decreased with increase in object distance, proving a consistent lack of depth constancy. These findings clearly demonstrate that systematic biases in grasping actions are not induced by the use of virtual environments and that action and perception may involve the same visual information, which does not engage a metric reconstruction of the scene.

Calibration is both functional and anatomical

Bingham and Pagano (1998) described calibration as a mapping from embodied perceptual units to an embodied action unit and suggested that it is an inherent component of perception/action that yields accurate targeted actions. We tested two predictions of this "Mapping Theory." First, calibration should transfer between limbs, because it involves a mapping from perceptual units to an action unit, and thus is functionally specific to the action (Pan, Coats, and Bingham, 2014). We used distorted haptic feedback to calibrate feedforward right hand reaches and tested right and left hand reaches after calibration. The calibration transferred. Second, the Mapping Theory predicts that limb specific calibration should be possible because the units are embodied and anatomy contributes to their scaling. Limbs must be calibrated to one another given potential anatomical differences among limbs. We used distorted haptic feedback to calibrate feedforward reaches with right and left arms simultaneously in opposite directions relative to a visually specified target. Reaches tested after calibration revealed reliable limb specific calibration. Both predictions were confirmed. This resolves a prevailing controversy as to whether calibration is functional (Bruggeman & Warren, 2010; Rieser, Pick, Ashmead, & Garing, 1995) or anatomical (Durgin et al., 2003; Durgin & Pelah, 1999). Necessarily, it is both.

How perceived egocentric distance varies with changes in tonic vergence

According to the eye muscle potentiation (EMP) hypothesis, sustained vergence leads to changes in egocentric perceived distance. This perceptual effect has been attributed to a change in the resting or tonic state of vergence. The goal of the present study was to test the EMP hypothesis by quantifying the relationship between prism-induced changes in tonic vergence and corresponding changes in perceived distance and by measuring the dynamics of changes in perceived distance. During a 10-min exposure to 5-diopter base-out prisms that increased the vergence demand, thirteen right-handed subjects pointed to visual targets located within reaching space using their left hand, without visual feedback. Pre- and post-exposure tests assessed tonic vergence through phoria measurements and egocentric distance estimate through pointing to visual targets with each hand successively, without visual feedback. Similar distance aftereffects were observed for both hands, although only the left hand was used during exposure, indicating that these aftereffects are mediated by visual processes rather than by visuomotor interactions. The distance aftereffects were significantly correlated with prism-induced changes in phoria, demonstrating a relationship between perceived distance and the level of tonic vergence. Changes in perceived distance increased monotonically across trials during prism exposure and remained stable during the post-test, indicating a long time constant for these perceptual effects, consistent with current models of the vergence control system. Overall, these results support the hypothesis that vergence plays a role in reduced-cue distance perception. They further illustrate that variations in tonic vergence influence perceived distance by altering the sensed vergence effort.

Manual matching of perceived surface orientation is affected by arm posture: evidence of calibration between proprioception and visual experience in near space

Proprioception of hand orientation (orientation production using the hand) is compared with manual matching of visual orientation (visual surface matching using the hand) in two experiments. In experiment 1, using self-selected arm postures, the proportions of wrist and elbow flexion spontaneously used to orient the pitch of the hand (20 and 80%, respectively) are relatively similar across both manual matching tasks and manual orientation production tasks for most participants. Proprioceptive error closely matched perceptual biases previously reported for visual orientation perception, suggesting calibration of proprioception to visual biases. A minority of participants, who attempted to use primarily wrist flexion while holding the forearm horizontal, performed poorly at the manual matching task, consistent with proprioceptive error caused by biomechanical constraints of their self-selected posture. In experiment 2, postural choices were constrained to primarily wrist or elbow flexion without imposing biomechanical constraints (using a raised forearm). Identical relative offsets were found between the two constraint groups in manual matching and manual orientation production. The results support two claims: (1) manual orientation matching to visual surfaces is based on manual proprioception and (2) calibration between visual and proprioceptive experiences guarantees relatively accurate manual matching for surfaces within reach, despite systematic visual biases in perceived surface orientation.

Large perspective changes yield perception of metric shape that allows accurate feedforward reaches-to-grasp and it persists after the optic flow has stopped!

Lee et al. (Percept Psychophys 70:1032-1046, 2008a) investigated whether visual perception of metric shape could be calibrated when used to guide feedforward reaches-to-grasp. It could not. Seated participants viewed target objects (elliptical cylinders) in normal lighting using stereo vision and free head movements that allowed small (approximately 10 degrees) perspective changes. The authors concluded that poor perception of metric shape was the reason reaches-to-grasp should be visually guided online. However, Bingham and Lind (Percept Psychophys 70:524-540, 2008) showed that large perspective changes (> or =45 degrees) yield good perception of metric shape. So, now we repeated the Lee et al.'s study with the addition of information from large perspective changes. The results were accurate feedforward reaches-to-grasp reflecting accurate perception of both metric shape and metric size. Large perspective changes occur when one locomotes into a workspace in which reaches-to-grasp are subsequently performed. Does the resulting perception of metric shape persist after the large perspective changes have ceased? Experiments 2 and 3 tested reaches-to-grasp with delays (Exp. 2, 5-s delay; Exp. 3, approximately 16-s delay) and multiple objects to be grasped after a single viewing. Perception of metric shape and metric size persisted yielding accurate reaches-to-grasp. We advocate the study of nested actions using a dynamic approach to perception/action.

The various perceptions of distance: an alternative view of how effort affects distance judgments

D. R. Proffitt and colleagues (e. g., D. R. Proffitt, J. Stefanucci, T. Banton, & W. Epstein, 2003) have suggested that objects appear farther away if more effort is required to act upon them (e.g., by having to throw a ball). The authors attempted to replicate several findings supporting this view but found no effort-related effects in a variety of conditions differing in environment, type of effort, and intention to act. Although they did find an effect of effort on verbal reports when participants were instructed to take into account nonvisual (cognitive) factors, no effort-related effect was found under apparent- and objective-distance instruction types. The authors' interpretation is that in the paradigms tested, effort manipulations are prone to influencing response calibration because they encourage participants to take nonperceptual connotations of distance into account while leaving perceived distance itself unaffected. This in no way rules out the possibility that effort influences perception in other contexts, but it does focus attention on the role of response calibration in any verbal distance estimation task.

Progressive locomotor recalibration during blind walking

Blind walking has become a common measure of perceived target location. This article addresses the possibility that blind walking might vary systematically within an experimental session as participants accrue exposure to nonvisual locomotion. Such variations could complicate the interpretation of blind walking as a measure of perceived location. We measured walked distance, velocity, and pace length in indoor and outdoor environments (1.5-16.0 m target distances). Walked distance increased over 37 trials by approximately 9.33% of the target distance; velocity (and to a lesser extent, pace length) also increased, primarily in the first few trials. In addition, participants exhibited more unintentional forward drift in a blindfolded marching-in-place task after exposure to nonvisual walking. The results suggest that participants not only gain confidence as blind-walking exposure increases, but also adapt to nonvisual walking in a way that biases responses toward progressively longer walked distances.