Grasping objects by their handles: a necessary interaction between cognition and action

Research has illustrated dissociations between "cognitive" and "action" systems, suggesting that different representations may underlie phenomenal experience and visuomotor behavior. However, these systems also interact. The present studies show a necessary interaction when semantic processing of an object is required for an appropriate action. Experiment 1 demonstrated that a semantic task interfered with grasping objects appropriately by their handles, but a visuospatial task did not. Experiment 2 assessed performance on a visuomotor task that had no semantic component and showed a reversal of the effects of the concurrent tasks. In Experiment 3, variations on concurrent word tasks suggested that retrieval of semantic information was necessary for appropriate grasping. In all, without semantic processing, the visuomotor system can direct the effective grasp of an object, but not in a manner that is appropriate for its use.

Hierarchical motion organization in random dot configurations

Motion organization has 2 aspects: the extraction of a (moving) frame of reference and the hierarchical organization of moving elements within the reference frame. Using a discrimination of relative motions task, the authors found large differences between different types of motion (translation, divergence, and rotation) in the degree to which each can serve as a moving frame of reference. Translation and divergence are superior to rotation. There are, however, situations in which rotation can serve as a reference frame. This is due to the presence of a second factor, structural invariants (SIs). SIs are spatial relationships persisting among the elements within a configuration such as a collinearity among points or one point coinciding with the center of rotation for another (invariant radius). The combined effect of these 2 factors--motion type and SIs-influences perceptual motion organization.

Hierarchical motion organization in random dot configurations

Motion organization has 2 aspects: the extraction of a (moving) frame of reference and the hierarchical organization of moving elements within the reference frame. Using a discrimination of relative motions task, the authors found large differences between different types of motion (translation, divergence, and rotation) in the degree to which each can serve as a moving frame of reference. Translation and divergence are superior to rotation. There are, however, situations in which rotation can serve as a reference frame. This is due to the presence of a second factor, structural invariants (SIs). SIs are spatial relationships persisting among the elements within a configuration such as a collinearity among points or one point coinciding with the center of rotation for another (invariant radius). The combined effect of these 2 factors--motion type and SIs-influences perceptual motion organization.

Eye height scaling of absolute size in immersive and nonimmersive displays

Eye-height (EH) scaling of absolute height was investigated in three experiments. In Experiment 1, standing observers viewed cubes in an immersive virtual environment. Observers' center of projection was placed at actual EH and at 0.7 times actual EH. Observers' size judgments revealed that the EH manipulation was 76.8% effective. In Experiment 2, seated observers viewed the same cubes on an interactive desktop display; however, no effect of EH was found in response to the simulated EH manipulation. Experiment 3 tested standing observers in the immersive environment with the field of view reduced to match that of the desktop. Comparable to Experiment 1, the effect of EH was 77%. These results suggest that EH scaling is not generally used when people view an interactive desktop display because the altitude of the center of projection is indeterminate. EH scaling is spontaneously evoked, however, in immersive environments.

Perception-action dissociations of a walkable Müller-Lyer configuration

These studies examined the role of spatial encoding in inducing perception-action dissociations in visual illusions. Participants were shown a large-scale Müller-Lyer configuration with hoops as its tails. In Experiment 1, participants either made verbal estimates of the extent of the Müller-Lyer shaft (verbal task) or walked the extent without vision, in an offset path (blind-walking task). For both tasks, participants stood a small distance away from the configuration, to elicit object-relative encoding of the shaft with respect to its hoops. A similar illusion bias was found in the verbal and motoric tasks. In Experiment 2, participants stood at one endpoint of the shaft in order to elicit egocentric encoding of extent. Verbal judgments continued to exhibit the illusion bias, whereas blind-walking judgments did not. These findings underscore the importance of egocentric encoding in motor tasks for producing perception-action dissociations.

Eye height scaling of absolute size in immersive and nonimmersive displays

Eye-height (EH) scaling of absolute height was investigated in three experiments. In Experiment 1, standing observers viewed cubes in an immersive virtual environment. Observers' center of projection was placed at actual EH and at 0.7 times actual EH. Observers' size judgments revealed that the EH manipulation was 76.8% effective. In Experiment 2, seated observers viewed the same cubes on an interactive desktop display; however, no effect of EH was found in response to the simulated EH manipulation. Experiment 3 tested standing observers in the immersive environment with the field of view reduced to match that of the desktop. Comparable to Experiment 1, the effect of EH was 77%. These results suggest that EH scaling is not generally used when people view an interactive desktop display because the altitude of the center of projection is indeterminate. EH scaling is spontaneously evoked, however, in immersive environments.

Updating displays after imagined object and viewer rotations

Six experiments compared spatial updating of an array after imagined rotations of the array versus viewer. Participants responded faster and made fewer errors in viewer tasks than in array tasks while positioned outside (Experiment 1) or inside (Experiment 2) the array. An apparent array advantage for updating objects rather than locations was attributable to participants imagining translations of single objects rather than rotations of the array (Experiment 3). Superior viewer performance persisted when the array was reduced to 1 object (Experiment 4); however, an object with a familiar configuration improved object performance somewhat (Experiment 5). Object performance reached near-viewer levels when rotations included haptic information for the turning object. The researchers discuss these findings in terms of the relative differences in which the human cognitive system transforms the spatial reference frames corresponding to each imagined rotation.

Seeing big things: overestimation of heights is greater for real objects than for objects in pictures

In six experiments we demonstrate that the vertical-horizontal illusion that is evoked when viewing photographs and line drawings is relatively small, whereas the magnitude of this illusion when large objects are viewed is at least twice as great. Furthermore, we show that the illusion is due more to vertical overestimation than horizontal underestimation. The lack of a difference in vertical overestimation between pictures and line drawings suggests that vertical overestimation in pictures depends solely on the perceived physical size of the projection on the picture surface, rather than on what is apparent about an object's represented size. The vertical-horizontal illusion is influenced by perceived physical size. It is greater when viewing large objects than small pictures of these same objects, even when visual angles are equated.

Updating displays after imagined object and viewer rotations

Six experiments compared spatial updating of an array after imagined rotations of the array versus viewer. Participants responded faster and made fewer errors in viewer tasks than in array tasks while positioned outside (Experiment 1) or inside (Experiment 2) the array. An apparent array advantage for updating objects rather than locations was attributable to participants imagining translations of single objects rather than rotations of the array (Experiment 3). Superior viewer performance persisted when the array was reduced to 1 object (Experiment 4); however, an object with a familiar configuration improved object performance somewhat (Experiment 5). Object performance reached near-viewer levels when rotations included haptic information for the turning object. The researchers discuss these findings in terms of the relative differences in which the human cognitive system transforms the spatial reference frames corresponding to each imagined rotation.

Visual-motor recalibration in geographical slant perception

In 4 experiments, it was shown that hills appear steeper to people who are encumbered by wearing a heavy backpack (Experiment 1), are fatigued (Experiment 2), are of low physical fitness (Experiment 3), or are elderly and/or in declining health (Experiment 4). Visually guided actions are unaffected by these manipulations of physiological potential. Although dissociable, the awareness and action systems were also shown to be interconnected. Recalibration of the transformation relating awareness and actions was found to occur over long-term changes in physiological potential (fitness level, age, and health) but not with transitory changes (fatigue and load). Findings are discussed in terms of a time-dependent coordination between the separate systems that control explicit visual awareness and visually guided action.

The influence of spatial reference frames on imagined object- and viewer rotations

The human visual system can represent an object's spatial structure with respect to multiple frames of reference. It can also utilize multiple reference frames to mentally transform such representations. Recent studies have shown that performance on some mental transformations is not equivalent: Imagined object rotations tend to be more difficult than imagined viewer rotations. We reviewed several related research domains to understand this discrepancy in terms of the different reference frames associated with each imagined movement. An examination of the mental rotation literature revealed that observers' difficulties in predicting an object's rotational outcome may stem from a general deficit with imagining the cohesive rotation of the object's intrinsic frame. Such judgments are thus more reliant on supplementary information provided by other frames, such as the environmental frame. In contrast, as assessed in motor imagery and other studies, imagined rotations of the viewer's relative frame are performed cohesively and are thus mostly immune to effects of other frames.

Visual-motor recalibration in geographical slant perception

In 4 experiments, it was shown that hills appear steeper to people who are encumbered by wearing a heavy backpack (Experiment 1), are fatigued (Experiment 2), are of low physical fitness (Experiment 3), or are elderly and/or in declining health (Experiment 4). Visually guided actions are unaffected by these manipulations of physiological potential. Although dissociable, the awareness and action systems were also shown to be interconnected. Recalibration of the transformation relating awareness and actions was found to occur over long-term changes in physiological potential (fitness level, age, and health) but not with transitory changes (fatigue and load). Findings are discussed in terms of a time-dependent coordination between the separate systems that control explicit visual awareness and visually guided action.

Relative size perception at a distance is best at eye level

Relative size judgments were collected for two objects at 30.5 m and 23.8 from the observer in order to assess how performance depends on the relationship between the size of the objects and the eye level of the observer. In three experiments in an indoor hallway and in one experiment outdoors, accuracy was higher for objects in the neighborhood of eye level. We consider these results in the light of two hypotheses. One proposes that observers localize the horizon as a reference for judging relative size, and the other proposes that observers perceive the general neighborhood of the horizon and then employ a height-in-visual-field heuristic. The finding that relative size judgments are best around the horizon implies that information that is independent of distance perception is used in perceiving size.

Two memories for geographical slant: separation and interdependence of action and awareness

The present study extended previous findings of geographical slant perception, in which verbal judgments of the incline of hills were greatly overestimated but motoric (haptic) adjustments were much more accurate. In judging slant from memory following a brief or extended time delay, subjects' verbal judgments were greater than those given when viewing hills. Motoric estimates differed depending on the length of the delay and place of response. With a short delay, motoric adjustments made in the proximity of the hill did not differ from those evoked during perception. When given a longer delay or when taken away from the hill, subjects' motoric responses increased along with the increase in verbal reports. These results suggest two different memorial influences on action. With a short delay at the hill, memory for visual guidance is separate from the explicit memory informing the conscious response. With short or long delays away from the hill, short-term visual guidance memory no longer persists, and both motor and verbal responses are driven by an explicit representation. These results support recent research involving visual guidance from memory, where actions become influenced by conscious awareness, and provide evidence for communication between the "what" and "how" visual processing systems.

Relative Size Perception at a Distance is Best at Eye Level

We studied the role of the horizon line as a source of information about the relative size of objects at a distance. Relative-size judgements (2AFC) were collected for two objects at 30.5 m and 23.8 m away from the observer to assess how performance depends on the relationship between the size of the objects and the eye level of the observer. In three experiments in an indoor hallway and in one experiment outdoors, accuracy was higher for objects in the neighbourhood of eye level. We consider these results in the light of two hypotheses: one which proposes that observers localise the horizon as a reference for judging relative size, ie on the basis of the horizon ratio, and another which proposes that observers perceive the general neighbourhood of the horizon and then employ a height-in-visual-field heuristic. The finding that relative-size judgements are best around the horizon implies the use of information independent of distance perception in perceiving size.

Misperceptions of angular velocities influence the perception of rigidity in the kinetic depth effect

Accuracy in discriminating rigid from nonrigid motion was investigated for orthographic projections of three-dimension rotating objects. In 3 experiments the hypothesis that magnitudes of angular velocity are misperceived in the kinetic depth effect was tested, and in 4 other experiments the hypothesis that misperceiving angular velocities leads to misperceiving rigidity was tested. The principal findings were (a) the magnitude of perceived angular velocity is derived heuristically as a function of a property of the first-order optic flow called deformation and (b) perceptual performance in discriminating rigid from nonrigid motion is accurate in cases when the variability of the deformations of the individual triplets of points of the stimulus displays favors this interpretation and not accurate in other cases.

Misperceptions of angular velocities influence the perception of rigidity in the kinetic depth effect

Accuracy in discriminating rigid from nonrigid motion was investigated for orthographic projections of three-dimension rotating objects. In 3 experiments the hypothesis that magnitudes of angular velocity are misperceived in the kinetic depth effect was tested, and in 4 other experiments the hypothesis that misperceiving angular velocities leads to misperceiving rigidity was tested. The principal findings were (a) the magnitude of perceived angular velocity is derived heuristically as a function of a property of the first-order optic flow called deformation and (b) perceptual performance in discriminating rigid from nonrigid motion is accurate in cases when the variability of the deformations of the individual triplets of points of the stimulus displays favors this interpretation and not accurate in other cases.

Semantic versus perceptual influences of color in object recognition

The influence of color as a surface feature versus its influence as stored knowledge in object recognition was assessed. Participants decided whether a briefly presented and masked picture matched a test name. For pictures and words referring to similarly shaped objects, semantic color similarity (SCS) was present when picture and word shared the same prototypical color (e.g., purple apple followed by cherry). Perceptual color similarity (PCS) was present when the surface color of the picture matched the prototypical color of the named object (e.g., purple apple followed by blueberry). Response interference was primarily due to SCS, despite the fact that participants based similarity ratings on PCS. When uncolored objects were used, SCS interference still occurred, implying that the influence of SCS did not depend on the presence of surface color. The results indicate that, relative to surface color, stored color knowledge was more influential in object recognition.

Hierarchical Motion Organization in Random-Dot Configurations

Motion fields differ in the degree to which they can serve as hierarchical frames of reference. To assess the strength of hierarchical motion organisation, we measured the ability of human observers to extract the motion of a target dot relative to a background of moving dots. The task was to discriminate circular from elliptical relative motions for the target dot (2AFC). Observers performed above chance for translational and divergence backgrounds, but were at chance level for rotational backgrounds. This finding, however, was based on random configurations of dots, where locations and trajectories were unrelated. When spatial constraints were introduced, observers used a different strategy and performed above chance also for rotational backgrounds. Both the effect of motion transformations and the effect of spatial information can be understood if we assume that the task is to find the most likely mechanical description of an object in a three-dimensional environment.

Semantic versus perceptual influences of color in object recognition

The influence of color as a surface feature versus its influence as stored knowledge in object recognition was assessed. Participants decided whether a briefly presented and masked picture matched a test name. For pictures and words referring to similarly shaped objects, semantic color similarity (SCS) was present when picture and word shared the same prototypical color (e.g., purple apple followed by cherry). Perceptual color similarity (PCS) was present when the surface color of the picture matched the prototypical color of the named object (e.g., purple apple followed by blueberry). Response interference was primarily due to SCS, despite the fact that participants based similarity ratings on PCS. When uncolored objects were used, SCS interference still occurred, implying that the influence of SCS did not depend on the presence of surface color. The results indicate that, relative to surface color, stored color knowledge was more influential in object recognition.

Visual learning in the perception of texture: simple and contingent aftereffects of texture density

Novel results elucidating the magnitude, binocularity and retinotopicity of aftereffects of visual texture density adaptation are reported as is a new contingent aftereffect of texture density which suggests that the perception of visual texture density is quite malleable. Texture aftereffects contingent upon orientation, color and temporal sequence are discussed. A fourth effect is demonstrated in which auditory contingencies are shown to produce a different kind of visual distortion. The merits and limitations of error-correction and classical conditioning theories of contingent adaptation are reviewed. It is argued that a third kind of theory which emphasizes coding efficiency and informational considerations merits close attention. It is proposed that malleability in the registration of texture information can be understood as part of the functional adaptability of perception.

Rotational and translational components of motion parallax: observers' sensitivity and implications for three-dimensional computer graphics

The motion of objects during motion parallax can be decomposed into 2 observer-relative components: translation and rotation. The depth ratio of objects in the visual field is specified by the inverse ratio of their angular displacement (from translation) or equivalently by the inverse ratio of their rotations. Despite the equal mathematical status of these 2 information sources, it was predicted that observers would be far more sensitive to the translational than rotational component. Such a differential sensitivity is implicitly assumed by the computer graphics technique billboarding, in which 3-dimensional (3-D) objects are drawn as planar forms (i.e., billboards) maintained normal to the line of sight. In 3 experiments, observers were found to be consistently less sensitive to rotational anomalies. The implications of these findings for kinetic depth effect displays and billboarding techniques are discussed.

Comparing depth from motion with depth from binocular disparity

The accuracy of depth judgments that are based on binocular disparity or structure from motion (motion parallax and object rotation) was studied in 3 experiments. In Experiment 1, depth judgments were recorded for computer simulations of cones specified by binocular disparity, motion parallax, or stereokinesis. In Experiment 2, judgments were recorded for real cones in a structured environment, with depth information from binocular disparity, motion parallax, or object rotation about the y-axis. In both of these experiments, judgments from binocular disparity information were quite accurate, but judgments on the basis of geometrically equivalent or more robust motion information reflected poor recovery of quantitative depth information. A 3rd experiment demonstrated stereoscopic depth constancy for distances of 1 to 3 m using real objects in a well-illuminated, structured viewing environment in which monocular depth cues (e.g., shading) were minimized.

Heuristic judgment of mass ratio in two-body collisions

The logic of judging relative mass from a two-body collision is developed from data presented by Runeson and Vedeler (1993). Data from two experiments are analyzed on a point-by-point basis, and strong support for the theory that mass-ratio judgments are mediated by separate speed and angle heuristics is shown. This analysis is accomplished by reducing the collision event to two elementary features: the presence of ricochet and the ratio of exit speeds. The heuristics that both ricochet and greater exit speed specify relative lightness are shown to explain the basic patterns of data presented by Runeson and Vedeler.