Depth perception as a function of motion parallax and absolute-distance information

Monocular information for perceiving large egocentric distance: A comparison between monocularly blind patients and normally sighted observers

The debate surrounding the advantages of binocular versus monocular vision has persisted for decades. This study aimed to investigate whether individuals with monocular vision loss could accurately and precisely perceive large egocentric distances in real-world environments, under natural viewing conditions, comparable to those with normal vision. A total of 49 participants took part in the study, divided into three groups based on their viewing conditions. Two experiments were conducted to assess the accuracy and precision of estimating egocentric distances to visual targets and the coordination of actions during blind walking. In Experiment 1, participants were positioned in both a hallway and a large open field, tasked with judging the midpoint of self-to-target distances spanning from 5 to 30 m. Experiment 2 involved a blind walking task, where participants attempted to walk towards the same targets without visual or environmental feedback at an unusually rapid pace. The findings revealed that perceptual accuracy and precision were primarily influenced by the environmental context, motion condition, and target distance, rather than the visual conditions. Surprisingly, individuals with monocular vision loss demonstrated comparable accuracy and precision in perceiving egocentric distances to that of individuals with normal vision.

Scene-relative object motion biases depth percepts

An important function of the visual system is to represent 3D scene structure from a sequence of 2D images projected onto the retinae. During observer translation, the relative image motion of stationary objects at different distances (motion parallax) provides potent depth information. However, if an object moves relative to the scene, this complicates the computation of depth from motion parallax since there will be an additional component of image motion related to scene-relative object motion. To correctly compute depth from motion parallax, only the component of image motion caused by self-motion should be used by the brain. Previous experimental and theoretical work on perception of depth from motion parallax has assumed that objects are stationary in the world. Thus, it is unknown whether perceived depth based on motion parallax is biased by object motion relative to the scene. Naïve human subjects viewed a virtual 3D scene consisting of a ground plane and stationary background objects, while lateral self-motion was simulated by optic flow. A target object could be either stationary or moving laterally at different velocities, and subjects were asked to judge the depth of the object relative to the plane of fixation. Subjects showed a far bias when object and observer moved in the same direction, and a near bias when object and observer moved in opposite directions. This pattern of biases is expected if subjects confound image motion due to self-motion with that due to scene-relative object motion. These biases were large when the object was viewed monocularly, and were greatly reduced, but not eliminated, when binocular disparity cues were provided. Our findings establish that scene-relative object motion can confound perceptual judgements of depth during self-motion.

Optic Flow: Perceiving and Acting in a 3-D World

In 1979, James Gibson completed his third and final book "The Ecological Approach to Visual Perception". That book can be seen as the synthesis of the many radical ideas he proposed over the previous 30 years - the concept of information and its sufficiency, the necessary link between perception and action, the need to see perception in relation to an animal's particular ecological niche and the meanings (affordances) offered by the visual world. One of the fundamental concepts that lies beyond all of Gibson's thinking is that of optic flow: the constantly changing patterns of light that reach our eyes and the information it provides. My purpose in writing this paper has been to evaluate the legacy of Gibson's conceptual ideas and to consider how his ideas have influenced and changed the way we study perception.

Gradients Account for the Thresholds for Perceiving Motion and Depth in Observer-Produced Parallax Displays

We examined whether the thresholds of motion and depth perception produced by motion parallax could be specified by the concept of a disparity gradient. We manipulated both the motion parallax amplitude and the angular separation of two dots and calculated the percentages of trials in which participants perceived motion or depth. The results showed that the amplitude of motion parallax for the threshold increased as the separation became larger with the gradients of 0.023, 0.072, and 0.430 for the lower depth, the lower motion, and the upper depth thresholds, respectively. These findings indicate that the gradient is a useful concept to specify the motion and depth thresholds together rather than parallax amplitude alone.

The neural basis of depth perception from motion parallax

In addition to depth cues afforded by binocular vision, the brain processes relative motion signals to perceive depth. When an observer translates relative to their visual environment, the relative motion of objects at different distances (motion parallax) provides a powerful cue to three-dimensional scene structure. Although perception of depth based on motion parallax has been studied extensively in humans, relatively little is known regarding the neural basis of this visual capability. We review recent advances in elucidating the neural mechanisms for representing depth-sign (near versus far) from motion parallax. We examine a potential neural substrate in the middle temporal visual area for depth perception based on motion parallax, and we explore the nature of the signals that provide critical inputs for disambiguating depth-sign.This article is part of the themed issue 'Vision in our three-dimensional world'.

A Pursuit Theory Account for the Perception of Common Motion in Motion Parallax

The visual system uses an extraretinal pursuit eye movement signal to disambiguate the perception of depth from motion parallax. Visual motion in the same direction as the pursuit is perceived nearer in depth while visual motion in the opposite direction as pursuit is perceived farther in depth. This explanation of depth sign applies to either an allocentric frame of reference centered on the fixation point or an egocentric frame of reference centered on the observer. A related problem is that of depth order when two stimuli have a common direction of motion. The first psychophysical study determined whether perception of egocentric depth order is adequately explained by a model employing an allocentric framework, especially when the motion parallax stimuli have common rather than divergent motion. A second study determined whether a reversal in perceived depth order, produced by a reduction in pursuit velocity, is also explained by this model employing this allocentric framework. The results show than an allocentric model can explain both the egocentric perception of depth order with common motion and the perceptual depth order reversal created by a reduction in pursuit velocity. We conclude that an egocentric model is not the only explanation for perceived depth order in these common motion conditions.

Additivity of Retinal and Pursuit Velocity in the Perceptions of Depth and Rigidity from Object-Produced Motion Parallax

Two psychophysical experiments were conducted to investigate the mechanism that generates stable depth structure from retinal motion combined with extraretinal signals from pursuit eye movements. Stimuli consisted of random dots that moved horizontally in one direction (ie stimuli had common motion on the retina), but at different speeds between adjacent rows. The stimuli were presented with different speeds of pursuit eye movements whose direction was opposite to that of the common retinal motion. Experiment 1 showed that the rows moving faster on the retina appeared closer when viewed without eye movements; however, they appeared farther when pursuit speed exceeded the speed of common retinal motion. The ‘transition’ speed of the pursuit eye movement was slightly, but consistently, larger than the speed of common retinal motion. Experiment 2 showed that parallax thresholds for perceiving relative motion between adjacent rows were minimum at the transition speed found in experiment 1. These results suggest that the visual system calculates head-centric velocity, by adding retinal velocity and pursuit velocity, to obtain a stable depth structure.

Motion Parallax Driven by Head Movements: Conditions for Visual Stability, Perceived Depth, and Perceived Concomitant Motion

Yoking the movement of the stimulus on the screen to the movement of the head, we examined visual stability and depth perception as a function of head-movement velocity and parallax. In experiment 1, for different head velocities, observers adjusted the parallax to find (a) the depth threshold and (b) the concomitant-motion threshold. Between these thresholds, depth was seen with no perceived motion. In experiment 2, for different head velocities, observers adjusted the parallax to produce the same perceived depth. A slower head movement required a greater parallax to produce the same perceived depth as faster head movements. In experiment 3, observers reported the perceived depth for different parallax magnitudes. Perceived depth covaried with smaller parallax without motion perception, but began to decrease with larger parallax and concomitant motion was seen. Only motion was seen with the larger parallax.

Effect of Display Technology on Perceived Scale of Space

OBJECTIVE

Our goal was to evaluate the degree to which display technologies influence the perception of size in an image.

BACKGROUND

Research suggests that factors such as whether an image is displayed stereoscopically, whether a user's viewpoint is tracked, and the field of view of a given display can affect users' perception of scale in the displayed image.

METHOD

Participants directly estimated the size of a gap by matching the distance between their hands to the gap width and judged their ability to pass unimpeded through the gap in one of five common implementations of three display technologies (two head-mounted displays [HMD] and a back-projection screen).

RESULTS

Both measures of gap width were similar for the two HMD conditions and the back projection with stereo and tracking. For the displays without tracking, stereo and monocular conditions differed from each other, with monocular viewing showing underestimation of size.

CONCLUSIONS

Display technologies that are capable of stereoscopic display and tracking of the user's viewpoint are beneficial as perceived size does not differ from real-world estimates. Evaluations of different display technologies are necessary as display conditions vary and the availability of different display technologies continues to grow.

APPLICATIONS

The findings are important to those using display technologies for research, commercial, and training purposes when it is important for the displayed image to be perceived at an intended scale.

Cognitive functions and stereopsis in patients with Parkinson's disease and Alzheimer's disease using 3-dimensional television: a case controlled trial

Stereopsis or depth perception is an awareness of the distances of objects from the observer, and binocular disparity is a necessary component of recognizing objects through stereopsis. In the past studies, patients with neurodegenerative disease (Alzheimer dementia, AD; Parkinson’s disease IPD) have problems of stereopsis but they did not have actual stimulation of stereopsis. Therefore in this study, we used a 3-dimensional (3D) movie on 3D television (TV) for actual stereopsis stimulation. We propose research through analyzing differences between the three groups (AD, IPD, and Controls), and identified relations between the results from the Titmus Stereo Fly Test, and the 3D TV test. The study also looked into factors that affect the 3D TV test. Before allowing the patients to watch TV, we examined Titmus stereo Fly Test and cognitive test. We used the 3D version of a movie, of 17 minutes 1 second duration, and carried out a questionnaire about stereopsis. The scores of the stereopsis questionnaire were decreased in AD patients, compared with in IPD and controls, although they did not have any difference of Titmus Stereo Fly Test scores. In IPD patients, cognitive function (Montreal cognitive assessment, MoCA) scores were correlated with the scores of the stereopsis questionnaire. We could conclude that Titmus fly test could not distinguish between the three groups and cognitive dysfunction contributes to actual stereopsis perception in IPD patients. Therefore the 3D TV test of AD and IPD patients was more effective than Titmus fly test.

Modeling depth from motion parallax with the motion/pursuit ratio

The perception of unambiguous scaled depth from motion parallax relies on both retinal image motion and an extra-retinal pursuit eye movement signal. The motion/pursuit ratio represents a dynamic geometric model linking these two proximal cues to the ratio of depth to viewing distance. An important step in understanding the visual mechanisms serving the perception of depth from motion parallax is to determine the relationship between these stimulus parameters and empirically determined perceived depth magnitude. Observers compared perceived depth magnitude of dynamic motion parallax stimuli to static binocular disparity comparison stimuli at three different viewing distances, in both head-moving and head-stationary conditions. A stereo-viewing system provided ocular separation for stereo stimuli and monocular viewing of parallax stimuli. For each motion parallax stimulus, a point of subjective equality (PSE) was estimated for the amount of binocular disparity that generates the equivalent magnitude of perceived depth from motion parallax. Similar to previous results, perceived depth from motion parallax had significant foreshortening. Head-moving conditions produced even greater foreshortening due to the differences in the compensatory eye movement signal. An empirical version of the motion/pursuit law, termed the empirical motion/pursuit ratio, which models perceived depth magnitude from these stimulus parameters, is proposed.

Perceptual scaling of visual and inertial cues: effects of field of view, image size, depth cues, and degree of freedom

In the field of motion-based simulation, it was found that a visual amplitude equal to the inertial amplitude does not always provide the best perceived match between visual and inertial motion. This result is thought to be caused by the "quality" of the motion cues delivered by the simulator motion and visual systems. This paper studies how different visual characteristics, like field of view (FoV) and size and depth cues, influence the scaling between visual and inertial motion in a simulation environment. Subjects were exposed to simulator visuals with different fields of view and different visual scenes and were asked to vary the visual amplitude until it matched the perceived inertial amplitude. This was done for motion profiles in surge, sway, and yaw. Results showed that the subjective visual amplitude was significantly affected by the FoV, visual scene, and degree-of-freedom. When the FoV and visual scene were closer to what one expects in the real world, the scaling between the visual and inertial cues was closer to one. For yaw motion, the subjective visual amplitudes were approximately the same as the real inertial amplitudes, whereas for sway and especially surge, the subjective visual amplitudes were higher than the inertial amplitudes. This study demonstrated that visual characteristics affect the scaling between visual and inertial motion which leads to the hypothesis that this scaling may be a good metric to quantify the effect of different visual properties in motion-based simulation.

Replicating and extending Bourdon's (1902) experiment on motion parallax

Bourdon conducted the first laboratory experiment on observer-produced motion parallax as a cue to depth. In three experiments, we replicated and extended Bourdon's experiment. In experiment 1, we reproduced his finding: when the two cues, motion parallax and relative height, were combined, accuracy of depth perception was high, and when the two cues were in conflict, accuracy was lower. In experiment 2, the relative height cue was replaced with relative retinal image size. As in experiment 1, when the two cues (motion parallax and relative retinal image size) were combined, accuracy was high, but when they were in conflict, it was lower. In experiment 3, the stimuli from experiments 1 and 2 were viewed monocularly with head movement and binocularly without head movement. In the binocular conditions, accuracy, certainty, and the extent of perceived depth were higher than in the monocular condition. In the conflict conditions, accuracy, certainty, and the extent of perceived depth were lower than in the no-conflict condition, but the extent of perceived motion was larger. These results are discussed in terms of recent findings about the effectiveness of motion parallax as a cue for depth.

Depth interval estimates from motion parallax and binocular disparity beyond interaction space

Static and dynamic observers provided binocular and monocular estimates of the depths between real objects lying well beyond interaction space. On each trial, pairs of LEDs were presented inside a dark railway tunnel. The nearest LED was always 40 m from the observer, with the depth separation between LED pairs ranging from 0 up to 248 m. Dynamic binocular viewing was found to produce the greatest (ie most veridical) estimates of depth magnitude, followed next by static binocular viewing, and then by dynamic monocular viewing. (No significant depth was seen with static monocular viewing.) We found evidence that both binocular and monocular dynamic estimates of depth were scaled for the observation distance when the ground plane and walls of the tunnel were visible up to the nearest LED. We conclude that both motion parallax and stereopsis provide useful long-distance depth information and that motion-parallax information can enhance the degree of stereoscopic depth seen.

Action-dependent perceptual invariants: from ecological to sensorimotor approaches

Ecological and sensorimotor theories of perception build on the notion of action-dependent invariants as the basic structures underlying perceptual capacities. In this paper we contrast the assumptions these theories make on the nature of perceptual information modulated by action. By focusing on the question, how movement specifies perceptual information, we show that ecological and sensorimotor theories endorse substantially different views about the role of action in perception. In particular we argue that ecological invariants are characterized with reference to transformations produced in the sensory array by movement: such invariants are transformation-specific but do not imply motor-specificity. In contrast, sensorimotor theories assume that perceptual invariants are intrinsically tied to specific movements. We show that this difference leads to different empirical predictions and we submit that the distinction between motor equivalence and motor-specificity needs further clarification in order to provide a more constrained account of action/perception relations.

Aging and the perception of depth and 3-D shape from motion parallax

The ability of younger and older observers to perceive 3-D shape and depth from motion parallax was investigated. In Experiment 1, the observers discriminated among differently curved 3-dimensional (3-D) surfaces in the presence of noise. In Experiment 2, the surfaces' shape was held constant and the amount of front-to-back depth was varied; the observers estimated the amount of depth they perceived. The effects of age were strongly task dependent. The younger observers' performance in Experiment 1 was almost 60% higher than that of the older observers. In contrast, no age effect was obtained in Experiment 2. Older observers can effectively perceive variations in depth from patterns of motion parallax, but their ability to discriminate 3-D shape is significantly compromised.

Relative distance cues contribute to scaling depth from motion parallax

The visual system scales motion parallax signals with information about absolute distance (M. E. Ono, Rivest, & H. Ono, 1986). The present study was designed to determine whether relative distance cues, which intrinsically provide information about relative distance, contribute to this scaling. In two experiments, two test stimuli, containing an equal extent of motion parallax, were presented simultaneously at a fixed viewing distance. The relative distance cues of dynamic occlusion and motion parallax in the areas surrounding the test stimuli (background motion parallax) and/or relative size were manipulated. The observers reported which of the two parallactic test stimuli appeared to have greater depth, and which appeared to be more distant. The results showed that the test stimulus specified, by the relative distance cues, as being more distant was perceived as having more depth and as being more distant. This indicates that relative distance cues contribute to scaling depth from motion parallax by modifying the information about the absolute distance of objects.

Surface discontinuity is critical in a moving observer's perception of objects' depth order and relative motion from retinal image motion

The visual system perceptually decomposes retinal image motion into three basic components that are ecologically significant for the human observer: object depth, object motion, and self motion. Using this conceptual framework, we explored the relationship between them by examining perception of objects' depth order and relative motion during self motion. We found that the visual system obeyed what we call the parallax-sign constraint, but in different ways depending on whether the retinal image motion contained velocity discontinuity or not. When velocity discontinuity existed (e.g. in dynamic occlusion, transparent motion), the subject perceptually interpreted image motion as relative motion between surfaces with stable depth order. When velocity discontinuity did not exist, he/she perceived depth-order reversal but no relative motion. The results suggest that the existence of surface discontinuity or of multiple surfaces indexed by velocity discontinuity inhibits the reversal of global depth order.

Apparent depth with retinal image motion of expansion and contraction yoked to head movement

The two main questions addressed in this study were (a) what effect does yoking the relative expansion and contraction (EC) of retinal images to forward and backward head movements have on the resultant magnitude and stability of perceived depth, and (b) how does this relative EC image motion interact with the depth cues of motion parallax? Relative EC image motion was produced by moving a small CCD camera toward and away from the stimulus, two random-dot surfaces separated in depth, in synchrony with the observers' forward and backward head movements. Observers viewed the stimuli monocularly, on a helmet-mounted display, while moving their heads at various velocities, including zero velocity. The results showed that (a) the magnitude of perceived depth was smaller with smaller head velocities (< 10 cm s-1), including the zero-head-velocity condition, than with a larger velocity (10 cm s-1), and (b) perceived depth, when motion parallax and the EC image motion cues were simultaneously presented, is equal to the greater of the two possible perceived depths produced from either of these two cues alone. The results suggested the role of nonvisual information of self-motion on perceiving depth.

An analysis of perceptions from changes in optical size

The allocation of perceived size and perceived motion or displacement in depth resulting from retinal size changes (changes in the visual angle of the stimulus) was investigated in situations in which all other cues of perceived changes in distance were absent. The allocation process was represented by the size-distance invariance hypothesis (SDIH), in which, for a given change in visual angle, the perceived depth was determined only by the amount of size constancy available. The changes in perceived size and perceived distance (perceived depth) were measured by kinesthetic observer (open-loop) adjustments in five situations. These situations consisted of optical expansions or contractions presented successively or simultaneously or as a mixture of successive and simultaneous presentations. The amounts of perceived motion or perceived displacement in depth obtained by kinesthetic measures were compared with those obtained from size constancy measures as applied to the SDIH. This latter measure accounted for more of the perceived depth obtained from simultaneous and mixed situations than it did for the perceived depth from the successive situations and more for the perceived depth obtained from the expansion than from the contraction situations, whether these were simultaneous or mixed. Perceived rigidity of the stimulus (perfect size constancy) clearly was not obtained in any of the situations. Significant partial size constancy and some predictive ability of the perceived sagittal motion was found using the SDIH in all the situations except in the successively presented contraction situation, with the predictive ability from the SDIH increasing with increases in the amount of size constancy. The difference between the observer's measures of the perceived motion or displacement in depth and the amount of perceived motion or displacement predicted from the perceptions of linear size using the SDIH is asserted to be due to a cognitive process associated with the perception of the different stimulus sizes as off-sized objects.

Measures of perceived linear size, sagittal motion, and visual angle from optical expansions and contractions

Using monocular observation, open-loop measurements were obtained of the perceptions of linear size, angular size, and sagittal motion associated with the terminal (largest or smallest) stimuli of repetitive optical expansions and contractions using 1-D or 2-D displays produced on a video monitor at a constant distance from the observer. The perceptions from these dynamic conditions were compared with those from static conditions in which the stimuli were of the same physical size and at the same physical distance as the terminal dynamic stimuli, but that were not part of the optical expansions or contractions. One result, as expected, was that the measures of perceived linear and angular size differed, but also, unexpectedly, some substantial errors were associated with the measures of perceived angular size. Another result was that the amount of size constancy was considerably less than was expected from the obtained amount of perceived motion in depth. Consistent with the latter result, it was found that the size-distance invariance hypothesis (SDIH), using the physical visual angles of the terminal stimuli, predicted only about half of the perceived motion in depth obtained with the dynamic changes. Using the obtained measures of perceived visual angles in the SDIH increased rather than decreased the error in predicting the amount of motion in depth as perceived. An additional experiment suggests that at least some of the error in the measurement of the perceived visual angle is a consequence of error in the perceived origin of the visual angles. The absence of the expected relation between size constancy and perceived motion in depth in the dynamic conditions is hypothesized to be due to cognitive processes associated with off-sized perceptions of the stimuli.

The efficient range of velocities for inducing depth perception by motion parallax

The range of velocities over which depth perception can be simulated by motion parallax, was studied experimentally. Perception of apparent depth was induced using method of simulated motion parallax. In the condition of ‘observer parallax,’ the range of angular velocity over which apparent depth accompanied by motion was perceived was 0.0048 to 0.048 rad/sec., while velocities for which robust perception of apparent depth was obtained were restricted to the range 0.0010 to 0.0024 rad/sec., and no perceived reversals of depth occurred over this range. No distinct range for robust perception of apparent depth could be found in the condition of ‘stimulus parallax.’ In the case of velocity ratios of 1:1.1 and 1:1.3, the velocity that produced the most robust perception of apparent depth was 0.0024 rad/sec., and inhibition of perceived depth reversals occurred at 0.0010 rad/sec. Under conditions of opposing relative motion, the velocity range over which robust perception of apparent depth was observed was 0.0005 to 0.0010 rad/sec., slightly lower than when both motions were in the same direction.

Remote operation: a selective review of research into visual depth perception

Some perceptual motor operations are performed remotely; examples include the handling of life-threatening materials and surgical procedures. A camera conveys the site of operation to a TV monitor, so depth perception relies mainly on pictorial information, perhaps with enhancement of the occlusion cue by motion. However, motion information such as motion parallax is not likely to be important. The effectiveness of pictorial information is diminished by monocular and binocular information conveying flatness of the screen and by difficulties in scaling: Only a degree of relative depth can be conveyed. Furthermore, pictorial information can mislead. Depth perception is probably adequate in remote operation, if target objects are well separated, with well-defined edges and familiar shapes. Stereoscopic viewing systems are being developed to introduce binocular information to remote operation. However, stereoscopic viewing is problematic because binocular disparity conflicts with convergence and monocular information. An alternative strategy to improve precision in remote operation may be to rely on individuals who lack binocular function: There is redundancy in depth information, and such individuals seem to compensate for the lack of binocular function.

Perceiving the orientation-in-depth of triangular surfaces: static-monocular, moving-monocular, and static-binocular viewing

Although data from simulations suggest that motion information and binocular information each elicit veridical depth perception, data from real stimuli, such as trapezoidal surfaces, are equivocal; the discrepancy might be explained by the complexity of nonveridical pictorial information in the latter. In the present study, observers judged the orientations-in-depth of triangular surfaces about a vertical axis: Pictorial information resided only in the visual lengths of surfaces, so it was predicted that motion and binocularity would be fully effective. Viewing conditions were static-monocular (SM), moving-monocular (MM), and static-binocular (SB). SM judgments were largely frontal, reflecting the equidistance tendency that applies in impoverished conditions. SB judgments were broadly veridical, as predicted. However, MM judgments were only partly influenced by motion information; the equidistance tendency and visual length also contributed--the latter in contrast to SM. It is concluded that motion information is only weakly effective, no matter what the complexity of pictorial information. Instead, motion may be valuable in enhancing pictorial information.

Depth judgments of triangular surfaces during moving monocular viewing

When an observer judges the orientation in depth of a trapezoidal surface, the pictorial information of the surface is often more influential than motion information. Motion information might be more effective if pictorial information is simplified: this prompts the present study. Surfaces were triangular and pictorial information resided only in the visual lengths of the surfaces. In experiment 1, monocular observers viewed during head motions of 0 to 30 cm extent. Static judgments were somewhat dependent on visual length and tended to be frontal. Contrary to predictions, moving judgments were similarly affected: only 30 cm motion elicited near-veridical perception, as in previous studies with trapezoidal surfaces, although visual length had a residual effect. Experiment 2 involved investigation of whether visual length requires prior exposure to triangular surfaces to be effective; this was found not to be the case, which argues that observers rely on internal models of triangular surfaces. Depth perception appears to balance rapidity of processing against accuracy, in a way suggesting that 'direct' approaches are incomplete. Finally, it is argued that depth-from-motion simulations-influential in assertions that motion information is fully effective-depend on pictorial information.

Perceiving the orientation in depth of real surfaces: background pattern affects motion and pictorial information

Motion information contributes weakly to veridical depth perception of real stimuli. To test whether background pattern might enhance veridicality, observers judged the orientations in depth of pictorially matched trapezoidal and rectangular surfaces, with and without a rectangular grid of vertical stripes in a frontal plane behind surfaces; viewing was monocular with lateral head motions of 15 cm extent. The grid did not enhance veridicality; instead, surfaces actually or pictorially slanted to the frontal plane were judged more slanted with the grid present. In a second experiment, observers were static or moved through 30 cm; the grid had little effect during stasis, but again elicited judgments of greater slant during motion, despite broadly veridical responses without the grid. Results from actual slant are interpreted in terms of motion contrast and suggest that motion information may be important in conveying differences in orientation. Results from pictorial slant suggest that the influence of pictorial information increases as its complexity increases.

A model of self-motion estimation within primate extrastriate visual cortex

Perrone [(1992) Journal of the Optical Society of America A, 9, 177-194] recently proposed a template-based model of self-motion estimation which uses direction- and speed-tuned input sensors similar to neurons in area MT of primate visual cortex. Such an approach would generally require an unrealistically large number of templates (five continuous dimensions). However, because primates, including humans, have a number of oculomotor mechanisms which stabilize gaze during locomotion, we can greatly reduce the number of templates required (two continuous dimensions and one compressed and bounded dimension). We therefore refined the model to deal with the gaze-stabilization case and extended it to extract heading and relative depth simultaneously. The new model is consistent with previous human psychophysics and has the emergent property that its output detectors have similar response properties to neurons in area MST.

A perturbation analysis of depth perception from combinations of texture and motion cues

We examined how depth information from two different cue types (object motion and texture gradient) is integrated into a single estimate in human vision. Two critical assumptions of a recent model of depth cue combination (termed modified weak fusion) were tested. The first assumption is that the overall depth estimate is a weighted linear combination of the estimates derived from the individual cues, after initial processing needed to bring them to a common format. The second assumption is that the weight assigned to a cue reflects the apparent reliability of that cue in a particular scene. By this account, the depth combination rule is linear and dynamic, changing in a predictable fashion in response to the particular scene and viewing conditions. A novel procedure was used to measure the weights assigned to the texture and motion cues across experimental conditions. This procedure uses a type of perturbation analysis. The results are consistent with the weighted linear combination rule. In addition, when either cue is corrupted by added noise, the weighted linear combination rule shifts in favor of the uncontaminated cue.

Detecting slant-in-depth of real trapezoidal and rectangular surfaces: moving-monocular viewing equivalent to stationary-binocular viewing

Cues from binocularity and observer motion are often believed to be more important in perceiving depth than pictorial cues such as relative visual size and linear perspective. Both binocularity and motion are effective in simulated displays. However, for real stimuli evincing nonveridical pictorial cues, binocularity has been more effective than motion; sometimes motion has had an insignificant effect. This may reflect inadequate extent of motion, an assertion investigated in the present study. Two groups of observers determined whether rectangular and trapezoidal surfaces were slanted-in-depth under stationary-monocular (SM), stationary-binocular (SB), and moving-monocular conditions with 15-cm (15MM) and 25-cm (25MM) lateral head-motion extents according to group. The trapezoidal surfaces appeared as rectangular during SM viewing to mislead regarding slant. The effect of pictorial cues was substantially diminished during SB viewing whereas 15MM viewing was weak, 25MM was as effective as SB viewing. Comparison of the overall numbers of correct responses for the two groups indicated no contextual biasing.

Perceiving surface orientation: pictorial information based on rectangularity can be overriden during observer motion

Although the observer's motion can elicit perception of relative depth, it is less successful in doing so when competing pictorial information is available. However, the evidence for this may be affected by limited extents of motion and by equidistance tendencies. Results obtained when monocular observers judged the orientation-in-depth of trapezoidal and of rectangular surfaces, during lateral head motion of extents 0 cm to 30 cm, are described. When the motion extent was less than 30 cm, trapezoidal surfaces were misperceived because they were interpreted as rectangular; this pictorial information was overriden only when the motion extent was 30 cm. The results may reflect the sequential nature of motion information and the redundancy of information in normal viewing: pictorial information may take precedence when motion is limited, but motion information can be indefinitely augmented. Comments are directed to: (i) the use of Ames 'distorted rooms' in this area of research, and (ii) the 'ecological' interpretation of pictorial information.

Determinants of the perception of sagittal motion

This study examines the change in the perceived distance of an object in three-dimensional space when the object and/or the observer's head is moved along the line of sight (sagittal motion) as a function of the perceived absolute (egocentric) distance of the object and the perceived motion of the head. To analyze the processes involved, two situations, labeled A and B, were used in four experiments. In Situation A, the observer was stationary and the perceived motion of the object was measured as the object was moved toward and away from the observer. In Situation B, the same visual information regarding the changing perceived egocentric distance between the observer and object was provided as in Situation A, but part or all of the change in visual egocentric distance was produced by the sagittal motion of the observer's head. A comparison of the perceived motion of the object in the two situations was used to measure the compensation in the perception of the motion of the object as a result of the head motion. Compensation was often clearly incomplete, and errors were often made in the perception of the motion of the stimulus object. A theory is proposed, which identifies the relation between the changes in the perceived egocentric distance of the object and the tandem motion of the object resulting from the perceived motion of the head to be the significant factor in the perception of the sagittal motion of the stimulus object in Situation B.

The spatial and temporal characteristics of perceiving 3-D structure from motion

In four experiments, a scalar judgment of perceived depth was used to examine the spatial and temporal characteristics of the perceptual buildup of three-dimensional (3-D) structure from optical motion as a function of the depth in the simulated object, the speed of motion, the number of elements defining the object, the smoothness of the optic flow field, and the type of motion. In most of the experiments, the objects were polar projections of simulated half-ellipsoids undergoing a curvilinear translation about the screen center. It was found that the buildup of 3-D structure was: (1) jointly dependent on the speed at which an object moved and on the range through which the object moved; (2) more rapid for deep simulated objects than for shallow objects; (3) unaffected by the number of points defining the object, including the maximum apparent depth within each simulated object-depth condition; (4) not disrupted by nonsmooth optic flow fields; and (5) more rapid for rotating objects than for curvilinearly translating objects.

Primary depth cues and background pattern in the portrayal of slant

A rectangularity postulate has been used in algorithms for the purpose of interpreting two-dimensional representations of rectilinear objects. This rectangularity postulate may affect the perception of true surfaces. In this study, rectangular surfaces and trapezoidal surfaces--the latter simulating the horizontal slant-in-depth of the rectangular surfaces--were viewed under static-monocular, moving-monocular, and static-binocular conditions, both with and without a background pattern. The static-binocular condition elicited the greatest number of accurate responses. The moving-monocular condition did not elicit significantly more accurate responses than the static-monocular viewing condition did. The effect of background pattern was insignificant. These results were unexpected in terms of ecological validity and (regarding moving-monocular viewing) because of the importance of the role of relative visual motion in the detection of object motion. However, the results are consistent with the perception of depth separation of two discrete objects.

The interaction of oculomotor cues and stimulus size in stereoscopic death constancy

In the natural world, observers perceive an object to have a relatively fixed size and depth over a wide range of distances. Retinal image size and binocular disparity are to some extent scaled with distance to give observers a measure of size constancy. The angle of convergence of the two eyes and their accommodative states are one source of scaling information, but even at close range this must be supplemented by other cues. We have investigated how angular size and oculomotor state interact in the perception of size and depth at different distances. Computer-generated images of planar and stereoscopically simulated 3-D surfaces covered with an irregular blobby texture were viewed on a computer monitor. The monitor rested on a movable sled running on rails within a darkened tunnel. An observer looking into the tunnel could see nothing but the simulated surface so that oculomotor signals provided the major potential cues to the distance of the image. Observers estimated the height of the surface, their distance from it, or the stereoscopically simulated depth within it over viewing distances which ranged from 45 cm to 130 cm. The angular width of the images lay between 2 deg and 10 deg. Estimates of the magnitude of a constant simulated depth dropped with increasing viewing distance when surfaces were of constant angular size. But with surfaces of constant physical size, estimates were more nearly independent of viewing distance. At any one distance, depths appeared to be greater, the smaller the angular size of the image. With most observers, the influence of angular size on perceived depth grew with increasing viewing distance. These findings suggest that there are two components to scaling. One is independent of angular size and related to viewing distance. The second component is related to angular size, and the weighting accorded to it grows with viewing distance. Control experiments indicate that in the tunnel, oculomotor state provides the principal cue to viewing distance. Thus, the contribution of oculomotor signals to depth scaling is gradually supplanted by other cues as viewing distance grows. Binocular estimates of the heights and distances of planar surfaces of different sizes revealed that angular size and viewing distance interact in a similar way to determine perceived size and perceived distance.

The roles of convergence and apparent distance in depth constancy with motion parallax

The question of whether motion parallax is calibrated by convergence or by apparent distance for depth perception was addressed in three experiments. In Experiment 1, a random dot parallactic display was viewed monocularly at a distance of 80 cm, and the convergence angles were set for distances of 40, 60, and 80 cm. Averaged apparent depth was not different across conditions. In Experiment 2, a display consisting of one surface showing dollar bills and one surface showing random dots was viewed monocularly at a distance of 80 cm. It was presented at two different apparent distances, which were manipulated by varying the size of the dollar bills. In one condition, normally sized dollar bills were presented, and in another condition, the size was reduced by 30%. The averaged apparent depth associated with the small-bill display was larger than the depth associated with the normally sized bill display. In Experiment 3, a random dot display was viewed monocularly at 120 cm. In the primary condition, the random dot display was viewed with an induction screen at 80 cm, and it was moved from side to side such that it appeared stationary and close to the plane of the induction screen. In a comparison condition, the display was viewed without the induction screen and was moving from side to side at 120 cm. In another comparison condition, the display was again viewed without the induction screen but was stationary at 120 cm. Observers adjusted the extent of motion parallax so that apparent depth was 1 cm. The mean extent of parallax was larger in the primary conditio.(ABSTRACT TRUNCATED AT 250 WORDS)