[Systems analysis of optic-vestibular interaction in the perception of verticality]

The motor vertical in the absence of gravicentric cues

When participants are asked to flip an omnidirectional switch "down", the direction of their responses depends mainly on gravicentric, less so on egocentric and least on visual cues about the vertical (Lackner and DiZio, Exp. Brain Res. 130:2-26, 2000). Here we evaluate response direction when gravicentric cues are not available. Participants flipped an omnidirectional switch "down" when gravito-inertial force acted orthogonally to the response plane on earth (session E), and when it was near zero during parabolic flights (session P). We found that the relative weight of visual cues was similar in both sessions, and it was similar to that in an earlier study where participants stood upright. Across all three data sets, the weight of visual cues averaged 0.09. The relative weight of egocentric cues was also similar in both sessions, averaging 0.87; however, it was significantly lower in the earlier study with upright participants, where it averaged 0.43. We further found that informative and noninformative tactile stimulation had no substantial effects on response direction, which suggests that the earlier reported anchoring effect of tactile signals for the perceived vertical may not extend to the motor vertical. We conclude that the absence of gravicentric cues is compensated by a higher weight of egocentric cues, but not by a higher weight of visual cues. As a consequence, astronauts, divers and persons who work on ground in a horizontal body posture may mishandle equipment because of their strong reliance on egocentric cues.

Reading sideways: Effects of egocentric and environmental orientation in a lexical decision task

Many image-level factors affect reading speed and comprehension, including the in-plane orientation of text. As words' angular deviation from upright increases, so do response times. Here we investigated whether these orientation effects in reading are based purely on an egocentric (retinal) reference frame, or whether there is also a contribution of the environmental reference frame. Participants completed a lexical decision task with six-letter, two-syllable words and nonwords presented at a wide range of angles, in increments of 22.5°. A control group of participants (N = 66) completed the task while sitting upright, and an experimental group (N = 43) completed the task while lying sideways on their right side. The function relating the egocentric orientation of strings to response times was symmetric for upright observers, but skewed for observers who lay sideways, with an advantage for responding to environmentally upright text. Our results suggest that sideways readers may use an oblique reference frame (similar to the perceptual upright) for mentally rotating text. We discuss implications for designing optimal text orientations in head mounted displays.

The influence of visual and vestibular orientation cues in a clock reading task

We investigated how performance in the real-life perceptual task of analog clock reading is influenced by the clock's orientation with respect to egocentric, gravitational, and visual-environmental reference frames. In Experiment 1, we designed a simple clock-reading task and found that observers' reaction time to correctly tell the time depends systematically on the clock's orientation. In Experiment 2, we dissociated egocentric from environmental reference frames by having participants sit upright or lie sideways while performing the task. We found that both reference frames substantially contribute to response times in this task. In Experiment 3, we placed upright or rotated participants in an upright or rotated immersive virtual environment, which allowed us to further dissociate vestibular from visual cues to the environmental reference frame. We found evidence of environmental reference frame effects only when visual and vestibular cues were aligned. We discuss the implications for the design of remote and head-mounted displays.

A Bayesian Account of Visual-Vestibular Interactions in the Rod-and-Frame Task

Panoramic visual cues, as generated by the objects in the environment, provide the brain with important information about gravity direction. To derive an optimal, i.e., Bayesian, estimate of gravity direction, the brain must combine panoramic information with gravity information detected by the vestibular system. Here, we examined the individual sensory contributions to this estimate psychometrically. We asked human subjects to judge the orientation (clockwise or counterclockwise relative to gravity) of a briefly flashed luminous rod, presented within an oriented square frame (rod-in-frame). Vestibular contributions were manipulated by tilting the subject's head, whereas visual contributions were manipulated by changing the viewing distance of the rod and frame. Results show a cyclical modulation of the frame-induced bias in perceived verticality across a 90° range of frame orientations. The magnitude of this bias decreased significantly with larger viewing distance, as if visual reliability was reduced. Biases increased significantly when the head was tilted, as if vestibular reliability was reduced. A Bayesian optimal integration model, with distinct vertical and horizontal panoramic weights, a gain factor to allow for visual reliability changes, and ocular counterroll in response to head tilt, provided a good fit to the data. We conclude that subjects flexibly weigh visual panoramic and vestibular information based on their orientation-dependent reliability, resulting in the observed verticality biases and the associated response variabilities.

Fusion of Visual and Vestibular Tilt Cues in the Perception of Visual Vertical

We investigated the effect of visual and vestibular body-tilt cues on the subjective visual vertical (SVV) in six human observers at roll tilts of 0, 60, and 120°. Subjects adjusted a small luminous test line parallel to the perceived direction of gravity, in the presence of a large peripheral visual frame line. These settings, referred to as the frame SVV, were compared with the SVV in complete darkness (dark SVV). The frame SVV was virtually identical to the dark SVV for frame lines parallel or orthogonal to the dark SVV. Away from these neutral positions, the frame induced a periodic SVV modulation, which was small in upright observers, but became quite pronounced when subjects were tilted. For upright, where the dark SVV was very accurate, the frame SVV showed errors in both directions, following a roughly symmetrical pattern. At 120° tilt, where the dark SVV invariably showed tilt undercompensation (A-effect), the frame effect became asymmetrical, with a stronger tendency to improve than to worsen accuracy. We tested whether our findings could be explained by two spatial orientation models: Mittelstaedt's idiotropic model and a Bayesian scheme with a stage for the processing of visual cues. Both models show a periodic frame effect that becomes stronger with increasing body tilt and can explain why frame lines parallel or perpendicular to the dark SVV are ineffective. Based on their performance, we conclude that perception of the visual vertical is based on a centrally weighted fusion of visual, vestibular, and egocentric references.

Top-Down Processing and Visual Reorientation Illusions in a Virtual Reality Environment

The role of top-down processing on the horizontal-vertical line length illusion was examined by means of an ambiguous room with dual visual verticals. In one of the test conditions, the subjects were cued to one of the two verticals and were instructed to cognitively reassign the apparent vertical to the cued orientation. When they have mentally adjusted their perception, two lines in a plus sign configuration appeared and the subjects had to evaluate which line was longer. The results showed that the line length appeared longer when it was aligned with the direction of the vertical currently perceived by the subject. This study provides a demonstration that top-down processing influences lower level visual processing mechanisms. In another test condition, the subjects had all perceptual cues available and the influence was even stronger.

Influences of visual pitch and visual yaw on visually perceived eye level (VPEL) and straight ahead (VPSA) for erect and rolled-to-horizontal observers

Localization within the space in front of an observer can be specified along two orthogonal physical dimensions: elevation ('up', 'down') and horizontal ('left','right'). For the erect observer, these correspond to egocentric dimensions along the long and short axes of the body, respectively. However, when subjects are rolled-to-horizontal (lying on their sides), the correspondence between the physical and egocentric dimensions is reversed. Employing egocentric coordinates, localization can be referred to a central perceptual point-visually perceived eye level (VPEL) along the long axis of the body, and visually perceived straight ahead (VPSA) along the short axis of the body. In the present experiment, measurements of VPEL and of VPSA were made on each of eight subjects who were either erect or rolled-to-horizontal while monocularly viewing a long 2-line stimulus (two parallel, 64 degrees -long lines separated by 50 degrees ) in otherwise complete darkness that was centered on the eye of the observer and was tilted out of the frontoparallel plane by a variable amount and direction (from -30 degrees to +30 degrees in 10 degrees steps). The stimulus tilt was either around an axis through the center of the two eyes (pitch; VPEL was measured) or around the long axis of the body that passed through the center of the viewing eye (yaw; VPSA was measured). Large variations in the localization settings were measured that were systematic with stimulus tilt. The slopes of the functions plouing the deviations from veridicality against the orientation of the 2-line stimulus ('induction functions') were larger for the rolled-to-horizontal observer than for the erect observer for both VPEL and VPSA, and for a given body orientation were larger for the VPEL discrimination than for the VPSA discrimination; the influences of body orientation in physical space and the direction of the discrimination relative to the body were lineraly additive. Both the y-intercepts of the induction functions and the central perceptual point measured in complete darkness were lower when the norm setting by the subject was along the vertical than when it was along the horizontal; this held for both the VPEL and VPSA discriminations. The systematic effects of body orientation on the slopes and of line orientation on the y-intercepts and dark values result from an effect of gravity on the settings and fit well to a general principle: any departure from erect posture increases the induction effects of the visual stimulus. The effect of gravity is consistent with the effect of gravity in previous work in high-g environments with the VPEL discrimination.

Roll motion stimuli: sensory conflict, perceptual weighting and motion sickness

In an experiment with 17 subjects, interactions of visual roll motion stimuli and vestibular body tilt stimuli were examined in determining the subjective vertical. Interindividual differences in weighting the visual information were observed, but in general, visual and vestibular responses added in setting the vertical. Despite the conflicting sensory information, motion sickness was not reported apart from one subject on one single occasion. This is in conflict with the sensory mismatch theory on motion sickness, but in agreement with the subjective vertical conflict theory.

Origin and processing of postural information

This contribution surveys the sources and the processing of spatial information about posture, that is, about the orientation of the body and its parts with respect to the vertical (whereas 'position' designates their orientation to each other). Postural information is, to a considerable extent, gained by sense organs in the head. Hence information gained by the mobile eyes and the pitched-up labyrinths is first transformed from a retinal and otolithic into a head-fixed frame of reference, then from head- to trunk-fixed coordinates, and, finally, from a trunk-fixed to an exocentric frame of reference. To that end the position of eyes and otoliths to the head, of the head to the trunk, and of the trunk to the rest of the world must be known, deduced by efference copies or measured by proprioceptors. It is shown that the perceived relation of the visual world to the vertical is exclusively determined by sense organs in the head, whereas body posture is also directly measured by recently discovered graviceptors in the human trunk. It appears that the proprioceptors mediate perception of position, but not, or only indirectly, of posture.

Spatial reference in weightlessness: perceptual factors and mental representations

The role of gravity in spatial coordinate assignment and the mental representation of space were studied in three experiments, varying different perceptual cues systematically: the retinal, the visual background, the vestibular, and proprioceptive information. Verbal descriptions of visually presented arrays were required under different head positions (straight/tilt) and under different gravitational conditions (gravity present/gravity absent). The results of two experiments conducted with 2 subjects who participated in a space flight revealed that subjects are able to adequately assign positions in space in the absence of gravitational information, and that they do this by using their head-retinal coordinates as primary references. This indicates that they cognitively adapted to the perceptually new situation. The findings from a third experiment conducted with a larger group of subjects under a condition in which the gravitational information was present but irrelevant to the task being solved (subjects were in a horizontal supine position) show that subjects, in general, are flexible in using cues other than gravitational ones as references when the latter cannot serve as a referential system. These findings, together with the observation that consistent spatial assignment is possible even immediately after first exposure to the perceptually totally novel situation of weightlessness, seem to suggest that the mental representation of space, onto which given perceptual information is mapped, is independent of a particular percept.

Ocular counterrolling. Some practical considerations of a new evaluation method for diagnostic purposes

Ocular counterrolling (OCR) data taken from the literature (12 publications) were used to test the best fit (least-square fit) of these measurements with respect to three mathematical models: a sine relation between OCR and the lateral tilt stimulus, a complex cosine-square relation, and a logarithmic relation between OCR gain and tilt. The latter proved to be the best fitting function. On the basis of this model, we attempted to define a physiological transfer function between OCR gain and tilt, which could serve as a reference of normal population, assuming healthy subjects for the investigations applied. Comparison of this physiological range with pathological data demonstrated marked differences between them. The mathematical simplicity of a logarithmic model permits rapid analysis of clinical OCR examinations, and a classification of the findings.

Simultaneous binocular integration of the visual tilt effect in normal and stereoblind observers

Apparent displacement of an edge from the subjective visual vertical is typically induced by the simultaneous inspection of a large rotating textured background. In the present series of experiments we have tested the binocular integration of such an effect in normal and stereoblind observers in whom inspection of the rotating background and vision of the vertical edge are presented to different eyes. In normal subjects there was no difference between the binocular and the dichoptic viewing condition while in stereoblind subjects there was a clearcut decrease in the strength of the tilt effect under dichoptic conditions. A residual tilt effect, however, was still present in the latter group under dichoptic conditions and this shows that binocular interactions related to visual tilt can be dissociated from those required for stereopsis.