Visual search asymmetry for viewing direction

Metacognitive asymmetries in visual perception

Representing the absence of objects is psychologically demanding. People are slower, less confident and show lower metacognitive sensitivity (the alignment between subjective confidence and objective accuracy) when reporting the absence compared with presence of visual stimuli. However, what counts as a stimulus absence remains only loosely defined. In this Registered Report, we ask whether such processing asymmetries extend beyond the absence of whole objects to absences defined by stimulus features or expectation violations. Our pre-registered prediction was that differences in the processing of presence and absence reflect a default mode of reasoning: we assume an absence unless evidence is available to the contrary. We predicted asymmetries in response time, confidence, and metacognitive sensitivity in discriminating between stimulus categories that vary in the presence or absence of a distinguishing feature, or in their compliance with an expected default state. Using six pairs of stimuli in six experiments, we find evidence that the absence of local and global stimulus features gives rise to slower, less confident responses, similar to absences of entire stimuli. Contrary to our hypothesis, however, the presence or absence of a local feature has no effect on metacognitive sensitivity. Our results weigh against a proposal of a link between the detection metacognitive asymmetry and default reasoning, and are instead consistent with a low-level visual origin of metacognitive asymmetries for presence and absence.

Metacognitive asymmetries in visual perception

People have better metacognitive sensitivity for decisions about the presence compared to the absence of objects. However, it is not only objects themselves that can be present or absent, but also parts of objects and other visual features. Asymmetries in visual search indicate that a disadvantage for representing absence may operate at these levels as well. Furthermore, a processing advantage for surprising signals suggests that a presence/absence asymmetry may be explained by absence being passively represented as a default state, and presence as a default-violating surprise. It is unknown whether the metacognitive asymmetry for judgments about presence and absence extends to these different levels of representation (object, feature, and default violation). To address this question and test for a link between the representation of absence and default reasoning more generally, here we measure metacognitive sensitivity for discrimination judgments between stimuli that are identical except for the presence or absence of a distinguishing feature, and for stimuli that differ in their compliance with an expected default state.

Asymmetries in visual acuity around the visual field

Human vision is heterogeneous around the visual field. At a fixed eccentricity, performance is better along the horizontal than the vertical meridian and along the lower than the upper vertical meridian. These asymmetric patterns, termed performance fields, have been found in numerous visual tasks, including those mediated by contrast sensitivity and spatial resolution. However, it is unknown whether spatial resolution asymmetries are confined to the cardinal meridians or whether and how far they extend into the upper and lower hemifields. Here, we measured visual acuity at isoeccentric peripheral locations (10 deg eccentricity), every 15° of polar angle. On each trial, observers judged the orientation (± 45°) of one of four equidistant, suprathreshold grating stimuli varying in spatial frequency (SF). On each block, we measured performance as a function of stimulus SF at 4 of 24 isoeccentric locations. We estimated the 75%-correct SF threshold, SF cutoff point (i.e., chance-level), and slope of the psychometric function for each location. We found higher SF estimates (i.e., better acuity) for the horizontal than the vertical meridian and for the lower than the upper vertical meridian. These asymmetries were most pronounced at the cardinal meridians and decreased gradually as the angular distance from the vertical meridian increased. This gradual change in acuity with polar angle reflected a shift of the psychometric function without changes in slope. The same pattern was found under binocular and monocular viewing conditions. These findings advance our understanding of visual processing around the visual field and help constrain models of visual perception.

Turning visual search time on its head

Our everyday visual experience frequently involves searching for objects in clutter. Why are some searches easy and others hard? It is generally believed that the time taken to find a target increases as it becomes similar to its surrounding distractors. Here, I show that while this is qualitatively true, the exact relationship is in fact not linear. In a simple search experiment, when subjects searched for a bar differing in orientation from its distractors, search time was inversely proportional to the angular difference in orientation. Thus, rather than taking search reaction time (RT) to be a measure of target-distractor similarity, we can literally turn search time on its head (i.e. take its reciprocal 1/RT) to obtain a measure of search dissimilarity that varies linearly over a large range of target-distractor differences. I show that this dissimilarity measure has the properties of a distance metric, and report two interesting insights come from this measure: First, for a large number of searches, search asymmetries are relatively rare and when they do occur, differ by a fixed distance. Second, search distances can be used to elucidate object representations that underlie search - for example, these representations are roughly invariant to three-dimensional view. Finally, search distance has a straightforward interpretation in the context of accumulator models of search, where it is proportional to the discriminative signal that is integrated to produce a response. This is consistent with recent studies that have linked this distance to neuronal discriminability in visual cortex. Thus, while search time remains the more direct measure of visual search, its reciprocal also has the potential for interesting and novel insights.

Extrastriate cortical activity reflects segmentation of motion into independent sources

Identical local image motion signals can arise from countless object motions in the world. In order to resolve this ambiguity, the visual system must somehow integrate motion signals arising from different locations along an object's contour. Difficulties arise, however, because image contours can derive from multiple objects and from occlusion. Thus, correctly integrating respective objects' motion signals presupposes the specification of what counts as an object. Depending on how this form analysis problem is solved, dramatically different object motion percepts can be constructed from the same set of local image motions. Here we apply fMRI to investigate the mechanisms underlying the segmentation and integration of motion signals that are critical to motion perception in general. We hold the number of image objects constant, but vary whether these objects are perceived to move independently or not. We find that BOLD signal in V3v, V4v, V3A, V3B and MT varies with the number of distinct sources of motion information in the visual scene. These data support the hypothesis that these areas integrate form and motion information in order to segment motion into independent sources (i.e. objects) thereby overcoming ambiguities that arise at the earliest stages of motion processing.

BOLD signal in both ipsilateral and contralateral retinotopic cortex modulates with perceptual fading

Under conditions of visual fixation, perceptual fading occurs when a stationary object, though present in the world and continually casting light upon the retina, vanishes from visual consciousness. The neural correlates of the consciousness of such an object will presumably modulate in activity with the onset and cessation of perceptual fading.

METHOD

In order to localize the neural correlates of perceptual fading, a green disk that had been individually set to be equiluminant with the orange background, was presented in one of the four visual quadrants; Subjects indicated with a button press whether or not the disk was subjectively visible as it perceptually faded in and out.

RESULTS

Blood oxygen-level dependent (BOLD) signal in V1 and ventral retinotopic areas V2v and V3v decreases when the disk subjectively disappears, and increases when it subjectively reappears. This effect occurs in early visual areas both ipsilaterally and contralaterally to the fading figure. That is, it occurs regardless of whether the fading stimulus is presented inside or outside of the corresponding portion of visual field. In addition, we find that the microsaccade rate rises before and after perceptual transitions from not seeing to seeing the disk, and decreases before perceptual transitions from seeing to not seeing the disk. These BOLD signal changes could be driven by a global process that operates across contralateral and ipsilateral visual cortex or by a confounding factor, such as microsaccade rate.

fMRI reveals that non-local processing in ventral retinotopic cortex underlies perceptual grouping by temporal synchrony

When spatially separated objects appear and disappear in a synchronous manner, they perceptually group into a single global object that itself appears and disappears. We employed functional magnetic resonance imaging (fMRI) to identify brain regions involved in this type of perceptual grouping. Subjects viewed four chromatically-defined disks (one per visual quadrant) that flashed on and off. We contrasted %BOLD signal changes between blocks of synchronously flashing disks (Grouping) with blocks of asynchronously flashing disks (no-Grouping).

RESULTS

A region of interest analysis revealed %BOLD signal change in the Grouping condition was significantly greater than in the no-Grouping condition within retinotopic areas V2, V3, and V4v. Within a single quadrant of the visual field, the spatio-temporal information present in the image was identical across the two stimulus conditions. As such, the two conditions could not be distinguished from each other on the basis of the rate or pattern of flashing within a single visual quadrant. The observed results must therefore arise through nonlocal interactions between or within these retinotopic areas, or arise from outside these retinotopic areas. Furthermore, when V2 and V3 were split into ventral and dorsal sub-ROIs, ventral retinotopic areas V2v and V3v preferentially differentiated between the two conditions whereas the corresponding dorsal areas V2d and V3d did not. In contrast, within hMT+, %BOLD signal was significantly greater in the no-Grouping condition.

CONCLUSION

Nonlocal processing within, between, or to ventral retinotopic cortex at least as early as V2v, and including V3v, and V4v, underlies perceptual grouping via temporal synchrony.

Effect of Spatial Position on Visual Search for 3-D Objects

We examined whether the position of objects in external space affects the visual-search task associated with the tilt of 3-D objects. An array of cube-like objects was stereoscopically displayed at a distance of 4.5 m on a large screen 1.5 m above or below eye height. Subjects were required to detect a downward-tilted target among upward-tilted distractors or an upward-tilted target among downward-tilted distractors. When the stimuli consisted of shaded parallelepipeds whose upper/bottom faces were lighter than their side faces, the upward-tilted target was detected faster. This result was in accordance with the ‘top-view assumption’ reported in previous research. Displaying stimuli in the upper position degraded overall performance. However, when the shaded objects whose upper/bottom faces were darker than their side faces were displayed, the detection of a downward-tilted target became as efficient as that of an upward-tilted target only at the upper position. These results indicate that it is possible for the spatial position of the stimulus to promote the detection of a downward-tilted target when shading and perspective information are consistent with the viewing direction.

The effects of inverting prisms on the horizontal-vertical illusion: a systematic effect of downward gaze

The purpose of this work is to compare the relative contributions from the extraocular and sensory systems on the magnitude of the horizontal-vertical illusion (HVI). The visual HVI refers to the general tendency to overestimate vertical extensions of small-scale lines on a picture plane relative to the horizontal by 4-16% depending on the method of measurement. The HVI line stimuli consisted of luminous vertical and horizontal lines forming "L-profiles" located in the frontoparallel plane at a 45 cm viewing distance, collinearly with a binocular gaze. The home position of gaze was aligned to the center of the screen with the ear-eye angle concordant with the environmental horizontal. Illusion strength was quantified when subjects fixated the HVI line stimuli in four quadrants of the visual field. The HVI was also viewed through prism lenses that inverted the retinal images by 180 degrees, thereby dissociating the sensory "up-down" direction from the oculomotor up-down frame of reference. The results revealed a systematically lower magnitude of the HVI in the bottom visual field regardless of whether subjects fixated the HVI with the distorting prisms or without. Taken together, these results suggest that the HVI is sensitive to small-angle gaze shifts. In agreement with several recent findings, these results are interpreted as implying that the brain imposes an enhanced analytic structure on the ascending sensory information during downward gaze.

Visual search asymmetry with uncertain targets

The underlying mechanism of search asymmetry is still unknown. Many computational models postulate top-down selection of target-defining features as a crucial factor. This feature selection account implies, and other theories implicitly assume, that predefined target identity is necessary for search asymmetry. The authors tested the validity of the feature selection account using a singleton search task without a predefined target. Participants conducted a target-defined and a singleton search task with a circle (O) and a circle with a vertical bar (Q). Search asymmetry was observed in both tasks with almost identical magnitude. The results were not due to trial-by-trial feature selection, because search asymmetry persisted even when the target was completely unpredictable. Asymmetry in the singleton search was also observed with more complex stimuli, Kanji characters. These results suggest that feature selection is not necessary for search asymmetry, and they impose important constraints on current visual search theories.

Visual search for a socially defined feature: what causes the search asymmetry favoring cross-race faces?

Levin (1996, 2000) reported that white subjects search for black targets more quickly than they search for white targets, suggesting that black faces are perceived as having a feature that is lacking in white faces. Here we test one of the implications of this asymmetry by having subjects search for same-race (SR) and cross-race (CR) faces that are distorted to look less like each other (producing caricatures that enhance race-specifying features), or are distorted to look more like each other (a prototypical distortion expected to reduce the salience of race-specifying features). Experiments 1 and 2 show that caricaturing the feature-positive CR distractors speeds search for the SR face and that prototypical distortion slows this search. The same distortions in SR faces did not affect the search slopes. However, these distortions also eliminated the overall advantage for CR faces. Experiment 3 shows that trial-to-trial variation in the specific distractors in each display can eliminate the asymmetry and suggests that this asymmetry depends on the subjects' ability to set a consistent a priori perceptual criterion when searching for a CR target, while the distortion effects emphasize the importance of distractor-rejection processes in determining the form of a serial search asymmetry.

Target-tilt and vertical-hemifield asymmetries in free-scan search for 3-D targets

In this study, asymmetries in finding pictorial 3-D targets defined by their tilt and rotation in space were investigated by means of a free-scan search task. In Experiment 1, feature search for cube tilt and rotation, as assessed by a spatial forced-choice task, was slow but still exhibited a characteristic "flat" slope; it was also much faster to upward-tilted cubes and to targets located in the upper half of the search field. Faster search times for cubes and rectangular solids in the upper field, an advantage for upward-tilted cubes, and a strong interaction between target tilt and direction of lighting (upward or downward) for the rectangular solids were all demonstrated in Experiment 2. Finally, an advantage in searching for tilted cubes located in the upper half of the display was shown in Experiment 3, which used a present-absent search task. The results of this study confirm that the upper-field bias in visual search is due mainly to a biased search mechanism and not to the features of the target stimulus or to specific ecological factors.

Visual search asymmetries in motion and optic flow fields

In visual search, items defined by a unique feature are found easily and efficiently. Search for a moving target among stationary distractors is one such efficient search. Search for a stationary target among moving distractors is markedly more difficult. In the experiments reported here, we confirm this finding and further show that searches for a stationary target within a structured flow field are more efficient than searches for stationary targets among distractors moving in random directions. The structured motion fields tested included uniform direction of motion, a radial flow field simulating observer forward motion, and a deformation flow field inconsistent with observer motion. The results using optic flow stimuli were not significantly different from the results obtained with other structured fields of distractors. The results suggest that the local properties of the flow fields rather than global optic flow properties are important for determining the efficiency of search for a stationary target.

Visual search asymmetry: the influence of stimulus familiarity and low-level features

Wang, Cavanagh, and Green (1994) demonstrated a pop-out effect in searching for an unfamiliar target among familiar distractors (U-F search) and argued for the importance of a familiarity difference between the target and the distractors in determining search efficiency. In four experiments, we explored the generality of that finding. Experiment 1 compared search efficiency across a variety of target-distractor pairs. In Experiments 2, 3, and 4, we used Chinese characters and their transforms as targets and distractors and compared search performance between Chinese and non-Chinese participants. We demonstrated that search asymmetry and search efficiency in the U-F condition are influenced by the presence of low-level feature differences between the familiar and the unfamiliar stimuli. Our findings suggest that the familiarity of the distractors, rather than the familiarity difference between the target and the distractors, determines search efficiency. We also documented a counterintuitive familiarity-inferiority effect, suggesting that knowledge of search stimuli may, sometimes, be detrimental to search performance.

Asymmetries in visual search: an introduction

In visual search tasks, observers look for a target stimulus among distractor stimuli. A visual search asymmetry is said to occur when a search for stimulus A among stimulus B produces different results from a search for B among A. Anne Treisman made search asymmetries into an important tool in the study of visual attention. She argued that it was easier to find a target that was defined by the presence of a preattentive basic feature than to find a target defined by the absence of that feature. Four of the eight papers in this symposium in Perception & Psychophysics deal with the use of search asymmetries to identify stimulus attributes that behave as basic features in this context. Another two papers deal with the long-standing question of whether a novelty can be considered to be a basic feature. Asymmetries can also arise when one type of stimulus is easier to identify or classify than another. Levin and Angelone's paper on visual search for faces of different races is an examination of an asymmetry of this variety. Finally, Previc and Naegele investigate an asymmetry based on the spatial location of the target. Taken as a whole, these papers illustrate the continuing value of the search asymmetry paradigm.

The psychophysics of visual search

Most theories of visual search emphasize issues of limited versus unlimited capacity and serial versus parallel processing. In the present article, we suggest a broader framework based on two principles, one empirical and one theoretical. The empirical principle is to focus on conditions at the intersection of visual search and the simple detection and discrimination paradigms of spatial vision. Such simple search conditions avoid artifacts and phenomena specific to more complex stimuli and tasks. The theoretical principle is to focus on the distinction between high and low threshold theory. While high threshold theory is largely discredited for simple detection and discrimination, it persists in the search literature. Furthermore, a low threshold theory such as signal detection theory can account for some of the phenomena attributed to limited capacity or serial processing. In the body of this article, we compare the predictions of high threshold theory and three versions of signal detection theory to the observed effects of manipulating set size, discriminability, number of targets, response bias, external noise, and distractor heterogeneity. For almost all cases, the results are inconsistent with high threshold theory and are consistent with all three versions of signal detection theory. In the Discussion, these simple theories are generalized to a larger domain that includes search asymmetry, multidimensional judgements including conjunction search, response time, search with multiple eye fixations and more general stimulus conditions. We conclude that low threshold theories can account for simple visual search without invoking mechanisms such as limited capacity or serial processing.

Asymmetry of the human visual field in magnetic response to apparent motion

Predominance of the lower visual field has been shown in various visual tasks, but whether the upper visual field is involved in a specific neural process is unknown. We used magnetoencephalography to study the effect of orientation and direction on the responses of five subjects to apparent motion from the human extrastriate cortex. The first magnetic response always was the largest, and the peak latency of about 200 ms did not change with the stimulus conditions. Amplitudes of the first responses were highest when motions were oriented at the horizontal meridian, decreasing with the degree of the angle between motion orientation and the horizontal meridian. There was no difference in amplitude between the two directions in the lower visual field, whereas the value of the response to downward motion in the upper visual field was significantly larger than that to upward motion. These amplitude changes are not due to differences in the anatomical distribution of neural activities because the estimated origins for the first responses always were in the same cortical area (around the occipito-parieto-temporal region) and the directions of the current vectors did not change with the stimulus conditions, and the estimated current strength changed with the stimulus conditions as did the response amplitude. These findings suggest that the human extrastriate cortex has a directional preference for downward versus upward motion in the upper visual field.

The effect of adapting luminance on the latency of visual search

Computational models of attentional processing typically view the "attentional spotlight" as a winner-take-all network whose focus can be shifted serially about a display if required. As a result, lateral inhibition is assumed in these models to be an important mechanism involved in visual search. On the basis of this assumption, we predicted that changes in adapting luminance would produce specific changes in search latency functions in virtue of affecting visual inhibition. The results of our first two experiments confirmed these predictions: when search was difficult, and produced reaction time results characteristic of serial processing, there was a main effect of adapting luminance and a significant interaction between adapting luminance and the number of display elements. These effects were both reflected in increases in the slopes and the intercepts of average search latency functions when adapting luminance was decreased. When search was easy, and produced pop out effects characteristic of parallel processing, there were no significant effects of adapting luminance on search latency. The third experiment used adapting luminance to further explore the possibility that arrow junctions are detected preattentively. The results suggested that a visual search for such elements involves a substantial serial component, which weighs against the claim that they are detected by low-level vision.

Visual search of expansion and contraction

The perception of expansion/contraction in human subjects was examined with a visual search paradigm. When searching for a target defined by two-dimensional expansion among distractors defined by two-dimensional contraction, the time needed to find the target did not vary as the number of distractors was increased. However, for a target defined by two-dimensional contraction among distractors defined by two-dimensional expansion, the search time increased as a function of the number of distractors in the display. A similar search asymmetry remained between one-dimensional expansion and one-dimensional contraction, even though one-dimensional expansion was searched in a serial manner. This asymmetry between expansion and contraction reflects a basic characteristic of higher-order motion information processing.

The detection of gaze direction: a stare-in-the-crowd effect

A visual-search paradigm was used to explore the relative ease with which the direction of gaze can be detected. Straight-gaze stimuli were presented as targets within a variable number of distractors with left-averted or right-averted gaze. Reaction time in this case was compared with that when either the left-averted or right-averted gaze stimuli were the targets among distractors of the two remaining gaze directions. The data were examined for the existence of a search asymmetry favoring the straight-gaze targets. Such an asymmetry was found with stimuli that were realistically drawn renditions of pairs of human eyes, as well as with similar schematic stimuli representing pairs of human eyes. The asymmetry, however, was not found with geometric control stimuli, which also presented the critical feature in the central, the left-lateral, or the right-lateral position within the stimulus, but were not eyelike. It was also not found for schematic stimuli consisting of only one eye. It was concluded that the straight gaze direction is a special stimulus with eyelike stimuli, which the visual system is set up to process faster and with fewer errors than averted gaze directions. The results are discussed in terms of the evolutionary significance of the straight gaze direction.