Discrimination of spatial phase shows a qualitative difference between foveal and peripheral processing

Opposing effects of selectivity and invariance in peripheral vision

Sensory processing necessitates discarding some information in service of preserving and reformatting more behaviorally relevant information. Sensory neurons seem to achieve this by responding selectively to particular combinations of features in their inputs, while averaging over or ignoring irrelevant combinations. Here, we expose the perceptual implications of this tradeoff between selectivity and invariance, using stimuli and tasks that explicitly reveal their opposing effects on discrimination performance. We generate texture stimuli with statistics derived from natural photographs, and ask observers to perform two different tasks: Discrimination between images drawn from families with different statistics, and discrimination between image samples with identical statistics. For both tasks, the performance of an ideal observer improves with stimulus size. In contrast, humans become better at family discrimination but worse at sample discrimination. We demonstrate through simulations that these behaviors arise naturally in an observer model that relies on a common set of physiologically plausible local statistical measurements for both tasks.

The distribution of spatial attention changes with task demands during goal-directed reaching

Goal-directed movements are commonly used to allow humans to interact with their environment. When making a goal-directed movement in a natural environment, there are many competing stimuli. It is therefore important to understand how making a goal-directed movement could be impacted by the need to divide attention between the movement and competing stimuli. We used a dual-task paradigm to investigate the sharing of attentional resources between a search task in central vision and a peripheral pointing task completed concurrently. Results suggest some degree of shared attentional resources between these two tasks with performance on both central and peripheral tasks degraded under dual-task conditions. Movement latency, but not movement time, was also affected by dual-task conditions. Altogether, the results suggest that there is a cost to reach performance if attention is engaged away from the movement goal. Interestingly, this cost is associated with movement planning rather than execution.

Uniformity and diversity of response properties of neurons in the primary visual cortex: selectivity for orientation, direction of motion, and stimulus size from center to far periphery

Although the primary visual cortex (V1) is one of the most extensively studied areas of the primate brain, very little is known about how the far periphery of visual space is represented in this area. We characterized the physiological response properties of V1 neurons in anaesthetized marmoset monkeys, using high-contrast drifting gratings. Comparisons were made between cells with receptive fields located in three regions of V1, defined by eccentricity: central (3-5°), near peripheral (5-15°), and far peripheral (>50°). We found that orientation selectivity of individual cells was similar from the center to the far periphery. Nonetheless, the proportion of orientation-selective neurons was higher in central visual field representation than in the peripheral representations. In addition, there were similar proportions of cells representing all orientations, with the exception of the representation of the far periphery, where we detected a bias favoring near-horizontal orientations. The proportions of direction-selective cells were similar throughout V1. When the center/surround organization of the receptive fields was tested with gratings with varying diameters, we found that the population of neurons that was suppressed by large gratings was smaller in the far periphery, although the strength of suppression in these cells tended to be stronger. In addition, the ratio between the diameters of the excitatory centers and suppressive surrounds was similar across the entire visual field. These results suggest that, superimposed on the broad uniformity of V1, there are subtle physiological differences, which indicate that spatial information is processed differently in the central versus far peripheral visual fields.

Peripheral vision and pattern recognition: a review

We summarize the various strands of research on peripheral vision and relate them to theories of form perception. After a historical overview, we describe quantifications of the cortical magnification hypothesis, including an extension of Schwartz's cortical mapping function. The merits of this concept are considered across a wide range of psychophysical tasks, followed by a discussion of its limitations and the need for non-spatial scaling. We also review the eccentricity dependence of other low-level functions including reaction time, temporal resolution, and spatial summation, as well as perimetric methods. A central topic is then the recognition of characters in peripheral vision, both at low and high levels of contrast, and the impact of surrounding contours known as crowding. We demonstrate how Bouma's law, specifying the critical distance for the onset of crowding, can be stated in terms of the retinocortical mapping. The recognition of more complex stimuli, like textures, faces, and scenes, reveals a substantial impact of mid-level vision and cognitive factors. We further consider eccentricity-dependent limitations of learning, both at the level of perceptual learning and pattern category learning. Generic limitations of extrafoveal vision are observed for the latter in categorization tasks involving multiple stimulus classes. Finally, models of peripheral form vision are discussed. We report that peripheral vision is limited with regard to pattern categorization by a distinctly lower representational complexity and processing speed. Taken together, the limitations of cognitive processing in peripheral vision appear to be as significant as those imposed on low-level functions and by way of crowding.

Detection and identification of crowded mirror-image letters in normal peripheral vision

Performance for discriminating single mirror-image letters in peripheral vision can be as good as that in central vision, provided that letter size is scaled appropriately [Higgins, K. E., Arditi, A., & Knoblauch, K. (1996). Detection and identification of mirror-image letter pairs in central and peripheral vision. Vision Research, 36, 331-337]. In this study, we asked whether or not there is a reduction in performance for discriminating mirror-image letters when the letters are flanked closely by other letters, compared with unflanked (single) letters; and if so, whether or not this effect is greater in peripheral than in central vision. We compared contrast thresholds for detecting and identifying mirror-image letters "b" and "d" for a range of letter separations, at the fovea and 10 degrees eccentricity, for letters that were scaled in size. For comparison, thresholds were also determined for a pair of non-mirror-image letters "o" and "x". Our principal finding is that there is an additional loss in sensitivity for identifying mirror-image letters ("bd"), compared with non-mirror-image letters ("ox"), when the letters are flanked closely by other letters. The effect is greater in peripheral than central vision. An auxiliary experiment comparing thresholds for letters "d" and "q" vs. "b" and "d" shows that the additional loss in sensitivity for identifying crowded mirror-image letters cannot be attributed to the similarity in letter features between the two letters, but instead, is specific to the axis of symmetry. Our results suggest that in the presence of proximal objects, there is a specific loss in sensitivity for processing broad-band left-right mirror images in peripheral vision.

Local motion processing limits fine direction discrimination in the periphery

Visual sensitivity is reduced in the periphery for many discrimination tasks. Previously it has been reported that motion coherence thresholds are higher for dot stimuli presented in the periphery, a finding that could arise either from (a) impaired motion integration or (b) from motion integrators inheriting more noisy local directional signals. We sought to disentangle these factors using an equivalent noise paradigm. We report a deterioration in discrimination thresholds in the periphery that does not result from reduced visibility and is fully accounted for by an increase in local directional uncertainty with no change in sampling efficiency. Changes in motion coherence thresholds with stimulus eccentricity, measured using similar stimuli, exhibit a high degree of inter-subject variability.

Texture segregation on the basis of contrast polarity of odd-symmetric filters

This is the first study to demonstrate the selectivity of learning for contrast polarity. The finding is the main result of an investigation into the existence of central and peripheral vision mechanisms selective for contrast polarity within the texture-segregation process, using the perceptual learning paradigm in a detection task. Energy models (Malik & Perona, 1990) exclude segregation of textures composed of elements of odd-symmetric luminance profile by contrast polarity differences. Here the target was a Gabor patch (0.8 deg) of 1 cyc/deg in sine phase (odd-symmetry) embedded in a background of mirror-image elements. Our results showed that, in fovea, segregation on the basis of contrast polarity was above threshold from the first session. After learning, the target popped-out in both central and peripheral vision for durations over 10 ms. Our major result is that learning is selective for contrast polarity; it is also selective for orientation and position, all characteristics distinctive of early processing. Since the learning effects were obtained with texture composed of odd-symmetric mirror-image elements, they indicate that the output from odd-symmetric filters was not excluded or inhibited in texture segmentation, but instead played an active role. Our data support models of texture segmentation, in which detection of texture gradient is achieved on the basis of early cortical process, before the non-linear transformation of their output.

Wideband enhancement of television images for people with visual impairments

Wideband enhancement was implemented by detecting visually relevant edge and bar features in an image to produce a bipolar contour map. The addition of these contours to the original image resulted in increased local contrast of these features and an increase in the spatial bandwidth of the image. Testing with static television images revealed that visually impaired patients (n = 35) could distinguish the enhanced images and preferred them over the original images (and degraded images). Most patients preferred a moderate level of wideband enhancement, since they preferred natural-looking images and rejected visible artifacts of the enhancement. Comparison of the enhanced images with the originals revealed that the improvement in the perceived image quality was significant for only 22% of the patients. Possible reasons for the limited increase in perceived image quality are discussed, and improvements are suggested.

Detection of animals in natural images using far peripheral vision

It is generally believed that the acuity of the peripheral visual field is too poor to allow accurate object recognition and, that to be identified, most objects need to be brought into foveal vision by using saccadic eye movements. However, most measures of form vision in the periphery have been done at eccentricities below 10 degrees and have used relatively artificial stimuli such as letters, digits and compound Gabor patterns. Little is known about how such data would apply in the case of more naturalistic stimuli. Here humans were required to categorize briefly flashed (28 ms) unmasked photographs of natural scenes (39 degrees high, and 26 degrees across) on the basis of whether or not they contained an animal. The photographs appeared randomly in nine locations across virtually the entire extent of the horizontal visual field. Accuracy was 93.3% for central vision and decreased almost linearly with increasing eccentricity (89.8% at 13 degrees, 76.1% at 44.5 degrees and 71.2% at 57.5 degrees ). Even at the most extreme eccentricity, where the images were centred at 70.5 degrees, subjects scored 60.5% correct. No evidence was found for hemispheric specialization. This level of performance was achieved despite the fact that the position of the image was unpredictable, ruling out the use of precued attention to target locations. The results demonstrate that even high-level visual tasks involving object vision can be performed using the relatively coarse information provided by the peripheral retina.

The scintillating grid illusion during smooth pursuit, stimulus motion, and brief exposure in humans

The Scintillating Grid Illusion occurs when small white disks are superimposed onto the intersections of a grey-on-black Hermann grid. As a result illusory dark spots are seen at numerous crossings, flashing with each flick of the eye and changing their location and distribution with each saccade. The illusion is absent with steady fixation. The present study shows that saccadic eye movements are not necessary to produce the illusion. Rather, the illusion was also found to occur (i) during smooth pursuit movements when the grid was stationary, (ii) during smooth displacement of the grid with the gaze kept steady, and (iii) during brief exposures of the stationary grid. It is concluded that, while transient stimulation is essential for generating the illusion, reduction in effective luminance contrast resulting from brief exposure and high stimulus speed are responsible for reductions in its strength.

Relationship between acuity for gratings and for tumbling-E letters in peripheral vision

Earlier studies have reported that grating resolution is sampling-limited in peripheral vision but that letter acuity is generally poorer than grating acuity. These results suggest that peripheral resolution of objects with rich Fourier spectra may be limited by some factor other than neural sampling. To examine this suggestion we formulated and tested the hypothesis that letter acuity in the periphery is sampling-limited, just as it is for extended and truncated gratings. We tested this hypothesis with improved methodology to avoid the confounding factors of target similarity, alphabet size, individual variation, peripheral refractive error, and stimulus size. Acuity was measured for an orientation-discrimination task (horizontal versus vertical) for a three-bar resolution target and for a block-E letter in which all strokes have the same length. We confirmed previous reports in the literature that acuity for these targets is worse than for extended sinusoidal gratings. To account for these results quantitatively, we used difference-spectrum analysis to identify those frequency components of the targets that might form a basis for performing the visual discrimination task. We find that discrimination performance for the three-bar targets and the block-E letters can be accounted for by a sampling-limited model, provided that the limited number of cycles that are present in the characteristic frequency of the stimulus is taken into account. Quantitative differences in acuity for discriminating other letter pairs (e.g., right versus left letters E or characters with short central strokes) could not be attributed to undersampling of either the characteristic frequency or the frequency of maximum energy in the difference spectrum. These results suggest additional tests of the sampling theory of visual resolution, which are the subject of a companion paper.

Adaptation to peripheral flicker

With strict fixation, a flickering disk presented in the peripheral retina rapidly appeared to lose contrast and stop flickering, owing to adaptation. Subjects measured this adaptation by continually adjusting the flicker amplitude of a peripherally viewed disk to hold it just at threshold.

RESULTS

(1) The contrast threshold for flicker increased logarithmically over time. (2) The slope of the temporal decay function increased with eccentricity (1-16 deg) and with decreasing disk size (8 deg-3.6 min arc). (3) M-scaling the stimulus size could abolish the dependence upon eccentricity for small disks, but not completely for large disks. (4) The temporal decay rate increased with flicker rate (3-15 Hz), as though each cycle of flicker elevated contrast threshold equally.

A comparison of word recognition and reading performance in foveal and peripheral vision

Word recognition thresholds and rapid serial visual presentation (RSVP) reading rates for both unrelated words and meaningful sentences were examined across the visual field. Both word recognition thresholds and RSVP reading rates for unrelated words can be equated across the visual field by an increase in size scale. RSVP reading rates for meaningful sentences cannot be equated across the visual field, with the fovea demonstrating a qualitative superiority over the periphery, irrespective of scale. The results suggest that the early visual machinery which underlies word recognition is the same across the visual field apart from a change in scale, whilst the periphery is qualitatively inferior to the fovea at interpreting sentences with meaning.

Sensitivity to spatial phase at equiluminance

We have measured sensitivity for discriminating the spatial phase of multi-harmonic and two-harmonic patterns modulated either in luminance or in chromaticity (red-green). The multi-harmonic patterns were either highpass squarewaves, lines or ramps. For all patterns, contrast thresholds for discriminating 0 from 180 deg phase were similar to those for discriminating -90 from 90 deg, for luminance or chromatic modulation (or both). For all types of multi-harmonic patterns, the ratio of contrast thresholds for the phase discrimination to that for pattern detection was the same for luminance and chromatic modulation, and for combinations of both. Similarly, phase thresholds, the minimum detectable differences in phase (about a mean 0 deg), were the same for chromatic and luminance patterns, provided that contrast was scaled to equate detection thresholds of the patterns. Similar results were observed for simple three-harmonic patterns (f + 2f + 3f), and for (f + 2f) two-harmonic patterns. Strangely, however, two-harmonic patterns of f + 3f (first two terms of square-wave) of moderate to high spatial frequency did show a two-fold advantage for luminance over colour, as Troscianko and Harris (1988) have previously reported (Vision Research, 28, 1041-1049), possibly because the two harmonics have a greater separation in frequency. However, for most classes of patterns, sensitivity for spatial phase is as good for chromatic as for luminance modulation, suggesting that similar sorts of mechanisms operate under these two conditions.