The figure has a shape, but the ground does not: evidence from a priming paradigm

Different patterns of foreground and background processing contribute to texture segregation in humans: an electrophysiological study

Background

Figure-ground segregation is a necessary process for accurate visual recognition. Previous neurophysiological and human brain imaging studies have suggested that foreground-background segregation relies on both enhanced foreground representation and suppressed background representation. However, in humans, it is not known when and how foreground and background processing play a role in texture segregation.

Methods

To answer this question, it is crucial to extract and dissociate the neural signals elicited by the foreground and background of a figure texture with high temporal resolution. Here, we combined an electroencephalogram (EEG) recording and a temporal response function (TRF) approach to specifically track the neural responses to the foreground and background of a figure texture from the overall EEG recordings in the luminance-tracking TRF. A uniform texture was included as a neutral condition. The texture segregation visual evoked potential (tsVEP) was calculated by subtracting the uniform TRF from the foreground and background TRFs, respectively, to index the specific segregation activity.

Results

We found that the foreground and background of a figure texture were processed differently during texture segregation. In the posterior region of the brain, we found a negative component for the foreground tsVEP in the early stage of foreground-background segregation, and two negative components for the background tsVEP in the early and late stages. In the anterior region, we found a positive component for the foreground tsVEP in the late stage, and two positive components for the background tsVEP in the early and late stages of texture processing.

Discussion

In this study we investigated the temporal profile of foreground and background processing during texture segregation in human participants at a high time resolution. The results demonstrated that the foreground and background jointly contribute to figure-ground segregation in both the early and late phases of texture processing. Our findings provide novel evidence for the neural correlates of foreground-background modulation during figure-ground segregation in humans.

Texture Segregation Causes Early Figure Enhancement and Later Ground Suppression in Areas V1 and V4 of Visual Cortex

Segregation of images into figures and background is fundamental for visual perception. Cortical neurons respond more strongly to figural image elements than to background elements, but the mechanisms of figure–ground modulation (FGM) are only partially understood. It is unclear whether FGM in early and mid-level visual cortex is caused by an enhanced response to the figure, a suppressed response to the background, or both.

We studied neuronal activity in areas V1 and V4 in monkeys performing a texture segregation task. We compared texture-defined figures with homogeneous textures and found an early enhancement of the figure representation, and a later suppression of the background. Across neurons, the strength of figure enhancement was independent of the strength of background suppression.

We also examined activity in the different V1 layers. Both figure enhancement and ground suppression were strongest in superficial and deep layers and weaker in layer 4. The current–source density profiles suggested that figure enhancement was caused by stronger synaptic inputs in feedback-recipient layers 1, 2, and 5 and ground suppression by weaker inputs in these layers, suggesting an important role for feedback connections from higher level areas. These results provide new insights into the mechanisms for figure–ground organization.

Perceptual Grouping in Shape from Shading

We report on the reversal of asymmetry in visual-search tasks with shaded items. Previous studies have suggested that the target of a bottom-lit disk among distractors of top-lit disks is detected in a rapid and parallel manner, but not vice versa. However, in this study, we have shown that the compound items of top-lit disks were searched more quickly than those composed of bottom-lit disks where the items had to be segregated from their background. By modulating the inter-element distances, we confirmed that the reversal of search asymmetry cannot be due to the grouping of items. Further, we showed that the regions of the top-lit disks were perceived as figure more consistently than those of bottom-lit disks. The results indicate that the boundary assignment to the compound items of the top-lit disks enhances the segregation of search items from the background, and that the search mechanism may access the relatively higher representation that includes figure – ground relations.

Grouping puts figure-ground assignment in context by constraining propagation of edge assignment

Figure-ground organization involves the assignment of edges to a figural shape on one or the other side of each dividing edge. Established visual cues for edge assignment primarily concern relatively local rather than contextual factors. In the present article, we show that an assignment for a locally unbiased edge can be affected by an assignment of a remote contextual edge that has its own locally biased assignment. We find that such propagation of edge assignment from the biased remote context occurs only when the biased and unbiased edges are grouped. This new principle, whereby grouping constrains the propagation of figural edge assignment, emerges from both subjective reports and an objective short-term edge-matching task. It generalizes from moving displays involving grouping by common fate and collinearity, to static displays with grouping by similarity of edge-contrast polarity, or apparent occlusion. Our results identify a new contextual influence on edge assignment. They also identify a new mechanistic relation between grouping and figure-ground processes, whereby grouping between remote elements can constrain the propagation of edge assignment between those elements. Supplemental materials for this article may be downloaded from http://app.psychonomic-journals.org/content/supplemental.

The edge complex: implicit memory for figure assignment in shape perception

Viewing a stepped edge is likely to prompt the perceptual assignment of one side of the edge as figure. This study demonstrates that even a single brief glance at a novel edge gives rise to an implicit memory regarding which side was seen as figure; this edge complex enters into the figure assignment process the next time the edge is encountered, both speeding same-different judgments when the figural side is repeated and slowing these judgments when the new figural side is identical to the former ground side (Experiments 1A and 1B). These results were obtained even when the facing direction of the repeated edge was mirror reversed (Experiment 2). This study shows that implicit measures can reveal the effects of past experience on figure assignment, following a single prior exposure to a novel shape, and supports a competitive model of figure assignment in which past experience serves as one of many figural cues.

The time course of figure-ground reversal

We report the results from five experiments employing a modified version of the short-term visual matching (STVM) method introduced by Driver and Baylis (1996). In STVM, participants see a study display with ambiguous figure-ground relations. After the study display, participants have to decide which of two shapes in a match display was seen before in the study display. STVM has been used by Vecera, Vogel, and Woodman (2002) to demonstrate that the lower region is a figure-ground cue. In our modified version of STVM, the study stimulus was preceded by a brief prime. This caused a biasing of the figural interpretation of the ambiguous figure-ground displays that contained the lower region cue. We show that 100-msec priming with an unambiguous display is enough to affect the subsequent interpretation of the ambiguous figure-ground display. It takes maximally 350 msec to complete a transition from the nondominant interpretation to the dominant interpretation of an ambiguous figure-ground display that contains the lower region cue.

Shape Saliency Modulates Contextual Processing in the Human Lateral Occipital Complex

Visual context influences our perception of target objects in natural scenes. However, little is known about the analysis of context information and its role in shape perception in the human brain. We investigated whether the human lateral occipital complex (LOC), known to be involved in the visual analysis of shapes, also processes information about the context of shapes within cluttered scenes. We employed an fMRI adaptation paradigm in which fMRI responses are lower for two identical than for two different stimuli presented consecutively. The stimuli consisted of closed target contours defined by aligned Gabor elements embedded in a background of randomly oriented Gabors. We measured fMRI adaptation in the LOC across changes in the context of the target shapes by manipulating the position and orientation of the background elements. No adaptation was observed across context changes when the background elements were presented in the same plane as the target elements. However, adaptation was observed when the grouping of the target elements was enhanced in a bottom-up (i.e., grouping by disparity or motion) or top-down (i.e., shape priming) manner and thus the saliency of the target shape increased. These findings suggest that the LOC processes information not only about shapes, but also about their context. This processing of context information in the LOC is modulated by figure–ground segmentation and grouping processes. That is, neural populations in the LOC encode context information when relevant to the perception of target shapes, but represent salient targets independent of context changes.

The shape of holes

The shape of holes can be recognized as accurately as the shape of objects (Palmer, S. E. (1999). Vision science: photons to phenomenology. Cambridge, MA: MIT Press), yet the area enclosed by a hole is a background region, and it can be demonstrated that background regions are not represented as having shape. What is therefore the shape of a hole, if any? To resolve this apparent paradox, we suggest that the shape of a hole is available indirectly from the shape of the surrounding object. We exploited the fact that observers are faster at judging the position of convex vertices than concave ones (Perception 30 (2001) 1295), and using a figural manipulation of figure/ground we found a reversal of the relative speeds when the same contours were presented as holes instead of objects. If contours were perceived as belonging to the hole rather than the surrounding object then there would have been no qualitative difference in responses to the object and hole stimuli. We conclude that the contour bounding a hole is automatically assigned to the surrounding object, and that a change in perception of a region from object to hole always drastically changes the encoded information. We discuss the many interesting aspects of holes as a subject of study in different disciplines and predict that much insight especially about shape will continue to come from holes.

Shape-coding in IT cells generalizes over contrast and mirror reversal, but not figure-ground reversal

We assessed how the visual shape preferences of neurons in the inferior temporal cortex of awake, behaving monkeys generalized across three different stimulus transformations. Stimulus-preferences of particular cells among different polygon displays were correlated across reversed contrast polarity or mirror reversal, but not across figure-ground reversal. This corresponds with psychological findings on human shape judgments. Our results imply that neurons in inferior temporal cortex respond to components of visual shape derived only after figure-ground assignment of contours, not to the contours themselves.