Inhibitory competition between shape properties in figure-ground perception

Disambiguating vision with sound

An important task for the visual system is to identify and segregate objects from background. Figure-ground illusions, such as Edgar Rubin's bistable 'vase-faces illusion'1, make the point clearly: we see either a central vase or lateral faces, alternating spontaneously, but never both images simultaneously. The border is perceptually assigned to either faces or vase, which become figure, the other shapeless background2. The stochastic alternation between figure and ground probably reflects mutual inhibitory processes that ensure a single perceptual outcome3. Which shape dominates perception depends on many factors, such as size, symmetry, convexity, enclosure, and so on, as well as attention and intention4. Here we show that the assignment of the visual border can be strongly influenced by auditory input, far more than is possible by voluntary intention. VIDEO ABSTRACT.

BOLD activation on the groundside of figures: More suppression of grounds that competed more for figural status

A fundamental aspect of object detection is assigning a border to one (figure) side but not the other (ground) side. Figures are shaped; grounds appear shapeless near the figure border. Accumulating evidence supports the view that the mechanism of figure assignment is inhibitory competition with the figure perceived on the winning side. Suppression has been observed on the groundside of figure borders. One prediction is that more suppression will be observed when the groundside competes more for figural status. We tested this prediction by assessing BOLD activation on the groundside of two types of stimuli with articulated borders: AE_nov and AE_fam stimuli. In both stimulus types, multiple image-based priors (symmetry, closure, small area, enclosure by a larger region) favored the inside as the figure. In AE_fam but not AE_nov stimuli, the figural prior of familiar configuration present on the outside competes for figural status. Observers perceived the insides of both types of stimuli as novel figures and the outsides as shapeless grounds. Previously, we observed lower BOLD activation in early visual areas representing the grounds of AE_fam than AE_nov stimuli, although unexpectedly, activation was above baseline. With articulated borders, it can be difficult to exclude figure activation from ground ROIs. Here, our ground ROIs better excluded figure activation; we also added straight-edge (SE) control stimuli and increased the sample size. In early visual areas representing the grounds, we observed lower BOLD activation on the groundside of AE_fam than AE_nov stimuli and below-baseline BOLD activation on the groundside of SE and AE_fam stimuli. These results, indicating that greater suppression is applied to groundsides that competed more for figural status but lost the competition, support a Bayesian model of figure assignment in which proto-objects activated at both low and high levels where image features and familiar configurations are represented, respectively, compete for figural status.

Columnar processing of border ownership in primate visual cortex

To understand a visual scene, the brain segregates figures from background by assigning borders to foreground objects. Neurons in primate visual cortex encode which object owns a border (border ownership), but the underlying circuitry is not understood. Here, we used multielectrode probes to record from border ownership-selective units in different layers in macaque visual area V4 to study the laminar organization and timing of border ownership selectivity. We find that border ownership selectivity occurs first in deep layer units, in contrast to spike latency for small stimuli in the classical receptive field. Units on the same penetration typically share the preferred side of border ownership, also across layers, similar to orientation preference. Units are often border ownership-selective for a range of border orientations, where the preferred sides of border ownership are systematically organized in visual space. Together our data reveal a columnar organization of border ownership in V4 where the earliest border ownership signals are not simply inherited from upstream areas, but computed by neurons in deep layers, and may thus be part of signals fed back to upstream cortical areas or the oculomotor system early after stimulus onset. The finding that preferred border ownership is clustered and can cover a wide range of spatially contiguous locations suggests that the asymmetric context integrated by these neurons is provided in a systematically clustered manner, possibly through corticocortical feedback and horizontal connections.

To understand a visual scene, the brain needs to identify objects and distinguish them from background. A border marks the transition from object to background, but to differentiate which side of the border belongs to the object and which to background, the brain must integrate information across space. An early signature of this computation is that brain cells signal which side of a border is ‘owned’ by an object, also known as border ownership. But how the brain computes border ownership remains unknown.

The optic nerve is a cable-like group of nerve cells that transmits information from the eye to the brain’s visual processing areas and into the visual cortex. This flow of information is often described as traveling in a feedforward direction, away from the eyes to progressively more specialized areas in the visual cortex. However, there are also numerous feedback connections in the brain, running backward from more specialized to less specialized cortical areas.

To better understand the role of these feedforward and feedback circuits in the visual processing of object borders, Franken and Reynolds made use of their stereotyped projection patterns across the cortex layers. Feedforward connections terminate in the middle layers of a cortical area, whereas feedback connections terminate in upper and lower layers. Since time is required for information to traverse the cortical layers, dissecting the timing of border ownership signals may reveal if border ownership is computed in a feedforward or feedback manner. To find out more, electrodes were used to record neural activity in the upper, middle and lower layers of the visual cortex of two rhesus monkeys as they were presented with a set of abstract scenes composed of simple shapes on a background.

This revealed that cells signaling border ownership in deep layers of the cortex did so before the signals appeared in the middle layer. This suggests that feedback rather than feedforward is required to compute border ownership. Moreover, Franken and Reynolds found evidence that cells that prefer the same side of border ownership are clustered in columns, showing how these neural circuits are organized within the visual cortex.

In summary, Franken and Reynolds found that the circuits of the primate brain that compute border ownership occur as columns, in which cells in deep layers signal border ownership first, suggesting that border ownership relies on feedback from more specialized areas. A better understanding of how feedback in the brain works to process visual information helps us appreciate what happens when these systems are impaired.

Task set and instructions influence the weight of figural priors: A psychophysical study with extremal edges and familiar configuration

In figure-ground organization, the figure is defined as a region that is both "shaped" and "nearer." Here we test whether changes in task set and instructions can alter the outcome of the cross-border competition between figural priors that underlies figure assignment. Extremal edge (EE), a relative distance prior, has been established as a strong figural prior when the task is to report "which side is nearer?" In three experiments using bipartite stimuli, EEs competed and cooperated with familiar configuration, a shape prior for figure assignment in a "which side is shaped?" task." Experiment 1 showed small but significant effects of familiar configuration for displays sketching upright familiar objects, although "shaped-side" responses were predominantly determined by EEs. In Experiment 2, instructions regarding the possibility of perceiving familiar shapes were added. Now, although EE remained the dominant prior, the figure was perceived on the familiar-configuration side of the border on a significantly larger percentage of trials across all display types. In Experiment 3, both task set (nearer/shaped) and the presence versus absence of instructions emphasizing that familiar objects might be present were manipulated within subjects. With familiarity thus "primed," effects of task set emerged when EE and familiar configuration favored opposite sides as figure. Thus, changing instructions can modulate the weighing of figural priors for shape versus distance in figure assignment in a manner that interacts with task set. Moreover, we show that the influence of familiar parts emerges in participants without medial temporal lobe/ perirhinal cortex brain damage when instructions emphasize that familiar objects might be present.

Learned value and predictiveness affect gaze but not figure assignment

Many factors affect figure-ground segregation, but the contributions of attention and reward history to this process is uncertain. We conducted two experiments to investigate whether reward learning influences figure assignment and whether this relationship was mediated by attention. Participants learned to associate certain shapes with a reward contingency: During a learning phase, they chose between two shapes on each trial, with subsets of shapes associated with high-probability win, low-probability win, high-probability loss, and low-probability loss. In a test phase, participants were given a figure-ground task, in which they indicated which of two regions that shared a contour they perceived as the figure (high-probability win and low-probability win shapes were pitted against each other, as were high-probability loss and low-probability loss shapes). The results revealed that participants had learned the reward contingencies and that, following learning, attention was reliably drawn to the optimal stimulus. Despite this, neither reward history nor the resulting attentional allocation influenced figure-ground organization.

Normative data for an expanded set of stimuli for testing high-level influences on object perception: OMEFA-II

We present normative data for an expanded set of stimuli designed to investigate past experience effects on object detection. The stimuli are vertically-elongated “bipartite” displays comprising two equal-area regions meeting at an articulated central border. When the central border is assigned to one side, a shaped figure (i.e., an object) is detected on that side. Participants viewing brief masked exposures typically detect figures more often on the critical side of Intact displays where a common (“familiar”) object is depicted than on a matched critical side of Part-Rearranged (PR) displays comprising the same parts arranged in novel configurations. This pattern of results showed that past experience in the form of familiar configuration rather than familiar parts is a prior for figure assignment. Spurred by research implicating a network involving the perirhinal cortex of the medial temporal lobe in these familiar configuration effects, we enlarged the stimulus set from 24 to 48 base stimuli to increase its usefulness for behavioral, neuropsychological, and neuroimaging experiments. We measured the percentage of participants who agreed on a single interpretation for each side of Intact, Upright PR, and Inverted PR displays (144 displays; 288 sides) under long exposure conditions. High inter-subject agreement is taken to operationally define a familiar configuration. This new stimulus set is well-suited to investigate questions concerning how parts and wholes are integrated and how high- and low-level brain areas interact in object detection. This set also allows tests of predictions regarding cross-border competition in figure assignment and assessments of individual differences. The displays, their image statistics, and normative data are available online (https://osf.io/j9kz2/).

Semantic category priming from the groundside of objects shown in nontarget locations and at unpredictable times

Previous research demonstrated that familiar objects that are suggested, but not consciously perceived, on the groundside of the contours of a figure activate their semantic category during perceptual organization, at least when the figure appears at fixation at an expected time. Here, we investigate whether evidence for such semantic activation extends to stimuli presented at unpredictable times in peripheral locations. Participants categorized words shown centrally as denoting natural or artificial objects (Experiments 1 and 2a) or positive or negative concepts (Experiment 2b). Prior to the word, two distractor silhouettes appeared above and below fixation; both depicted novel figures. On experimental trials, portions of well-known (familiar) objects were suggested on the groundside of the borders of one (Experiment 1) or both (Experiment 2a and 2b) silhouettes. In Experiment 1, reaction times were slower when targets words were preceded by experimental distractor silhouettes regardless of whether the object suggested on the groundside of their borders was in the same or a different category as the object denoted by the word. Overall slowing may have occurred because (a) semantic category access by objects suggested on the groundside of experimental distractor silhouettes was sufficient to require filtering but not category-specific priming, (b) more competition for object status slowed processing of experimental compared to control silhouettes, or (c) featural differences increased the difficulty of processing the experimental versus the control silhouettes. The use of two identical experimental silhouettes in Experiment 2a allowed a semantic category priming effect to emerge, showing that the categories of objects suggested on the groundside of silhouette borders can be activated at unpredictable times in nontarget locations and in more than one location of the visual field. Experiment 2a suggested that (a) better explains the results of Experiment 1 than (b and c). Experiment 2b further ruled out explanations (b and c) as reasons for the Experiment 1 results by showing that the same pattern is not obtained when the semantic category of the objects suggested on the groundside of the experimental silhouettes borders is not task-relevant and does not require filtering. Thus, spatial prime-target congruence and temporal certainty are not necessary for priming by objects suggested on the groundside of figures. Implications for our understanding of the complex processes involved in perceptual organization are considered.

Generating Ambiguous Figure-Ground Images

Ambiguous figure-ground images, mostly represented as binary images, are fascinating as they present viewers a visual phenomena of perceiving multiple interpretations from a single image. In one possible interpretation, the white region is seen as a foreground figure while the black region is treated as shapeless background. Such perception can reverse instantly at any moment. In this paper, we investigate the theory behind this ambiguous perception and present an automatic algorithm to generate such images. We model the problem as a binary image composition using two object contours and approach it through a three-stage pipeline. The algorithm first performs a partial shape matching to find a good partial contour matching between objects. This matching is based on a content-aware shape matching metric, which captures features of ambiguous figure-ground images. Then we combine matched contours into a compound contour using an adaptive contour deformation, followed by computing an optimal cropping window and image binarization for the compound contour that maximize the completeness of object contours in the final composition. We have tested our system using a wide range of input objects and generated a large number of convincing examples with or without user guidance. The efficiency of our system and quality of results are verified through an extensive experimental study.

Texture Segregation Causes Early Figure Enhancement and Later Ground Suppression in Areas V1 and V4 of Visual Cortex

Segregation of images into figures and background is fundamental for visual perception. Cortical neurons respond more strongly to figural image elements than to background elements, but the mechanisms of figure–ground modulation (FGM) are only partially understood. It is unclear whether FGM in early and mid-level visual cortex is caused by an enhanced response to the figure, a suppressed response to the background, or both.

We studied neuronal activity in areas V1 and V4 in monkeys performing a texture segregation task. We compared texture-defined figures with homogeneous textures and found an early enhancement of the figure representation, and a later suppression of the background. Across neurons, the strength of figure enhancement was independent of the strength of background suppression.

We also examined activity in the different V1 layers. Both figure enhancement and ground suppression were strongest in superficial and deep layers and weaker in layer 4. The current–source density profiles suggested that figure enhancement was caused by stronger synaptic inputs in feedback-recipient layers 1, 2, and 5 and ground suppression by weaker inputs in these layers, suggesting an important role for feedback connections from higher level areas. These results provide new insights into the mechanisms for figure–ground organization.

Enhanced spatial resolution on figures versus grounds

Much is known about the cues that determine figure-ground assignment, but less is known about the consequences of figure-ground assignment on later visual processing. Previous work has demonstrated that regions assigned figural status are subjectively more shape-like and salient than background regions. The increase in subjective salience of figural regions could be caused by a number of processes, one of which may be enhanced perceptual processing (e.g., an enhanced neural representation) of figures relative to grounds. We explored this hypothesis by having observers perform a perceptually demanding spatial resolution task in which targets appeared on either figure or ground regions. To rule out a purely attentional account of figural salience, observers discriminated targets on the basis of a region's color (red or green), which was equally likely to define the figure or the ground. The results of our experiments showed that targets appearing on figures were discriminated more accurately than those appearing in ground regions. In addition, targets appearing on figures were discriminated better than those presented in regions considered figurally neutral, but targets appearing within ground regions were discriminated more poorly than those appearing in figurally neutral regions. Taken together, our findings suggest that when two regions share a contour, regions assigned as figure are perceptually enhanced, whereas regions assigned as ground are perceptually suppressed.

Semantic access occurs outside of awareness for the ground side of a figure

Traditional theories of vision assume that figures and grounds are assigned early in processing, with semantics being accessed later and only by figures, not by grounds. We tested this assumption by showing observers novel silhouettes with borders that suggested familiar objects on their ground side. The ground appeared shapeless near the figure's borders; the familiar objects suggested there were not consciously perceived. Participants' task was to categorize words shown immediately after the silhouettes as naming natural versus artificial objects. The words named objects from the same or from a different superordinate category as the familiar objects suggested in the silhouette ground. In Experiment 1, participants categorized words faster when they followed silhouettes suggesting upright familiar objects from the same rather than a different category on their ground sides, whereas no category differences were observed for inverted silhouettes. This is the first study to show unequivocally that, contrary to traditional assumptions, semantics are accessed for objects that might be perceived on the side of a border that will ultimately be perceived as a shapeless ground. Moreover, although the competition for figural status results in suppression of the shape of the losing contender, its semantics are not suppressed. In Experiment 2, we used longer silhouette-to-word stimulus onset asynchronies to test whether semantics would be suppressed later in time, as might occur if semantics were accessed later than shape memories. No evidence of semantic suppression was observed; indeed, semantic activation of the objects suggested on the ground side of a border appeared to be short-lived. Implications for feedforward versus dynamical interactive theories of object perception are discussed.

Spatially rearranged object parts can facilitate perception of intact whole objects

The familiarity of an object depends on the spatial arrangement of its parts; when the parts are spatially rearranged, they form a novel, unrecognizable configuration. Yet the same collection of parts comprises both the familiar and novel configuration. Is it possible that the collection of familiar parts activates a representation of the intact familiar configuration even when they are spatially rearranged? We presented novel configurations as primes before test displays that assayed effects on figure-ground perception from memories of intact familiar objects. In our test displays, two equal-area regions shared a central border; one region depicted a portion of a familiar object. Previous research with such displays has shown that participants are more likely to perceive the region depicting a familiar object as the figure and the abutting region as its ground when the familiar object is depicted in its upright orientation rather than upside down. The novel primes comprised either the same or a different collection of parts as the familiar object in the test display (part-rearranged and control primes, respectively). We found that participants were more likely to perceive the familiar region as figure in upright vs. inverted displays following part-rearranged primes but not control primes. Thus, priming with a novel configuration comprising the same familiar parts as the upcoming figure-ground display facilitated orientation-dependent effects of object memories on figure assignment. Similar results were obtained when the spatially rearranged collection of parts was suggested on the groundside of the prime's border, suggesting that familiar parts in novel configurations access the representation of their corresponding intact whole object before figure assignment. These data demonstrate that familiar parts access memories of familiar objects even when they are arranged in a novel configuration.

Temporal resolution of figures and grounds

Recent studies have demonstrated that establishing figure-ground organization influences other perceptual processes. Specifically, figures undergo perceptual processing earlier than ground regions (Lester, Hecht, & Vecera, 2009), and they are processed for longer durations relative to ground regions (Hecht & Vecera, 2011). One potential consequence of figures' extended processing is degraded temporal resolution compared to ground regions. To test this hypothesis, observers completed a modified flicker-fusion task while viewing either displays that contained well-defined figures and grounds or displays that were ambiguous. As evidenced by increased sensitivity for flickering targets on the ground regions, the current results support the claim that figures have poorer temporal resolution than ground regions.

The Shape of a Hole is Perceived as the Shape of its Interior

In typical figure–ground displays the figure has shape and is perceived as being in front, whereas the ground is shapeless and recedes to the back. The recent literature on the visual perception of holes has questioned the nature of this coupling between shape and depth both theoretically and empirically. In this paper we provide a theoretical framework that clarifies the underlying issues and we report new evidence supporting the view that the shape of a hole is perceived as the shape of its interior region. Palmer, Davis, Nelson, and Rock (2008 Perception, 37, 1569–1586) showed that the shape of the interior region of a hole is remembered as such, even though the surface visible through it is perceived as farther in depth. The present paper extends this evidence to perceiving holes. Participants performed a speeded shape-matching task in which they compared a surrounded interior region (of either a hole or an object) or its exterior complement with one of several shapes. The results indicate that holes are perceived as shaped in the same way as their material counterparts. We conclude that the shape of a hole is encoded as the shape of its interior region, even though that region contains no surface material. These results can be reconciled with recent experiments that have provided evidence that holes are perceived differently from their material counterparts.

The ground side of an object: perceived as shapeless yet processed for semantics

Traditional theories of perception posit that only objects access semantics; abutting, patently shapeless grounds do not. Surprisingly, this assumption has been untested until now. In two experiments, participants classified silhouettes as depicting meaningful real-world or meaningless novel objects while event-related potentials (ERPs) were recorded. The borders of half of the novel objects suggested portions of meaningful objects on the ground side. Participants were unaware of these meaningful objects because grounds are perceived as shapeless. In Experiment 1, in which silhouettes were presented twice, N400 ERP repetition effects indicated that semantics were accessed for novel silhouettes that suggested meaningful objects in the ground and for silhouettes that depicted real-world objects, but not for novel silhouettes that did not suggest meaningful objects in the ground. In Experiment 2, repetition was manipulated via matching prime words. This experiment replicated the effect observed in Experiment 1. These experiments provide the first neurophysiological evidence that semantic access can occur for the apparently shapeless ground side of a border.

Borders, contours, and mechanism

Kogo and Wagemans claim that subjective contours are assigned from the earliest processing stages. I argue that in making this claim, Kogo and Wagemans are mistaking subjective experience with the perceptual mechanism. There is ample evidence that before figure assignment occurs object properties on opposite sides of unassigned borders compete for perception as figures. In order for these properties to compete, these must be a point in processing at which a border exists before it is assigned to one side.

Processing convexity and concavity along a 2-D contour: figure-ground, structural shape, and attention

Interest in convexity has a long history in vision science. For smooth contours in an image, it is possible to code regions of positive (convex) and negative (concave) curvature, and this provides useful information about solid shape. We review a large body of evidence on the role of this information in perception of shape and in attention. This includes evidence from behavioral, neurophysiological, imaging, and developmental studies. A review is necessary to analyze the evidence on how convexity affects (1) separation between figure and ground, (2) part structure, and (3) attention allocation. Despite some broad agreement on the importance of convexity in these areas, there is a lack of consensus on the interpretation of specific claims--for example, on the contribution of convexity to metric depth and on the automatic directing of attention to convexities or to concavities. The focus is on convexity and concavity along a 2-D contour, not convexity and concavity in 3-D, but the important link between the two is discussed. We conclude that there is good evidence for the role of convexity information in figure-ground organization and in parsing, but other, more specific claims are not (yet) well supported.

A century of Gestalt psychology in visual perception: I. Perceptual grouping and figure-ground organization

In 1912, Max Wertheimer published his paper on phi motion, widely recognized as the start of Gestalt psychology. Because of its continued relevance in modern psychology, this centennial anniversary is an excellent opportunity to take stock of what Gestalt psychology has offered and how it has changed since its inception. We first introduce the key findings and ideas in the Berlin school of Gestalt psychology, and then briefly sketch its development, rise, and fall. Next, we discuss its empirical and conceptual problems, and indicate how they are addressed in contemporary research on perceptual grouping and figure-ground organization. In particular, we review the principles of grouping, both classical (e.g., proximity, similarity, common fate, good continuation, closure, symmetry, parallelism) and new (e.g., synchrony, common region, element and uniform connectedness), and their role in contour integration and completion. We then review classic and new image-based principles of figure-ground organization, how it is influenced by past experience and attention, and how it relates to shape and depth perception. After an integrated review of the neural mechanisms involved in contour grouping, border ownership, and figure-ground perception, we conclude by evaluating what modern vision science has offered compared to traditional Gestalt psychology, whether we can speak of a Gestalt revival, and where the remaining limitations and challenges lie. A better integration of this research tradition with the rest of vision science requires further progress regarding the conceptual and theoretical foundations of the Gestalt approach, which is the focus of a second review article.

The Effect of Contour Closure on Shape Recognition

Recent research on the Gestalt principle of closure has focused on how the presence of closure affects the ability to detect contours hidden in cluttered visual arrays. Some of the earliest research on closure, however, dealt with encoding and recognizing closed and open shapes, rather than detection. This research re-addresses the relation between closure and shape memory, focusing on how contour closure affects the ability to learn to recognize novel contour shapes. Of particular interest is whether closed contour shapes are easier to learn to recognize and, if so, whether this benefit is due to better encoding of closed contour shapes or easier comparison of closed contour shapes to already learned shapes. The results show that closed contours are indeed easier to recognize and, further, that this advantage appears to be related to better encoding.

Interactions of memory and perception in amnesia: the figure-ground perspective

The medial temporal lobes (MTLs) have been thought to function exclusively in service of declarative memory. Recent research shows that damage to the perirhinal cortex (PRC) of the MTL impairs the discrimination of objects sharing many similar parts/features, leading to the hypothesis that the PRC contributes to the perception when the feature configurations, rather than the individual features, are required to solve the task. It remains uncertain, however, whether the previous research demands a slight extension of PRC function to include working memory or a more dramatic extension to include perception. We present 2 experiments assessing the implicit effects of familiar configuration on figure assignment, an early and fundamental perceptual outcome. Unlike controls, PRC-damaged individuals failed to perceive the regions portraying familiar configurations, as figure more often, than the regions comprising the same parts rearranged into novel configurations. They were also impaired in identifying the familiar objects. In a third experiment, PRC-damaged individuals performed poorly when asked to choose a familiar object from pairs of familiar and novel objects comprising the same parts. Our results demonstrate that the PRC is involved in both implicit and explicit perceptual discriminations of novel and familiar configurations. These results reveal that complex object representations in the PRC subserve both perception and memory.

Basic-level categorization of intermediate complexity fragments reveals top-down effects of expertise in visual perception

Visual expertise is usually defined as the superior ability to distinguish between exemplars of a homogeneous category. Here, we ask how real-world expertise manifests at basic-level categorization and assess the contribution of stimulus-driven and top-down knowledge-based factors to this manifestation. Car experts and novices categorized computer-selected image fragments of cars, airplanes, and faces. Within each category, the fragments varied in their mutual information (MI), an objective quantifiable measure of feature diagnosticity. Categorization of face and airplane fragments was similar within and between groups, showing better performance with increasing MI levels. Novices categorized car fragments more slowly than face and airplane fragments, while experts categorized car fragments as fast as face and airplane fragments. The experts' advantage with car fragments was similar across MI levels, with similar functions relating RT with MI level for both groups. Accuracy was equal between groups for cars as well as faces and airplanes, but experts' response criteria were biased toward cars. These findings suggest that expertise does not entail only specific perceptual strategies. Rather, at the basic level, expertise manifests as a general processing advantage arguably involving application of top-down mechanisms, such as knowledge and attention, which helps experts to distinguish between object categories.

Binocular rivalry: competition and inhibition in visual perception

When the brain is presented with ambiguous visual stimuli supporting two interpretations, perception becomes bistable and alternates over time between one interpretation and the other. This process contains elements of competition (between the rivaling percepts) as well as inhibition, as the percepts are mutually exclusive so that one is always suppressed. This review covers the most widely studied form of bistable perception-binocular rivalry. Suppression in rivalry is covered in detail, including discussion of its general and specific components, its local nature and spatial organization, techniques for quantifying it, and the role of global feedback. The competitive dynamics of rivalry are discussed within the context of the classical 'adapting reciprocal inhibition' model of rivalry and recent evidence supporting this model is discussed. This model is contrasted with alternative models based on late competition and with hybrid models. Finally, the role of attention in rivalry is examined and commonalities with other forms of bistable perception are noted. WIREs Cogn Sci 2012, 3:87-103. doi: 10.1002/wcs.151 For further resources related to this article, please visit the WIREs website.

Update on memory systems and processes

Ideas about how the brain organizes learning and memory have been evolving in recent years, with potentially important ramifications. We review traditional thinking about learning and memory and consider more closely emerging trends from both human and animal research that could lead to profound shifts in how we understand the neural basis of memory.

The effect of recognizability on figure-ground processing: does it affect parsing or only figure selection?

Though figure-ground assignment has been shown to be probably affected by recognizability, it appears sensible that object recognition must follow at least the earlier process of figure-ground segregation. To examine whether or not rudimentary object recognition could, counterintuitively, start even before the completion of the stage of parsing in which figure-ground segregation is done, participants were asked to respond, in a go/no-go fashion, whenever any out of 16 alternative connected patterns (that constituted familiar stimuli in the upright orientation) appeared. The white figure of the to-be-attended stimulus-target or foil-could be segregated from the white ambient ground only by means of a frame surrounding it. Such a frame was absent until the onset of target display. Then, to manipulate organizational quality, the greyness of the frame was either gradually increased from zero (in Experiment 1) or changed abruptly to a stationary level whose greyness was varied between trials (in Experiments 2 and 3). Stimulus recognizability was manipulated by orientation angle. In all three experiments the effect of recognizability was found to be considerably larger when organizational quality was minimal due to an extremely faint frame. This result is argued to be incompatible with any version of a serial thesis suggesting that processing aimed at object recognition starts only with a good enough level of organizational quality. The experiments rather provide some support to the claim, termed here "early interaction hypothesis", positing interaction between early recognition processing and preassignment parsing processes.

Natural-scene statistics predict how the figure-ground cue of convexity affects human depth perception

The shape of the contour separating two regions strongly influences judgments of which region is "figure" and which is "ground." Convexity and other figure-ground cues are generally assumed to indicate only which region is nearer, but nothing about how much the regions are separated in depth. To determine the depth information conveyed by convexity, we examined natural scenes and found that depth steps across surfaces with convex silhouettes are likely to be larger than steps across surfaces with concave silhouettes. In a psychophysical experiment, we found that humans exploit this correlation. For a given binocular disparity, observers perceived more depth when the near surface's silhouette was convex rather than concave. We estimated the depth distributions observers used in making those judgments: they were similar to the natural-scene distributions. Our findings show that convexity should be reclassified as a metric depth cue. They also suggest that the dichotomy between metric and nonmetric depth cues is false and that the depth information provided many cues should be evaluated with respect to natural-scene statistics. Finally, the findings provide an explanation for why figure-ground cues modulate the responses of disparity-sensitive cells in visual cortex.

Audiovisual integration of speech in a bistable illusion

Visible speech enhances the intelligibility of auditory speech when listening conditions are poor [1], and can modify the perception of otherwise perfectly audible utterances [2]. This audiovisual perception is our most natural form of communication and one of our most common multisensory phenomena. However, where and in what form the visual and auditory representations interact is still not completely understood. Although there are longstanding proposals that multisensory integration occurs relatively late in the speech-processing sequence [3], considerable neurophysiological evidence suggests that audiovisual interactions can occur in the brain stem and primary sensory cortices [4, 5]. A difficulty testing such hypotheses is that when the degree of integration is manipulated experimentally, the visual and/or auditory stimulus conditions are drastically modified [6, 7]; thus, the perceptual processing within a modality and the corresponding processing loads are affected [8]. Here, we used a bistable speech stimulus to examine the conditions under which there is a visual influence on auditory perception in speech. The results indicate that visual influences on auditory speech processing, at least for the McGurk illusion, necessitate the conscious perception of the visual speech gestures, thus supporting the hypothesis that multisensory speech integration is not completed in early processing stages.

Figure-ground segmentation can occur without attention

The question of whether or not figure-ground segmentation can occur without attention is unresolved. Early theorists assumed it can, but the evidence is scant and open to alternative interpretations. Recent research indicating that attention can influence figure-ground segmentation raises the question anew. We examined this issue by asking participants to perform a demanding change-detection task on a small matrix presented on a task-irrelevant scene of alternating regions organized into figures and grounds by convexity. Independently of any change in the matrix, the figure-ground organization of the scene changed or remained the same. Changes in scene organization produced congruency effects on target-change judgments, even though, when probed with surprise questions, participants could report neither the figure-ground status of the region on which the matrix appeared nor any change in that status. When attending to the scene, participants reported figure-ground status and changes to it highly accurately. These results clearly demonstrate that figure-ground segmentation can occur without focal attention.