Temporal frequency and contrast tagging bias the type of competition in interocular switch rivalry

Neural Dynamics during Binocular Rivalry: Indications from Human Lateral Geniculate Nucleus

When two sufficiently different stimuli are presented to each eye, perception alternates between them. This binocular rivalry is conceived as a competition for representation in the single stream of visual consciousness. The magnocellular (M) and parvocellular (P) pathways, originating in the retina, encode disparate information, but their potentially different contributions to binocular rivalry have not been determined. Here, we used functional magnetic resonance imaging to measure the human lateral geniculate nucleus (LGN), where the M and P neurons are segregated into layers receiving input from a single eye. We had three participants (one male, two females) and used achromatic stimuli to avoid contributions from color opponent neurons that may have confounded previous studies. We observed activity in the eye-specific regions of LGN correlated with perception, with similar magnitudes during rivalry or physical stimuli alternations, also similar in the M and P regions. These results suggest that LGN activity reflects our perceptions during binocular rivalry and is not simply an artifact of color opponency. Further, perception appears to be a global phenomenon in the LGN, not just limited to a single information channel.

The Certainty of Ambiguity in Visual Neural Representations

Some images evoke bistable percepts: two different visual experiences seen in alternation while continuously viewing an unchanged stimulus. The Necker Cube and Rubin's Vase are classic examples, each of which gives alternating percepts of different shapes. Other bistable percepts are alternating colors or directions of motion. Although stimuli that result in salient bistability are rare and sometimes cleverly constructed to emphasize ambiguity, they have been influential for over 150 years, since the work of von Helmholtz, who considered them to be evidence for perceptual visual processes that interpret retinal stimuli. While bistability in natural viewing is uncommon, the main point of this review is that implicit ambiguity in visual neural representations is pervasive. Resolving ambiguity, therefore, is a fundamental and ubiquitous process of vision that routinely affects what we see, not an oddity arising from cleverly crafted images. This review focuses on the causes of widespread ambiguity, historical perspectives on it, and modern knowledge and theory about resolving it.

Stimulus rivalry and binocular rivalry share a common neural substrate

When two incompatible images are shown separately to each eye, a perceptual process known as binocular rivalry occurs by which the two images compete for awareness. The site of competition for binocular rivalry has been a topic of debate, and recent theories are that it may occur either at low levels of the visual system where the inputs from the two eyes are combined or at high levels of the visual system where the two images are processed. One of the major pieces of evidence for a high-level image account of rivalry is a phenomenon known as stimulus rivalry, in which two competing stimuli are swapped between the eyes at 3 Hz. However, there is little available neurophysiological evidence for a neural substrate for this high-level competition. Here, we used frequency tagging of two competing stimuli in binocular rivalry and stimulus rivalry in humans to evaluate whether the steady-state visually evoked potentials (SSVEPs) show similar signatures of neural competition for both conditions. We found that flickering the stimuli generates spectral power at the tagged frequencies in both types of rivalry in the early visual cortex. We then quantified dynamic signatures of competition by tracking amplitude changes in the frequency tags, which showed that both types of rivalry colocalized in occipital regions of the cortex. Thus, contrary to our hypothesis that stimulus rivalry was being mediated by high-level competition between the images, we find that neural competition measured by the SSVEP instead suggests that the sites of competition for stimulus rivalry and binocular rivalry may similarly include the occipital pole and middle temporal gyrus (hMT+/V5) of the visual system, consistent with a low-level, binocular interpretation.

Binocular flash suppression in the primary visual cortex of anesthetized and awake macaques

Primary visual cortex (V1) was implicated as an important candidate for the site of perceptual suppression in numerous psychophysical and imaging studies. However, neurophysiological results in awake monkeys provided evidence for competition mainly between neurons in areas beyond V1. In particular, only a moderate percentage of neurons in V1 were found to modulate in parallel with perception with magnitude substantially smaller than the physical preference of these neurons. It is yet unclear whether these small modulations are rooted from local circuits in V1 or influenced by higher cognitive states. To address this question we recorded multi-unit spiking activity and local field potentials in area V1 of awake and anesthetized macaque monkeys during the paradigm of binocular flash suppression. We found that a small but significant modulation was present in both the anesthetized and awake states during the flash suppression presentation. Furthermore, the relative amplitudes of the perceptual modulations were not significantly different in the two states. We suggest that these early effects of perceptual suppression might occur locally in V1, in prior processing stages or within early visual cortical areas in the absence of top-down feedback from higher cognitive stages that are suppressed under anesthesia.

Image-based grouping during binocular rivalry is dictated by eye-of-origin

Prolonged viewing of dichoptically presented images with different content results in perceptual alternations known as binocular rivalry. This phenomenon is thought to be the result of competition at a local level, where local rivalry zones interact to give rise to a single, global dominant percept. Certain perceived combinations that result from this local competition are known to last longer than others, which is referred to as grouping during binocular rivalry. In recent years, the phenomenon has been suggested to be the result of competition at both eye- and image-based processing levels, although the exact contribution from each level remains elusive. Here we use a paradigm designed specifically to quantify the contribution of eye- and image-based processing to grouping during rivalry. In this paradigm we used sine-wave gratings as well as upright and inverted faces, with and without binocular disparity-based occlusion. These stimuli and conditions were used because they are known to result in processing at different stages throughout the visual processing hierarchy. Specifically, more complex images were included in order to maximize the potential contribution of image-based grouping. In spite of this, our results show that increasing image complexity did not lead to an increase in the contribution of image-based processing to grouping during rivalry. In fact, the results show that grouping was primarily affected by the eye-of-origin of the image parts, irrespective of stimulus type. We suggest that image content affects grouping during binocular rivalry at low-level processing stages, where it is intertwined with eye-of-origin information.

Understanding attentional modulation of binocular rivalry: a framework based on biased competition

Starting from early scientific explorations of binocular rivalry, researchers have wondered about the degree to which an observer can exert voluntary attentional control over rivalry dynamics. The answer to this question would not only reveal the extent to which we may determine our own conscious visual experience, but also advance our understanding of the neural mechanisms underlying binocular rivalry. Classic studies, intriguingly, reached contradictory conclusions, ranging from an absence of attentional control, as advocated by Breese, to nearly complete control of rivalry dynamics, as reported by Helmholtz. Recent investigations have revisited this question, but the results have continued to echo the conflicting findings of earlier studies, seemingly precluding a comprehensive understanding of attentional effects on rivalry. Here, we review both classic and modern studies, and propose a unifying framework derived from the biased competition theory of attention. The key assumption of this theory is that the nature of stimulus conflict determines the limits of attentional modulation. For example, a condition in which unresolved stimulus conflict transpires through many levels of visual processing should be very susceptible to attentional control. When applied to binocular rivalry, this framework predicts strong attentional modulations under conditions of unresolved stimulus conflict (e.g., initial selection) and conditions where conflict is resolved at higher levels of visual processing (e.g., stimulus rivalry). Additionally, the efficacy of attentional control over rivalry can be increased by utilization of demanding, behaviorally relevant tasks, and likely through perceptual training paradigms. We show that this framework can help facilitate the understanding and synthesis of a diverse set of results on attentional control over rivalry, and we propose several directions for future research on this interesting topic.

High-level binocular rivalry effects

Binocular rivalry (BR) occurs when the brain cannot fuse percepts from the two eyes because they are different. We review results relating to an ongoing controversy regarding the cortical site of the BR mechanism. Some BR qualities suggest it is low-level: (1) BR, as its name implies, is usually between eyes and only low-levels have access to utrocular information. (2) All input to one eye is suppressed: blurring doesn’t stimulate accommodation; pupilary constrictions are reduced; probe detection is reduced. (3) Rivalry is affected by low-level attributes, contrast, spatial frequency, brightness, motion. (4) There is limited priming due to suppressed words or pictures. On the other hand, recent studies favor a high-level mechanism: (1) Rivalry occurs between patterns, not eyes, as in patchwork rivalry or a swapping paradigm. (2) Attention affects alternations. (3) Context affects dominance. There is conflicting evidence from physiological studies (single cell and fMRI) regarding cortical level(s) of conscious perception. We discuss the possibility of multiple BR sites and theoretical considerations that rule out this solution. We present new data regarding the locus of the BR switch by manipulating stimulus semantic content or high-level characteristics. Since these variations are represented at higher cortical levels, their affecting rivalry supports high-level BR intervention. In Experiment I, we measure rivalry when one eye views words and the other non-words and find significantly longer dominance durations for non-words. In Experiment II, we find longer dominance times for line drawings of simple, structurally impossible figures than for similar, possible objects. In Experiment III, we test the influence of idiomatic context on rivalry between words. Results show that generally words within their idiomatic context have longer mean dominance durations. We conclude that BR has high-level cortical influences, and may be controlled by a high-level mechanism.

What is Grouping during Binocular Rivalry?

During binocular rivalry, perception alternates between dissimilar images presented dichoptically. Although perception during rivalry is believed to originate from competition at a local level, different rivalry zones are not independent: rival targets that are spaced apart but have similar features tend to be dominant at the same time. We investigated grouping of spatially separated rival targets presented to the same or to different eyes and presented in the same or in different hemifields. We found eye-of-origin to be the strongest cue for grouping during binocular rivalry. Grouping was additionally affected by orientation: identical orientations were grouped longer than dissimilar orientations, even when presented to different eyes. Our results suggest that eye-based and orientation-based grouping is independent and additive in nature. Grouping effects were further modulated by the distribution of the targets across the visual field. That is, grouping within the same hemifield can be stronger or weaker than between hemifields, depending on the eye-of-origin of the grouped targets. We also quantified the contribution of the previous cues to grouping of two images during binocular rivalry. These quantifications can be successfully used to predict the dominance durations of different studies. Incorporating the relative contribution of different cues to grouping, and the dependency on hemifield, into future models of binocular rivalry will prove useful in our understanding of the functional and anatomical basis of the phenomenon of binocular rivalry.

Distinct contributions of the magnocellular and parvocellular visual streams to perceptual selection

During binocular rivalry, conflicting images presented to the two eyes compete for perceptual dominance, but the neural basis of this competition is disputed. In interocular switch rivalry, rival images periodically exchanged between the two eyes generate one of two types of perceptual alternation: (1) a fast, regular alternation between the images that is time-locked to the stimulus switches and has been proposed to arise from competition at lower levels of the visual processing hierarchy or (2) a slow, irregular alternation spanning multiple stimulus switches that has been associated with higher levels of the visual system. The existence of these two types of perceptual alternation has been influential in establishing the view that rivalry may be resolved at multiple hierarchical levels of the visual system. We varied the spatial, temporal, and luminance properties of interocular switch rivalry gratings and found, instead, an association between fast, regular perceptual alternations and processing by the magnocellular stream and between slow, irregular alternations and processing by the parvocellular stream. The magnocellular and parvocellular streams are two early visual pathways that are specialized for the processing of motion and form, respectively. These results provide a new framework for understanding the neural substrates of binocular rivalry that emphasizes the importance of parallel visual processing streams, and not only hierarchical organization, in the perceptual resolution of ambiguities in the visual environment.

Binocular vision

This essay reviews major developments - empirical and theoretical - in the field of binocular vision during the last 25years. We limit our survey primarily to work on human stereopsis, binocular rivalry and binocular contrast summation, with discussion where relevant of single-unit neurophysiology and human brain imaging. We identify several key controversies that have stimulated important work on these problems. In the case of stereopsis those controversies include position vs. phase encoding of disparity, dependence of disparity limits on spatial scale, role of occlusion in binocular depth and surface perception, and motion in 3D. In the case of binocular rivalry, controversies include eye vs. stimulus rivalry, role of "top-down" influences on rivalry dynamics, and the interaction of binocular rivalry and stereopsis. Concerning binocular contrast summation, the essay focuses on two representative models that highlight the evolving complexity in this field of study.

The role of the primary visual cortex in perceptual suppression of salient visual stimuli

The role of primary visual cortex (area V1) in subjective perception has intrigued students of vision for decades. Specifically, the extent to which the activity of different types of cells (monocular versus binocular) and electrophysiological signals (i.e., local field potentials versus spiking activity) reflect perception is still debated. To address these questions we recorded from area V1 of the macaque using tetrodes during the paradigm of binocular flash suppression, where incongruent images presented dichoptically compete for perceptual dominance. We found that the activity of a minority (20%) of neurons reflect the perceived visual stimulus and these cells exhibited perceptual modulations substantially weaker compared with their sensory modulation induced by congruent stimuli. Importantly, perceptual modulations were found equally often for monocular and binocular cells, demonstrating that perceptual competition in V1 involves mechanisms across both types of neurons. The power of the local field potential (LFP) also showed moderate perceptual modulations with similar percentages of sites showing significant effects across frequency bands (18-22%). The possibility remains that perception may be strongly reflected in more elaborate aspects of activity in V1 circuits (e.g., specific neuronal subtypes) or perceptual states might have a modulatory role on more intricate aspects of V1 firing patterns (e.g., synchronization), not necessarily altering the firing rates of single cells or the LFP power dramatically.

Endogenous attention selection during binocular rivalry at early stages of visual processing

Directing attention to one of two superimposing surfaces composed of dot fields rotating in opposing directions facilitates processing of brief translations of the attended surface [Valdes-Sosa, M., Bobes, M. A., Rodriguez, V., & Pinilla, T. (1998). Switching attention without shifting the spotlight object-based attentional modulation of brain potentials. Journal of Cognition and Neuroscience, 10(1), 137-151]. Here we used ERP recordings to investigate the mechanisms of endogenous attentional selection of such competing dot surfaces under conditions of dichoptic viewing (one surface to each eye) and monocular viewing (both surfaces to one eye). Under dichoptic conditions, which induced binocular rivalry, translations of the attended surface presented to one eye elicited enhanced visual P1 and N1 ERP components relative to translations of the unattended surface presented to the other eye. In comparison, during monocular viewing the attended surface translations elicited a significantly larger N1 component in the absence of any P1 modulation. These results indicate that processing of the attended surface is biased at an earlier level in extrastriate visual cortex under conditions of inter-ocular versus intra-ocular competition.

Caloric vestibular stimulation reveals discrete neural mechanisms for coherence rivalry and eye rivalry: A meta-rivalry model

Binocular rivalry is an extraordinary visual phenomenon that has engaged investigators for centuries. Since its first report, there has been vigorous debate over how the brain achieves the perceptual alternations that occur when conflicting images are presented simultaneously, one to each eye. Opposing high-level/stimulus-representation models and low-level/eye-based models have been proposed to explain the phenomenon, recently merging into an amalgam view. Here, we provide evidence that during viewing of Díaz-Caneja stimuli, coherence rivalry -- in which aspects of each eye's presented image are perceptually regrouped into rivalling coherent images -- and eye rivalry operate via discrete neural mechanisms. We demonstrate that high-level brain activation by unilateral caloric vestibular stimulation shifts the predominance of perceived coherent images (coherence rivalry) but not half-field images (eye rivalry). This finding suggests that coherence rivalry (like conventional rivalry according to our previous studies) is mediated by interhemispheric switching at a high level, while eye rivalry is mediated by intrahemispheric mechanisms, most likely at a low level. Based on the present data, we further propose that Díaz-Caneja stimuli induce 'meta-rivalry' whereby the discrete high- and low-level competitive processes themselves rival for visual consciousness.