Similarities in normal and binocularly rivalrous viewing

Spatial Interactions in Interocular and Monocular "Blur Suppression"

SIGNIFICANCE

The suppression of blurred images in one eye by clear images in the other eye is thought to contribute to the success of monovision correction. We show that interocular suppression occurs also for low-contrast targets that are not blurred and, to a lesser extent, when clear and low-contrast targets are presented to the same eye.

PURPOSE

A blurred target presented to one eye may be suppressed when a clear target is presented to the other eye. We sought to determine how this interocular suppression varies according to the separation between the blurred and clear targets and the magnitude of imposed blur. In addition, we examined whether a similar suppression occurs when the clear and blurred targets are imaged in the same eye.

METHODS

Subjects (N = 4) viewed a clear 20/40 Sloan letter surrounded by four 2 × 10 min-arc flanking bars. In different blocks of trials, the gap between the letter and flanking bars varied from 0.5 to 4 bar widths. In addition, the flanking bars were either clear or spatially filtered to simulate 0.5 to 2 D of blur. The contrast required to detect the flanking bars was determined when the letter and flanking bars were presented either dichoptically or monoptically and compared with the thresholds for the bar targets presented alone.

RESULTS

In both dichoptic and monoptic viewing conditions, detection thresholds for the blurred flanking bars are highest for the smallest spatial gap and decrease systematically as the gap increases. Thresholds are uniformly higher during dichoptic than monocular viewing, but the proportional change with the bar-to-letter separation is similar in both conditions. Surprisingly, the magnitude of imposed blur has very little influence on the magnitude of threshold elevation in either the dichoptic or monoptic viewing conditions.

CONCLUSIONS

Because threshold elevation is nearly the same in the presence of 0 to 2 D of blur, we prefer to designate the phenomenon we studied as "contrast suppression." The similar spatial characteristics of suppression during dichoptic and monoptic viewing are consistent with contributions from a common neural mechanism.

Binocular luster - A review

Binocular luster is a visual phenomenon that can be elicited by dichoptic stimuli showing an interocular difference in color or luminance contrast. For instance, when the two eyes are presented with simple center-surround stimuli in which the center patch in one eye is brighter and in the other eye darker than the common surround, the center patch in the fused percept assumes a lustrous appearance reminiscent of metal or graphite. Soon after the discovery of this phenomenon in the mid-19th century, it was intensively studied and several explanations were proposed. After this initial phase, however, research interest waned significantly. Stimulated by new insights into related phenomena and the underlying physiological mechanisms, the last 20 years have seen an increase in research activity in this field, which has considerably expanded our understanding of binocular luster. In this paper, we provide a detailed review of research on binocular luster over the past 170 years. We present and discuss the existing findings in a number of separate sections, dealing with 1) the phenomenology of binocular luster, 2) different theories that have been proposed, 3) several factors influencing the lustrous impression, 4) the relationship between binocular luster and binocular rivalry, 5) the current understanding of its neural basis, and 6) potential applications based on binocular luster.

Voluntary and Involuntary Attention in Bistable Visual Perception: A MEG Study

In this study, voluntary and involuntary visual attention focused on different interpretations of a bistable image, were investigated using magnetoencephalography (MEG). A Necker cube with sinusoidally modulated pixels' intensity in the front and rear faces with frequencies 6.67 Hz (60/9) and 8.57 Hz (60/7), respectively, was presented to 12 healthy volunteers, who interpreted the cube as either left- or right-oriented. The tags of these frequencies and their second harmonics were identified in the average Fourier spectra of the MEG data recorded from the visual cortex. In the first part of the experiment, the subjects were asked to voluntarily control their attention by interpreting the cube orientation as either being on the left or right. Accordingly, we observed the dominance of the corresponding spectral component, and voluntary attention performance was measured. In the second part of the experiment, the subjects were asked to focus their gaze on a red marker at the center of the cube image without putting forth effort in its interpretation. The alternation of the dominant spectral energies at the second harmonics of the stimulation frequencies was treated as changes in the cube orientation. Based on the results of the first experimental stage and using a wavelet analysis, we developed a method which allowed us to identify the currently perceived cube orientation. Finally, we characterized involuntary attention using the distribution of dominance times when focusing attention on one of the cube orientations, which was related to voluntary attention performance and brain noise. In particular, we confirmed our hypothesis that higher attention performance is associated with stronger brain noise.

Ring models of binocular rivalry and fusion

When similar visual stimuli are presented binocularly to both eyes, one perceives a fused single image. However, when the two stimuli are distinct, one does not perceive a single image; instead, one perceives binocular rivalry. That is, one perceives one of the stimulated patterns for a few seconds, then the other for few seconds, and so on - with random transitions between the two percepts. Most theoretical studies focus on rivalry, with few considering the coexistence of fusion and rivalry. Here we develop three distinct computational neuronal network models which capture binocular rivalry with realistic stochastic properties, fusion, and the hysteretic transition between. Each is a conductance-based point neuron model, which is multi-layer with two ocular dominance columns (L & R) and with an idealized "ring" architecture where the orientation preference of each neuron labels its location on a ring. In each model, the primary mechanism initiating binocular rivalry is cross-column inhibition, with firing rate adaptation governing the temporal properties of the transitions between percepts. Under stimulation by similar visual patterns, each of three models uses its own mechanism to overcome cross-column inhibition, and thus to prevent rivalry and allow the fusion of similar images: The first model uses cross-column feedforward inhibition from the opposite eye to "shut off" the cross-column feedback inhibition; the second model "turns on" a second layer of monocular neurons as a parallel pathway to the binocular neurons, rivaling out of phase with the first layer, and together these two pathways represent fusion; and the third model uses cross-column excitation to overcome the cross-column inhibition and enable fusion. Thus, each of the idealized ring models depends upon a different mechanism for fusion that might emerge as an underlying mechanism present in real visual cortex.

Individual differences point to two separate processes involved in the resolution of binocular rivalry

Although binocular rivalry is different from other perceptually bistable phenomena in requiring interocular conflict, it also shares numerous features with those phenomena. This raises the question of whether, and to what extent, the neural bases of binocular rivalry and other bistable phenomena overlap. Here we examine this question using an individual-differences approach. In a first experiment, observers reported perception during four binocular rivalry tasks that differed in the features and retinal locations of the stimuli used. Perceptual dominance durations were highly correlated when compared between stimuli that differed in location only. Correlations were substantially weaker, however, when comparing stimuli comprised of different features. Thus, individual differences in binocular-rivalry perception partly reflect a feature-specific factor that is not shared among all variants of binocular rivalry. Our second experiment again included several binocular rivalry variants, but also a different form of bistability: moving plaid rivalry. Correlations in dominance durations between binocular rivalry variants that differed in feature content were again modest. Moreover, and surprisingly, correlations between binocular rivalry and moving plaid rivalry were of similar magnitude. This indicates a second, more general, factor underlying individual differences in binocular rivalry perception: one that is shared across binocular rivalry and moving plaid rivalry. We propose that the first, feature-specific factor corresponds to feature-tuned mechanisms involved in the treatment of interocular conflict, whereas the second, general factor corresponds to mechanisms involved in representing surfaces. These latter mechanisms would operate at a binocular level and be central to both binocular rivalry and other forms of bistability.

Genomic Analyses of Visual Cognition: Perceptual Rivalry and Top-Down Control

Visual cognition in humans has traditionally been studied with cognitive behavioral methods and brain imaging, but much less with genetic methods. Perceptual rivalry, an important phenomenon in visual cognition, is the spontaneous perceptual alternation that occurs between two distinct interpretations of a physically constant visual stimulus (e.g., binocular rivalry stimuli) or a perceptually ambiguous stimulus (e.g., the Necker cube). The switching rate varies dramatically across individuals and can be voluntarily modulated by observers. Here, we adopted a genomic approach to systematically investigate the genetics underlying binocular rivalry, Necker cube rivalry and voluntary modulation of Necker cube rivalry in young Chinese adults (Homo sapiens, 81% female, 20 ± 1 years old) at multiple levels, including common single nucleotide polymorphism (SNP)-based heritability estimation, SNP-based genome-wide association study (GWAS), gene-based analysis, and pathway analysis. We performed a pilot GWAS in 2441 individuals and replicated it in an independent cohort of 943 individuals. Common SNP-based heritability was estimated to be 25% for spontaneous perceptual rivalry. SNPs rs184765639 and rs75595941 were associated with voluntary modulation, and imaging data suggested genotypic difference of rs184765639 in the surface area of the left caudal-middle frontal cortex. Additionally, converging evidence from multilevel analyses associated genes such as PRMT1 with perceptual switching rate, and MIR1178 with voluntary modulation strength. In summary, this study discovered specific genetic contributions to perceptual rivalry and its voluntary modulation in human beings. These findings may promote our understanding of psychiatric disorders, as perceptual rivalry is a potential psychiatric biomarker.SIGNIFICANCE STATEMENT Perceptual rivalry is an important visual phenomenon in which our perception of a physically constant visual input spontaneously switches between two different states. There are individual variations in perceptual switching rate and voluntary modulation strength. Our genomic analyses reveal several loci associated with these two kinds of variation. Because perceptual rivalry is thought to be relevant to and potentially an endophenotype for psychiatric disorders, these results may help understand not only visual cognition, but also psychiatric disorders.

On the Discovery of Monocular Rivalry by Tscherning in 1898: Translation and Review

Monocular rivalry was named by Breese in 1899. He made prolonged observation of superimposed orthogonal gratings; they fluctuated in clarity with either one or the other grating occasionally being visible alone. A year earlier, Tscherning observed similar fluctuations with a grid of vertical and horizontal lines and with other stimuli; we draw attention to his prior account. Monocular rivalry has since been shown to occur with a wide variety of superimposed patterns with several independent rediscoveries of it. We also argue that Helmholtz described some phenomenon other than monocular rivalry in 1867.

Multiplexing Prisms for Field Expansion

PURPOSE

Prisms used for field expansion are limited by the optical scotoma at a prism apex (apical scotoma). For a patient with two functioning eyes, fitting prisms unilaterally allows the other eye to compensate for the apical scotoma. A monocular patient's field loss cannot be expanded with a conventional or Fresnel prism because of the apical scotoma. A newly invented optical device, the multiplexing prism (MxP), was developed to overcome the apical scotoma limitation in monocular field expansion.

METHODS

A Fresnel-prism-like device with alternating prism and flat elements superimposes shifted and see-through views, thus creating the (monocular) visual confusion required for field expansion and eliminating the apical scotoma. Several implementations are demonstrated and preliminarily evaluated for different monocular conditions with visual field loss. The field expansion of the MxP is compared with the effect of conventional prisms using calculated and measured perimetry.

RESULTS

Field expansion without apical scotomas is shown to be effective for monocular patients with hemianopia or constricted peripheral field. The MxPs are shown to increase the nasal field for a patient with only one eye and for patients with bitemporal hemianopia. The MxPs placed at the far temporal field are shown to expand the normal visual field. The ability to control the contrast ratio between the two images is verified.

CONCLUSIONS

A novel optical device is demonstrated to have the potential for field expansion technology in a variety of conditions. The devices may be inexpensive and can be constructed in a cosmetically acceptable format.

The Role of Voluntary and Involuntary Attention in Selecting Perceptual Dominance during Binocular Rivalry

When incompatible images are presented to corresponding regions of each eye, perception alternates between the two monocular views (binocular rivalry). In this study, we have investigated how involuntary (exogenous) and voluntary (endogenous) attention can influence the perceptual dominance of one rival image or the other during contour rivalry. Subjects viewed two orthogonal grating stimuli that were presented to both eyes. Involuntary attention was directed to one of the grating stimuli with a brief change in orientation. After a short period, the cued grating was removed from the image in one eye and the uncued grating was removed from the image in the other eye, generating binocular rivalry. Subjects usually reported dominance of the cued grating during the rivalry period. We found that the influence of the cue declined with the interval between its onset and the onset of binocular rivalry in a manner consistent with the effect of involuntary attention. Finally, we demonstrated that voluntary attention to a grating stimulus could also influence the ongoing changes in perceptual dominance that accompany longer periods of binocular rivalry. Voluntary attention did not increase the mean dominance period of the attended grating, but rather decreased the mean dominance period of the non-attended grating. This pattern is analogous to increasing the perceived contrast of the attended grating. These results suggest that the competition during binocular rivalry might be an example of a more general attentional mechanism within the visual system.

Natural Tendency towards Beauty in Humans: Evidence from Binocular Rivalry

Although human preference for beauty is common and compelling in daily life, it remains unknown whether such preference is essentially subserved by social cognitive demands or natural tendency towards beauty encoded in the human mind intrinsically. Here we demonstrate experimentally that humans automatically exhibit preference for visual and moral beauty without explicit cognitive efforts. Using a binocular rivalry paradigm, we identified enhanced gender-independent perceptual dominance for physically attractive persons, and the results suggested universal preference for visual beauty based on perceivable forms. Moreover, we also identified perceptual dominance enhancement for characters associated with virtuous descriptions after controlling for facial attractiveness and vigilance-related attention effects, which suggested a similar implicit preference for moral beauty conveyed in prosocial behaviours. Our findings show that behavioural preference for beauty is driven by an inherent natural tendency towards beauty in humans rather than explicit social cognitive processes.

3D-MAD: A Full Reference Stereoscopic Image Quality Estimator Based on Binocular Lightness and Contrast Perception

Algorithms for a stereoscopic image quality assessment (IQA) aim to estimate the qualities of 3D images in a manner that agrees with human judgments. The modern stereoscopic IQA algorithms often apply 2D IQA algorithms on stereoscopic views, disparity maps, and/or cyclopean images, to yield an overall quality estimate based on the properties of the human visual system. This paper presents an extension of our previous 2D most apparent distortion (MAD) algorithm to a 3D version (3D-MAD) to evaluate 3D image quality. The 3D-MAD operates via two main stages, which estimate perceived quality degradation due to 1) distortion of the monocular views and 2) distortion of the cyclopean view. In the first stage, the conventional MAD algorithm is applied on the two monocular views, and then the combined binocular quality is estimated via a weighted sum of the two estimates, where the weights are determined based on a block-based contrast measure. In the second stage, intermediate maps corresponding to the lightness distance and the pixel-based contrast are generated based on a multipathway contrast gain-control model. Then, the cyclopean view quality is estimated by measuring the statistical-difference-based features obtained from the reference stereopair and the distorted stereopair, respectively. Finally, the estimates obtained from the two stages are combined to yield an overall quality score of the stereoscopic image. Tests on various 3D image quality databases demonstrate that our algorithm significantly improves upon many other state-of-the-art 2D/3D IQA algorithms.

The 'laws' of binocular rivalry: 50 years of Levelt's propositions

It has been fifty years since Levelt's monograph On Binocular Rivalry (1965) was published, but its four propositions that describe the relation between stimulus strength and the phenomenology of binocular rivalry remain a benchmark for theorists and experimentalists even today. In this review, we will revisit the original conception of the four propositions and the scientific landscape in which this happened. We will also provide a brief update concerning distributions of dominance durations, another aspect of Levelt's monograph that has maintained a prominent presence in the field. In a critical evaluation of Levelt's propositions against current knowledge of binocular rivalry we will then demonstrate that the original propositions are not completely compatible with what is known today, but that they can, in a straightforward way, be modified to encapsulate the progress that has been made over the past fifty years. The resulting modified, propositions are shown to apply to a broad range of bistable perceptual phenomena, not just binocular rivalry, and they allow important inferences about the underlying neural systems. We argue that these inferences reflect canonical neural properties that play a role in visual perception in general, and we discuss ways in which future research can build on the work reviewed here to attain a better understanding of these properties.

Interpreting the Temporal Dynamics of Perceptual Rivalries

Diverse forms of perceptual rivalry are claimed to tap a common causal mechanism. One of the bases for this claim is that the reported dynamics of binocular rivalry and motion-induced blindness are similar on an individual basis (Carter & Pettigrew, 2003 Perception, 32, 295–305). We examined this relationship and found no evidence for a strong correlation. We therefore question the proposition that the dynamics of diverse forms of rivalry are driven by a common mechanism.

A model of binocular rivalry and cross-orientation suppression

Binocular rivalry and cross-orientation suppression are well-studied forms of competition in visual cortex, but models of these two types of competition are in tension with one another. Binocular rivalry occurs during the presentation of dichoptic grating stimuli, where two orthogonal gratings presented separately to the two eyes evoke strong alternations in perceptual dominance. Cross-orientation suppression occurs during the presentation of plaid stimuli, where the responses to a component grating presented to both eyes is weakened by the presence of a superimposed orthogonal grating. Conventional models of rivalry that rely on strong competition between orientation-selective neurons incorrectly predict rivalry between the components of plaids. Lowering the inhibitory weights in such models reduces rivalry for plaids, but also reduces it for dichoptic gratings. Using an exhaustive grid search, we show that this problem cannot be solved simply by adjusting the parameters of the model. Instead, we propose a robust class of models that rely on ocular opponency neurons, previously proposed as a mechanism for efficient stereo coding, to yield rivalry only for dichoptic gratings, not for plaids. This class of models reconciles models of binocular rivalry with the divisive normalization framework that has been used to explain cross-orientation. Our model makes novel predictions that we confirmed with psychophysical tests.

Interactions between apparent motion rivalry in vision and touch

In multistable perception, the brain alternates between several perceptual explanations of ambiguous sensory signals. It is unknown whether multistable processes can interact across the senses. In the study reported here, we presented subjects with unisensory (visual or tactile), spatially congruent visuotactile, and spatially incongruent visuotactile apparent motion quartets. Congruent stimulation induced pronounced visuotactile interactions, as indicated by increased dominance times for both vision and touch, and an increased percentage bias for the percept already dominant under unisensory stimulation. Thus, the joint evidence from vision and touch stabilizes the more likely perceptual interpretation and thereby decelerates the rivalry dynamics. Yet the temporal dynamics depended also on subjects' attentional focus and was generally slower for tactile than for visual reports. Our results support Bayesian approaches to perceptual inference, in which the probability of a perceptual interpretation is determined by combining visual, tactile, or visuotactile evidence with modality-specific priors that depend on subjects' attentional focus. Critically, the specificity of visuotactile interactions for spatially congruent stimulation indicates multisensory rather than cognitive-bias mechanisms.

Adults' awareness of faces follows newborns' looking preferences

From the first days of life, humans preferentially orient towards upright faces, likely reflecting innate subcortical mechanisms. Here, we show that binocular rivalry can reveal face detection mechanisms in adults that are surprisingly similar to inborn face detection mechanism. We used continuous flash suppression (CFS), a variant of binocular rivalry, to render stimuli invisible at the beginning of each trial and measured the time upright and inverted stimuli needed to overcome such interocular suppression. Critically, specific stimulus properties previously shown to modulate looking preferences in neonates similarly modulated adults' awareness of faces presented during CFS. First, the advantage of upright faces in overcoming CFS was strongly modulated by contrast polarity and direction of illumination. Second, schematic patterns consisting of three dark blobs were suppressed for shorter durations when the arrangement of these blobs respected the face-like configuration of the eyes and the mouth, and this effect was modulated by contrast polarity. No such effects were obtained in a binocular control experiment not involving CFS, suggesting a crucial role for face-sensitive mechanisms operating outside of conscious awareness. These findings indicate that visual awareness of faces in adults is governed by perceptual mechanisms that are sensitive to similar stimulus properties as those modulating newborns' face preferences.

Feeling without seeing? Engagement of ventral, but not dorsal, amygdala during unaware exposure to emotional faces

The ability to selectively perceive items in the environment may be modulated by the emotional content of those items. The neural mechanism that underlies the privileged processing of emotionally salient content is poorly understood. Here, using fMRI, we investigated this issue via a binocular rivalry procedure when face stimuli depicting fearful or neutral expressions competed for awareness with a house. Results revealed an interesting dissociation in the amygdala during rivalry condition: Whereas its dorsal component exhibited dominant activation to aware fearful faces, a ventral component was more active during the suppression of fearful faces. Moreover, during rivalry, the dorsal and ventral components of the amygdala were coupled with segregated cortical activations in the brainstem and medial PFC, respectively. In summary, this study points to a differential involvement of two clusters within the amygdala and their connected networks in naturally occurring perceptual biases of emotional content in faces.

Why is Binocular Rivalry Uncommon? Discrepant Monocular Images in the Real World

When different images project to corresponding points in the two eyes they can instigate a phenomenon called binocular rivalry (BR), wherein each image seems to intermittently disappear such that only one of the two images is seen at a time. Cautious readers may have noted an important caveat in the opening sentence – this situation can instigate BR, but usually it doesn’t. Unmatched monocular images are frequently encountered in daily life due to either differential occlusions of the two eyes or because of selective obstructions of just one eye, but this does not tend to induce BR. Here I will explore the reasons for this and discuss implications for BR in general. It will be argued that BR is resolved in favor of the instantaneously stronger neural signal, and that this process is driven by an adaptation that enhances the visibility of distant fixated objects over that of more proximate obstructions of an eye. Accordingly, BR would reflect the dynamics of an inherently visual operation that usually deals with real-world constraints.

The visual impact of gossip

Gossip is a form of affective information about who is friend and who is foe. We show that gossip does not influence only how a face is evaluated--it affects whether a face is seen in the first place. In two experiments, neutral faces were paired with negative, positive, or neutral gossip and were then presented alone in a binocular rivalry paradigm (faces were presented to one eye, houses to the other). In both studies, faces previously paired with negative (but not positive or neutral) gossip dominated longer in visual consciousness. These findings demonstrate that gossip, as a potent form of social affective learning, can influence vision in a completely top-down manner, independent of the basic structural features of a face.

Binocular rivalry: competition and inhibition in visual perception

When the brain is presented with ambiguous visual stimuli supporting two interpretations, perception becomes bistable and alternates over time between one interpretation and the other. This process contains elements of competition (between the rivaling percepts) as well as inhibition, as the percepts are mutually exclusive so that one is always suppressed. This review covers the most widely studied form of bistable perception-binocular rivalry. Suppression in rivalry is covered in detail, including discussion of its general and specific components, its local nature and spatial organization, techniques for quantifying it, and the role of global feedback. The competitive dynamics of rivalry are discussed within the context of the classical 'adapting reciprocal inhibition' model of rivalry and recent evidence supporting this model is discussed. This model is contrasted with alternative models based on late competition and with hybrid models. Finally, the role of attention in rivalry is examined and commonalities with other forms of bistable perception are noted. WIREs Cogn Sci 2012, 3:87-103. doi: 10.1002/wcs.151 For further resources related to this article, please visit the WIREs website.

Experience-driven plasticity in binocular vision

Experience-driven neuronal plasticity allows the brain to adapt its functional connectivity to recent sensory input. Here we use binocular rivalry, an experimental paradigm in which conflicting images are presented to the individual eyes, to demonstrate plasticity in the neuronal mechanisms that convert visual information from two separated retinas into single perceptual experiences. Perception during binocular rivalry tended to initially consist of alternations between exclusive representations of monocularly defined images, but upon prolonged exposure, mixture percepts became more prevalent. The completeness of suppression, reflected in the incidence of mixture percepts, plausibly reflects the strength of inhibition that likely plays a role in binocular rivalry. Recovery of exclusivity was possible but required highly specific binocular stimulation. Documenting the prerequisites for these observed changes in perceptual exclusivity, our experiments suggest experience-driven plasticity at interocular inhibitory synapses, driven by the correlated activity (and also the lack thereof) of neurons representing the conflicting stimuli. This form of plasticity is consistent with a previously proposed but largely untested anti-Hebbian learning mechanism for inhibitory synapses in vision. Our results implicate experience-driven plasticity as one governing principle in the neuronal organization of binocular vision.

Pupil dilation betrays the timing of decisions

The notion of “mind-reading” by carefully observing another individual's physiological responses has recently become commonplace in popular culture, particularly in the context of brain imaging. The question remains, however, whether outwardly accessible physiological signals indeed betray a decision before a person voluntarily reports it. In one experiment we asked observers to push a button at any time during a 10-s period (“immediate overt response”). In a series of three additional experiments observers were asked to select one number from five sequentially presented digits but concealed their decision until the trial's end (“covert choice”). In these experiments observers either had to choose the digit themselves under conditions of reward and no reward, or were instructed which digit to select via an external cue provided at the time of the digit presentation. In all cases pupil dilation alone predicted the choice (timing of button response or chosen digit, respectively). Consideration of the average pupil-dilation responses, across all experiments, showed that this prediction of timing was distinct from a general arousal or reward-anticipation response. Furthermore, the pupil dilation appeared to reflect the post-decisional consolidation of the selected outcome rather than the pre-decisional cognitive appraisal component of the decision. Given the tight link between pupil dilation and norepinephrine levels during constant illumination, our results have implications beyond the tantalizing mind-reading speculations. These findings suggest that similar noradrenergic mechanisms may underlie the consolidation of both overt and covert decisions.

Bistable perception modeled as competing stochastic integrations at two levels

We propose a novel explanation for bistable perception, namely, the collective dynamics of multiple neural populations that are individually meta-stable. Distributed representations of sensory input and of perceptual state build gradually through noise-driven transitions in these populations, until the competition between alternative representations is resolved by a threshold mechanism. The perpetual repetition of this collective race to threshold renders perception bistable. This collective dynamics - which is largely uncoupled from the time-scales that govern individual populations or neurons - explains many hitherto puzzling observations about bistable perception: the wide range of mean alternation rates exhibited by bistable phenomena, the consistent variability of successive dominance periods, and the stabilizing effect of past perceptual states. It also predicts a number of previously unsuspected relationships between observable quantities characterizing bistable perception. We conclude that bistable perception reflects the collective nature of neural decision making rather than properties of individual populations or neurons.

Stimulus specificity in spatially-extended interocular suppression

In typical binocular rivalry demonstrations, disparate images presented in corresponding locations to the two eyes are found to alternate perceptually over time. Alternation in perception can occur even if the images presented to the two eyes do not overlap, if they are sufficiently close in space. This implies a spatial spread in the interocular interaction. The current set of experiments explores how the luminance pattern of a target, in relation to a rivalrous suppressor, affects its susceptibility to suppression. It was found that the susceptibility to suppression of a target pattern was nonlinearly related to the amount of luminance variation along the target in the direction perpendicular to the suppressing stimulus. For instance, there was a strong effect of the orientation of the grating pattern within the target on the total time of suppression, with much more suppression for horizontal gratings than vertical gratings when suppressor bars were oriented vertically, regardless of the luminance pattern within the suppressors. Furthermore, it was shown that the inclusion of a spatial gap between the vertical suppressors and the central portion of the target does more than simply change the spatial relationships, it adds new figural information, such as vertically orientated edges in the targets, that modify the susceptibility to suppression of the target, thereby interfering with measurements of spatial interaction functions. All of the results are consistent with selectively suppressing stimulus information that would interfere with stereoscopic matching to aid the binocular fusion of disparate retinal images.

Inter-ocular contrast normalization in human visual cortex

The brain combines visual information from the two eyes and forms a coherent percept, even when inputs to the eyes are different. However, it is not clear how inputs from the two eyes are combined in visual cortex. We measured fMRI responses to single gratings presented monocularly, or pairs of gratings presented monocularly or dichoptically with several combinations of contrasts. Gratings had either the same orientation or orthogonal orientations (i.e., plaids). Observers performed a demanding task at fixation to minimize top-down modulation of the stimulus-evoked responses. Dichoptic presentation of compatible gratings (same orientation) evoked greater activity than monocular presentation of a single grating only when contrast was low (<10%). A model that assumes linear summation of activity from each eye failed to explain binocular responses at 10% contrast or higher. However, a model with binocular contrast normalization, such that activity from each eye reduced the gain for the other eye, fitted the results very well. Dichoptic presentation of orthogonal gratings evoked greater activity than monocular presentation of a single grating for all contrasts. However, activity evoked by dichoptic plaids was equal to that evoked by monocular plaids. Introducing an onset asynchrony (stimulating one eye 500 ms before the other, which under attentive vision results in flash suppression) had no impact on the results; the responses to dichoptic and monocular plaids were again equal. We conclude that when attention is diverted, inter-ocular suppression in V1 can be explained by a normalization model in which the mutual suppression between orthogonal orientations does not depend on the eye of origin, nor on the onset times, and cross-orientation suppression is weaker than inter-ocular (same orientation) suppression.

Tactile rivalry demonstrated with an ambiguous apparent-motion quartet

When observers view ambiguous visual stimuli, their perception will often alternate between the possible interpretations, a phenomenon termed perceptual rivalry [1]. To induce perceptual rivalry in the tactile domain, we developed a new tactile illusion, based on the visual apparent-motion quartet [2]. Pairs of 200 ms vibrotactile stimuli were applied to the finger pad at intervals separated by 300 ms. The location of each successive stimulus pair alternated between the opposing diagonal corners of the approximately 1 cm(2) stimulation array. This stimulation sequence led all participants to report switches between the perception of motion traveling either up and down or left and right across their fingertip. Adaptation to tactile stimulation biased toward one direction caused subsequent ambiguous stimulation to be experienced in the opposing direction. In contrast, when consecutive trials of ambiguous stimulation were presented, motion was generally perceived in the direction consistent with the motion reported in the previous trial. Voluntary eye movements induced shifts in the tactile perception toward a motion axis aligned along a world-centered coordinate frame. Because the tactile quartet results in switching perceptual states despite unvaried sensory input, it is ideally suited to future studies of the neural processes associated with conscious tactile perception.

Predictive coding explains binocular rivalry: an epistemological review

Binocular rivalry occurs when the eyes are presented with different stimuli and subjective perception alternates between them. Though recent years have seen a number of models of this phenomenon, the mechanisms behind binocular rivalry are still debated and we still lack a principled understanding of why a cognitive system such as the brain should exhibit this striking kind of behaviour. Furthermore, psychophysical and neurophysiological (single cell and imaging) studies of rivalry are not unequivocal and have proven difficult to reconcile within one framework. This review takes an epistemological approach to rivalry that considers the brain as engaged in probabilistic unconscious perceptual inference about the causes of its sensory input. We describe a simple empirical Bayesian framework, implemented with predictive coding, which seems capable of explaining binocular rivalry and reconciling many findings. The core of the explanation is that selection of one stimulus, and subsequent alternation between stimuli in rivalry occur when: (i) there is no single model or hypothesis about the causes in the environment that enjoys both high likelihood and high prior probability and (ii) when one stimulus dominates, the bottom-up, driving signal for that stimulus is explained away while, crucially, the bottom-up signal for the suppressed stimulus is not, and remains as an unexplained but explainable prediction error signal. This induces instability in perceptual dynamics that can give rise to perceptual transitions or alternations during rivalry.

Enhancement of bistable perception associated with visual stimulus rivalry

Rapid, repetitive exchange of dissimilar, rival stimuli between the two eyes can produce slow alternations in perceptual dominance. This phenomenon, called stimulus rivalry, is potentially important for studying resolution of visual conflict associated with neural processing beyond the level of interocular competition. As previously implemented, however, stimulus rivalry can be difficult for some observers to experience, and it tends to occur within a relatively narrow range of contrasts and spatial frequencies. Here we show that it is possible to increase the incidence of stimulus rivalry by brief, periodic presentation of a composite configuration created by superimposition of the two rival stimuli. Possible reasons for the effectiveness of the composite in promotion of stimulus rivalry are discussed.

Pupil dilation reflects perceptual selection and predicts subsequent stability in perceptual rivalry

During sustained viewing of an ambiguous stimulus, an individual's perceptual experience will generally switch between the different possible alternatives rather than stay fixed on one interpretation (perceptual rivalry). Here, we measured pupil diameter while subjects viewed different ambiguous visual and auditory stimuli. For all stimuli tested, pupil diameter increased just before the reported perceptual switch and the relative amount of dilation before this switch was a significant predictor of the subsequent duration of perceptual stability. These results could not be explained by blink or eye-movement effects, the motor response or stimulus driven changes in retinal input. Because pupil dilation reflects levels of norepinephrine (NE) released from the locus coeruleus (LC), we interpret these results as suggestive that the LC-NE complex may play the same role in perceptual selection as in behavioral decision making.

Mechanisms for Frequency Control in Neuronal Competition Models

We investigate analytically a firing rate model for a two-population network based on mutual inhibition and slow negative feedback in the form of spike frequency adaptation. Both neuronal populations receive external constant input whose strength determines the system's dynamical state-a steady state of identical activity levels or periodic oscillations or a winner-take-all state of bistability. We prove that oscillations appear in the system through supercritical Hopf bifurcations and that they are antiphase. The period of oscillations depends on the input strength in a nonmonotonic fashion, and we show that the increasing branch of the period versus input curve corresponds to a release mechanism and the decreasing branch to an escape mechanism. In the limiting case of infinitely slow feedback we characterize the conditions for release, escape, and occurrence of the winner-take-all behavior. Some extensions of the model are also discussed.

Staying focused: a functional account of perceptual suppression during binocular rivalry

Presenting different images to either eye can induce perceptual switching, with alternating disappearances of each image--a phenomenon called binocular rivalry. We believe that disappearances during binocular rivalry can be driven by a process that facilitates visibility near the point of fixation. As the point of fixation is tied neither to a particular stimulus nor to a specific eye, indifference to both would be an essential characteristic for the process we envisage. Many factors that influence disappearances during binocular rivalry scale with distance in depth from fixation. Of these, here we use blur. We break the links between this cue and both eye of origin and stimulus type. We find that perceptual dominance can track a better focused image as it is swapped between the eyes and that perceptual switches can be driven by alternating the focus of images fixed in each eye. This implies that, as a determinant of suppression selectivity, blur is functionally independent from both eye of origin and stimulus type. Our data and theoretical account suggest that binocular rivalry is not an irrelevant laboratory curiosity but, rather, that it is a product of a functional adaptation that promotes visibility in cluttered environments.

Attentional control over either of the two competing percepts of ambiguous stimuli revealed by a two-parameter analysis: Means do not make the difference

We studied distributions of perceptual rivalry reversals, as defined by the two fitted parameters of the Gamma distribution. We did so for a variety of bi-stable stimuli and voluntary control exertion tasks. Subjects' distributions differed from one another for a particular stimulus and control task in a systematic way that reflects a constraint on the describing parameters. We found a variety of two-parameter effects, the most important one being that distributions of subjects differ from one another in the same systematic way across different stimuli and control tasks (i.e., a fast switcher remains fast across all conditions in a parameter-specified way). The cardinal component of subject-dependent variation was not the conventionally used mean reversal rate, but a component that was oriented-for all stimuli and tasks-roughly perpendicular to the mean rate. For the Necker cube, we performed additional experiments employing specific variations in control exertion, suggesting that subjects have to a considerable extent independent control over the reversal rate of either of the two competing percepts.

Neural bases of binocular rivalry

During binocular rivalry, conflicting monocular images compete for access to consciousness in a stochastic, dynamical fashion. Recent human neuroimaging and psychophysical studies suggest that rivalry entails competitive interactions at multiple neural sites, including sites that retain eye-selective information. Rivalry greatly suppresses activity in the ventral pathway and attenuates visual adaptation to form and motion; nonetheless, some information about the suppressed stimulus reaches higher brain areas. Although rivalry depends on low-level inhibitory interactions, high-level excitatory influences promoting perceptual grouping and selective attention can extend the local dominance of a stimulus over space and time. Inhibitory and excitatory circuits considered within a hybrid model might account for the paradoxical properties of binocular rivalry and provide insights into the neural bases of visual awareness itself.

fMRI Measures of Perceptual Filling-in in the Human Visual Cortex

Filling-in refers to the tendency of stabilized retinal stimuli to fade and become replaced by their background. This phenomenon is a good example of central brain mechanisms that can selectively add or delete information to/from the retinal input. Importantly, such cortical mechanisms may overlap with those that are used more generally in visual perception. In order to identify cortical areas that contribute to perceptual filling-in, we used functional magnetic resonance imaging to image activity in the visual cortex while subjects experienced filling-in. Nine subjects viewed an achromatic disc with slightly higher luminance than the background and indicated the presence or absence of filling-in by a keypress. The disc was placed in either the upper or lower left quadrant. Similar high-contrast stimuli were used to map out the retinotopic representation of the disc. Unexpectedly, the lower-field high-contrast stimulus produced more parietal cortex activation than the upper-field condition, indicating preferential representation of the lower field by attentional control mechanisms. During perceptual filling-in, we observed significant contralateral reductions in activation in lower-tier retinotopic areas V1 and V2. In contrast, increased activation was consistently observed in visual areas V3A and V4v, higher-level cortex in the intraparietal sulcus, posterior superior temporal sulcus, and the ventral occipital–temporal region, as well as the pulvinar. The filling-in activation pattern was remarkably similar for both the upper- and lower-field conditions. Behaviorally, filling-in was reported to be easier for the lower visual field, and filling-in periods were longer for the lower than the upper quadrant. We suggest this behavioral asymmetry may be partially due to the preferential parietal representation of the lower field. The results lead us to propose that perceptual filling-in recruits high-level control mechanisms to reconcile competing percepts, and alters the normal image-related signals at the first stages of cortical processing. Moreover, the overall pattern of activation during filling-in resembles that seen in other studies of perceptually bistable stimuli, including binocular rivalry, indicating common control mechanisms.

When your brain decides what you see: grouping across monocular, binocular, and stimulus rivalry

Research suggests that the neural concomitants of visual rivalry are contingent on the stimulus parameters, implying the existence of three different types of rivalry. Binocular rivalry (dissimilar patterns are presented, one to each eye) is seemingly mediated by interactions between pools of monocular neurons. Monocular rivalry (superimposed patterns are presented to one or both eyes) is presumably the result of competition between neural representations of the patterns. Stimulus rivalry (dissimilar patterns are swapped rapidly between the two eyes) is independent of eye of origin. In the experiment reported here, we integrated these three different types of rivalry into one stimulus. We found that perceptual alternations span the three types of rivalry, demonstrating that the brain can produce a coherent percept sourced from three different types of visual conflict. This result is in agreement with recent work suggesting that the resolution of competitive visual stimuli is mediated by a general mechanism spanning different levels of the visual-processing hierarchy.

Binocular rivalry between emotional and neutral stimuli: a validation using fear conditioning and EEG

When two incompatible pictures are projected to the two eyes, they compete for perceptual dominance. Previous research has claimed that meaningful and emotionally valenced pictures predominate over neutral pictures in this rivalry. This may be interpreted as evidence for preferential processing of emotionally significant stimuli in the visual system but it is difficult to dismiss that the physical characteristics of the different pictures or response biases influenced the results of these studies. Thus, we set out to examine the influence of emotion using methods eliminating the influence of physical characteristics and minimizing response biases. We used simple visual patterns and induced emotional valence by fear conditioning. In Experiment 1 the aversive CS+ predominated over the CS-. In Experiment 2 we extended previous findings by showing that participants' self-reported perception is validated by corresponding steady-state visually evoked potentials in the EEG in the context of such a conditioning experiment. This was accomplished by frequency coding the rivalling stimuli with a stimulus specific pattern reversal and extracting the corresponding frequency from the occipital lobe EEG. Taken together, these studies provide further evidence that picture valence can influence perception in binocular rivalry. This is discussed in terms of subcortical mechanisms supporting the efficient processing of threatening information.

Independent binocular integration for form and colour

Although different features of an object are processed in anatomically distinct regions of the cerebral cortex, they often appear bound together in perception. Here, using binocular rivalry, we reveal that the awareness of form can occur independently from the awareness of colour. First, we report that, if both eyes briefly view a grating stimulus prior to the presentation of the same grating in one eye and an orthogonal grating in the other, subjects tend to report perceptual dominance of the non-primed grating. The primer was most effective when it was similar in orientation, spatial frequency and spatial phase to one of the rival images. Next, we showed that the process underlying the binocular integration of chromatic information was selectively influenced by the colour of a previously presented stimulus. We then combined these paradigms by using a primer that had the same colour as one rival stimulus, but the same form as the other stimulus. In this situation, we found that rival stimuli differing in form and colour can sometimes achieve states of dominance in which the chromatic information from one eye's image combines with the form of the other eye's image temporarily creating a binocular impression that corresponds with neither monocular component. Finally, we demonstrated that during continuous viewing of rival stimuli differing in form and colour, chromatic integration could occur independently of form rivalry. Paradoxically, however, we found that changes to the form of the stimulus had more of an influence on chromatic integration than on form rivalry. Together these phenomena show that the neural processes involved in integrating information from the two eyes can operate selectively on different stimulus features.

Spatio-temporal dynamics of the visual system revealed in binocular rivalry

From the evolutionary viewpoint, animals need to monitor the surrounding environment and capture salient features, such as motion, for survival. The visual system is highly developed for monitoring a wide area of visual field and capturing such salient features. In humans and primates, there is a wide binocular field, suggesting a necessity of integrating the images from the two eyes. Binocular rivalry [R. Blake, A neural theory of binocular rivalry, Psychol. Rev. 96 (1989) 145-167; R. Blake, N.K. Logothetis, Visual competition, Nat. Rev. Neurosci. 3 (2002) 13-21], where incompatible inputs from the two eyes compete to emerge in the subject's visual percept, has been shown to exhibit highly adaptive behavior [I. Kovacs, T.V. Parathomas, M. Yang, A. Feher, When the brain changes its mind: interocular grouping during binocular rivalry. Proc. Natl. Acad. Sci. U.S.A. 93 (1996) 15508-15511; N.K. Logothetis, Single units and conscious vision, Philos. Trans. R. Soc. Lond. B. Biol. Sci. 353 (1998) 1801-1818]. Here we investigated the spatio-temporal dynamics of the ocular dominance pattern in binocular rivalry under conditions where conflicting salient features were presented in a temporally varying manner. We found a striking example of the detailed structure of the dominance wave propagation, by using a spatio-temporal sampling method. The data show in detail the ability of the visual system to dynamically adapt to the changing stimuli in the context of the massively parallel visual field. We show by model prediction that the globally coherent dominance change in the presence of multiple stimuli can be explained by a mechanism based on local saliency comparison.

Cross-orientation suppression: monoptic and dichoptic mechanisms are different

The response of a cell in the primary visual cortex to an optimally oriented grating is suppressed by a superimposed orthogonal grating. This cross-orientation suppression (COS) is exhibited when the orthogonal and optimal stimuli are presented to the same eye (monoptically) or to different eyes (dichoptically). A recent study suggested that monoptic COS arises from subcortical processes; however, the mechanisms underlying dichoptic COS were not addressed. We have compared the temporal frequency tuning and stimulus adaptation properties of monoptic and dichoptic COS. We found that dichoptic COS is best elicited with lower temporal frequencies and is substantially reduced after prolonged adaptation to a mask grating. In contrast, monoptic COS is more pronounced with mask gratings at much higher temporal frequencies and is less prone to stimulus adaptation. These results suggest that monoptic COS is mediated by subcortical mechanisms, whereas intracortical inhibition is the mechanism for dichoptic COS.

Competing global representations fail to initiate binocular rivalry

A longstanding debate in binocular rivalry literature is whether the perceptual competition in rivalry occurs at an early or late stage of visual processing. Central to this debate is the determination of the source of the competition. Overwhelming evidence exists that local interocular differences can lead to binocular rivalry, but it is not yet clear whether interocular conflicts at the global level are sufficient to generate binocular rivalry. The current study adopted a novel stimulus that enabled the introduction of dramatic global differences between the two eyes with compatible local elements. Results show that global differences between the two eyes' images do not result in rivalry if local elements are compatible. The implication of these findings is that the registration of competing interocular information, necessary to generate binocular rivalry, is performed at an early stage of visual processing prior to global analysis of the image.

Local factors determine the stabilization of monocular ambiguous and binocular rivalry stimuli

Perceptual alternation in viewing bistable stimuli can be slowed or halted if the stimuli are presented intermittently. Memory of the recent perceptual experience has been proposed to explain this stabilization effect. But the nature of this "perceptual memory" remains unclear. By using a bistable rotating cylinder and two dichoptically presented orthogonal gratings, we explored the features that are important for the stabilization by changing a particular feature of the stimuli between alternate presentations. For the rotating cylinder, changing its color, rotating speed, size, or its stereo depth had no or minimal effect on the stabilization of its perceived rotation direction. For binocular rivalry, when the two gratings were matched in strength and then swapped between the two eyes synchronously with the intermittent presentation, the percepts were usually stabilized to one eye. In both cases, perceptual stabilization occurred only if the stimuli were presented to the same retinal location. These results suggest that the stabilization of monocular bistable stimuli is likely due to the removal of local adaptation, insensitive to the features that define the object identity. For binocular rivalry, preservation of the direction of interocular suppression rather than memory of the stimulus identity accounts for the stabilization effect.

Sound-aided recovery from and persistence against visual filling-in

Disappearance phenomena, in which salient visual stimuli do not register consciously, have been known to occur. Recovery from such phenomena typically occurs through change in some visual attribute, such as increase in luminance contrast or stimulus duration. Thus far, there have been no reports of cross-modal modulation of disappearance phenomena. In particular, what effect a cross-modal attentional cue has on sensory suppression is unknown. Here, we show that an adapted, flickered visual target that is synchronous with a brief sound appears more vivid than a similarly adapted, otherwise identical, visual target that is offset in time by more than 200 ms from the auditory cue. We argue that the brief auditory stimuli momentarily boost the concurrent signal of the adapted visual stimulus at a site downstream of the visual adaptation, thus causing the transient recovery from the visual adaptation. Repetitive visual cues cause significantly less recovery from visual adaptation than repetitive auditory cues, implying that there are functions a cross-modal cue can perform that a cue of the same modality cannot. Moreover repetitive auditory cues selectively prevent synchronous visual targets from undergoing visual adaptation. Ours is the first report of cross-modal modulation of a disappearance phenomenon.

Generalized flash suppression of salient visual targets

A pattern of light striking the retina of an alert observer is normally readily perceived. While a handful of conditions exist in which even salient visual stimuli can be rendered invisible, the mechanisms underlying such suppression remain poorly understood. Here, we describe experiments using a novel stimulation sequence that gives rise to the sudden and reliable subjective disappearance of a wide range of visual patterns. We found that a parafoveal target immediately vanished from perception following the abrupt onset of a surrounding texture. The probability of disappearance was influenced by the ocular configuration of the target and surround, as well as their spatial separation. In addition, suppression was critically dependent upon several hundred milliseconds of stimulus-specific adaptation. These findings demonstrate that the all-or-none disappearance of a salient visual target, which is reminiscent of a high-level selection process, is inextricably linked to topographic stimulus representations, presumably in the early visual cortex.

Visual motion retards alternations between conflicting perceptual interpretations

When the visual system is faced with conflicting or ambiguous stimulus information, visual perception fluctuates over time. We found that perceptual alternations are slowed when inducing stimuli move within the visual field, constantly engaging fresh, unadapted neural tissue. During binocular rivalry, dominance durations were longer when rival figures moved compared to when they were stationary, yielding lower alternation rates. Rate was not reduced, however, when observers tracked the moving targets, keeping the images on approximately the same retinal area. Alternations were reliably triggered when rival targets passed through a local region of the visual field preadapted to one of the rival targets. During viewing of a kinetic globe whose direction of rotation was ambiguous, observers experienced fewer alternations in perceived direction when the globe moved around the visual field or when the globe's axis of rotation changed continuously. Evidently, local neural adaptation is a key ingredient in the instability of perception.