A common oscillator for perceptual rivalries?

Bimodal moment-by-moment coupling in perceptual multistability

Multistable perception occurs in all sensory modalities, and there is ongoing theoretical debate about whether there are overarching mechanisms driving multistability across modalities. Here we study whether multistable percepts are coupled across vision and audition on a moment-by-moment basis. To assess perception simultaneously for both modalities without provoking a dual-task situation, we query auditory perception by direct report, while measuring visual perception indirectly via eye movements. A support-vector-machine (SVM)-based classifier allows us to decode visual perception from the eye-tracking data on a moment-by-moment basis. For each timepoint, we compare visual percept (SVM output) and auditory percept (report) and quantify the co-occurrence of integrated (one-object) or segregated (two-objects) interpretations in the two modalities. Our results show an above-chance coupling of auditory and visual perceptual interpretations. By titrating stimulus parameters toward an approximately symmetric distribution of integrated and segregated percepts for each modality and individual, we minimize the amount of coupling expected by chance. Because of the nature of our task, we can rule out that the coupling stems from postperceptual levels (i.e., decision or response interference). Our results thus indicate moment-by-moment perceptual coupling in the resolution of visual and auditory multistability, lending support to theories that postulate joint mechanisms for multistable perception across the senses.

Motion-induced blindness as a noisy excitable system

Perceptual disappearance of a salient target induced by a moving texture mask (MIB: Motion-Induced Blindness) is a striking effect, currently poorly understood. Here, we investigated whether the dynamics of MIB qualify as an excitable system. Excitable systems exhibit fast switches from one state to another (e.g., visible/invisible) induced by an above-threshold perturbation and stimulus-independent dynamics, followed by a refractory period. In the experiments, disappearance was induced by masks consisting of slowly rotating radial bars with a gap at the target location, leading to periodic perturbation of the visual field around the target (a bright parafoveal spot). When passed around the target location, masks frequently induced an abrupt target disappearance, pointing to locality. As expected from excitable systems, the disappearance time was not affected by additional bars crossing the target during invisibility, and there was little dependence on the mask configuration. After the target reappeared, it stayed for at least 0.5-2 s (the refractory period). Therefore, the dynamics governing MIB represent an example of an excitable system, where the transition to the invisible state is induced by the mask. The dynamics that follow were determined mostly by the internal network properties.

Measuring the reliability of binocular rivalry

Binocular rivalry is a widely used tool in sensory and cognitive neuroscience to investigate different aspects of vision and cognition. The dynamics of binocular rivalry (e.g., duration of perceptual dominance phases and mixed percept proportions) differ across individuals; based on rivalry dynamics, it is also possible to calculate an index of ocular dominance (by comparing the perceptual dominance of the images in the two eyes). In this study, we investigated the reliability of binocular rivalry dynamics using different methods for dichoptic stimulation and different rivalry stimuli. For the three main indices we defined (ocular dominance, phase durations and mixed percept proportions), we found a high test-retest reliability across sessions. Moreover, the test-retest reliability of the ocular dominance index was predictable from its internal consistency, supporting its stability over time. Phase durations and mixed percept proportions, in contrast, had worse test-retest reliability than expected based on internal consistency, indicating that these parameters are susceptible to state-dependent changes. Our results support the use of the ocular dominance index and binocular rivalry in the measurement of sensory eye dominance and its plasticity, but advise caution when investigating the association between phase durations or mixed percepts and stable characteristics like psychological traits or disorders.

Perceptual filling-in dispels the veridicality problem of conscious perception research

Conscious perceptual experiences are expected to correlate with content-specific brain activity. A veridicality problem arises when attempting to disentangle unconscious and conscious brain processes if conscious perceptual contents accurately match the physical nature of the stimulus. We argue that perceptual filling-in, a phenomenon whereby visual information inaccurately spreads across visual space, is a promising approach to circumvent the veridicality problem. Filling-in generates non-veridical although unambiguous percepts dissociated from stimulus input. In particular, the radial uniformity illusion induces a filling-in experience between a central disk and the surrounding periphery. We discuss how this illusion facilitates both the detection of neurophysiological responses and subjective phenomenological monitoring. We report behavioral effects from a large-sample (n = 200) psychophysics study and examine key stimulus parameters that drive the conscious filling-in experience. We propose that these data underpin future hypothesis-driven studies of filling-in to further delineate the neural mechanisms of conscious perception.

Alpha fluctuations regulate the accrual of visual information to awareness

Endogenous brain processes play a paramount role in shaping up perceptual phenomenology. This is illustrated by the alternations experienced by humans (and other animals) when watching perceptually ambiguous, static images. We hypothesised that endogenous alpha fluctuations in the visual cortex pace the accumulation of sensory information leading to perceptual outcomes. Here, we addressed this hypothesis using binocular rivalry combined with visual entrainment and electroencephalography in humans (64 female, 53 male). The results revealed a correlation between the individual frequency of alpha oscillations in the occipital cortex and perceptual alternation rates experienced during binocular rivalry. In subsequent experiments we show that regulating endogenous brain activity via rhythmic entrainment produced corresponding changes in perceptual alternation rate. These changes were observed only in the alpha range but not at lower entrainment frequencies, and were much reduced when using arrhythmic stimulation. Additionally, entraining at frequencies above the alpha range did not result in speeding up perceptual alternation rates. Overall, these findings support the notion that visual information is accumulated via alpha cycles to promote the emergence of conscious perceptual representations. We suggest that models of binocular rivalry incorporating posterior alpha as a pacemaker can provide an important advance in the comprehension of the dynamics of visual awareness.

Vestibular and active self-motion signals drive visual perception in binocular rivalry

Multisensory integration helps the brain build reliable models of the world and resolve ambiguities. Visual interactions with sound and touch are well established but vestibular influences on vision are less well studied. Here, we test the vestibular influence on vision using horizontally opposed motions presented one to each eye so that visual perception is unstable and alternates irregularly. Passive, whole-body rotations in the yaw plane stabilized visual alternations, with perceived direction oscillating congruently with rotation (leftward motion during leftward rotation, and vice versa). This demonstrates a purely vestibular signal can resolve ambiguous visual motion and determine visual perception. Active self-rotation following the same sinusoidal profile also entrained vision to the rotation cycle – more strongly and with a lesser time lag, likely because of efference copy and predictive internal models. Both experiments show that visual ambiguity provides an effective paradigm to reveal how vestibular and motor inputs can shape visual perception.

•

Binocular rivalry between left/right motions is stabilized by congruent head movement

•

Left/right head rotations entrain rivalry dynamics so matching direction is perceived

•

Active and passive rotations both drive rivalry dominance to match rotation direction

•

Resolving ambiguous vision occurs in a broader vestibular and action-based context

Collaborative dialogue between Buddhism and science: A contribution to expanding a science of consciousness

Investigation of consciousness (experience, mind, awareness, subjectivity) has become an accepted endeavor in contemporary neuroscience. However, current work is largely limited to study of neural correlates of consciousness. While this is interesting and important, it may not be sufficient to carry us to a place of truly new insight regarding consciousness. I argue that one element of expanding a science of consciousness is appreciation of the interdependent co-creation or enfolding of mind and world. Addressing this interdependence is an aspect of the collaborative engagement of the traditions of Buddhism and science-a project that is exploring how complementary worldviews and analytic procedures might further the development of an expanded science of mind. In this essay, written for a collection honoring the life and work of Jack Pettigrew, I describe his connection to this project.

How experimental neuroscientists can fix the hard problem of consciousness

For the materialist, the hard problem is fundamentally an explanatory problem. Solving it requires explaining why the relationship between brain and experience is the way it is and not some other way. We use the tools of the interventionist theory of explanation to show how a systematic experimental project could help move beyond the hard problem. Key to this project is the development of second-order interventions and invariant generalizations. Such interventions played a crucial scientific role in untangling other scientific mysteries, and we suggest that the same will be true of consciousness. We further suggest that the capacity for safe and reliable self-intervention will play a key role in overcoming both the hard and meta-problems of consciousness. Finally, we evaluate current strategies for intervention, with an eye to how they might be improved.

Individual differences point to two separate processes involved in the resolution of binocular rivalry

Although binocular rivalry is different from other perceptually bistable phenomena in requiring interocular conflict, it also shares numerous features with those phenomena. This raises the question of whether, and to what extent, the neural bases of binocular rivalry and other bistable phenomena overlap. Here we examine this question using an individual-differences approach. In a first experiment, observers reported perception during four binocular rivalry tasks that differed in the features and retinal locations of the stimuli used. Perceptual dominance durations were highly correlated when compared between stimuli that differed in location only. Correlations were substantially weaker, however, when comparing stimuli comprised of different features. Thus, individual differences in binocular-rivalry perception partly reflect a feature-specific factor that is not shared among all variants of binocular rivalry. Our second experiment again included several binocular rivalry variants, but also a different form of bistability: moving plaid rivalry. Correlations in dominance durations between binocular rivalry variants that differed in feature content were again modest. Moreover, and surprisingly, correlations between binocular rivalry and moving plaid rivalry were of similar magnitude. This indicates a second, more general, factor underlying individual differences in binocular rivalry perception: one that is shared across binocular rivalry and moving plaid rivalry. We propose that the first, feature-specific factor corresponds to feature-tuned mechanisms involved in the treatment of interocular conflict, whereas the second, general factor corresponds to mechanisms involved in representing surfaces. These latter mechanisms would operate at a binocular level and be central to both binocular rivalry and other forms of bistability.

Ensemble modeling of auditory streaming reveals potential sources of bistability across the perceptual hierarchy

Perceptual bistability-the spontaneous, irregular fluctuation of perception between two interpretations of a stimulus-occurs when observing a large variety of ambiguous stimulus configurations. This phenomenon has the potential to serve as a tool for, among other things, understanding how function varies across individuals due to the large individual differences that manifest during perceptual bistability. Yet it remains difficult to interpret the functional processes at work, without knowing where bistability arises during perception. In this study we explore the hypothesis that bistability originates from multiple sources distributed across the perceptual hierarchy. We develop a hierarchical model of auditory processing comprised of three distinct levels: a Peripheral, tonotopic analysis, a Central analysis computing features found more centrally in the auditory system, and an Object analysis, where sounds are segmented into different streams. We model bistable perception within this system by applying adaptation, inhibition and noise into one or all of the three levels of the hierarchy. We evaluate a large ensemble of variations of this hierarchical model, where each model has a different configuration of adaptation, inhibition and noise. This approach avoids the assumption that a single configuration must be invoked to explain the data. Each model is evaluated based on its ability to replicate two hallmarks of bistability during auditory streaming: the selectivity of bistability to specific stimulus configurations, and the characteristic log-normal pattern of perceptual switches. Consistent with a distributed origin, a broad range of model parameters across this hierarchy lead to a plausible form of perceptual bistability.

Humans Perceive Binocular Rivalry and Fusion in a Tristable Dynamic State

Human vision combines inputs from the two eyes into one percept. Small differences "fuse" together, whereas larger differences are seen "rivalrously" from one eye at a time. These outcomes are typically treated as mutually exclusive processes, with paradigms targeting one or the other and fusion being unreported in most rivalry studies. Is fusion truly a default, stable state that only breaks into rivalry for non-fusible stimuli? Or are monocular and fused percepts three sub-states of one dynamical system? To determine whether fusion and rivalry are separate processes, we measured human perception of Gabor patches with a range of interocular orientation disparities. Observers (10 female, 5 male) reported rivalrous, fused, and uncertain percepts over time. We found a dynamic "tristable" zone spanning from ∼25-35° of orientation disparity where fused, left-eye-, or right-eye-dominant percepts could all occur. The temporal characteristics of fusion and non-fusion periods during tristability matched other bistable processes. We tested statistical models with fusion as a higher-level bistable process alternating with rivalry against our findings. None of these fit our data, but a simple bistable model extended to have three states reproduced many of our observations. We conclude that rivalry and fusion are multistable substates capable of direct competition, rather than separate bistable processes.SIGNIFICANCE STATEMENT When inputs to the two eyes differ, they can either fuse together or engage in binocular rivalry, where each eye's view is seen exclusively in turn. Visual stimuli have often been tailored to produce either fusion or rivalry, implicitly treating them as separate mutually-exclusive perceptual processes. We have found that some similar-but-different stimuli can result in both outcomes over time. Comparing various simple models with our results suggests that rivalry and fusion are not independent processes, but compete within a single multistable system. This conceptual shift is a step toward unifying fusion and rivalry, and understanding how they both contribute to the visual system's production of a unified interpretation of the conflicting images cast on the retina by real-world scenes.

Individual variation in inter-ocular suppression and sensory eye dominance

The competitive and inhibitory interactions between the two eyes' images are a pervasive aspect of binocular vision. Over the last decade, our understanding of the neural processes underpinning binocular rivalry (BR) and continuous flash suppression (CFS) has increased substantially, but we still have little understanding of the relationship between these two effects and their variation in the general population. Studies that pool data across individuals and eyes risk masking substantial variations in binocular vision that exist in the general population. To investigate this issue we compared the depth of inter-ocular suppression evoked by BR with that elicited by CFS, in a group (N = 25) of visually normal individuals. A noise pattern (either static for BR or dynamic for CFS) was presented to one eye and its suppressive influence on a probe grating presented simultaneously to the other eye was measured. We found substantial individual differences in the magnitude of suppression (a 10-fold variation in probe detection threshold) evoked by each task, but performance on BR was a significant predictor of performance on the CFS task. However many individuals showed marked asymmetries between the two eyes' ability to detect a suppressed target, that were not necessarily the same for the two tasks. There was a tendency for the magnitude of the asymmetry to increase as the refresh rate of the dynamic noise increased. The results suggest a common underlying mechanism is likely to be responsible, at least in part, for driving inter-ocular suppression under BR and CFS. The marked asymmetries in inter-ocular suppression at higher noise refresh rates, may be indicative of a difference in temporal processing between the eyes.

Individual differences in continuous flash suppression: Potency and linkages to binocular rivalry dynamics

Binocular rivalry (BR) and continuous flash suppression (CFS) are compelling psychophysical phenomena involving interocular suppression. Using an individual differences approach we assessed whether interocular suppression induced by CFS is predictable in potency from characteristics of BR that are plausibly governed by interocular inhibition. We found large individual differences in BR dynamics and, in addition, in the strength of CFS as gauged by the incidence and durations of breakthroughs in CFS during an extended viewing periods. CFS's potency waned with repeated trials, but stable individual differences persisted despite these mean shifts. We also discovered large individual differences in the strength of the post-CFS shift in BR dominance produced by interocular suppression. While CFS breakthroughs were significantly negatively correlated with shifts in BR dominance after CFS, there were no significant associations between individual differences in alternation rate during pre-CFS binocular rivalry and either breakthroughs during CFS or post-CFS dominance shifts. Bayesian hypothesis tests and highest posterior density intervals confirmed the weak association between these two forms of interocular suppression. Thus, our findings suggest that the substantial individual differences in BR dynamics and CFS effectiveness are modestly related but not entirely mediated by one common neural substrate.

Two paradigms of bistable plaid motion reveal independent mutual inhibition processes

Perception is sometimes bistable, switching between two possible interpretations. Levelt developed several propositions to explain bistable perception in binocular rivalry, based on a model of competing neural populations connected through reciprocal inhibition. Here we test Levelt's laws with bistable plaid motion. Plaids are typically tristable, either a coherent pattern, transparent with one component in front, or transparent with the opposite depth order. In Experiment 1, we use a large angle between component directions to prevent plaid coherence, limiting the ambiguity to alternations of grating depth order. Similar to increasing contrast in binocular rivalry, increasing component speed led to higher switch rates (analogous to Levelt's fourth proposition). In Experiment 2, we used occlusion cues to prevent one depth order and limit bistability to one transparent depth order alternating with coherence. Increasing grating speed shortened coherent motion periods but left transparent periods largely unchanged (analogous to Levelt's second proposition). Switch dynamics showed no correlation between the experiments. These data suggest that plaid component speed acts like contrast in binocular rivalry to vary switch dynamics through a mutual inhibition model. The lack of correlation between both experiments suggests reciprocal inhibition mediates bistability between a variety of neural populations across the visual system.

Intrinsic timescales of sensory integration for motion perception

A subject-specific process of perceptual decision making is of importance to how the brain translates its interpretation of sensory information into behavior. In particular, a number of studies reported substantial variation across the observers’ decision behavior, which may reflect different profiles of evidence accumulated by each individual. However, a detailed profile of perceptual integration has not yet been verified from human behavioral data. To address the issue, we precisely measured the time course of sensory integration, as the “sensory integration kernel” of subjects, using a coherence-varying motion discrimination task. We found that each subject has a distinct profile of sensory integration. We observed that kernel size (maximum sensory integration interval) is consistent within subjects, independent of external stimuli conditions. The observed kernel could accurately predict subject-specific perceptual behaviors and explain the inter-individual variation of observed behaviors. Surprisingly, the performance of most subjects did not improve in proportion to increased duration of the stimulus, but was maximized when the stimulus duration matched their kernel size. We also found that the observed kernel size was strongly correlated with the subject-specific perceptual characteristics for illusory motion. Our results suggest that perceptual decisions arise from intrinsic decision dynamics, and on individual timescales of sensory integration.

Transcutaneous Vagus Nerve Stimulation (tVNS) and the Dynamics of Visual Bistable Perception

Transcutaneous vagus nerve stimulation (tVNS) is widely used for clinical applications, but its mechanism of action is poorly understood. One candidate pathway that might mediate the effects of tVNS is an increase in GABAergic neurotransmission. In this study, we investigated the effect of tVNS on visual bistable perception, which is highly coupled to GABA. Participants were 34 healthy young subjects. We used a static (Necker cube) and a dynamic (structure from motion) bistable perception task. Each subject underwent tVNS as well as sham (placebo) stimulation for ∼45 min. We analyze effects of tVNS on percept durations by means of Bayesian multilevel regression. We find no evidence for a modulation of bistable perception dynamics through tVNS in either task, but the analyses do not ultimately confirm the null hypothesis either. We discuss different possible implications of our finding and propose that GABAergic effects of tVNS should be further investigated using more direct measures of GABA concentration, and, more generally, that a better understanding of the mechanisms of action of vagus nerve stimulation is needed. Finally, we discuss limitations of our study design, data analysis, and conclusions.

Frequency of alpha oscillation predicts individual differences in perceptual stability during binocular rivalry

When ambiguous visual stimuli have multiple interpretations, human perception can alternate between them, producing perceptual multistability. There is a large variation between individuals in how long stable percepts endure, on average, between switches, but the underlying neural basis of this individual difference in perceptual dynamics remains obscure. Here, we show that in one widely studied multistable paradigm-binocular rivalry-perceptual stability in individuals is predicted by the frequency of their neural oscillations within the alpha range (7-13 Hz). Our results suggest revising models of rivalry to incorporate effects of neural oscillations on perceptual alternations, and raise the possibility that a common factor may influence dynamics in many neural processes.

Revisiting individual differences in the time course of binocular rivalry

Simultaneously showing an observer two incompatible displays, one to each eye, causes binocular rivalry, during which the observer regularly switches between perceiving one eye's display and perceiving the other. Observers differ in the rate of this perceptual cycle, and these individual differences have been reported to correlate with differences in the perceptual switch rate for other bistable perception phenomena. Identifying which psychological or neural factors explain this variability can help clarify the mechanisms underlying binocular rivalry and of bistable perception generally. Motivated by the prominent theory that perceptual switches during binocular rivalry are brought about by neural adaptation, we investigated whether perceptual switch rates are correlated with the strength of neural adaptation, indexed by visual aftereffects. We found no compelling evidence for such correlations. Moreover, we did not corroborate previous findings that switch rates are correlated between binocular rivalry and other forms of bistable perception. This latter nonreplication prompted us to perform a meta-analysis of existing research into correlations among forms of bistable perception, which revealed that evidence for such correlations is much weaker than is generally believed. By showing no common factor linking individual differences in binocular rivalry and in our other paradigms, these results fit well with other work that has shown such common factors to be rare among visual phenomena generally.

Genomic Analyses of Visual Cognition: Perceptual Rivalry and Top-Down Control

Visual cognition in humans has traditionally been studied with cognitive behavioral methods and brain imaging, but much less with genetic methods. Perceptual rivalry, an important phenomenon in visual cognition, is the spontaneous perceptual alternation that occurs between two distinct interpretations of a physically constant visual stimulus (e.g., binocular rivalry stimuli) or a perceptually ambiguous stimulus (e.g., the Necker cube). The switching rate varies dramatically across individuals and can be voluntarily modulated by observers. Here, we adopted a genomic approach to systematically investigate the genetics underlying binocular rivalry, Necker cube rivalry and voluntary modulation of Necker cube rivalry in young Chinese adults (Homo sapiens, 81% female, 20 ± 1 years old) at multiple levels, including common single nucleotide polymorphism (SNP)-based heritability estimation, SNP-based genome-wide association study (GWAS), gene-based analysis, and pathway analysis. We performed a pilot GWAS in 2441 individuals and replicated it in an independent cohort of 943 individuals. Common SNP-based heritability was estimated to be 25% for spontaneous perceptual rivalry. SNPs rs184765639 and rs75595941 were associated with voluntary modulation, and imaging data suggested genotypic difference of rs184765639 in the surface area of the left caudal-middle frontal cortex. Additionally, converging evidence from multilevel analyses associated genes such as PRMT1 with perceptual switching rate, and MIR1178 with voluntary modulation strength. In summary, this study discovered specific genetic contributions to perceptual rivalry and its voluntary modulation in human beings. These findings may promote our understanding of psychiatric disorders, as perceptual rivalry is a potential psychiatric biomarker.SIGNIFICANCE STATEMENT Perceptual rivalry is an important visual phenomenon in which our perception of a physically constant visual input spontaneously switches between two different states. There are individual variations in perceptual switching rate and voluntary modulation strength. Our genomic analyses reveal several loci associated with these two kinds of variation. Because perceptual rivalry is thought to be relevant to and potentially an endophenotype for psychiatric disorders, these results may help understand not only visual cognition, but also psychiatric disorders.

Visceral theory of sleep and origins of mental disorders

Visceral theory of sleep states that the same brain neurons, which process external information in wakefulness, during sleep switch to the processing of internal information coming from various visceral systems. Here we hypothesize that a failure in the commutation of exteroceptive and interoceptive information flows in the brain can manifest itself as a mental illness.

Human single neuron activity precedes emergence of conscious perception

Identifying the neuronal basis of spontaneous changes in conscious experience in the absence of changes in the external environment is a major challenge. Binocular rivalry, in which two stationary monocular images lead to continuously changing perception, provides a unique opportunity to address this issue. We studied the activity of human single neurons in the medial temporal and frontal lobes while patients were engaged in binocular rivalry. Here we report that internal changes in the content of perception are signaled by very early (~-2000 ms) nonselective medial frontal activity, followed by selective activity of medial temporal lobe neurons that precedes the perceptual change by ~1000 ms. Such early activations are not found for externally driven perceptual changes. These results suggest that a medial fronto-temporal network may be involved in the preconscious internal generation of perceptual transitions.

Autistic Traits Are Not a Strong Predictor of Binocular Rivalry Dynamics

It has been suggested that differences in binocular rivalry switching rates and mixed percept durations in ASD could serve as a biomarker of excitation/inhibition imbalances in the autistic brain. If so, one would expect these differences to extend to neurotypical groups with high vs. low levels of autistic tendency. Previous studies did not detect any correlations between binocular rivalry dynamics and Autism Spectrum Quotient (AQ) scores in neurotypical control groups; however it is unclear whether this was due to the characteristics of the rivalry stimuli that were used. We further investigated this possibility in a sample of neurotypical young adults. The binocular rivalry stimuli were simple gratings, complex objects, or scrambled objects, which were presented dichoptically, either at fixation or in the periphery. A Bayesian correlation analysis showed that individuals with higher AQ scores tended to have lower perceptual switching rates for the centrally presented, simple grating rival stimuli. However, there was no evidence of a relationship between AQ and switching rates, reversal rates or mixed percept durations for any of the other binocular rivalry conditions. Overall, our findings suggest that in the non-clinical population, autistic personality traits are not a strong predictor of binocular rivalry dynamics.

The Independent and Shared Mechanisms of Intrinsic Brain Dynamics: Insights From Bistable Perception

In bistable perception, constant input leads to alternating perception. The dynamics of the changing perception reflects the intrinsic dynamic properties of the “unconscious inferential” process in the brain. Under the same condition, individuals differ in how fast they experience the perceptual alternation. In this study, testing many forms of bistable perception in a large number of observers, we investigated the key question of whether there is a general and common mechanism or multiple and independent mechanisms that control the dynamics of the inferential brain. Bistable phenomena tested include binocular rivalry, vase-face, Necker cube, moving plaid, motion induced blindness, biological motion, spinning dancer, rotating cylinder, Lissajous-figure, rolling wheel, and translating diamond. Switching dynamics for each bistable percept was measured in 100 observers. Results show that the switching rates of subsets of bistable percept are highly correlated. The clustering of dynamic properties of some bistable phenomena but not an overall general control of switching dynamics implies that the brain’s inferential processes are both shared and independent – faster in constructing 3D structure from motion does not mean faster in integrating components into an objects.

Conflict-sensitive neurons gate interocular suppression in human visual cortex

Neural suppression plays an important role in cortical function, including sensory, memory, and motor systems. It remains, however, relatively poorly understood. A paradigmatic case arises when conflicting images are presented to the two eyes. These images can compete for awareness, and one is usually strongly suppressed. The mechanisms that resolve such interocular conflict remain unclear. Suppression could arise solely from “winner-take-all” competition between neurons responsive to each eye. Alternatively, suppression could also depend upon neurons detecting interocular conflict. Here, we provide physiological evidence in human visual cortex for the latter: suppression depends upon conflict-sensitive neurons. We recorded steady-state visual evoked potentials (SSVEP), and used the logic of selective adaptation. The amplitude of SSVEP responses at intermodulation frequencies strengthened as interocular conflict in the stimulus increased, suggesting the presence of neurons responsive to conflict. Critically, adaptation to conflict both reduced this SSVEP effect, and increased the amount of conflict needed to produce perceptual suppression. The simplest account of these results is that interocular-conflict-sensitive neurons exist in human cortex: adaptation likely reduced the responsiveness of these neurons which in turn raised the amount of conflict required to produce perceptual suppression. Similar mechanisms may be used to resolve other varieties of perceptual conflict.

Does direction of walking impact binocular rivalry between competing patterns of optic flow?

When dissimilar monocular images are viewed simultaneously by the two eyes, stable binocular vision gives way to unstable vision characterized by alternations in dominance between the two images in a phenomenon called binocular rivalry. These alternations in perception reveal the existence of inhibitory interactions between neural representations associated with conflicting visual inputs. Binocular rivalry has been studied since the days of Wheatstone, but one recent strategy is to investigate its susceptibility to influences caused by one's own motor activity. This paper focused on the activity of walking, which produces an expected, characteristic direction of optic flow dependent upon the direction of one's walking. In a set of experiments, we employed virtual reality technology to present dichoptic stimuli to observers who walked forward, backward, or were sitting. Optic flow was presented to a given eye, and was sometimes congruent with the direction of walking, sometimes incongruent, and sometimes random, except when the participant was sitting. Our results indicate that, while walking had a reliable influence on rivalry dynamics, the predominance of congruent or incongruent motion did not.

Multistable Perception and the Role of the Frontoparietal Cortex in Perceptual Inference

A given pattern of optical stimulation can arise from countless possible real-world sources, creating a dilemma for vision: What in the world actually gives rise to the current pattern? This dilemma was pointed out centuries ago by the astronomer and mathematician Ibn Al-Haytham and was forcefully restated 150 years ago when von Helmholtz characterized perception as unconscious inference. To buttress his contention, von Helmholtz cited multistable perception: recurring changes in perception despite unchanging sensory input. Recent neuroscientific studies have exploited multistable perception to identify brain areas uniquely activated in association with these perceptual changes, but the specific roles of those activations remain controversial. This article provides an overview of theoretical models of multistable perception, a review of recent neuroimaging and brain stimulation studies focused on mechanisms associated with these perceptual changes, and a synthesis of available evidence within the context of current notions about Bayesian inference that find their historical roots in von Helmholtz's work.

Chromatic interocular-switch rivalry

Interocular-switch rivalry (also known as stimulus rivalry) is a kind of binocular rivalry in which two rivalrous images are swapped between the eyes several times a second. The result is stable periods of one image and then the other, with stable intervals that span many eye swaps (Logothetis, Leopold, & Sheinberg, 1996). Previous work used this close kin of binocular rivalry with rivalrous forms. Experiments here test whether chromatic interocular-switch rivalry, in which the swapped stimuli differ in only chromaticity, results in slow alternation between two colors. Swapping equiluminant rivalrous chromaticities at 3.75 Hz resulted in slow perceptual color alternation, with one or the other color often continuously visible for two seconds or longer (during which there were 15+ eye swaps). A well-known theory for sustained percepts from interocular-switch rivalry with form is inhibitory competition between binocular neurons driven by monocular neurons with matched orientation tuning in each eye; such binocular neurons would produce a stable response when a given orientation is swapped between the eyes. A similar model can account for the percepts here from chromatic interocular-switch rivalry and is underpinned by the neurophysiological finding that color-preferring binocular neurons are driven by monocular neurons from each eye with well-matched chromatic selectivity (Peirce, Solomon, Forte, & Lennie, 2008). In contrast to chromatic interocular-switch rivalry, luminance interocular-switch rivalry with swapped stimuli that differ in only luminance did not result in slowly alternating percepts of different brightnesses.

Audio-visual interactions uniquely contribute to resolution of visual conflict in people possessing absolute pitch

Individuals possessing absolute pitch (AP) are able to identify a given musical tone or to reproduce it without reference to another tone. The present study sought to learn whether this exceptional auditory ability impacts visual perception under stimulus conditions that provoke visual competition in the form of binocular rivalry. Nineteen adult participants with 3–19 years of musical training were divided into two groups according to their performance on a task involving identification of the specific note associated with hearing a given musical pitch. During test trials lasting just over half a minute, participants dichoptically viewed a scrolling musical score presented to one eye and a drifting sinusoidal grating presented to the other eye; throughout the trial they pressed buttons to track the alternations in visual awareness produced by these dissimilar monocular stimuli. On “pitch-congruent” trials, participants heard an auditory melody that was congruent in pitch with the visual score, on “pitch-incongruent” trials they heard a transposed auditory melody that was congruent with the score in melody but not in pitch, and on “melody-incongruent” trials they heard an auditory melody completely different from the visual score. For both groups, the visual musical scores predominated over the gratings when the auditory melody was congruent compared to when it was incongruent. Moreover, the AP participants experienced greater predominance of the visual score when it was accompanied by the pitch-congruent melody compared to the same melody transposed in pitch; for non-AP musicians, pitch-congruent and pitch-incongruent trials yielded equivalent predominance. Analysis of individual durations of dominance revealed differential effects on dominance and suppression durations for AP and non-AP participants. These results reveal that AP is accompanied by a robust form of bisensory interaction between tonal frequencies and musical notation that boosts the salience of a visual score.

Comparison of perceptual properties of auditory streaming between spectral and amplitude modulation domains

The two-tone sequence (ABA_), which comprises two different sounds (A and B) and a silent gap, has been used to investigate how the auditory system organizes sequential sounds depending on various stimulus conditions or brain states. Auditory streaming can be evoked by differences not only in the tone frequency ("spectral cue": ΔF_TONE, TONE condition) but also in the amplitude modulation rate ("AM cue": ΔF_AM, AM condition). The aim of the present study was to explore the relationship between the perceptual properties of auditory streaming for the TONE and AM conditions. A sequence with a long duration (400 repetitions of ABA_) was used to examine the property of the bistability of streaming. The ratio of feature differences that evoked an equivalent probability of the segregated percept was close to the ratio of the Q-values of the auditory and modulation filters, consistent with a "channeling theory" of auditory streaming. On the other hand, for values of ΔF_AM and ΔF_TONE evoking equal probabilities of the segregated percept, the number of perceptual switches was larger for the TONE condition than for the AM condition, indicating that the mechanism(s) that determine the bistability of auditory streaming are different between or sensitive to the two domains. Nevertheless, the number of switches for individual listeners was positively correlated between the spectral and AM domains. The results suggest a possibility that the neural substrates for spectral and AM processes share a common switching mechanism but differ in location and/or in the properties of neural activity or the strength of internal noise at each level.

Extending Levelt's Propositions to perceptual multistability involving interocular grouping

Levelt's Propositions are central to understanding a wide range of multistable perceptual phenomena, but it is unclear whether they extend to perceptual multistability involving interocular grouping. We presented split-grating stimuli with complementary halves of the same color (either red or green) to human subjects. The subjects reported four percepts in alternation: the two stimuli presented to each eye (half red and half green), as well as the two single color (all red or all green), interocularly grouped percepts. Increasing color saturation lead to increased reports of the single color percept in most subjects, indicating increased predominance of grouped percepts (Levelt's Proposition I). This increase in predominance was due to a decrease in the average dominance duration of single-eye percepts, with grouped percept dominance largely unaffected. This agrees with a generalization of Levelt's Proposition II, as the average dominance duration of the stronger (in this case single-eye) percept was primarily affected by changes in stimulus strength. Moreover, in agreement with Levelt's Proposition III the alternation rate between percepts increased as the difference in the strength of the percepts decreased.

Filling-in rivalry: Perceptual alternations in the absence of retinal image conflict

During perceptual rivalry, an observer's perceptual experience alternates over time despite constant sensory stimulation. Perceptual alternations are thought to be driven by conflicting or ambiguous retinal image features at a particular spatial location and modulated by global context from surrounding locations. However, rivalry can also occur between two illusory stimuli-such as two filled-in stimuli within the retinal blind spot. In this "filling-in rivalry," what observers perceive in the blind spot changes in the absence of local stimulation. It remains unclear if filling-in rivalry shares common mechanisms with other types of rivalry. We measured the dynamics of rivalry between filled-in percepts in the blind spot, finding a high degree of exclusivity (perceptual dominance of one filled-in percept, rather than a perception of transparency), alternation rates that were highly consistent for individual observers, and dynamics that closely resembled other forms of perceptual rivalry. The results suggest that mechanisms common to a wide range of rivalry situations need not rely on conflicting retinal image signals.

Does Interhemispheric Competition Mediate Motion-Induced Blindness? A Transcranial Magnetic Stimulation Study

Motion-induced blindness (MIB) is a phenomenon, perhaps related to perceptual rivalry, where stationary targets disappear and reappear in a cyclic mode when viewed against a background (mask) of coherent, apparent 3-D motion. Since MIB has recently been shown to share similar temporal properties with binocular rivalry, we probed the appearance–disappearance cycle of MIB using unilateral, single-pulse transcranial magnetic stimulation (TMS)—a manipulation that has previously been shown to influence binocular rivalry. Effects were seen for both hemispheres when the timing of TMS was determined prospectively on the basis of a given subject's appearance–disappearance cycle, so that it occurred on average around 300 ms before the time of perceptual switch. Magnetic stimulation of either hemisphere shortened the time to switch from appearance to disappearance and vice versa. However, TMS of left posterior parietal cortex more selectively shortened the disappearance time of the targets if delivered in phase with the disappearance cycle, but lengthened it if TMS was delivered in the appearance phase after the perceptual switch. Opposite effects were seen in the right hemisphere, although less marked than the left-hemisphere effects. As well as sharing temporal characteristics with binocular rivalry, MIB therefore seems to share a similar underlying mechanism of interhemispheric modulation. Interhemispheric switching may thus provide a common temporal framework for uniting the diverse, multilevel phenomena of perceptual rivalry.

The time course of binocular rivalry during the phases of the menstrual cycle

Binocular rivalry occurs when markedly different inputs to the two eyes initiate alternations in perceptual dominance between the two eyes' views. A link between individual differences in perceptual dynamics of rivalry and concentrations of GABA, a prominent inhibitory neurotransmitter in the brain, has highlighted binocular rivalry as a potential tool to investigate inhibitory processes in the brain. The present experiment investigated whether previously reported fluctuations of GABA concentrations in a healthy menstrual cycle (Epperson et al., 2002) also are associated with measurable changes in rivalry dynamics within individuals. We obtained longitudinal measures of alternation rate, dominance, and mixture durations in 300 rivalry tracking blocks measured over 5 weeks from healthy female participants who monitored the start of the follicular and luteal phases of their cycle. Although we demonstrate robust and stable individual differences in rivalry dynamics, across analytic approaches and dependent measures, we found no significant change or even trends across menstrual phases in the temporal dynamics of dominance percepts. We found only sparse between-phase differences in skew and kurtosis on mixture percepts when data were pooled across sessions and blocks. These results suggest a complex dynamic between hormonal steroids, binocular rivalry, and GABAeric signaling in the brain and thus implicate the need to consider a systemic perspective when linking GABA with perceptual alternations in binocular rivalry.

A Common Mechanism for Perceptual Reversals in Motion-Induced Blindness, the Troxler Effect, and Perceptual Filling-In

Several striking visual phenomena involve a physically present stimulus that alternates between being perceived and being "invisible." For example, motion-induced blindness, the Troxler effect, and perceptual filling-in all consist of subjective alternations where an item repeatedly changes from being seen to unseen. In the present study, we explored whether these three specific visual phenomena share any commonalities in their alternation rates and patterns to better understand the mechanisms of each. Data from 69 individuals revealed moderate to strong correlations across the three phenomena for the number of perceptual disappearances and the accumulated duration of the disappearances. Importantly, these effects were not correlated with eye movement patterns (saccades) assessed through eye tracking, differences in motion sensitivity as indexed by dot coherence and speed perception thresholds, or simple reaction time abilities. Principal component analyses revealed a single component that explained 67% of the variance for the number of perceptual reversals and 60% for the accumulated duration of the disappearances. The temporal dynamics of illusory disappearances was also compared for each phenomenon, and normalized durations of disappearances were well fit by a gamma distribution with similar shape parameters for each phenomenon, suggesting that they may be driven by a single oscillatory mechanism.

Does visual attention drive the dynamics of bistable perception?

How does attention interact with incoming sensory information to determine what we perceive? One domain in which this question has received serious consideration is that of bistable perception: a captivating class of phenomena that involves fluctuating visual experience in the face of physically unchanging sensory input. Here, some investigations have yielded support for the idea that attention alone determines what is seen, while others have implicated entirely attention-independent processes in driving alternations during bistable perception. We review the body of literature addressing this divide and conclude that in fact both sides are correct-depending on the form of bistable perception being considered. Converging evidence suggests that visual attention is required for alternations in the type of bistable perception called binocular rivalry, while alternations during other types of bistable perception appear to continue without requiring attention. We discuss some implications of this differential effect of attention for our understanding of the mechanisms underlying bistable perception, and examine how these mechanisms operate during our everyday visual experiences.

Plaid Motion Rivalry: Correlates with Binocular Rivalry and Positive Mood State

Recently Hupé and Rubin (2003, Vision Research43 531–548) re-introduced the plaid as a form of perceptual rivalry by using two sets of drifting gratings behind a circular aperture to produce quasi-regular perceptual alternations between a coherent moving plaid of diamond-shaped intersections and the two sets of component ‘sliding’ gratings. We call this phenomenon plaid motion rivalry (PMR), and have compared its temporal dynamics with those of binocular rivalry in a sample of subjects covering a wide range of perceptual alternation rates. In support of the proposal that all rivalries may be mediated by a common switching mechanism, we found a high correlation between alternation rates induced by PMR and binocular rivalry. In keeping with a link discovered between the phase of rivalry and mood, we also found a link between PMR and an individual's mood state that is consistent with suggestions that each opposing phase of rivalry is associated with one or the other hemisphere, with the ‘diamonds’ phase of PMR linked with the ‘positive’ left hemisphere.

Perceptual Alternation Induced by Visual Transients

When our visual system is confronted with ambiguous stimuli, the perceptual interpretation spontaneously alternates between the competing incompatible interpretations. The timing of such perceptual alternations is highly stochastic and the underlying neural mechanisms are poorly understood. We show that perceptual alternations can be triggered by a transient stimulus presented nearby. The induction was tested for four types of bistable stimuli: structure-from-motion, binocular rivalry, Necker cube, and ambiguous apparent motion. While underlying mechanisms may vary among them, a transient flash induced time-locked perceptual alternations in all cases. The effect showed a dependence on the adaptation to the dominant percept prior to the presentation of a flash. These perceptual alternations show many similarities to perceptual disappearances induced by transient stimuli (Kanai and Kamitani, 2003 Journal of Cognitive Neuroscience15 664–672; Moradi and Shimojo, 2004 Vision Research44 449–460). Mechanisms linking these two transient-induced phenomena are discussed.

Individual differences in the temporal dynamics of binocular rivalry and stimulus rivalry

Binocular rivalry and stimulus rivalry are two forms of perceptual instability that arise when the visual system is confronted with conflicting stimulus information. In the case of binocular rivalry, dissimilar monocular stimuli are presented to the two eyes for an extended period of time, whereas for stimulus rivalry the dissimilar monocular stimuli are exchanged rapidly and repetitively between the eyes during extended viewing. With both forms of rivalry, one experiences extended durations of exclusive perceptual dominance that fluctuate between the two stimuli. Whether these two forms of rivalry arise within different stages of visual processing has remained debatable. Using an individual-differences approach, we found that both stimulus rivalry and binocular rivalry exhibited same-shaped distributions of dominance durations among a sample of 30 observers and, moreover, that the dominance durations measured during binocular and stimulus rivalry were significantly correlated among our sample of observers. Furthermore, we found a significant, positive correlation between alternation rate in binocular rivalry and the incidence of stimulus rivalry. These results suggest that the two forms of rivalry may be tapping common neural mechanisms, or at least different mechanisms with comparable time constants. It remains to be learned just why the incidences of binocular rivalry and stimulus rivalry vary so greatly among people.

Melodic sound enhances visual awareness of congruent musical notes, but only if you can read music

Predictive influences of auditory information on resolution of visual competition were investigated using music, whose visual symbolic notation is familiar only to those with musical training. Results from two experiments using different experimental paradigms revealed that melodic congruence between what is seen and what is heard impacts perceptual dynamics during binocular rivalry. This bisensory interaction was observed only when the musical score was perceptually dominant, not when it was suppressed from awareness, and it was observed only in people who could read music. Results from two ancillary experiments showed that this effect of congruence cannot be explained by differential patterns of eye movements or by differential response sluggishness associated with congruent score/melody combinations. Taken together, these results demonstrate robust audiovisual interaction based on high-level, symbolic representations and its predictive influence on perceptual dynamics during binocular rivalry.

The 'laws' of binocular rivalry: 50 years of Levelt's propositions

It has been fifty years since Levelt's monograph On Binocular Rivalry (1965) was published, but its four propositions that describe the relation between stimulus strength and the phenomenology of binocular rivalry remain a benchmark for theorists and experimentalists even today. In this review, we will revisit the original conception of the four propositions and the scientific landscape in which this happened. We will also provide a brief update concerning distributions of dominance durations, another aspect of Levelt's monograph that has maintained a prominent presence in the field. In a critical evaluation of Levelt's propositions against current knowledge of binocular rivalry we will then demonstrate that the original propositions are not completely compatible with what is known today, but that they can, in a straightforward way, be modified to encapsulate the progress that has been made over the past fifty years. The resulting modified, propositions are shown to apply to a broad range of bistable perceptual phenomena, not just binocular rivalry, and they allow important inferences about the underlying neural systems. We argue that these inferences reflect canonical neural properties that play a role in visual perception in general, and we discuss ways in which future research can build on the work reviewed here to attain a better understanding of these properties.

To see or not to see--thalamo-cortical networks during blindsight and perceptual suppression

Even during moments when we fail to be fully aware of our environment, our brains never go silent. Instead, it appears that the brain can also operate in an alternate, unconscious mode. Delineating unconscious from conscious neural processes is a promising first step toward investigating how awareness emerges from brain activity. Here we focus on recent insights into the neuronal processes that contribute to visual function in the absence of a conscious visual percept. Drawing on insights from findings on the phenomenon of blindsight that results from injury to primary visual cortex and the results of experimentally induced perceptual suppression, we describe what kind of visual information the visual system analyzes unconsciously and we discuss the neuronal routing and responses that accompany this process. We conclude that unconscious processing of certain visual stimulus attributes, such as the presence of visual motion or the emotional expression of a face can occur in a geniculo-cortical circuit that runs independent from and in parallel to the predominant route through primary visual cortex. We speculate that in contrast, bidirectional neuronal interactions between cortex and the thalamic pulvinar nucleus that support large-scale neuronal integration and visual awareness are impeded during blindsight and perceptual suppression.

Individual peak gamma frequency predicts switch rate in perceptual rivalry

Perceptual rivalry-the experience of alternation between two mutually exclusive interpretations of an ambiguous image-provides powerful opportunities to study conscious awareness. It is known that individual subjects experience perceptual alternations for various types of bistable stimuli at distinct rates, and this a stable, heritable trait. Also stable and heritable is the peak frequency of induced gamma-band (30-100 Hz) oscillation of a population-level response in occipital cortex to simple visual patterns, which has been established as a neural correlate of conscious processing. Interestingly, models for rivalry alternation rate and for the frequency of population-level oscillation have both cited inhibitory connections in cortex as crucial determinants of individual differences, and yet the relationship between these two variables has not yet been investigated. Here, we used magnetoencephalography to compare differences in alternation rate for binocular and monocular types of perceptual rivalry to differences in evoked and induced gamma-band frequency of neuromagnetic brain responses to simple nonrivalrous grating stimuli. For both types of bistable images, alternation rate was inversely correlated with the peak frequency of late evoked gamma activity in primary visual cortex (200-400 ms latency). Our results advance models of inhibition that account for subtle variation in normal visual cortex, and shed light on how small differences in anatomy and physiology relate to individual cognition and performance.

Rhythmic gamma stimulation affects bistable perception

When our brain is confronted with ambiguous visual stimuli, perception spontaneously alternates between different possible interpretations although the physical stimulus remains the same. Both alpha (8-12 Hz) and gamma (>30 Hz) oscillations have been reported to correlate with such spontaneous perceptual reversals. However, whether these oscillations play a causal role in triggering perceptual switches remains unknown. To address this question, we applied transcranial alternating current stimulation (tACS) over the posterior cortex of healthy human participants to boost alpha and gamma oscillations. At the same time, participants were reporting their percepts of an ambiguous structure-from-motion stimulus. We found that tACS in the gamma band (60 Hz) increased the number of spontaneous perceptual reversals, whereas no significant effect was found for tACS in alpha (10 Hz) and higher gamma (80 Hz) frequencies. Our results suggest a mechanistic role of gamma but not alpha oscillations in the resolution of perceptual ambiguity.

Top-down modulation in human visual cortex predicts the stability of a perceptual illusion

Conscious perception sometimes fluctuates strongly, even when the sensory input is constant. For example, in motion-induced blindness (MIB), a salient visual target surrounded by a moving pattern suddenly disappears from perception, only to reappear after some variable time. Whereas such changes of perception result from fluctuations of neural activity, mounting evidence suggests that the perceptual changes, in turn, may also cause modulations of activity in several brain areas, including visual cortex. In this study, we asked whether these latter modulations might affect the subsequent dynamics of perception. We used magnetoencephalography (MEG) to measure modulations in cortical population activity during MIB. We observed a transient, retinotopically widespread modulation of beta (12-30 Hz)-frequency power over visual cortex that was closely linked to the time of subjects' behavioral report of the target disappearance. This beta modulation was a top-down signal, decoupled from both the physical stimulus properties and the motor response but contingent on the behavioral relevance of the perceptual change. Critically, the modulation amplitude predicted the duration of the subsequent target disappearance. We propose that the transformation of the perceptual change into a report triggers a top-down mechanism that stabilizes the newly selected perceptual interpretation.