Form and motion have independent access to consciousness

Binocular Integration of Perceptually Suppressed Visual Information in Amblyopia

Purpose

The purpose of this study was to assess whether motion information from suppressed amblyopic eyes can influence visual perception.

Methods

Participants with normal vision (n = 20) and with amblyopia (n = 20; 11 anisometropic and 9 strabismic/mixed) viewed dichoptic, orthogonal drifting gratings through a mirror stereoscope. Participants continuously reported form and motion percepts as gratings rivaled for 60 seconds. Responses were binned into categories ranging from binocular integration to complete suppression. Periods when the grating presented to the nondominant/amblyopic eye was suppressed were analyzed further to determine the extent of binocular integration of motion.

Results

Individuals with amblyopia experienced longer periods of non-preferred eye suppression than controls. When the non-preferred eye grating was suppressed, binocular integration of motion occurred 48.1 ± 6.2% and 31.2 ± 5.8% of the time in control and amblyopic participants, respectively. Periods of motion integration from the suppressed eye were significantly non-zero for both groups.

Conclusions

Visual information seen only by a suppressed amblyopic eye can be binocularly integrated and influence the overall visual percept. These findings reveal that visual information subjected to interocular suppression can still contribute to binocular vision and suggest the use of appropriate optical correction for the amblyopic eye to improve image quality for binocular combination.

Long-range traveling waves of activity triggered by local dichoptic stimulation in V1 of behaving monkeys

Traveling waves of cortical activity, in which local stimulation triggers lateral spread of activity to distal locations, have been hypothesized to play an important role in cortical function. However, there is conflicting physiological evidence for the existence of spreading traveling waves of neural activity triggered locally. Dichoptic stimulation, in which the two eyes view dissimilar monocular patterns, can lead to dynamic wave-like fluctuations in visual perception and therefore, provides a promising means for identifying and studying cortical traveling waves. Here, we used voltage-sensitive dye imaging to test for the existence of traveling waves of activity in the primary visual cortex of awake, fixating monkeys viewing dichoptic stimuli. We find clear traveling waves that are initiated by brief, localized contrast increments in one of the monocular patterns and then, propagate at speeds of ∼ 30 mm/s. These results demonstrate that under an appropriate visual context, circuitry in visual cortex in alert animals is capable of supporting long-range traveling waves triggered by local stimulation.

Neural processing of visual information under interocular suppression: a critical review

When dissimilar stimuli are presented to the two eyes, only one stimulus dominates at a time while the other stimulus is invisible due to interocular suppression. When both stimuli are equally potent in competing for awareness, perception alternates spontaneously between the two stimuli, a phenomenon called binocular rivalry. However, when one stimulus is much stronger, e.g., due to higher contrast, the weaker stimulus can be suppressed for prolonged periods of time. A technique that has recently become very popular for the investigation of unconscious visual processing is continuous flash suppression (CFS): High-contrast dynamic patterns shown to one eye can render a low-contrast stimulus shown to the other eye invisible for up to minutes. Studies using CFS have produced new insights but also controversies regarding the types of visual information that can be processed unconsciously as well as the neural sites and the relevance of such unconscious processing. Here, we review the current state of knowledge in regard to neural processing of interocularly suppressed information. Focusing on recent neuroimaging findings, we discuss whether and to what degree such suppressed visual information is processed at early and more advanced levels of the visual processing hierarchy. We review controversial findings related to the influence of attention on early visual processing under interocular suppression, the putative differential roles of dorsal and ventral areas in unconscious object processing, and evidence suggesting privileged unconscious processing of emotional and other socially relevant information. On a more general note, we discuss methodological and conceptual issues, from practical issues of how unawareness of a stimulus is assessed to the overarching question of what constitutes an adequate operational definition of unawareness. Finally, we propose approaches for future research to resolve current controversies in this exciting research area.

Influence of contrast and coherence on the temporal dynamics of binocular motion rivalry

Levelt’s four propositions (L1–L4), which characterize the relation between changes in “stimulus strength” in the two eyes and percept alternations, are considered benchmark for binocular rivalry models. It was recently demonstrated that adaptation mutual-inhibition models of binocular rivalry capture L4 only in a limited range of input strengths, predicting an increase rather than a decrease in dominance durations with increasing stimulus strength for weak stimuli. This observation challenges the validity of those models, but possibly L4 itself is invalid. So far, L1–L4 have been tested mainly by varying the contrast of static stimuli, but since binocular rivalry breaks down at low contrasts, it has been difficult to study L4. To circumvent this problem, and to test if the recent revision of L2 has more general validity, we studied changes in binocular rivalry evoked by manipulating coherence of oppositely-moving random-dot stimuli in the two eyes, and compared them against the effects of stimulus contrast. Thirteen human observers participated. Both contrast and coherence manipulations in one eye produced robust changes in both eyes; dominance durations of the eye receiving the stronger stimulus increased while those of the other eye decreased, albeit less steeply. This is inconsistent with L2 but supports its revision. When coherence was augmented in both eyes simultaneously, dominance durations first increased at low coherence, and then decreased for further increases in coherence. The same held true for the alternation periods. The initial increase in dominance durations was absent in the contrast experiments, but with coherence manipulations, rivalry could be tested at much lower stimulus strengths. Thus, we found that L4, like L2, is only valid in a limited range of stimulus strengths. Outside that range, the opposite is true. Apparent discrepancies between contrast and coherence experiments could be fully reconciled with adaptation mutual-inhibition models using a simple input transfer-function.

Colour misbinding during motion rivalry

When two dissimilar colours are displayed to the two eyes at overlapping retinal locations, binocular rivalry typically results: a fluctuating struggle for perceptual dominance of each eye's stimulus. We found instead that isoluminant counter-rotating patterns consisting of coloured and achromatic portions can promote an illusory colour 'misbinding', where the colours from both eyes were perceived within a single rotating pattern. The achromatic portion of one rotating pattern thus appeared to take on the colour of the other, oppositely rotating pattern. The results suggest that the neural mechanisms of colour binding can operate even while representations of the same patterns' motions are undergoing rivalry, and support the idea that rivalry can occur in isolation within the motion system.

Binocular eye movement control and motion perception: what is being tracked?

PURPOSE

We investigated under what conditions humans can make independent slow phase eye movements. The ability to make independent movements of the two eyes generally is attributed to few specialized lateral eyed animal species, for example chameleons. In our study, we showed that humans also can move the eyes in different directions. To maintain binocular retinal correspondence independent slow phase movements of each eye are produced.

METHODS

We used the scleral search coil method to measure binocular eye movements in response to dichoptically viewed visual stimuli oscillating in orthogonal direction.

RESULTS

Correlated stimuli led to orthogonal slow eye movements, while the binocularly perceived motion was the vector sum of the motion presented to each eye. The importance of binocular fusion on independency of the movements of the two eyes was investigated with anti-correlated stimuli. The perceived global motion pattern of anti-correlated dichoptic stimuli was perceived as an oblique oscillatory motion, as well as resulted in a conjugate oblique motion of the eyes.

CONCLUSIONS

We propose that the ability to make independent slow phase eye movements in humans is used to maintain binocular retinal correspondence. Eye-of-origin and binocular information are used during the processing of binocular visual information, and it is decided at an early stage whether binocular or monocular motion information and independent slow phase eye movements of each eye are produced during binocular tracking.

Binocular rivalry produced by temporal frequency differences

When the eyes view images that are sufficiently different to prevent binocular fusion, binocular rivalry occurs and the images are seen sequentially in a stochastic alternation. Here we examine whether temporal frequency differences will trigger binocular rivalry by presenting two dynamic random-pixel arrays that are spatially matched but which modulate temporally at two different rates. We found that binocular rivalry between the two temporal frequencies did indeed occur, provided the frequencies were sufficiently different. Differences greater than two octaves (i.e., a factor of four) produced robust rivalry with clear-cut alternations similar to those experienced with spatial rivalry and with similar alternation rates. This finding indicates that temporal information can produce binocular rivalry in the absence of spatial conflict and is discussed in terms of rivalry requiring conflict between temporal channels.

How Simultaneous is the Perception of Binocular Depth and Rivalry in Plaid Stimuli?

Psychophysical experiments have demonstrated that it is possible to perceive both binocular depth and rivalry in plaids (Buckthought and Wilson 2007, Vision Research47 2543–2556). In a recent study, we investigated the neural substrates for depth and rivalry processing with these plaid patterns, when either a depth or rivalry task was performed (Buckthought and Mendola 2011, Journal of Vision11 1–15). However, the extent to which perception of the two stimulus aspects was truly simultaneous remained somewhat unclear. In the present study, we introduced a new task in which subjects were instructed to perform both depth and rivalry tasks concurrently. Subjects were clearly able to perform both tasks at the same time, but with a modest, symmetric drop in performance when compared to either task carried out alone. Subjects were also able to raise performance levels for either task by performing it with a higher priority, with a decline in performance for the other task. The symmetric declines in performance are consistent with the interpretation that the two tasks are equally demanding of attention (Braun and Julesz 1998, Perception & Psychophysics60 1–23). The results demonstrate the impressive combination of binocular features that supports coincident depth and rivalry in surface perception, within the constraints of presumed orientation and spatial frequency channels.

High-level binocular rivalry effects

Binocular rivalry (BR) occurs when the brain cannot fuse percepts from the two eyes because they are different. We review results relating to an ongoing controversy regarding the cortical site of the BR mechanism. Some BR qualities suggest it is low-level: (1) BR, as its name implies, is usually between eyes and only low-levels have access to utrocular information. (2) All input to one eye is suppressed: blurring doesn’t stimulate accommodation; pupilary constrictions are reduced; probe detection is reduced. (3) Rivalry is affected by low-level attributes, contrast, spatial frequency, brightness, motion. (4) There is limited priming due to suppressed words or pictures. On the other hand, recent studies favor a high-level mechanism: (1) Rivalry occurs between patterns, not eyes, as in patchwork rivalry or a swapping paradigm. (2) Attention affects alternations. (3) Context affects dominance. There is conflicting evidence from physiological studies (single cell and fMRI) regarding cortical level(s) of conscious perception. We discuss the possibility of multiple BR sites and theoretical considerations that rule out this solution. We present new data regarding the locus of the BR switch by manipulating stimulus semantic content or high-level characteristics. Since these variations are represented at higher cortical levels, their affecting rivalry supports high-level BR intervention. In Experiment I, we measure rivalry when one eye views words and the other non-words and find significantly longer dominance durations for non-words. In Experiment II, we find longer dominance times for line drawings of simple, structurally impossible figures than for similar, possible objects. In Experiment III, we test the influence of idiomatic context on rivalry between words. Results show that generally words within their idiomatic context have longer mean dominance durations. We conclude that BR has high-level cortical influences, and may be controlled by a high-level mechanism.

Stimulus fractionation by interocular suppression

Can human observers distinguish physical removal of a visible stimulus from phenomenal suppression of that stimulus during binocular rivalry? As so often happens, simple questions produce complex answers, and that is the case in the study reported here. Using continuous flash suppression to produce binocular rivalry, we were able to identify stimulus conditions where most - but not all - people utterly fail to distinguish physical from phenomenal stimulus removal, although we can be certain that those two equivalent perceptual states are accompanied by distinct neural events. More interestingly, we find subtle variants of the task where distinguishing the two states is trivially easy, even for people who utterly fail under the original conditions. We found that stimulus features are differentially vulnerable to suppression. Observers are able to be aware of existence/removal of some stimulus attributes (flicker) but not others (orientation), implying that interocular suppression breaks down the unitary awareness of integrated features belonging to a visual object. These findings raise questions about the unitary nature of awareness and, also, place qualifications on the utility of binocular rivalry as a tool for studying the neural concomitants of conscious visual awareness.

Distinct contributions of the magnocellular and parvocellular visual streams to perceptual selection

During binocular rivalry, conflicting images presented to the two eyes compete for perceptual dominance, but the neural basis of this competition is disputed. In interocular switch rivalry, rival images periodically exchanged between the two eyes generate one of two types of perceptual alternation: (1) a fast, regular alternation between the images that is time-locked to the stimulus switches and has been proposed to arise from competition at lower levels of the visual processing hierarchy or (2) a slow, irregular alternation spanning multiple stimulus switches that has been associated with higher levels of the visual system. The existence of these two types of perceptual alternation has been influential in establishing the view that rivalry may be resolved at multiple hierarchical levels of the visual system. We varied the spatial, temporal, and luminance properties of interocular switch rivalry gratings and found, instead, an association between fast, regular perceptual alternations and processing by the magnocellular stream and between slow, irregular alternations and processing by the parvocellular stream. The magnocellular and parvocellular streams are two early visual pathways that are specialized for the processing of motion and form, respectively. These results provide a new framework for understanding the neural substrates of binocular rivalry that emphasizes the importance of parallel visual processing streams, and not only hierarchical organization, in the perceptual resolution of ambiguities in the visual environment.

Intercepting the First Pass: Rapid Categorization is Suppressed for Unseen Stimuli

The operations and processes that the human brain employs to achieve fast visual categorization remain a matter of debate. A first issue concerns the timing and place of rapid visual categorization and to what extent it can be performed with an early feed-forward pass of information through the visual system. A second issue involves the categorization of stimuli that do not reach visual awareness. There is disagreement over the degree to which these stimuli activate the same early mechanisms as stimuli that are consciously perceived. We employed continuous flash suppression (CFS), EEG recordings, and machine learning techniques to study visual categorization of seen and unseen stimuli. Our classifiers were able to predict from the EEG recordings the category of stimuli on seen trials but not on unseen trials. Rapid categorization of conscious images could be detected around 100 ms on the occipital electrodes, consistent with a fast, feed-forward mechanism of target detection. For the invisible stimuli, however, CFS eliminated all traces of early processing. Our results support the idea of a fast mechanism of categorization and suggest that this early categorization process plays an important role in later, more subtle categorizations, and perceptual processes.

Tracking without perceiving: a dissociation between eye movements and motion perception

Can people react to objects in their visual field that they do not consciously perceive? We investigated how visual perception and motor action respond to moving objects whose visibility is reduced, and we found a dissociation between motion processing for perception and for action. We compared motion perception and eye movements evoked by two orthogonally drifting gratings, each presented separately to a different eye. The strength of each monocular grating was manipulated by inducing adaptation to one grating prior to the presentation of both gratings. Reflexive eye movements tracked the vector average of both gratings (pattern motion) even though perceptual responses followed one motion direction exclusively (component motion). Observers almost never perceived pattern motion. This dissociation implies the existence of visual-motion signals that guide eye movements in the absence of a corresponding conscious percept.

Binocular integration of pattern motion signals by MT neurons and by human observers

Analysis of the movement of a complex visual stimulus is expressed in the responses of pattern-direction-selective neurons in area MT, which depend in turn on directionally selective inputs from area V1. How do MT neurons integrate their inputs? Pattern selectivity in MT breaks down when the gratings comprising a moving plaid are presented to non-overlapping regions of the (monocular) receptive field. Here we ask an analogous question, is pattern selectivity maintained when the component gratings are presented dichoptically to binocular MT neurons? We recorded from single units in area MT, measuring responses to monocular gratings and plaids, and to dichoptic plaids in which the components are presented separately to each eye. Neurons that are pattern selective when tested monocularly lose this selectivity when stimulated with dichoptic plaids. When human observers view these same stimuli, dichoptic plaids induce binocular rivalry. Yet motion signals from each eye can be integrated despite rivalry, revealing a dissociation of form and motion perception. These results reveal the role of monocular mechanisms in the computation of pattern motion in single neurons, and demonstrate that the perception of motion is not fully represented by the responses of individual MT neurons.

The neural bases of multistable perception

Multistable perception is the spontaneous alternation between two or more perceptual states that occurs when sensory information is ambiguous. Multistable phenomena permit dissociation of neural activity related to conscious perception from that related to sensory stimulation, and therefore have been used extensively to study the neural correlates of consciousness. Here, we review recent work on the neural mechanisms underlying multistable perception and how such work has contributed to understanding the neural correlates of consciousness. Particular emphasis is put on the role of high-level brain mechanisms that are involved in actively selecting and interpreting sensory information, and their interactions with lower-level processes that are more directly concerned with the processing of sensory stimulus properties.

Inter-ocular contrast normalization in human visual cortex

The brain combines visual information from the two eyes and forms a coherent percept, even when inputs to the eyes are different. However, it is not clear how inputs from the two eyes are combined in visual cortex. We measured fMRI responses to single gratings presented monocularly, or pairs of gratings presented monocularly or dichoptically with several combinations of contrasts. Gratings had either the same orientation or orthogonal orientations (i.e., plaids). Observers performed a demanding task at fixation to minimize top-down modulation of the stimulus-evoked responses. Dichoptic presentation of compatible gratings (same orientation) evoked greater activity than monocular presentation of a single grating only when contrast was low (<10%). A model that assumes linear summation of activity from each eye failed to explain binocular responses at 10% contrast or higher. However, a model with binocular contrast normalization, such that activity from each eye reduced the gain for the other eye, fitted the results very well. Dichoptic presentation of orthogonal gratings evoked greater activity than monocular presentation of a single grating for all contrasts. However, activity evoked by dichoptic plaids was equal to that evoked by monocular plaids. Introducing an onset asynchrony (stimulating one eye 500 ms before the other, which under attentive vision results in flash suppression) had no impact on the results; the responses to dichoptic and monocular plaids were again equal. We conclude that when attention is diverted, inter-ocular suppression in V1 can be explained by a normalization model in which the mutual suppression between orthogonal orientations does not depend on the eye of origin, nor on the onset times, and cross-orientation suppression is weaker than inter-ocular (same orientation) suppression.

The role of temporally coarse form processing during binocular rivalry

Presenting the eyes with spatially mismatched images causes a phenomenon known as binocular rivalry—a fluctuation of awareness whereby each eye's image alternately determines perception. Binocular rivalry is used to study interocular conflict resolution and the formation of conscious awareness from retinal images. Although the spatial determinants of rivalry have been well-characterized, the temporal determinants are still largely unstudied. We confirm a previous observation that conflicting images do not need to be presented continuously or simultaneously to elicit binocular rivalry. This process has a temporal limit of about 350 ms, which is an order of magnitude larger than the visual system's temporal resolution. We characterize this temporal limit of binocular rivalry by showing that it is independent of low-level information such as interocular timing differences, contrast-reversals, stimulus energy, and eye-of-origin information. This suggests the temporal factors maintaining rivalry relate more to higher-level form information, than to low-level visual information. Systematically comparing the role of form and motion—the processing of which may be assigned to ventral and dorsal visual pathways, respectively—reveals that this temporal limit is determined by form conflict rather than motion conflict. Together, our findings demonstrate that binocular conflict resolution depends on temporally coarse form-based processing, possibly originating in the ventral visual pathway.

Stimulus motion propels traveling waves in binocular rivalry

State transitions in the nervous system often take shape as traveling waves, whereby one neural state is replaced by another across space in a wave-like manner. In visual perception, transitions between the two mutually exclusive percepts that alternate when the two eyes view conflicting stimuli (binocular rivalry) may also take shape as traveling waves. The properties of these waves point to a neural substrate of binocular rivalry alternations that have the hallmark signs of lower cortical areas. In a series of experiments, we show a potent interaction between traveling waves in binocular rivalry and stimulus motion. The course of the traveling wave is biased in the motion direction of the suppressed stimulus that gains dominance by means of the wave-like transition. Thus, stimulus motion may propel the traveling wave across the stimulus to the extent that the stimulus motion dictates the traveling wave's direction completely. Using a computational model, we show that a speed-dependent asymmetry in lateral inhibitory connections between retinotopically organized and motion-sensitive neurons can explain our results. We argue that such a change in suppressive connections may play a vital role in the resolution of dynamic occlusion situations.

Context-dependent perceptual modulation of single neurons in primate visual cortex

Some neurons in the visual cortex alter their spiking rate according to the perceptual interpretation of an observed stimulus, rather than its physical structure alone. Experiments in monkeys have suggested that, although the proportion of neurons showing this effect differs greatly between cortical areas, this proportion remains similar across different stimuli. These findings have raised the intriguing questions of whether the same neurons always participate in the disambiguation of sensory patterns and whether such neurons might represent a special class of cortical cells that relay perceptual signals to higher cortical areas. Here we explore this question by measuring activity in the middle temporal cortex of monkeys and asking to what degree the percept-related responses of individual neurons depend upon the specific sensory input. In contrast to our expectations, we found that even small differences in the stimuli led to significant changes in the signaling of the perceptual state by single neurons. We conclude that nearly all feature-responsive neurons in this area, rather than a select subset, can contribute to the resolution of sensory conflict, and that the role of individual cells in signaling the perceptual outcome is tightly linked to the fine details of the stimuli involved.

Independent Binocular Rivalry Processes for Motion and Form

During binocular rivalry, conflicting monocular images undergo alternating suppression. This study explores rivalry suppression by probing visual sensitivity during rivalry with various probe stimuli. When two faces engage in rivalry, sensitivity to face probes is reduced 4-fold during suppression. Rivaling global motions also rivaled very deeply when probed with a global motion. However, in a surprising finding, sensitivity to face probes is completely unimpaired during global motion rivalry, and motion sensitivity is unimpaired during face rivalry. This suggests that rivalry suppression is localized to the neurons representing the image conflict, which means that probes of a different kind suffer no suppression. Sensibly, this would leave visual processes not involved in rivalry free to function normally.

Neural bases of binocular rivalry

During binocular rivalry, conflicting monocular images compete for access to consciousness in a stochastic, dynamical fashion. Recent human neuroimaging and psychophysical studies suggest that rivalry entails competitive interactions at multiple neural sites, including sites that retain eye-selective information. Rivalry greatly suppresses activity in the ventral pathway and attenuates visual adaptation to form and motion; nonetheless, some information about the suppressed stimulus reaches higher brain areas. Although rivalry depends on low-level inhibitory interactions, high-level excitatory influences promoting perceptual grouping and selective attention can extend the local dominance of a stimulus over space and time. Inhibitory and excitatory circuits considered within a hybrid model might account for the paradoxical properties of binocular rivalry and provide insights into the neural bases of visual awareness itself.

Competition in bistable vision is attribute-specific

We employ ambiguous figures and rivalrous stimuli that have multiple ambiguous properties to show that the different attributes of an ambiguous stimulus can undergo independent switching dynamics. This suggests that competition is distributed and attribute-specific, consistent with the known functional segregation of visual processing. Conflicting evidence that binocular rivalry is an early or late visual process may be better understood as evidence for attribute-specific competition occurring at multiple stages of visual processing. Specifically, we show that whether perceptual selection during binocular rivalry is early and eye-based or late and percept-based depends on the particular ambiguous attributes of the rivalrous stimulus.

Suppressed Patterns Alter Vision during Binocular Rivalry

Binocular rivalry occurs when incongruent patterns are presented to corresponding regions of the retinas, leading to fluctuations of awareness between the patterns . One attribute of a stimulus may rival whereas another may combine between the eyes , but it is typically assumed that the dominant features are perceived veridically. Here, we show this is not necessarily the case and that a suppressed visual feature can alter dominant perception. The cortical representations of oriented gratings can interact even when one of them is perceptually suppressed, such that the perceived orientation of the dominant grating is systematically biased depending on the orientation of the suppressed grating. A suppressed inducing pattern has the same qualitative effect as a visible one, but suppression reduces effective contrast by a factor of around six. A simple neural model quantifies and helps explain these illusions. These results demonstrate that binocular rivalry suppression operates in a graded fashion across multiple sites in the visual hierarchy rather than truncating processing at a single site and that suppressed visual information can alter dominant vision in real-time.

Monocular texture segmentation and proto-rivalry

When the right eye's target is the left eye's distracter and vice versa, orientation-defined search is impossible unless, as we show here, the elements are close together. More than 1s was required to find inverse-cyclopean texture boundaries when elements were arranged on a 16 x 16 grid. Less than 250 ms was required for a 24 x 24 grid covering the same area. The conventional view is that binocular rivalry requires at least 200 ms to develop, but our results suggest a more rapid access to monocular signals. We call this rapid form of access "proto-rivalry."

Independent binocular integration for form and colour

Although different features of an object are processed in anatomically distinct regions of the cerebral cortex, they often appear bound together in perception. Here, using binocular rivalry, we reveal that the awareness of form can occur independently from the awareness of colour. First, we report that, if both eyes briefly view a grating stimulus prior to the presentation of the same grating in one eye and an orthogonal grating in the other, subjects tend to report perceptual dominance of the non-primed grating. The primer was most effective when it was similar in orientation, spatial frequency and spatial phase to one of the rival images. Next, we showed that the process underlying the binocular integration of chromatic information was selectively influenced by the colour of a previously presented stimulus. We then combined these paradigms by using a primer that had the same colour as one rival stimulus, but the same form as the other stimulus. In this situation, we found that rival stimuli differing in form and colour can sometimes achieve states of dominance in which the chromatic information from one eye's image combines with the form of the other eye's image temporarily creating a binocular impression that corresponds with neither monocular component. Finally, we demonstrated that during continuous viewing of rival stimuli differing in form and colour, chromatic integration could occur independently of form rivalry. Paradoxically, however, we found that changes to the form of the stimulus had more of an influence on chromatic integration than on form rivalry. Together these phenomena show that the neural processes involved in integrating information from the two eyes can operate selectively on different stimulus features.

The motion-induced position shift depends on the visual awareness of motion

Visual motion signals distort the perceived positions of briefly presented stimuli; a briefly-flashed, stationary stimulus appears spatially displaced in the direction of a nearby motion. The present study examined the role of the visual awareness of motion in the motion-induced position shift by using exclusive dominance and suppression of binocular rivalry. Observers dichoptically viewed a flickering radial checkerboard and two sinusoidal gratings that drifted vertically in opposite directions. When observers viewed exclusively either the checkerboard or motion stimulus, two horizontal lines were flashed, one for each side of the rivalry stimulus. During the exclusive dominance of the grating motion, the lines appeared to shift in the directions of the nearby motions. The position shift was identical to that during non-rivalry, monocular viewing of the motion stimulus. However, when the grating motions were completely suppressed, no position shift was observed. These results demonstrate that the motion-induced position shift depends on the visual awareness of motion.

Role of primary visual cortex in the binocular integration of plaid motion perception

This study assessed the early mechanisms underlying perception of plaid motion. Thus, two superimposed gratings drifting in a rightward direction composed plaid stimuli whose global motion direction was perceived as the vector sum of the two components. The first experiment was aimed at comparing the perception of plaid motion when both components were presented to both eyes (dioptic) or separately to each eye (dichoptic). When components of the patterns had identical spatial frequencies, coherent motion was correctly perceived under dioptic and dichoptic viewing condition. However, the perceived direction deviated from the predicted direction when spatial frequency differences were introduced between components in both conditions. The results suggest that motion integration follows similar rules for dioptic and dichoptic plaids even though performance under dichoptic viewing did not reach dioptic levels. In the second experiment, the role of early cortical areas in the processing of both plaids was examined. As convergence of monocular inputs is needed for dichoptic perception, we tested the hypothesis that primary visual cortex (V1) is required for dichoptic plaid processing by delivering repetitive transcranial magnetic stimulation to this area. Ten minutes of magnetic stimulation disrupted subsequent dichoptic perception for approximately 15 min, whereas no significant changes were observed for dioptic plaid perception. Taken together, these findings suggest that V1 is not crucial for the processing of dioptic plaids but it is necessary for the binocular integration underlying dichoptic plaid motion perception.

Pupillary response induced by stereoscopic stimuli

Besides luminance change, the pupil responds to changes in spatial pattern, color content and target motion. Our experimental results show that transient pupillary constriction can also be elicited by dichoptically viewing a change in stereoscopic stimuli composed of dynamic random-dot stereograms from an initially flat surface to a stationary sinusoidal grating shown in depth. On the other hand, monocular viewing of these stimuli produced no obvious pupillary response. This indicates that the pupillary response in the dichoptic experiment was induced by the stereo information rather than by any change in the monocular stimuli. This finding presents a novel approach for the investigation of stereo perception that can also be applied in the clinical environment.

Competing global representations fail to initiate binocular rivalry

A longstanding debate in binocular rivalry literature is whether the perceptual competition in rivalry occurs at an early or late stage of visual processing. Central to this debate is the determination of the source of the competition. Overwhelming evidence exists that local interocular differences can lead to binocular rivalry, but it is not yet clear whether interocular conflicts at the global level are sufficient to generate binocular rivalry. The current study adopted a novel stimulus that enabled the introduction of dramatic global differences between the two eyes with compatible local elements. Results show that global differences between the two eyes' images do not result in rivalry if local elements are compatible. The implication of these findings is that the registration of competing interocular information, necessary to generate binocular rivalry, is performed at an early stage of visual processing prior to global analysis of the image.

Multi-directional shifts of optokinetic responses to binocular-rivalrous motion stimuli

Previous dichoptic experiments showed that dissimilar stationary pattern stimuli resulted in the perception of binocular rivalry, whereas oppositely-directly moving grating stimuli resulted in alternating optokinetic nystagmus (OKN) and the perception of binocular motion rivalry. The present study extended these dichoptic motion experiments by introducing obliquely-oriented targets with the aim of probing further the cortical mechanisms underlying binocular processing of motion. Two-dimensional eye movements were recorded along with their subjective perceptual responses. The stimuli consisted of two tilted gratings, one moving diagonally upwards and to the right (UR, 45 degrees ) and the other diagonally upwards and to the left (UL, 135 degrees ), which were presented dichoptically to subjects under two stimulus modes. For the non-exchange mode, the OKN slow phases exhibited three types of directional shifts. Two of these directional shifts tracked the stimuli (i.e. UR or UL), whereas the third moved purely upwards (UP). Since physically there was no upward-moving target, the OKN and perceptual responses appeared to be associated with a perceptual interocular grouping of the two dichoptic stimuli in their reassembled vector-sum direction. The OKN shifts were also found to be highly correlated with the psychophysical responses of motion perception. For the rapid-exchange mode, in which the stimuli were rapidly exchanged between the two eyes, the OKN slow phases exhibited primarily two types of directional shifts, UR and UL, but no UP responses for most subjects. It also appeared that these two coherent motion percepts, UL and UR, were interocularly regrouped from the exchanged stimuli. Moreover, the lack of perceptual grouping to create an UP response in the rapid-exchange mode indicated that temporal integration of at least 200 ms was necessary for the development of a reassembled vector-sum-direction motion percept. The findings under both stimulus modes support the stimulus-feature rivalry hypothesis, in which higher cortical centers mediate interocular perceptual grouping and the associated motor response.

Visual masking and RSVP reveal neural competition

A test visual stimulus is harder to recognize when another stimulus is presented in close temporal vicinity; presenting stimuli in close spatial vicinity of a test stimulus reduces its visibility; presenting a stimulus to one eye can render invisible another stimulus presented to the other eye; and perceiving one interpretation of an ambiguous image prevents the simultaneous perception of other visual interpretations. A single, neurophysiological theory, which may be called 'neural competition' might explain all these phenomena: when two alternative neural visual representations co-exist in the brain, they compete against each other.

Integration of motion information during binocular rivalry

When two moving gratings are superimposed in normal viewing they often combine to form a pattern that moves with a single direction of motion. Here, we investigated whether the same mechanism underlies pattern motion when drifting gratings are presented independently to the two eyes. We report that, with relatively large circular grating patches (4 deg), there are periods of monocular dominance in which one eye's orientation alone is perceived, usually moving orthogonal to the contours (component motion). But, during the transitions from one monocular view to the other, a fluid mosaic is perceived, consisting of contiguous patches, each containing contours of only one of the gratings. This entire mosaic often appears to move in a single direction (pattern motion), just as when two gratings are literally superimposed. Although this implies that motion signals from the perceptually suppressed grating continue to influence the perception of motion, an alternative possibility is that it reflects a strategy that involves integrating directional information from the contiguous single-grating patches. To test between these possibilities, we performed a second experiment with very small grating stimuli that were about the same size as the contiguous single-grating patches in the mosaic (1-deg diameter). Despite the fact that the form of only one grating was perceived, we report that pattern motion was still perceived on about one third of trials. Moreover, a decrease in the occurrence of pattern motion was apparent when the contrast and spatial frequency of the gratings were made more different from each other. This phenomenon clearly demonstrates an independent binocular interaction for form and motion.

Binocular rivalry and visual awareness

Physiological studies of binocular rivalry have provided important clues to the relationship between neural activity in the brain and visual awareness. However, uncertainty about these insights has been raised by a recent study showing that the events underlying binocular rivalry occur earlier in the visual pathway than was previously thought.

Ambiguity in the perception of moving stimuli is resolved in favour of the cardinal axes

The aim of this study was to determine whether there is a link between the statistical properties of natural scenes and our perception of moving surfaces. Accordingly, we devised an ambiguous moving stimulus that could be perceived as moving in one of three directions of motion. The stimulus was a circular patch containing three square-wave drifting gratings. One grating was always either horizontal or vertical; the other two had component directions of drift at 120 degrees to the first (and to each other), producing four possible stimulus geometries. These were presented in a pseudorandom sequence. In brief presentations, subjects always perceived two of the gratings to cohere and move as a pattern in one direction, and the third grating to move independently in the opposite direction (its component direction). Although there were three equally plausible axes (one cardinal and two oblique) along which the coherent and independent motions could occur, subjects routinely saw motion along one of the cardinal axes. Thus, the visual system preferentially combines the two oblique gratings to form a pattern that drifts in the opposite direction to the cardinal grating. It was only when the contrast of one of the oblique gratings was changed that an oblique axis of motion was perceived. This perceptual anisotropy can be related to naturally occurring bias in the visual environment, notably the predominance of horizontal and vertical contours in our visual world.

Neuronal activity in human primary visual cortex correlates with perception during binocular rivalry

During binocular rivalry, two incompatible monocular images compete for perceptual dominance, with one pattern temporarily suppressed from conscious awareness. We measured fMRI signals in early visual cortex while subjects viewed rival dichoptic images of two different contrasts; the contrast difference served as a 'tag' for the neuronal representations of the two monocular images. Activity in primary visual cortex (V1) increased when subjects perceived the higher contrast pattern and decreased when subjects perceived the lower contrast pattern. These fluctuations in V1 activity during rivalry were about 55% as large as those evoked by alternately presenting the two monocular images without rivalry. The rivalry-related fluctuations in V1 activity were roughly equal to those observed in other visual areas (V2, V3, V3a and V4v). These results challenge the view that the neuronal mechanisms responsible for binocular rivalry occur primarily in later visual areas.

Visible binocular beats from invisible monocular stimuli during binocular rivalry

When two qualitatively different stimuli are presented at the same time, one to each eye, the stimuli can either integrate or compete with each other. When they compete, one of the two stimuli is alternately suppressed, a phenomenon called binocular rivalry [1,2]. When they integrate, observers see some form of the combined stimuli. Many different properties (for example, shape or color) of the two stimuli can induce binocular rivalry. Not all differences result in rivalry, however. Visual 'beats', for example, are the result of integration of high-frequency flicker between the two eyes [3,4], and are thus a binocular fusion phenomenon. It remains in dispute whether binocular fusion and rivalry can co-exist with one another [5-7]. Here, we report that rivalry and beats, two apparently opposing phenomena, can be perceived at the same time within the same spatial location. We hypothesized that the interocular difference in visual attributes that are predominantly processed in the Parvocellular pathway will lead to rivalry, and differences in visual attributes that are predominantly processed in the Magnocellular pathway tend to integrate. Further predictions based on this hypothesis were tested and confirmed.