Neural correlates of spontaneous percept switches in ambiguous stimuli: an event-related functional magnetic resonance imaging study

Perceptual Awareness and Its Relationship with Consciousness: Hints from Perceptual Multistability

Many interesting theories of consciousness have been proposed, but so far, there is no "unified" theory capable of encompassing all aspects of this phenomenon. We are all aware of what it feels like to be conscious and what happens if there is an absence of consciousness. We are becoming more and more skilled in measuring consciousness states; nevertheless, we still "don't get it" in its deeper essence. How does all the processed information converge from different brain areas and structures to a common unity, giving us this very private "feeling of being conscious", despite the constantly changing flow of information between internal and external states? "Multistability" refers to a class of perceptual phenomena where subjective awareness spontaneously and continuously alternates between different percepts, although the objective stimuli do not change, supporting the idea that the brain "interprets" sensorial input in a "constructive" way. In this perspective paper, multistability and perceptual awareness are discussed as a methodological window for understanding the "local" states of consciousness, a privileged position from which it is possible to observe the brain dynamics and mechanisms producing the subjective phenomena of perceptual awareness in the very moment they are happening.

Identifying neural correlates of visual consciousness with ALE meta-analyses

Neural correlates of consciousness (NCC) have been a topic of study for nearly two decades. In functional imaging studies, several regions have been proposed to constitute possible candidates for NCC, but as of yet, no quantitative summary of the literature on NCC has been done. The question whether single (striate or extrastriate) regions or a network consisting of extrastriate areas that project directly to fronto-parietal regions are necessary and sufficient neural correlates for visual consciousness is still highly debated [e.g., Rees et al., 2002, Nat Rev. Neurosci 3, 261-270; Tong, 2003, Nat Rev. Neurosci 4, 219-229]. The aim of this work was to elucidate this issue and give a synopsis of the present state of the art by conducting systematic and quantitative meta-analyses across functional magnetic resonance imaging (fMRI) studies using several standard paradigms for conscious visual perception. In these paradigms, consciousness is operationalized via perceptual changes, while the visual stimulus remains invariant. An activation likelihood estimation (ALE) meta-analysis was performed, representing the best approach for voxel-wise meta-analyses to date. In addition to computing a meta-analysis across all paradigms, separate meta-analyses on bistable perception and masking paradigms were conducted to assess whether these paradigms show common or different NCC. For the overall meta-analysis, we found significant clusters of activation in inferior and middle occipital gyrus; fusiform gyrus; inferior temporal gyrus; caudate nucleus; insula; inferior, middle, and superior frontal gyri; precuneus; as well as in inferior and superior parietal lobules. These results suggest a subcortical-extrastriate-fronto-parietal network rather than a single region that constitutes the necessary NCC. The results of our exploratory paradigm-specific meta-analyses suggest that this subcortical-extrastriate-fronto-parietal network might be differentially activated as a function of the paradigms used to probe for NCC.

Individual variability in perceptual switching behaviour is associated with reversal-related EEG modulations

OBJECTIVE

High individual variability is frequently observed in multistable perception, but few ERP studies have considered this factor. The present investigation evaluates the relation between individual perceptual switching and the modulation of reversal-related ERP components.

METHODS

We used a bistable perception paradigm (Kornmeier and Bach, 2004), consisting of briefly flashed grid of nine Necker cubes, interspersed by a blank screen. The subject's task was to compare the previous stimulus with the latter one. The number of reversal perceptions was used as a measure of individual perceptual switching behaviour.

RESULTS

As in previously reported findings, Reversal Negativity (RN, 180-300 ms) and Late Positive Component (LPC, 350-600 ms) were identified in response to reversal perception. In terms of individual differences, higher reversals were associated with reduced negativity of the RN and enhanced positivity of the LPC.

CONCLUSION

The timing of the present results supports the hypothesis that individual variability in perceptual reversal is associated with different neural activations at later stage of processing, when the neural representation of ambiguous figure must be internalized to produce an appropriate response/behaviour.

SIGNIFICANCE

Multistable perception can reveal crucial mechanisms underlying individual perceptual re-organization when inconsistent or incoherent stimuli come from the environment.

Multistable perception in children: Prefrontal delta oscillations in the developing brain

The prefrontal cortex (PFC) is considered to be the primary source of attentional control during elementary visual processing as exemplified in perceptual ambiguity. Assuming that multistable perception activates a fronto-parietal network, we contrast the results of mature and developing cognitive systems to deduce the developmental status of underlying structures from behavioral performances and functional EEG parameters. We analyzed the topographical distribution, amplitude characteristics and inter-trial variability of a reversal-related delta response that accompanies perceptual switches between the two alternative percepts of an ambiguous motion pattern. Fourteen ten-year old children and an adult control group indicated changes of perceived motion directions by a button-press. EEG was recorded from frontal, central, parietal, and occipital locations of both hemispheres. Behavioral data shows a considerably lower reversal rate within the children sample, suggesting that the related mechanisms are not yet operating on an adult level. In contrast to findings in adults, the involved delta component emerges as part of an unspecific posterior activation, suggesting that a cortical specialization process has not been accomplished yet. On frontal locations the ten-year old children fail to yield a stable component. The synchronized fronto-parietal activity in adults may constitute the result of a specialization process that determined connection patterns and functionally tuned the involved areas. This implies a deficit in timing and temporal sequencing of neuronal activity in children, mainly attributable to a less functional differentiated PFC that has not been fully integrated yet into the cognitive ensemble.

Quadri-stability of a spatially ambiguous auditory illusion

In addition to vision, audition plays an important role in sound localization in our world. One way we estimate the motion of an auditory object moving towards or away from us is from changes in volume intensity. However, the human auditory system has unequally distributed spatial resolution, including difficulty distinguishing sounds in front vs. behind the listener. Here, we introduce a novel quadri-stable illusion, the Transverse-and-Bounce Auditory Illusion, which combines front-back confusion with changes in volume levels of a nonspatial sound to create ambiguous percepts of an object approaching and withdrawing from the listener. The sound can be perceived as traveling transversely from front to back or back to front, or "bouncing" to remain exclusively in front of or behind the observer. Here we demonstrate how human listeners experience this illusory phenomenon by comparing ambiguous and unambiguous stimuli for each of the four possible motion percepts. When asked to rate their confidence in perceiving each sound's motion, participants reported equal confidence for the illusory and unambiguous stimuli. Participants perceived all four illusory motion percepts, and could not distinguish the illusion from the unambiguous stimuli. These results show that this illusion is effectively quadri-stable. In a second experiment, the illusory stimulus was looped continuously in headphones while participants identified its perceived path of motion to test properties of perceptual switching, locking, and biases. Participants were biased towards perceiving transverse compared to bouncing paths, and they became perceptually locked into alternating between front-to-back and back-to-front percepts, perhaps reflecting how auditory objects commonly move in the real world. This multi-stable auditory illusion opens opportunities for studying the perceptual, cognitive, and neural representation of objects in motion, as well as exploring multimodal perceptual awareness.

Ambiguous figures - what happens in the brain when perception changes but not the stimulus

During observation of ambiguous figures our perception reverses spontaneously although the visual information stays unchanged. Research on this phenomenon so far suffered from the difficulty to determine the instant of the endogenous reversals with sufficient temporal precision. A novel experimental paradigm with discontinuous stimulus presentation improved on previous temporal estimates of the reversal event by a factor of three. It revealed that disambiguation of ambiguous visual information takes roughly 50 ms or two loops of recurrent neural activity. Further, the decision about the perceptual outcome has taken place at least 340 ms before the observer is able to indicate the consciously perceived reversal manually. We provide a short review about physiological studies on multistable perception with a focus on electrophysiological data. We further present a new perspective on multistable perception that can easily integrate previous apparently contradicting explanatory approaches. Finally we propose possible extensions toward other research fields where ambiguous figure perception may be useful as an investigative tool.

Ambiguous figures and binding: EEG frequency modulations during multistable perception

Ambiguous figures induce sudden transitions between rivaling percepts. We investigated electroencephalogram frequency modulations of accompanying change-related de- and rebinding processes. Presenting the stimuli discontinously, we synchronized perceptual reversals with stimulus onset, which served as a time reference for averaging. The resultant gain in temporal resolution revealed a sequence of time-frequency correlates of the reversal process. Most conspicuous was a transient right-hemispheric gamma modulation preceding endogenous reversals by at least 200 ms. No such modulation occurred with exogenously induced reversals of unambiguous stimulus variants. Post-onset components were delayed for ambiguous compared to unambiguous stimuli. The time course of oscillatory activity differed in several respects from predictions based on binding-related hypotheses. The gamma modulation preceding endogenous reversals may indicate an unstable brain state, ready to switch.

Frontoparietal activity and its structural connectivity in binocular rivalry

To understand the brain areas associated with visual awareness and their anatomical interconnections, we studied binocular rivalry with functional magnetic resonance imaging (fMRI) and diffusion tensor imaging (DTI). Binocular rivalry occurs when one image is viewed by one eye and a different image by the other; it is experienced as perceptual alternations between the two images. Our first experiment addressed problems with a popular comparison condition, namely permanent suppression, by comparing rivalry with binocular fusion instead. We found an increased fMRI signal in right frontal, parietal, and occipital regions during rivalry viewing. The pattern of neural activity differed from findings of permanent suppression comparisons, except for adjacent activity in the right superior parietal lobule. This location was near fMRI signal changes related to reported rivalry alternations in our second experiment, indicating that neighbouring areas in the right parietal cortex may be involved in different components of rivalry. In our second experiment, we used probabilistic tractography to detect white matter fibres between right-hemispheric areas that showed event-related fMRI signal changes time-locked to reported perceptual alternations during rivalry viewing. Most of these functionally defined areas were linked by probabilistic fibre tracts, some of which followed long-distance connections such as the inferior occipitofrontal fasciculus. Corresponding anatomical pathways might mediate communication within the functional network associated with changes in conscious perception during binocular rivalry.