Separable pupillary signatures of perception and action during perceptual multistability

Pupillometry indexes ocular dominance plasticity

Short-term monocular deprivation in normally sighted adult humans produces a transient shift of ocular dominance, boosting the deprived eye. This effect has been documented with both perceptual tests and through physiological recordings, but no previous study simultaneously measured physiological responses and the perceptual effects of deprivation. Here we propose an integrated experimental paradigm that combines binocular rivalry with pupillometry, to introduce an objective physiological index of ocular dominance plasticity, acquired concurrently with perceptual testing. Ten participants reported the perceptual dynamics of binocular rivalry, while we measured pupil diameter. Stimuli were a white and a black disk, each presented monocularly. Rivalry dynamics and pupil-size traces were compared before and after 2 h of monocular deprivation, achieved by applying a translucent patch over the dominant eye. Consistent with prior research, we observed that monocular deprivation boosts the deprived-eye signal and consequently increases ocular dominance. In line with previous studies, we also observed subtle but systematic modulations of pupil size that tracked alternations between exclusive dominance phases of the black or white disk. Following monocular deprivation, the amplitude of these pupil-size modulations increased, which is consistent with the post-deprivation boost of the deprived eye and the increase of ocular dominance. This provides evidence that deprivation impacts the effective strength of monocular visual stimuli, coherently affecting perceptual reports and the automatic and unconscious regulation of pupil diameter. Our results show that a combined paradigm of binocular rivalry and pupillometry gives new insights into the physiological mechanisms underlying deprivation effects.

Perception-action Dissociations as a Window into Consciousness

Understanding the neural correlates of unconscious perception stands as a primary goal of experimental research in cognitive psychology and neuroscience. In this Perspectives paper, we explain why experimental protocols probing qualitative dissociations between perception and action provide valuable insights into conscious and unconscious processing, along with their corresponding neural correlates. We present research that utilizes human eye movements as a sensitive indicator of unconscious visual processing. Given the increasing reliance on oculomotor and pupillary responses in consciousness research, these dissociations also provide a cautionary tale about inferring conscious perception solely based on no-report protocols.

Bistable perception, precision and neuromodulation

Bistable perception follows from observing a static, ambiguous, (visual) stimulus with two possible interpretations. Here, we present an active (Bayesian) inference account of bistable perception and posit that perceptual transitions between different interpretations (i.e. inferences) of the same stimulus ensue from specific eye movements that shift the focus to a different visual feature. Formally, these inferences are a consequence of precision control that determines how confident beliefs are and change the frequency with which one can perceive-and alternate between-two distinct percepts. We hypothesized that there are multiple, but distinct, ways in which precision modulation can interact to give rise to a similar frequency of bistable perception. We validated this using numerical simulations of the Necker cube paradigm and demonstrate the multiple routes that underwrite the frequency of perceptual alternation. Our results provide an (enactive) computational account of the intricate precision balance underwriting bistable perception. Importantly, these precision parameters can be considered the computational homologs of particular neurotransmitters-i.e. acetylcholine, noradrenaline, dopamine-that have been previously implicated in controlling bistable perception, providing a computational link between the neurochemistry and perception.

Spontaneous Necker-cube reversals may not be that spontaneous

Introduction

During observation of the ambiguous Necker cube, our perception suddenly reverses between two about equally possible 3D interpretations. During passive observation, perceptual reversals seem to be sudden and spontaneous. A number of theoretical approaches postulate destabilization of neural representations as a pre-condition for reversals of ambiguous figures. In the current study, we focused on possible Electroencephalogram (EEG) correlates of perceptual destabilization, that may allow prediction of an upcoming perceptual reversal.

Methods

We presented ambiguous Necker cube stimuli in an onset-paradigm and investigated the neural processes underlying endogenous reversals as compared to perceptual stability across two consecutive stimulus presentations. In a separate experimental condition, disambiguated cube variants were alternated randomly, to exogenously induce perceptual reversals. We compared the EEG immediately before and during endogenous Necker cube reversals with corresponding time windows during exogenously induced perceptual reversals of disambiguated cube variants.

Results

For the ambiguous Necker cube stimuli, we found the earliest differences in the EEG between reversal trials and stability trials already 1 s before a reversal occurred, at bilateral parietal electrodes. The traces remained similar until approximately 1100 ms before a perceived reversal, became maximally different at around 890 ms (p = 7.59 × 10^-6, Cohen's d = 1.35) and remained different until shortly before offset of the stimulus preceding the reversal. No such patterns were found in the case of disambiguated cube variants.

Discussion

The identified EEG effects may reflect destabilized states of neural representations, related to destabilized perceptual states preceding a perceptual reversal. They further indicate that spontaneous Necker cube reversals are most probably not as spontaneous as generally thought. Rather, the destabilization may occur over a longer time scale, at least 1 s before a reversal event, despite the reversal event as such being perceived as spontaneous by the viewer.

Feedback information sharing in the human brain reflects bistable perception in the absence of report

In the search for the neural basis of conscious experience, perception and the cognitive processes associated with reporting perception are typically confounded as neural activity is recorded while participants explicitly report what they experience. Here, we present a novel way to disentangle perception from report using eye movement analysis techniques based on convolutional neural networks and neurodynamical analyses based on information theory. We use a bistable visual stimulus that instantiates two well-known properties of conscious perception: integration and differentiation. At any given moment, observers either perceive the stimulus as one integrated unitary object or as two differentiated objects that are clearly distinct from each other. Using electroencephalography, we show that measures of integration and differentiation based on information theory closely follow participants' perceptual experience of those contents when switches were reported. We observed increased information integration between anterior to posterior electrodes (front to back) prior to a switch to the integrated percept, and higher information differentiation of anterior signals leading up to reporting the differentiated percept. Crucially, information integration was closely linked to perception and even observed in a no-report condition when perceptual transitions were inferred from eye movements alone. In contrast, the link between neural differentiation and perception was observed solely in the active report condition. Our results, therefore, suggest that perception and the processes associated with report require distinct amounts of anterior-posterior network communication and anterior information differentiation. While front-to-back directed information is associated with changes in the content of perception when viewing bistable visual stimuli, regardless of report, frontal information differentiation was absent in the no-report condition and therefore is not directly linked to perception per se.

From pupil to the brain: New insights for studying cortical plasticity through pupillometry

Pupil size variations have been associated with changes in brain activity patterns related with specific cognitive factors, such as arousal, attention, and mental effort. The locus coeruleus (LC), a key hub in the noradrenergic system of the brain, is considered to be a key regulator of cognitive control on pupil size, with changes in pupil diameter corresponding to the release of norepinephrine (NE). Advances in eye-tracking technology and open-source software have facilitated accurate pupil size measurement in various experimental settings, leading to increased interest in using pupillometry to track the nervous system activation state and as a potential biomarker for brain disorders. This review explores pupillometry as a non-invasive and fully translational tool for studying cortical plasticity starting from recent literature suggesting that pupillometry could be a promising technique for estimating the degree of residual plasticity in human subjects. Given that NE is known to be a critical mediator of cortical plasticity and arousal, the review includes data revealing the importance of the LC-NE system in modulating brain plasticity and pupil size. Finally, we will review data suggesting that pupillometry could provide a quantitative and complementary measure of cortical plasticity also in pre-clinical studies.

Multistability, perceptual value, and internal foraging

Substantial experimental, theoretical, and computational insights into sensory processing have been derived from the phenomena of perceptual multistability-when two or more percepts alternate or switch in response to a single sensory input. Here, we review a range of findings suggesting that alternations can be seen as internal choices by the brain responding to values. We discuss how elements of external, experimenter-controlled values and internal, uncertainty- and aesthetics-dependent values influence multistability. We then consider the implications for the involvement in switching of regions, such as the anterior cingulate cortex, which are more conventionally tied to value-dependent operations such as cognitive control and foraging.

Attention cueing in rivalry: insights from pupillometry

We used pupillometry to evaluate the effects of attention cueing on perceptual bi-stability, as reported by adult human observers. Perceptual alternations and pupil diameter were measured during two forms of rivalry, generated by presenting a white and a black disk to the two eyes (binocular rivalry) or splitting the disks between eyes (interocular grouping rivalry). In line with previous studies, we found that subtle pupil size modulations (about 0.05 mm) tracked alternations between exclusive dominance phases of the black or white disk. These pupil responses were larger for perceptually stronger stimuli: presented to the dominant eye or with physically higher luminance contrast. However, cueing of endogenous attention to one of the rivaling percepts did not affect pupil modulations during exclusive dominance phases. This was observed despite the reliable effects of endogenous attention on perceptual dominance, which shifted in favor of the cued percept by about 10%. The results were comparable for binocular and interocular grouping rivalry. Cueing only had a marginal modulatory effect on pupil size during mixed percepts in binocular rivalry. This may suggest that, rather than acting by modulating perceptual strength, endogenous attention primarily acts during periods of unresolved competition, which is compatible with attention being automatically directed to the rivaling stimuli during periods of exclusive dominance and thereby sustaining perceptual alternations.Significance StatementBinocular rivalry depends on attention. When it is diverted away from the stimuli, perceptual alternations slow down; when it is preferentially directed to one stimulus, perception lingers more on it, consistent with attention enhancing the effective strength of the rivaling stimuli. Here we introduce pupillometry as a means to indirectly track changes in effective stimulus strength. We find that pupil size accurately tracks perceived luminance during two forms of rivalry: binocular rivalry and interocular grouping rivalry. Both show robust effects of attention cueing on perceptual dominance, but pupil modulations during exclusive dominance are unaffected by cueing. This suggests that endogenous attention does not affect perceptual strength during exclusive dominance, though it might do so during transition phases.

Pupillometry as an integrated readout of distinct attentional networks

The course of pupillary constriction and dilation provides an easy-to-access, inexpensive, and noninvasive readout of brain activity. We propose a new taxonomy of factors affecting the pupil and link these to associated neural underpinnings in an ascending hierarchy. In addition to two well-established low-level factors (light level and focal distance), we suggest two further intermediate-level factors, alerting and orienting, and a higher-level factor, executive functioning. Alerting, orienting, and executive functioning - including their respective underlying neural circuitries - overlap with the three principal attentional networks, making pupil size an integrated readout of distinct states of attention. As a now widespread technique, pupillometry is ready to provide meaningful applications and constitutes a viable part of the psychophysiological toolbox.

Separable pupillary signatures of perception and action during perceptual multistability

The pupil provides a rich, non-invasive measure of the neural bases of perception and cognition and has been of particular value in uncovering the role of arousal-linked neuromodulation, which alters both cortical processing and pupil size. But pupil size is subject to a multitude of influences, which complicates unique interpretation. We measured pupils of observers experiencing perceptual multistability-an ever-changing subjective percept in the face of unchanging but inconclusive sensory input. In separate conditions, the endogenously generated perceptual changes were either task-relevant or not, allowing a separation between perception-related and task-related pupil signals. Perceptual changes were marked by a complex pupil response that could be decomposed into two components: a dilation tied to task execution and plausibly indicative of an arousal-linked noradrenaline surge, and an overlapping constriction tied to the perceptual transient and plausibly a marker of altered visual cortical representation. Constriction, but not dilation, amplitude systematically depended on the time interval between perceptual changes, possibly providing an overt index of neural adaptation. These results show that the pupil provides a simultaneous reading on interacting but dissociable neural processes during perceptual multistability, and suggest that arousal-linked neuromodulator release shapes action but not perception in these circumstances.