Eye tracking under dichoptic viewing conditions: a practical solution

Conscious awareness is necessary to assess trust and mimic facial expressions, while pupils impact trust unconsciously

People make rapid inferences about others' thoughts and intentions. For example, they observe facial movements and pupil size of others and unwittingly make use of this information when deciding whether to trust someone or not. However, whether spontaneous mimicry depends on visual awareness of the stimulus and whether these processes underlie trust decisions is still unknown. To investigate whether visual awareness modulates the relationship between emotional expressions, mimicry and trust, participants played a series of trust games and saw either their partners' faces with a neutral, happy or fearful expression, or their partners' eyes in which the pupil size was large, medium or small. Subjects' trust investments, facial movements and pupil responses were measured. In half of the trials, the stimuli were rendered invisible by continuous flash suppression. Results showed that facial expressions were mimicked and influenced trust decisions during the conscious condition, but not during the unconscious (suppressed) condition. The opposite was found for pupil size, which influenced trust decisions during states of unawareness. These results suggest that the neurobiological pathway linking the observation of facial expressions to mimicry and trust is predominantly conscious, whereas partner pupil size influences trust primarily when presented unconsciously. This article is part of the theme issue 'Cracking the laugh code: laughter through the lens of biology, psychology and neuroscience'.

MRI Stereoscope: A Miniature Stereoscope for Human Neuroimaging

Stereoscopic vision enables the perception of depth. To study the brain mechanisms behind stereoscopic vision using noninvasive brain imaging (magnetic resonance brain imaging; MRI), scientists need to reproduce the independent views of the left and right eyes in the brain scanner using "dichoptic" displays. However, high-quality dichoptic displays are technically challenging and costly to implement in the MRI scanner. The novel miniature stereoscope system ("MRI stereoscope") is an affordable and open-source tool that displays high-quality dichoptic images inside the MRI scanner. The MRI stereoscope takes advantage of commonly used display equipment, the MRI head coil, and a display screen. To validate the MRI stereoscope, binocular disparity stimuli were presented in a 3T MRI scanner while neural activation was recorded using functional MRI in six human participants. The comparison of large binocular disparities compared with disparities close to zero evoked strong responses across dorsal and ventral extra-striate visual cortex. In contrast, binocularly anti-correlated stimuli, which are not perceived in depth, did not evoke comparable activation. These results are the proof-of-concept that the MRI stereoscope can deliver dichoptic images that produce the perception of stereoscopic depth during acquisition of MR responses. Application of the MRI stereoscope to neuroscience can help to address important questions in perception and consciousness.

A haploscope based binocular pupillometer system to quantify the dynamics of direct and consensual Pupillary Light Reflex

This study described the development of a haploscope-based pupillometer for the parametrization of the Pupillary Light Reflex (PLR), and its feasibility in a set of 30 healthy subjects (light or dark-colored irides) and five patients diagnosed with Relative Afferent Pupillary Defect (RAPD). Our supplementary aim focused on evaluating the influence of iris colour on the PLR to decide whether a difference in PLR parameters should be anticipated when this system is used across ethnicities. All the participants underwent a customized pupillometry protocol and the generated pupil traces, captured by an eye tracker, were analyzed using exponential fits to derive PLR parameters. A Pupil Response Symmetry (PRS) coefficient was calculated to predict the presence of RAPD. The mean (SD) Initial PD during dilation (3.2 (0.5) mm) and the minimum PD during constriction (2.9 (0.4) mm) in the light iris group had a statistically significant (p < 0.001) higher magnitude compared to the dark iris group. The normal limits of the PRS coefficient ranged from - 0.20 to + 1.07 and all RAPD patients were outside the calculated normal limits. This proposed system, analysis strategies, and the tested metrics showed good short-term repeatability and the potential in detecting pupil abnormalities in neuro-ophthalmic diseases.

Perceptual Difficulty Persistently Increases Dominance in Binocular Rivalry-Even Without a Task

A major objective of perception is the reduction of uncertainty about the outside world. Eye-movement research has demonstrated that attention and oculomotor control can subserve the function of decreasing uncertainty in vision. Here, we ask whether a similar effect exists for awareness in binocular rivalry, when two distinct stimuli presented to the two eyes compete for awareness. We tested whether this competition can be biased by uncertainty about the stimuli and their relevance for a perceptual task. Specifically, we have stimuli that are perceptually difficult (i.e., carry high perceptual uncertainty) compete with stimuli that are perceptually easy (low perceptual uncertainty). Using a no-report paradigm and reading the dominant stimulus continuously from the observers' eye movements, we find that the perceptually difficult stimulus becomes more dominant than the easy stimulus. This difference is enhanced by the stimuli's relevance for the task. In trials with task, the difference in dominance emerges quickly, peaks before the response, and then persists throughout the trial (further 10 s). However, the difference is already present in blocks before task instruction and still observable when the stimuli have ceased to be task relevant. This shows that perceptual uncertainty persistently increases perceptual dominance, and this is magnified by task relevance.

Adaptation to transients disrupts spatial coherence in binocular rivalry

When one eye is presented with an image that is distinct from the image presented to the other eye, the eyes start to rival and suppress each other's image. Binocular rivalry leads to perceptual alternations between the images of each eye, during which only one of the images is perceived at a time. However, when the eyes exert weak and shallow suppression, participants tend to perceive both images intermixed more often. A recent study proposed that the precedence of mixed percepts positively correlates with the degree of adaptation to conflict between the eyes. However, this study neglected the role of visual transients, which covaried with the degree of conflict in the stimulus design. Here we report that not the conflict between the eyes but prolonged and repeated observations of strong visual transients cause participants to report more mixed percepts. We conclude that visual transients, such as sudden changes in contrast, draw attention, strengthen both eyes' image representations, and facilitate the adaptation to interocular suppression, which consequentially disrupts the spatial coherence in binocular rivalry. This finding is relevant to virtual- and augmented reality for which it is crucial to design stereoscopic environments in which binocular rivalry is limited.

Dichoptic vision in the absence of attention: neither fusion nor rivalry

When the two eyes' processing streams meet in visual cortex, two things can happen: sufficiently similar monocular inputs are combined into a fused representation, whereas markedly different inputs engage in rivalry. Interestingly, the emergence of rivalry appears to require attention. Withdrawing attention causes the alternating monocular dominance that characterizes rivalry to cease, apparently allowing both monocular signals to be processed simultaneously. What happens to these signals in this case, however, remains something of a mystery; are they fused into an integrated representation? In a set of experiments, we show this not to be the case: visual aftereffects are consistent with the simultaneous yet separate presence of two segregated monocular representations, rather than a joint representation. These results provide evidence that dichoptic vision without attention prompts a third and previously unknown mode, where both eyes' inputs receive equal processing, but escape interocular fusion.

Altered short-term neural plasticity related to schizotypal traits: Evidence from visual adaptation

Abnormalities in synaptic plasticity are argued to underlie the neural dysconnectivity observed in schizophrenia. One way to measure synaptic plasticity is through sensory adaptation, whereby sensory neurons exhibit reduced sensitivity after sustained stimulus exposure. Evidence for decreased adaptation in individuals with schizophrenia is currently inconclusive, possibly due to heterogeneity in clinical and medication status across samples. Here we circumvent these confounds by examining whether altered adaptation is represented sub-clinically in the general population. To test this we used three paradigms from visual perception research that provide a precise and non-invasive index of adaptation in the visual system. Two paradigms involve a class of illusory percepts termed visual aftereffects. The third relies on a visual phenomenon termed binocular rivalry, where incompatible stimuli are presented to the two eyes and observers alternate between perceiving exclusively one stimulus or a combination of the two (i.e. mixed perception). We analyzed the strength and dynamics of visual adaptation in these paradigms, in relation to schizotypy. Our results showed that increased schizotypal traits were related to reduced orientation, but not luminance, aftereffect strength (Exp. 1). Further, increased schizotypy was related to a greater proportion of mixed perception during binocular rivalry (Exp. 1 and 2). Given that visual adaption is well understood at cellular and computational levels, our data suggest that short-term plasticity in the visual system can provide important information about the disease mechanisms of schizophrenia.

Perception of action-outcomes is shaped by life-long and contextual expectations

The way humans perceive the outcomes of their actions is strongly colored by their expectations. These expectations can develop over different timescales and are not always complementary. The present work examines how long-term (structural) expectations - developed over a lifetime - and short-term (contextual) expectations jointly affect perception. In two studies, including a pre-registered replication, participants initiated the movement of an ambiguously rotating sphere by operating a rotary switch. In the absence of any learning, participants predominantly perceived the sphere to rotate in the same direction as their rotary action. This bias toward structural expectations was abolished (but not reversed) when participants were exposed to incompatible action-effect contingencies (e.g., clockwise actions causing counterclockwise percepts) during a preceding learning phase. Exposure to compatible action-effect contingencies, however, did not add to the existing structural bias. Together, these findings reveal that perception of action-outcomes results from the combined influence of both long-term and immediate expectations.

Perceptual reversals in binocular rivalry: Improved detection from OKN

When binocular rivalry is induced by opponent motion displays, perceptual reversals are often associated with changed oculomotor behavior (Frässle, Sommer, Jansen, Naber, & Einhäuser, 2014; Fujiwara et al., 2017). Specifically, the direction of smooth pursuit phases in optokinetic nystagmus typically corresponds to the direction of motion that dominates perceptual appearance at any given time. Here we report an improved analysis that continuously estimates perceived motion in terms of "cumulative smooth pursuit." In essence, smooth pursuit segments are identified, interpolated where necessary, and joined probabilistically into a continuous record of cumulative smooth pursuit (i.e., probability of eye position disregarding blinks, saccades, signal losses, and artefacts). The analysis is fully automated and robust in healthy, developmental, and patient populations. To validate reliability, we compare volitional reports of perceptual reversals in rivalry displays, and of physical reversals in nonrivalrous control displays. Cumulative smooth pursuit detects physical reversals and estimates eye velocity more accurately than existing methods do (Frässle et al., 2014). It also appears to distinguish dominant and transitional perceptual states, detecting changes with a precision of ±100 ms. We conclude that cumulative smooth pursuit significantly improves the monitoring of binocular rivalry by means of recording optokinetic nystagmus.

Revisiting individual differences in the time course of binocular rivalry

Simultaneously showing an observer two incompatible displays, one to each eye, causes binocular rivalry, during which the observer regularly switches between perceiving one eye's display and perceiving the other. Observers differ in the rate of this perceptual cycle, and these individual differences have been reported to correlate with differences in the perceptual switch rate for other bistable perception phenomena. Identifying which psychological or neural factors explain this variability can help clarify the mechanisms underlying binocular rivalry and of bistable perception generally. Motivated by the prominent theory that perceptual switches during binocular rivalry are brought about by neural adaptation, we investigated whether perceptual switch rates are correlated with the strength of neural adaptation, indexed by visual aftereffects. We found no compelling evidence for such correlations. Moreover, we did not corroborate previous findings that switch rates are correlated between binocular rivalry and other forms of bistable perception. This latter nonreplication prompted us to perform a meta-analysis of existing research into correlations among forms of bistable perception, which revealed that evidence for such correlations is much weaker than is generally believed. By showing no common factor linking individual differences in binocular rivalry and in our other paradigms, these results fit well with other work that has shown such common factors to be rare among visual phenomena generally.

The influence of action-effect anticipation on bistable perception: differences between onset rivalry and ambiguous motion

Perception is strongly shaped by the actions we perform. According to the theory of event coding, and forward models of motor control, goal-directed action preparation activates representations of desired effects. These expectations about the precise stimulus identity of one's action-outcomes (i.e. identity predictions) are thought to selectively influence perceptual processing of action-contingent effects. However, the existing evidence for such identity-prediction effects is scarce and mixed. Here, we developed a new paradigm to capture such effects and examined whether action-outcome predictions can bias the perception of binocular onset rivalry (Experiments 1a and 1b) and bistable motion (Experiment 2). Participants performed learning tasks in which they were exposed to action-outcome associations. On test trials, actions were followed by bistable stimuli that could be perceived as being either congruent or incongruent with the aforementioned associations (i.e. rivalrous oriented gratings in Experiments 1a and 1b and spheres with ambiguous rotation directions in Experiment 2). Across three experiments, we show that, whilst exposure to action-effect associations can bias the apparent motion direction of ambiguous spheres, it fails to influence perceptual selection of grating orientations in binocular onset rivalry. This pattern of results extends previous work on ambiguous motion by demonstrating that action-induced modulations do not generalize to all types of bistable percepts.

How to Build a Dichoptic Presentation System That Includes an Eye Tracker

The presentation of different stimuli to the two eyes, dichoptic presentation, is essential for studies involving 3D vision and interocular suppression. There is a growing literature on the unique experimental value of pupillary and oculomotor measures, especially for research on interocular suppression. Although obtaining eye-tracking measures would thus benefit studies that use dichoptic presentation, the hardware essential for dichoptic presentation (e.g. mirrors) often interferes with high-quality eye tracking, especially when using a video-based eye tracker. We recently described an experimental setup that combines a standard dichoptic presentation system with an infrared eye tracker by using infrared-transparent mirrors1. The setup is compatible with standard monitors and eye trackers, easy to implement, and affordable (on the order of US$1,000). Relative to existing methods it has the benefits of not requiring special equipment and posing few limits on the nature and quality of the visual stimulus. Here we provide a visual guide to the construction and use of our setup.

On the functional order of binocular rivalry and blind spot filling-in

Binocular rivalry is an important phenomenon for understanding the mechanisms of visual awareness. Here we assessed the functional locus of binocular rivalry relative to blind spot filling-in, which is thought to transpire in V1, thus providing a reference point for assessing the locus of rivalry. We conducted two experiments to explore the functional order of binocular rivalry and blind spot filling-in. Experiment 1 examined if the information filled-in at the blind spot can engage in rivalry with a physical stimulus at the corresponding location in the fellow eye. Participants' perceptual reports showed no difference between this condition and a condition where filling-in was precluded by presenting the same stimuli away from the blind spot, suggesting that the rivalry process is not influenced by any filling-in that might occur. In Experiment 2, we presented the fellow eye's stimulus directly in rivalry with the 'inducer' stimulus that surrounds the blind spot, and compared it with two control conditions away from the blind spot: one involving a ring physically identical to the inducer, and one involving a disc that resembled the filled-in percept. Perceptual reports in the blind spot condition resembled those in the 'ring' condition, more than those in the latter, 'disc' condition, indicating that a perceptually suppressed inducer does not engender filling-in. Thus, our behavioral data suggest binocular rivalry functionally precedes blind spot filling-in. We conjecture that the neural substrate of binocular rivalry suppression includes processing stages at or before V1.