Task-Irrelevant Expectation Violations in Sequential Manual Actions: Evidence for a "Check-after-Surprise" Mode of Visual Attention and Eye-Hand Decoupling

What if Hitler had won WWII and met Kennedy in 1964? Perception and evaluation of counterfactual historical fiction

Introduction

This study investigates the cognitive processing and perception of counterfactual historical fiction and its effects on readers' receptivity to fascism, superstitious beliefs, and satisfaction with the present state of politics. Counterfactual historical fiction presents alternative realities where history diverges from the official historiography, such as in Robert Harris' novel Fatherland, which depicts a counterfactual world where Hitler won WWII. It was hypothesized that reading this genre incurs additional cognitive costs and is perceived with less realism and more aesthetic appreciation compared to historical fiction.

Methods

Seventy-four subjects were divided into two groups and presented with two versions of paragraphs from Fatherland. An experimental group read the original version, describing a counterfactual reality where Hitler is still alive in 1964 (counterfactual historical fiction). A control group read a manipulated version, where events are made plausible by being backdated to 1941 (historical fiction). The study employed a triangulation of methods, utilizing online eye tracking and self-report questionnaires with 7-point Likert scale measurements.

Results

The results indicate that counterfactual historical fiction is associated with increased cognitive demands at the first point of divergence, i.e., the first linguistic cue indicating counterfactuality. This genre also induced less perceived realism of history (factuality) and more surprise. Both versions of the text impacted readers by decreasing agreement with fascism, reducing superstitious beliefs, and enhancing their positive evaluation of the current political situation.

Discussion

The study reveals the cognitive processing of counterfactual historical fiction, highlighting the need for revising current theoretical assumptions. Additionally, the positive impact on readers' attitudes and beliefs may underscore literature's potential role in fostering critical thinking, pro-social behavior, and satisfaction. Further research is suggested for subsequent empirical validation.

Novelty competes with saliency for attention

A highly debated question in attention research is to what extent attention is biased by bottom-up factors such as saliency versus top-down factors as governed by the task. Visual search experiments in which participants are briefly familiarized with the task and then see a novel stimulus unannounced and for the first time support yet another factor, showing that novel and surprising features attract attention. In the present study, we tested whether gaze behavior as an indicator for attentional prioritization can be predicted accurately within displays containing both salient and novel stimuli by means of a priority map that assumes novelty as an additional source of activation. To that aim, we conducted a visual search experiment where a color singleton was presented for the first time in the surprise trial and manipulated the color-novelty of the remaining non-singletons between participants. In one group, the singleton was the only novel stimulus ("one-new"), whereas in another group, the non-singleton stimuli were likewise novel ("all-new"). The surprise trial was always target absent and designed such that top-down prioritization of any color was unlikely. The results show that the singleton in the all-new group captured the gaze less strongly, with more early fixations being directed to the novel non-singletons. Overall, the fixation pattern can accurately be explained by noisy priority maps where saliency and novelty compete for gaze control.

The function of "looking-at-nothing" for sequential sensorimotor tasks: Eye movements to remembered action-target locations

When performing manual actions, eye movements precede hand movements to target locations: Before we grasp an object, we look at it. Eye-hand guidance is even preserved when visual targets are unavailable, e.g., grasping behind an occlusion. This "looking-atnothing" behavior might be functional, e.g., as "deictic pointer" for manual control or as memory-retrieval cue, or a by-product of automatization. Here, it is studied if looking at empty locations before acting on them is beneficial for sensorimotor performance. In five experiments, participants completed a click sequence on eight visual targets for 0-100 trials while they had either to fixate on the screen center or could move their eyes freely. During 50-100 consecutive trials, participants clicked the same sequence on a blank screen with free or fixed gaze. During both phases, participants looked at target locations when gaze shifts were allowed. With visual targets, target fixations led to faster, more precise clicking, fewer errors, and sparser cursor-paths than central fixation. Without visual information, a tiny free-gaze benefit could sometimes be observed and was rather a memory than a motor-calculation benefit. Interestingly, central fixation during learning forced early explicit encoding causing a strong benefit for acting on remembered targets later, independent of whether eyes moved then.

"Looking-at-nothing" during sequential sensorimotor actions: Long-term memory-based eye scanning of remembered target locations

Before acting humans saccade to a target object to extract relevant visual information. Even when acting on remembered objects, locations previously occupied by relevant objects are fixated during imagery and memory tasks - a phenomenon called "looking-at-nothing". While looking-at-nothing was robustly found in tasks encouraging declarative memory built-up, results are mixed in the case of procedural sensorimotor tasks. Eye-guidance to manual targets in complete darkness was observed in a task practiced for days beforehand, while investigations using only a single session did not find fixations to remembered action targets. Here, it is asked whether looking-at-nothing can be found in a single sensorimotor session and thus independent from sleep consolidation, and how it progresses when visual information is repeatedly unavailable. Eye movements were investigated in a computerized version of the trail making test. Participants clicked on numbered circles in ascending sequence. Fifty trials were performed with the same spatial arrangement of 9 visual targets to enable long-term memory consolidation. During 50 consecutive trials, participants had to click the remembered target sequence on an empty screen. Participants scanned the visual targets and also the empty target locations sequentially with their eyes, however, the latter less precise than the former. Over the course of the memory trials, manual and oculomotor sequential target scanning became more similar to the visual trials. Results argue for robust looking-at-nothing during procedural sensorimotor tasks provided that long-term memory information is sufficient.

Humans show a higher preference for stimuli that are predictive relative to those that are predictable

Recent studies suggest that humans prefer information that is linked to the process of prediction. Yet it remains to be specified whether preference judgments are biased to information that can be predicted, or information that enables to predict. We here use a serial reaction time task to disentangle these two options. In a first learning phase, participants were exposed to a continuous stream of arbitrary shapes while performing a go/no-go task. Embedded in this stream were hidden pairs of go-stimuli (e.g., shape A was always followed by shape B). Data show faster reaction times to predictable shapes (i.e., shape B) as compared to random and predictive shapes (i.e., shape A), indicating that participants learned the regularities and anticipated upcoming information. Importantly, in a subsequent, unannounced forced-choice preference task, the shapes that were predictive of others were significantly more preferred over random shapes than shapes that could be predicted. Because both the reaction time benefit in the learning phase and the effect in the preference phase could be considered rather small, we studied the relation between both. Interestingly, the preference correlated with the reaction time benefit from the learning phase. A closer look at this correlation further suggested that the difference in preference was only observed when participants picked up the contingencies between predictive and predictable shapes. This study adds evidence to the idea that prediction processes are not only fundamental for cognition, but contribute to the way we evaluate our external world.