Overt attention and context factors: the impact of repeated presentations, image type, and individual motivation

How body postures affect gaze control in scene viewing under specific task conditions

Gaze movements during visual exploration of natural scenes are typically investigated with the static picture viewing paradigm in the laboratory. While this paradigm is attractive for its highly controlled conditions, limitations in the generalizability of the resulting findings to more natural viewing behavior have been raised frequently. Here, we address the combined influences of body posture and viewing task on gaze behavior with the static picture viewing paradigm under free viewing as a baseline condition. We recorded gaze data using mobile eye tracking during postural manipulations in scene viewing. Specifically, in Experiment 1, we compared gaze behavior during head-supported sitting and quiet standing under two task conditions. We found that task affects temporal and spatial gaze parameters, while posture produces no effects on temporal and small effects on spatial parameters. In Experiment 2, we further investigated body posture by introducing four conditions (sitting with chin rest, head-free sitting, quiet standing, standing on an unstable platform). Again, we found no effects on temporal and small effects on spatial gaze parameters. In our experiments, gaze behavior is largely unaffected by body posture, while task conditions readily produce effects. We conclude that results from static picture viewing may allow predictions of gaze statistics under more natural viewing conditions, however, viewing tasks should be chosen carefully because of their potential effects on gaze characteristics.

An eye-tracking study of biased attentional processing of emotional faces in severe alcohol use disorder

BACKGROUND

Social cognition impairments in severe alcohol use disorder (SAUD) are increasingly established. However, fundamental aspects of social cognition, and notably the attentional processing of socio-affective information, remain unexplored, limiting our understanding of underlying mechanisms. Here, we determined whether patients with SAUD show attentional biases to specific socio-affective cues, namely emotional faces.

METHOD

In a modified dot-probe paradigm, 30 patients with SAUD and 30 demographically matched healthy controls (HC) were presented with pairs of neutral-emotional (angry, disgusted, happy, sad) faces while having their eye movements recorded. Indices of early/automatic (first fixations, latency to first fixations) and later/controlled (number of fixations, dwell-time) processes were computed.

RESULTS

Patients with SAUD did not differ from HC in their attention to angry/disgusted/sad vs. neutral faces. However, patients with SAUD fixated/dwelled less on happy vs. neutral faces in the first block of stimuli than HC, who presented an attentional bias to happy faces.

LIMITATIONS

Sample-size was determined to detect medium-to-large effects and subtler ones may have been missed. Further, our cross-sectional design provides no explanation as to whether the evidenced biases precede or are a consequence of SAUD.

CONCLUSIONS

These results extend the social cognition literature in SAUD to the attentional domain, by evidencing the absence of a controlled attentional bias toward positive social cues in SAUD. This may reflect reduced sensitivity to social reward and could contribute to higher order social cognition difficulties and social dysfunction.

Active vision in sight recovery individuals with a history of long-lasting congenital blindness

What we see is intimately linked to how we actively and systematically explore the world through eye movements. However, it is unknown to what degree visual experience during early development is necessary for such systematic visual exploration to emerge. The present study investigated visual exploration behavior in ten human participants whose sight had been restored only in childhood or adulthood, after a period of congenital blindness due to dense bilateral congenital cataracts. Participants freely explored real-world images while their eye movements were recorded. Despite severe residual visual impairments and gaze instability (nystagmus), visual exploration patterns were preserved in individuals with reversed congenital cataract. Modelling analyses indicated that similar to healthy controls, visual exploration in individuals with reversed congenital cataract was based on the low-level (luminance contrast) and high-level (object components) visual content of the images. Moreover, participants used visual short-term memory representations for narrowing down the exploration space. More systematic visual exploration in individuals with reversed congenital cataract was associated with better object recognition, suggesting that active vision might be a driving force for visual system development and recovery. The present results argue against a sensitive period for the development of neural mechanisms associated with visual exploration.SIGNIFICANCE STATEMENTHumans explore the visual world with systematic patterns of eye movements, but it is unknown whether early visual experience is necessary for the acquisition of visual exploration. Here, we show that sight recovery individuals who had been born blind demonstrate highly systematic eye movements while exploring real-world images, despite visual impairments and pervasive gaze instability. In fact, their eye movement patterns were predicted by those of normally sighted controls and models calculating eye movements based on low- and high-level visual features, and they moreover took memory information into account. Since object recognition performance was associated with systematic visual exploration it was concluded that eye movements might be a driving factor for the development of the visual system.

Restorative benefits of urban green space: Physiological, psychological restoration and eye movement analysis

Urban life is associated with a range of health risks. However, urban green spaces have been found to promote health recovery and reduce mental stress. This study sought to assess the influence of the spatial and environmental characteristics of urban green space on environmental restoration. We measured physiological and psychological changes among 60 participants to evaluate the restorative benefits of 12 green spaces in Shenyang. The Perceived Restorativeness Scale and two physiological measures (heart rate variation and skin conductance response) were used to analyze the effects of spatial characteristics on restorative benefits. In addition, eye-tracking was used to explore the influence of environmental components on restorative benefits. The results revealed that, although there were slight differences between physiological and psychological findings, both confirmed that urban green space had a restorative benefit. Partially-open green spaces with a high degree of naturalness had more positive effects than open green spaces with a high degree of hard paved spaces. Eye movement analysis results revealed that trees and shrubs, as well as water, had a positive effect on the environmental restoration benefits, whereas buildings and paving had a negative effect. Among environmental features, trees and shrubs, water, and buildings exerted the strongest effects on environment restoration. In the future, combining spatial characteristics and environmental components will aid improvement of the restorative qualities of urban green space.

Rapid coordination of effective learning by the human hippocampus

Although the human hippocampus is necessary for long-term memory, controversial findings suggest that it may also support short-term memory in the service of guiding effective behaviors during learning. We tested the counterintuitive theory that the hippocampus contributes to long-term memory through remarkably short-term processing, as reflected in eye movements during scene encoding. While viewing scenes for the first time, short-term retrieval operative within the episode over only hundreds of milliseconds was indicated by a specific eye-movement pattern, which was effective in that it enhanced spatiotemporal memory formation. This viewing pattern was predicted by hippocampal theta oscillations recorded from depth electrodes and by shifts toward top-down influence of hippocampal theta on activity within visual perception and attention networks. The hippocampus thus supports short-term memory processing that coordinates behavior in the service of effective spatiotemporal learning.

(Eye-) Tracking the Other-Race Effect: Comparison of Eye Movements During Encoding and Recognition of Ingroup Faces With Proximal and Distant Outgroup Faces

People experience difficulties recognizing faces of ethnic outgroups, known as the other-race effect. The present eye-tracking study investigates if this effect is related to differences in visual attention to ingroup and outgroup faces. We measured gaze fixations to specific facial features and overall eye-movement activity level during an old/new recognition task comparing ingroup faces with proximal and distal ethnic outgroup faces. Recognition was best for ingroup faces and decreased gradually for proximal and distal outgroup faces. Participants attended more to the eyes of ingroup faces than outgroup faces, but this effect was unrelated to recognition performance. Ingroup-outgroup differences in eye-movement activity level did not emerge during the study phase, but during the recognition phase, with ingroup-outgroup differences varying as a function of recognition accuracy and old/new effects. Overall, ingroup-outgroup effects on recognition performance and eye movements were more pronounced for recognition of new items, emphasizing the role of retrieval processes.

Influence of personality traits on users’ viewing behaviour

Different views on the role of personal factors in moderating individual viewing behaviour exist. This study examined the impact of personality traits on individual viewing behaviour of facial stimulus. A total of 96 students (46 males and 50 females, age 23–28 years) were participated in this study. The Big-Five personality traits of all the participants together with data related to their eye-movements were collected and analysed. The results showed three groups of users who scored high on the personality traits of neuroticism, agreeableness and conscientiousness. Individuals who scored high in a specific personality trait were more probably to interpret the visual image differently from individuals with other personality traits. To determine the extent to which a specific personality trait is associated with users’ viewing behaviour of visual stimulus, a predictive model was developed and validated. The prediction results showed that 96.73% of the identified personality traits can potentially be predicted by the viewing behaviour of users. The findings of this study can expand the current understanding of human personality and choice behaviour. The study also contributes to the perceptual encoding process of faces and the perceptual mechanism in the holistic face processing theory.

Gaze-pattern similarity at encoding may interfere with future memory

Human brains have a remarkable ability to separate streams of visual input into distinct memory-traces. It is unclear, however, how this ability relates to the way these inputs are explored via unique gaze-patterns. Moreover, it is yet unknown how motivation to forget or remember influences the link between gaze similarity and memory. In two experiments, we used a modified directed-forgetting paradigm and either showed blurred versions of the encoded scenes (Experiment 1) or pink noise images (Experiment 2) during attempted memory control. Both experiments demonstrated that higher levels of across-stimulus gaze similarity relate to worse future memory. Although this across-stimulus interference effect was unaffected by motivation, it depended on the perceptual overlap between stimuli and was more pronounced for different scene comparisons, than scene–pink noise comparisons. Intriguingly, these findings echo the pattern similarity effects from the neuroimaging literature and pinpoint a mechanism that could aid the regulation of unwanted memories.

Fixation durations in natural scene viewing are guided by peripheral scene content

Fixation durations provide insights into processing demands. We investigated factors controlling fixation durations during scene viewing in two experiments. In Experiment 1, we tested the degree to which fixation durations adapt to global scene processing difficulty by manipulating the contrast (from original contrast to isoluminant) and saturation (original vs. grayscale) of the entire scene. We observed longer fixation durations for lower levels of contrast, and longer fixation durations for grayscale than for color scenes. Thus fixation durations were globally slowed as visual information became more and more degraded, making scene processing increasingly more difficult. In Experiment 2, we investigated two possible sources for this slow-down. We used "checkerboard" stimuli in which unmodified patches alternated with patches from which luminance information had been removed (isoluminant patches). Fixation durations showed an inverted immediacy effect (longer, rather than shorter, fixation durations on unmodified patches) along with a parafoveal-on-foveal effect (shorter fixation durations, when an unmodified patch was fixated next). This effect was stronger when the currently fixated patch was isoluminant as opposed to unmodified. Our results suggest that peripheral scene information substantially affects fixation durations and are consistent with the notion of competition among the current and potential future fixation locations.

Not all fixations are created equal: The benefits of using ex-Gaussian modeling of fixation durations

Various cognitive and perceptual factors have been shown to modulate the duration of fixations during visual exploration of complex scenes. The majority of these studies have only considered the mean of the distribution of fixation durations. However, this distribution is skewed to the right, so that an increase in the mean may be driven by a lengthening of all fixations (i.e., a right shift of the whole distribution) or only the relatively longer ones (i.e., a longer right tail of the distribution). To determine which factor is at play, the distribution can be modeled with an ex-Gaussian distribution, which is a convolution of a Gaussian and an exponential distribution. Here we demonstrate the usefulness of applying the ex-Gaussian model to empirical distributions of fixation durations and the reliability of its parameters across time. We demonstrate how the ex-Gaussian model had advantages over exclusive consideration of the mean, by showing that an increase in the mean can stem from specific changes in the components of the ex-Gaussian distribution. Specifically, the type of image leads to a change in the Gaussian component alone, indicating a right shift of the main mass of the distribution. By contrast, familiarity with the inspected image modifies the exponential component, and results in a more specific modulation of a subset of relatively long fixations. Hence, estimating the ex-Gaussian parameters may provide novel insights into the underlying processes that determine fixation duration and can contribute to the future development of process-based computational models of gaze behavior.

Temporal context guides visual exploration during scene recognition

Memories for episodes are temporally structured. Cognitive models derived from list-learning experiments attribute this structure to the retrieval of temporal context information that indicates when a memory occurred. These models predict key features of memory recall, such as the strong tendency to retrieve studied items in the order in which they were first encountered. Can such models explain ecological memory behaviors, such as eye movements during encoding and retrieval of complex visual stimuli? We tested predictions from retrieved-context models using three data sets involving recognition memory and free viewing of complex scenes. Subjects reinstated sequences of eye movements from one scene-viewing episode to the next. Moreover, sequence reinstatement decayed over time and was associated with successful memory. We observed memory-driven reinstatement even after accounting for intrinsic scene properties that produced consistent eye movements. These findings confirm predictions of retrieved-context models, suggesting retrieval of temporal context influences complex behaviors generated during naturalistic memory experiences. (PsycInfo Database Record (c) 2021 APA, all rights reserved).

The Development of Context-Sensitive Attention Across Cultures: The Impact of Stimulus Familiarity

Across cultures, there are marked differences in visual attention that gradually develop between 4 and 6 years of age. According to the social orientation hypothesis, people in interdependent cultures should show more pronounced context sensitivity than people in independent cultures. However, according to the differential familiarity hypothesis, the focus on the salient object should also depend on the familiarity of the stimulus; people will focus more on the focal object (i.e., less context sensitivity), if it is a less familiar stimulus. To examine the differences in visual attention between interdependent and independent cultures while taking into account stimulus familiarity, this study used an eye-tracking paradigm to assess visual attention of participants between 4 and 20 years who came from urban middle-class families from Germany (n = 53; independent culture) or from Nso families in a rural area in Cameroon (n = 50; interdependent culture). Each participant saw four sets of stimuli, which varied in terms of their familiarity: (1) standard stimuli, (2) non-semantic stimuli, both more familiar to participants from Germany, (3) culture-specific matched stimuli, and (4) simple stimuli, similarly familiar to the individuals of both cultures. Overall, the findings show that mean differences in visual attention between cultures were highly contingent on the stimuli sets: In support of the social orientation hypothesis, German participants showed a higher object focus for the culture-specific matched stimuli, while there were no cultural differences for the simple set. In support of the differential familiarity hypothesis, the Cameroonian participants showed a higher object focus for the less familiar sets, namely the standard and non-semantic sets. Furthermore, context sensitivity correlated across all the sets. In sum, these findings suggest that the familiarity of a stimulus strongly affects individuals’ visual attention, meaning that stimulus familiarity needs to be considered when investigating culture-specific differences in attentional styles.

Been there, seen that, done that: Modification of visual exploration across repeated exposures

The underlying factors that determine gaze position are a central topic in visual cognitive research. Traditionally, studies emphasized the interaction between the low-level properties of an image and gaze position. Later studies examined the influence of the semantic properties of an image. These studies explored gaze behavior during a single presentation, thus ignoring the impact of familiarity. Sparse evidence suggested that across repetitive exposures, gaze exploration attenuates but the correlation between gaze position and the low-level features of the image remains stable. However, these studies neglected two fundamental issues: (a) repeated scenes are displayed later in the testing session, such that exploration attenuation could be a result of lethargy, and (b) even if these effects are related to familiarity, are they based on a verbatim familiarity with the image, or on high-level familiarity with the gist of the scene? We investigated these issues by exposing participants to a sequence of images, some of them repeated across blocks. We found fewer, longer fixations as familiarity increased, along with shorter saccades and decreased gaze allocation towards semantically meaningful regions. These effects could not be ascribed to tonic fatigue, since they did not manifest for images that changed across blocks. Moreover, there was no attenuation of gaze behavior when participants observed a flipped version of the familiar images, suggesting that gist familiarity is not sufficient for eliciting these effects. These findings contribute to the literature on memory-guided gaze behavior and provide novel insights into the mechanism underlying the visual exploration of familiar environments.

Spatial statistics for gaze patterns in scene viewing: Effects of repeated viewing

Scene viewing is used to study attentional selection in complex but still controlled environments. One of the main observations on eye movements during scene viewing is the inhomogeneous distribution of fixation locations: While some parts of an image are fixated by almost all observers and are inspected repeatedly by the same observer, other image parts remain unfixated by observers even after long exploration intervals. Here, we apply spatial point process methods to investigate the relationship between pairs of fixations. More precisely, we use the pair correlation function, a powerful statistical tool, to evaluate dependencies between fixation locations along individual scanpaths. We demonstrate that aggregation of fixation locations within 4° is stronger than expected from chance. Furthermore, the pair correlation function reveals stronger aggregation of fixations when the same image is presented a second time. We use simulations of a dynamical model to show that a narrower spatial attentional span may explain differences in pair correlations between the first and the second inspection of the same image.

Personally relevant online advertisements: Effects of demographic targeting on visual attention and brand evaluation

Global investments in online advertising rise quickly but internet users often avoid looking at ads due to established banner blindness. Demographic targeting is expected to overcome this tendency by attracting users' attention to more self-relevant ad content. However, little is known about the effect of demographically targeted versus non-targeted ads on users' actual attention allocation during exposure to webpages. The present study aimed to further fill this empirical gap by clarifying whether demographic targeting attracts visual attention and to exploratively examine whether it also affects brand attitude and website evaluation, as suggested by previous studies. Eye tracking data revealed that demographic targeting can have medium- to large-sized effects on several eye movement parameters when internet users are in a free-viewing mode. In contrast, demographic targeting did not influence brand attitude and website evaluation. We conclude that attention for personally relevant advertisement can be strong. However, attention, although being a necessary condition for subsequent judgment formation according to the model of human information processing, is not sufficient to elicit positive effects at the level of subjective judgments.

Context-sensitive attention is socialized via a verbal route in the parent-child interaction

The way humans perceive and attend to visual scenes differs profoundly between individuals. This is most compellingly demonstrated for context-sensitivity, the relative attentional focus on focal objects and background elements of a scene, in cross-cultural comparisons. Differences in context-sensitivity have been reported in verbal accounts (e.g. picture descriptions) and in visual attention (e.g., eye-tracking paradigms). The present study investigates (1) if the way parents verbally guide the attention of their children in visual scenes is associated with differences in children’s context-sensitivity and (2) if verbal descriptions of scenes are related to early visual attention (i.e., gaze behavior) in 5-year-old children and their parents. Importantly, the way parents verbally described visual scenes to their children was related to children’s context-sensitivity, when describing these scenes themselves. This is, we found a correlation in the number of references made to the object versus the background as well as the number of relations made between different elements of a scene. Furthermore, verbal descriptions were closely related to visual attention in adults, but not in children. These findings support our hypotheses that context-sensitivity is socialized via a verbal route and that visual attention processes align with acquired narrative structures only later in development, after the preschool years.

Eye Fixation Assisted Video Saliency Detection via Total Variation-based Pairwise Interaction

As human visual attention is naturally biased towards foreground objects in a scene, it can be used to extract salient objects in video clips. In this work, we proposed a weakly supervised learning based video saliency detection algorithm utilizing eye fixations information from multiple subjects. Our main idea is to extend eye fixations to saliency regions step by step. First, visual seeds are collected using multiple color space geodesic distance based seed region mapping with filtered and extended eye fixations. This operation helps raw fixation points spread to the most likely salient regions, namely, visual seed regions. Second, in order to seize the essential scene structure from video sequences, we introduce the total variance based pairwise interaction model to learn the potential pairwise relationship between foreground and background within a frame or across video frames. In this vein, visual seed regions eventually grow into salient regions. Compared with previous approaches the generated saliency maps has two most outstanding properties: integrity and purity, which are conductive to segment the foreground and significant to the follow-up tasks. Extensive quantitative and qualitative experiments on various video sequences demonstrate that the proposed method outperforms state-of-theart image and video saliency detection algorithms.

Visual attention in 5-year-olds from three different cultures

Cognitive processes differ markedly between children from different cultures, with best evidence for attention to visual scenes and the activities of others. Children from urban Western cultures tend to focus on focal objects, whereas children from urban East-Asian cultures rather attend to contextual elements of a visual scene. Regarding the attention to others' activities, children from subsistence-based farming communities often observe several activities simultaneously, while children from urban Western contexts focus on activities sequentially. Here we assessed 144 5-year-old children from three prototypical cultural contexts (urban Germany, rural Cameroon, urban Japan) to investigate variations in attention across a variety of tasks. Attention to the elements of a visual scene was assessed in an optical illusion task, in picture descriptions and an eye-tracking paradigm. Attention to and learning from others' activities was assessed in a parallel action task and a rule-based game. Some tasks indicated higher context-sensitive attention in urban Japan, while other findings indicated higher context-sensitive attention in urban Germany. Levels of parallel attention and learning from others' activities were lower in rural Cameroonian children compared to the urban samples. Across tasks, the visual attention measures were unrelated. These findings substantiate that culture has a profound influence on early cognitive development, already in the preschool years. Furthermore, they raise critical questions about the early origins of cultural specificities in attention and the generalizability of attention phenomena beyond specific tasks and populations.

Study of an Extensive Set of Eye Movement Features: Extraction Methods and Statistical Analysis

This work presents a study of an extensive set of 101 categories of eye movement features from three types of eye movement events: fixations, saccades, and post-saccadic oscillations. We present a unified framework of methods for the extraction of features that describe the temporal, positional and dynamic characteristics of eye movements. We perform statistical analysis of feature values by employing eye movement data from a normative population of 298 subjects, recorded during a text reading task. We present overall measures for the central tendency and variability of feature values, and we quantify the test-retest reliability of features using either the Intraclass Correlation Coefficient (for normally distributed and normalized features) or Kendall’s coefficient of concordance (for non-normally distributed features). Finally, for the case of normally distributed and normalized features we additionally perform factor analysis and provide interpretations of the resulting factors. The presented methods and analysis can provide a valuable tool for researchers in various fields that explore eye movements, such as in behavioral studies, attention and cognition research, medical research, biometric recognition, and humancomputer interaction.

Visual cortical networks align with behavioral measures of context-sensitivity in early childhood

This study investigates how visual cortical networks align with context-sensitivity, namely the relative focus on the object versus the background of a visual scene, in early childhood. Context-sensitivity was assessed by a picture description and a recognition memory task. To segregate object and background processing in the visual cortex in 5- and 7-year-old children, object and background were presented at different frequencies (12 Hz or 15 Hz), evoking disparate neuronal responses (steady state visually evoked potentials, SSVEPs) in the electroencephalogram. In younger compared to older children the background elicited higher SSVEPs. Visual cortical processing of object versus background was associated with behavioral measures for older but not for younger children. This relation was strongest for verbal descriptions and generalized to the cortical processing of abstract stimuli and object and background presented alone. Thus, visual cortical networks restructure and align with behavioral measures of context-sensitivity in early childhood.

Exploration and Exploitation in Natural Viewing Behavior

Many eye-tracking studies investigate visual behavior with a focus on image features and the semantic content of a scene. A wealth of results on these aspects is available, and our understanding of the decision process where to look has reached a mature stage. However, the temporal aspect, whether to stay and further scrutinize a region (exploitation) or to move on and explore image regions that were yet not in the focus of attention (exploration) is less well understood. Here, we investigate the trade-off between these two processes across stimuli with varying properties and sizes. In a free viewing task, we examined gaze parameters in humans, involving the central tendency, entropy, saccadic amplitudes, number of fixations and duration of fixations. The results revealed that the central tendency and entropy scaled with stimulus size. The mean saccadic amplitudes showed a linear increase that originated from an interaction between the distribution of saccades and the spatial bias. Further, larger images led to spatially more extensive sampling as indicated by a higher number of fixations at the expense of reduced fixation durations. These results demonstrate a profound shift from exploitation to exploration as an adaptation of main gaze parameters with increasing image size.

Fixation durations in scene viewing: Modeling the effects of local image features, oculomotor parameters, and task

Scene perception requires the orchestration of image- and task-related processes with oculomotor constraints. The present study was designed to investigate how these factors influence how long the eyes remain fixated on a given location. Linear mixed models (LMMs) were used to test whether local image statistics (including luminance, luminance contrast, edge density, visual clutter, and the number of homogeneous segments), calculated for 1° circular regions around fixation locations, modulate fixation durations, and how these effects depend on task-related control. Fixation durations and locations were recorded from 72 participants, each viewing 135 scenes under three different viewing instructions (memorization, preference judgment, and search). Along with the image-related predictors, the LMMs simultaneously considered a number of oculomotor and spatiotemporal covariates, including the amplitudes of the previous and next saccades, and viewing time. As a key finding, the local image features around the current fixation predicted this fixation’s duration. For instance, greater luminance was associated with shorter fixation durations. Such immediacy effects were found for all three viewing tasks. Moreover, in the memorization and preference tasks, some evidence for successor effects emerged, such that some image characteristics of the upcoming location influenced how long the eyes stayed at the current location. In contrast, in the search task, scene processing was not distributed across fixation durations within the visual span. The LMM-based framework of analysis, applied to the control of fixation durations in scenes, suggests important constraints for models of scene perception and search, and for visual attention in general.

Predicting rhesus monkey eye movements during natural-image search

There are three prominent factors that can predict human visual-search behavior in natural scenes: the distinctiveness of a location (salience), similarity to the target (relevance), and features of the environment that predict where the object might be (context). We do not currently know how well these factors are able to predict macaque visual search, which matters because it is arguably the most popular model for asking how the brain controls eye movements. Here we trained monkeys to perform the pedestrian search task previously used for human subjects. Salience, relevance, and context models were all predictive of monkey eye fixations and jointly about as precise as for humans. We attempted to disrupt the influence of scene context on search by testing the monkeys with an inverted set of the same images. Surprisingly, the monkeys were able to locate the pedestrian at a rate similar to that for upright images. The best predictions of monkey fixations in searching inverted images were obtained by rotating the results of the model predictions for the original image. The fact that the same models can predict human and monkey search behavior suggests that the monkey can be used as a good model for understanding how the human brain enables natural-scene search.

An extensive dataset of eye movements during viewing of complex images

We present a dataset of free-viewing eye-movement recordings that contains more than 2.7 million fixation locations from 949 observers on more than 1000 images from different categories. This dataset aggregates and harmonizes data from 23 different studies conducted at the Institute of Cognitive Science at Osnabrück University and the University Medical Center in Hamburg-Eppendorf. Trained personnel recorded all studies under standard conditions with homogeneous equipment and parameter settings. All studies allowed for free eye-movements, and differed in the age range of participants (~7-80 years), stimulus sizes, stimulus modifications (phase scrambled, spatial filtering, mirrored), and stimuli categories (natural and urban scenes, web sites, fractal, pink-noise, and ambiguous artistic figures). The size and variability of viewing behavior within this dataset presents a strong opportunity for evaluating and comparing computational models of overt attention, and furthermore, for thoroughly quantifying strategies of viewing behavior. This also makes the dataset a good starting point for investigating whether viewing strategies change in patient groups.

Direction and viewing area-sensitive influence of EOG artifacts revealed in the EEG topographic pattern analysis

The influence of eye movement-related artifacts on electroencephalography (EEG) signals of human subjects, who were requested to perform a direction or viewing area dependent saccade task, was investigated by using a simultaneous recording with ocular potentials as electro-oculography (EOG). In the past, EOG artifact removals have been studied in tasks with a single fixation point in the screen center, with less attention to the sensitivity of cornea-retinal dipole orientations to the EEG head map. In the present study, we hypothesized the existence of a systematic EOG influence that differs according to coupling conditions of eye-movement directions with viewing areas including different fixation points. The effect was validated in the linear regression analysis by using 12 task conditions combining horizontal/vertical eye-movement direction and three segregated zones of gaze in the screen. In the first place, event-related potential topographic patterns were analyzed to compare the 12 conditions and propagation coefficients of the linear regression analysis were successively calculated in each condition. As a result, the EOG influences were significantly different in a large number of EEG channels, especially in the case of horizontal eye-movements. In the cross validation, the linear regression analysis using the appropriate dataset of the target direction/viewing area combination demonstrated an improved performance compared with the traditional methods using a single fixation at the center. This result may open a potential way to improve artifact correction methods by considering the systematic EOG influence that can be predicted according to the view angle such as using eye-tracker systems.

Hand washing induces a clean slate effect in moral judgments: a pupillometry and eye-tracking study

Physical cleansing is commonly understood to protect us against physical contamination. However, recent studies showed additional effects on moral judgments. Under the heading of the "Macbeth effect" direct links between bodily cleansing and one's own moral purity have been demonstrated. Here we investigate (1) how moral judgments develop over time and how they are altered by hand washing, (2) whether changes in moral judgments can be explained by altered information sampling from the environment, and (3) whether hand washing affects emotional arousal. Using a pre-post control group design, we found that morality ratings of morally good and bad scenes acquired more extreme values in the control group over time, an effect that was fully counteracted by intermediate hand washing. This result supports the notion of a clean slate effect by hand washing. Thereby, eye-tracking data did not uncover differences in eye movement behavior that may explain differences in moral judgments. Thus, the clean slate effect is not due to altered information sampling from the environment. Finally, compared to the control group, pupil diameter decreased after hand washing, thus demonstrating a direct physiological effect. The results shed light on the physiological mechanisms behind this type of embodiment phenomenon.

Effects of contextual information and stimulus ambiguity on overt visual sampling behavior

The sampling of our visual environment through saccadic eye movements is an essential function of the brain, allowing us to overcome the limits of peripheral vision. Understanding which parts of a scene attract overt visual attention is subject to intense research, and considerable progress has been made in unraveling the underlying cortical mechanisms. In contrast to spatial aspects, however, relatively little is understood about temporal aspects of overt visual sampling. At every fixation, the oculomotor system faces the decision whether to keep exploring different aspects of an object or scene or whether to remain fixated to allow for in-depth cortical processing - a situation that can be understood in terms of an exploration-exploitation dilemma. To improve our understanding of the factors involved in these decisions, we here investigate how the level of visual information, experimentally manipulated by scene context and stimulus ambiguity, changes the sampling behavior preceding the recognition of centrally presented ambiguous and disambiguated objects. Behaviorally, we find that context, although only presented until the first voluntary saccade, biases the perceptual outcome and significantly reduces reaction times. Importantly, we find that increased information about an object significantly alters its visual exploration, as evident through increased fixation durations and reduced saccade amplitudes. These results demonstrate that the initial sampling of an object, preceding its recognition, is subject to change based on the amount of information available in the system: increased evidence for its identity biases the exploration-exploitation strategy towards in-depth analyses.

The experience of new sensorimotor contingencies by sensory augmentation

•

We investigate learning of sensorimotor contingencies by sensory augmentation.

•

The sensory device maps information of magnetic north to vibrotactile stimulation.

•

Active training with the device leads to marked changes in perception of space.

•

The device facilitates navigation and alters navigational strategies.

•

The device gives subjects a strong feeling of security and of “never get lost”.

Embedded in the paradigm of embodied cognition, the theory of sensorimotor contingencies (SMCs) proposes that motor actions and associated sensory stimulations are tied together by lawful relations termed SMCs. We aimed to investigate whether SMCs can be learned by means of sensory augmentation. Therefore we focused on related perceptual changes. Subjects trained for 7 weeks with the feelSpace belt mapping information of the magnetic north to vibrotactile stimulation around the waist. They experienced substantial changes in their space perception. The belt facilitated navigation and stimulated the usage of new navigation strategies. The belt’s vibrating signal changed to a kind of spatial information over time while the belt’s appeal and perceived usability increased. The belt also induced certain emotional states. Overall, the results show that learning new SMCs with this relatively small and usable device leads to profound perceptual and emotional changes, which are fully compatible with embodied theories of cognition.

The contributions of image content and behavioral relevancy to overt attention

During free-viewing of natural scenes, eye movements are guided by bottom-up factors inherent to the stimulus, as well as top-down factors inherent to the observer. The question of how these two different sources of information interact and contribute to fixation behavior has recently received a lot of attention. Here, a battery of 15 visual stimulus features was used to quantify the contribution of stimulus properties during free-viewing of 4 different categories of images (Natural, Urban, Fractal and Pink Noise). Behaviorally relevant information was estimated in the form of topographical interestingness maps by asking an independent set of subjects to click at image regions that they subjectively found most interesting. Using a Bayesian scheme, we computed saliency functions that described the probability of a given feature to be fixated. In the case of stimulus features, the precise shape of the saliency functions was strongly dependent upon image category and overall the saliency associated with these features was generally weak. When testing multiple features jointly, a linear additive integration model of individual saliencies performed satisfactorily. We found that the saliency associated with interesting locations was much higher than any low-level image feature and any pair-wise combination thereof. Furthermore, the low-level image features were found to be maximally salient at those locations that had already high interestingness ratings. Temporal analysis showed that regions with high interestingness ratings were fixated as early as the third fixation following stimulus onset. Paralleling these findings, fixation durations were found to be dependent mainly on interestingness ratings and to a lesser extent on the low-level image features. Our results suggest that both low- and high-level sources of information play a significant role during exploration of complex scenes with behaviorally relevant information being more effective compared to stimulus features.

Saccadic momentum and facilitation of return saccades contribute to an optimal foraging strategy

The interest in saccadic IOR is funneled by the hypothesis that it serves a clear functional purpose in the selection of fixation points: the facilitation of foraging. In this study, we arrive at a different interpretation of saccadic IOR. First, we find that return saccades are performed much more often than expected from the statistical properties of saccades and saccade pairs. Second, we find that fixation durations before a saccade are modulated by the relative angle of the saccade, but return saccades show no sign of an additional temporal inhibition. Thus, we do not find temporal saccadic inhibition of return. Interestingly, we find that return locations are more salient, according to empirically measured saliency (locations that are fixated by many observers) as well as stimulus dependent saliency (defined by image features), than regular fixation locations. These results and the finding that return saccades increase the match of individual trajectories with a grand total priority map evidences the return saccades being part of a fixation selection strategy that trades off exploration and exploitation.

Sometimes humans look at the same location twice. To appreciate the importance of this inconspicuous statement you have to consider that we move our eyes several billion (10⁹) times during our lives and that looking at something is a necessary condition to enable conscious visual awareness. Thus, understanding why and how we move our eyes provides a window into our mental life. Here we investigate one heavily discussed aspect of human's fixation selection strategy: whether it inhibits returning to previously fixated locations. We analyze a large data set (more than 550,000 fixations from 235 subjects) and find that, returning to previously fixated locations happens much more often than expected from the statistical properties of eye-movement trajectories. Furthermore, those locations that we return to are not ordinary – they are more salient than locations that we do not return to. Thus, the inconspicuous statement that we look at the same locations twice reveals an important aspect of our strategy to select fixation points: That we trade off exploring our environment against making sure that we have fully comprehended the relevant parts of our environment.

Emotions' impact on viewing behavior under natural conditions

Human overt attention under natural conditions is guided by stimulus features as well as by higher cognitive components, such as task and emotional context. In contrast to the considerable progress regarding the former, insight into the interaction of emotions and attention is limited. Here we investigate the influence of the current emotional context on viewing behavior under natural conditions.In two eye-tracking studies participants freely viewed complex scenes embedded in sequences of emotion-laden images. The latter primes constituted specific emotional contexts for neutral target images.Viewing behavior toward target images embedded into sets of primes was affected by the current emotional context, revealing the intensity of the emotional context as a significant moderator. The primes themselves were not scanned in different ways when presented within a block (Study 1), but when presented individually, negative primes were more actively scanned than positive primes (Study 2). These divergent results suggest an interaction between emotional priming and further context factors. Additionally, in most cases primes were scanned more actively than target images. Interestingly, the mere presence of emotion-laden stimuli in a set of images of different categories slowed down viewing activity overall, but the known effect of image category was not affected. Finally, viewing behavior remained largely constant on single images as well as across the targets' post-prime positions (Study 2).We conclude that the emotional context significantly influences the exploration of complex scenes and the emotional context has to be considered in predictions of eye-movement patterns.

What Guides Visual Overt Attention under Natural Conditions? Past and Future Research

In the last decade, overt attention under natural conditions became a prominent topic in neuroscientific and psychological research. In this context, one central question is “what guides the direction of gaze on complex visual scenes?” In the present review recent research on bottom-up influences on overt attention is presented first. Against this background, strengths and limitations of the bottom-up approach are discussed and future directions in this field are outlined. In addition to that, the current scope on top-down factors in visual attention is enlarged by discussing the impact of emotions and motivational tendencies on viewing behavior. Overall, this review highlights how behavioral and neurophysiological research on overt attention can benefit from a broader scope on influential factors in visual attention.

Emotions and personality traits as high-level factors in visual attention: a review

The visual sense has outstanding significance for human perception and behavior, and visual attention plays a central role in the processing of the sensory input. Thereby, multiple low- and high-level factors contribute to the guidance of attention. The present review focuses on two neglected high-level factors: emotion and personality. The review starts with an overview of different models of attention, providing a conceptual framework and illustrating the nature of low- and high-level factors in visual attention. Then, the ambiguous concept of emotion is described, and recommendations are made for the experimental practice. In the following, we present several studies showing the influence of emotion on overt attention, whereby the distinction between internally and externally located emotional impacts are emphasized. We also provide evidence showing that emotional stimuli influence perceptual processing outside of the focus of attention, whereby results in this field are mixed. Then, we present some detached studies showing the reversed causal effect: attention can also affect emotional responses. The final section on emotion–attention interactions addresses the interplay on the neuronal level, which has been neglected for a long time in neuroscience. In this context, several conceptual recommendations for future research are made. Finally, based on findings showing inter-individual differences in human sensitivity to emotional items, we introduce the wide range of time-independent personality traits that also influence attention, and in this context we try to raise awareness of the consideration of inter-individual differences in the field of neuroscience.