Developmental changes in attention to faces and bodies in static and dynamic scenes

Age differences in orienting to faces in dynamic scenes depend on face centering, not visual saliency

The current study investigated how infants (6-24 months), children (2-12 years), and adults differ in how visual cues-visual saliency and centering-guide their attention to faces in videos. We report a secondary analysis of Kadooka and Franchak (2020), in which observers' eye movements were recorded during viewing of television clips containing a variety of faces. For every face on every video frame, we calculated its visual saliency (based on both static and dynamic image features) and calculated how close the face was to the center of the image. Results revealed that participants of every age looked more often at each face when it was more salient compared to less salient. In contrast, centering did not increase the likelihood that infants looked at a given face, but in later childhood and adulthood, centering became a stronger cue for face looking. A control analysis determined that the age-related change in centering was specific to face looking; participants of all ages were more likely to look at the center of the image, and this center bias did not change with age. The implications for using videos in educational and diagnostic contexts are discussed.

Comparison of Slides and Video Clips as Different Methods for Inducing Emotions: An Electroencephalographic Alpha Modulation Study

Films, compared with emotional static pictures, represent true-to-life dynamic stimuli that are both ecological and effective in inducing an emotional response given the involvement of multimodal stimulation (i.e., visual and auditory systems). We hypothesized that a direct comparison between the two methods would have shown greater efficacy of movies, compared to standardized slides, in eliciting emotions at both subjective and neurophysiological levels. To this end, we compared these two methods of emotional stimulation in a group of 40 young adults (20 females). Electroencephalographic (EEG) Alpha rhythm (8–12 Hz) was recorded from 64 scalp sites while participants watched (in counterbalanced order across participants) two separate blocks of 45 slides and 45 clips. Each block included three groups of 15 validated stimuli classified as Erotic, Neutral and Fear content. Greater self-perceived arousal was found after the presentation of Fear and Erotic video clips compared with the same slide categories. sLORETA analysis showed a different lateralization pattern: slides induced decreased Alpha power (greater activation) in the left secondary visual area (Brodmann Area, BA, 18) to Erotic and Fear compared with the Neutral stimuli. Instead, video clips elicited reduced Alpha in the homologous right secondary visual area (BA 18) again to both Erotic and Fear contents compared with Neutral ones. Comparison of emotional stimuli showed smaller Alpha power to Erotic than to Fear stimuli in the left precuneus/posterior cingulate cortex (BA 7/31) for the slide condition, and in the left superior parietal lobule (BA 7) for the clip condition. This result matched the parallel analysis of the overlapped Mu rhythm (corresponding to the upper Alpha band) and can be interpreted as Mu/Alpha EEG suppression elicited by greater motor action tendency to Erotic (approach motivation) compared to Fear (withdrawal motivation) stimuli. Correlation analysis found lower Alpha in the left middle temporal gyrus (BA 21) associated with greater pleasantness to Erotic slides (r38 = –0.62, p = 0.009), whereas lower Alpha in the right supramarginal/angular gyrus (BA 40/39) was associated with greater pleasantness to Neutral clips (r38 = –0.69, p = 0.012). Results point to stronger emotion elicitation of movies vs. slides, but also to a specific involvement of the two hemispheres during emotional processing of slides vs. video clips, with a shift from the left to the right associative visual areas.

Inhibiting saccades to a social stimulus: a developmental study

Faces are an important source of social signal throughout the lifespan. In adults, they have a prioritized access to the orienting system. Here we investigate when this effect emerges during development. We tested 139 children, early adolescents, adolescents and adults in a mixed pro- and anti-saccades task with faces, cars or noise patterns as visual targets. We observed an improvement in performance until about 15 years of age, replicating studies that used only meaningless stimuli as targets. Also, as previously reported, we observed that adults made more direction errors to faces than abstract patterns and cars. The children showed this effect too with regards to noise patterns but it was not specific since performance for cars and faces did not differ. The adolescents, in contrast, made more errors for faces than for cars but as many errors for noise patterns and faces. In all groups latencies for pro-saccades were faster towards faces. We discuss these findings with regards to the development of executive control in childhood and adolescence and the influence of social stimuli at different ages.

Gaze patterns in viewing static and dynamic body expressions

Evidence for the importance of bodily cues for emotion recognition has grown over the last two decades. Despite this growing literature, it is underspecified how observers view whole bodies for body expression recognition. Here we investigate to which extent body-viewing is face- and context-specific when participants are categorizing whole body expressions in static (Experiment 1) and dynamic displays (Experiment 2). Eye-movement recordings showed that observers viewed the face exclusively when visible in dynamic displays, whereas viewing was distributed over head, torso and arms in static displays and in dynamic displays with faces not visible. The strong face bias in dynamic face-visible expressions suggests that viewing of the body responds flexibly to the informativeness of facial cues for emotion categorisation. However, when facial expressions are static or not visible, observers adopt a viewing strategy that includes all upper body regions. This viewing strategy is further influenced by subtle viewing biases directed towards emotion-specific body postures and movements to optimise recruitment of diagnostic information for emotion categorisation.

Changes in infant visual attention when observing repeated actions

Infants' early visual preferences for faces, and their observational learning abilities, are well-established in the literature. The current study examines how infants' attention changes as they become increasingly familiar with a person and the actions that person is demonstrating. The looking patterns of 12- (n = 61) and 16-month-old infants (n = 29) were tracked while they watched videos of an adult presenting novel actions with four different objects three times. A face-to-action ratio in visual attention was calculated for each repetition and summarized as a mean across all videos. The face-to-action ratio increased with each action repetition, indicating that there was an increase in attention to the face relative to the action each additional time the action was demonstrated. Infant's prior familiarity with the object used was related to face-to-action ratio in 12-month-olds and initial looking behavior was related to face-to-action ratio in the whole sample. Prior familiarity with the presenter, and infant gender and age, were not related to face-to-action ratio. This study has theoretical implications for face preference and action observations in dynamic contexts.

Do People "Pop Out"?

The human body is a highly familiar and socially very important object. Does this mean that the human body has a special status with respect to visual attention? In the current paper we tested whether people in natural scenes attract attention and “pop out” or, alternatively, are at least searched for more efficiently than targets of another category (machines). Observers in our study searched a visual array for dynamic or static scenes containing humans amidst scenes containing machines and vice versa. The arrays consisted of 2, 4, 6 or 8 scenes arranged in a circular array, with targets being present or absent. Search times increased with set size for dynamic and static human and machine targets, arguing against pop out. However, search for human targets was more efficient than for machine targets as indicated by shallower search slopes for human targets. Eye tracking further revealed that observers made more first fixations to human than to machine targets and that their on-target fixation durations were shorter for human compared to machine targets. In summary, our results suggest that searching for people in natural scenes is more efficient than searching for other categories even though people do not pop out.

Reduced gaze following and attention to heads when viewing a "live" social scene

Social stimuli are known to both attract and direct our attention, but most research on social attention has been conducted in highly controlled laboratory settings lacking in social context. This study examined the role of social context on viewing behaviour of participants whilst they watched a dynamic social scene, under three different conditions. In two social groups, participants believed they were watching a live webcam of other participants. The socially-engaged group believed they would later complete a group task with the people in the video, whilst the non-engaged group believed they would not meet the people in the scene. In a third condition, participants simply free-viewed the same video with the knowledge that it was pre-recorded, with no suggestion of a later interaction. Results demonstrated that the social context in which the stimulus was viewed significantly influenced viewing behaviour. Specifically, participants in the social conditions allocated less visual attention towards the heads of the actors in the scene and followed their gaze less than those in the free-viewing group. These findings suggest that by underestimating the impact of social context in social attention, researchers risk coming to inaccurate conclusions about how we attend to others in the real world.

Neural signals evoked by stimuli of increasing social scene complexity are detectable at the single-trial level and right lateralized

Classification of neural signals at the single-trial level and the study of their relevance in affective and cognitive neuroscience are still in their infancy. Here we investigated the neurophysiological correlates of conditions of increasing social scene complexity using 3D human models as targets of attention, which may also be important in autism research. Challenging single-trial statistical classification of EEG neural signals was attempted for detection of oddball stimuli with increasing social scene complexity. Stimuli had an oddball structure and were as follows: 1) flashed schematic eyes, 2) simple 3D faces flashed between averted and non-averted gaze (only eye position changing), 3) simple 3D faces flashed between averted and non-averted gaze (head and eye position changing), 4) animated avatar alternated its gaze direction to the left and to the right (head and eye position), 5) environment with 4 animated avatars all of which change gaze and one of which is the target of attention. We found a late (> 300 ms) neurophysiological oddball correlate for all conditions irrespective of their complexity as assessed by repeated measures ANOVA. We attempted single-trial detection of this signal with automatic classifiers and obtained a significant balanced accuracy classification of around 79%, which is noteworthy given the amount of scene complexity. Lateralization analysis showed a specific right lateralization only for more complex realistic social scenes. In sum, complex ecological animations with social content elicit neurophysiological events which can be characterized even at the single-trial level. These signals are right lateralized. These finding paves the way for neuroscientific studies in affective neuroscience based on complex social scenes, and given the detectability at the single trial level this suggests the feasibility of brain computer interfaces that can be applied to social cognition disorders such as autism.