The eye contact effect: mechanisms and development

The role of task-irrelevant configural and featural face processing in the selective attention to gaze

In face processing theories, it is commonly proposed that structural and social information of faces are processed through different pathways. Recent research suggests that the type of face processing (i.e., configural/featural) can influence how social information is processed. However, the influence of face processing type on the perception of gaze, a crucial social cue, remains unclear. This study aimed to investigate how task-irrelevant face processing influences attentional selection to gaze. Using a visual search paradigm, the study examined participants' ability to detect direct and averted gaze in arrays of configural or featural faces. The rectangular array was adopted in Experiment 1 and the diamond array was adopted in Experiment 2. Behavioral results of two experiments showed that detecting averted gaze among direct gazes was more efficient than the reverse, particularly in featural faces. The ERP findings showed that task-irrelevant facial processing types influence attention selection to gaze in a rectangular array (Experiment 1), but not in a diamond array (Experiment 2). Averted gaze captures more attention than direct gaze in both configural and featural processing when presented in the right visual field, while direct gaze in featural processing exhibits more attentional suppression than averted gaze in the left visual field. Overall, this study underscores the dynamic interplay of different types of information during face perception.

Differences in Gaze Patterns for Facial Areas of the Asian Human Face between Female Patients Undergoing Upper Blepharoplasty and Nonoperators: An Eye-Tracking Analysis

Blepharoplasty's psychological effects are well-studied, but its impact on social cognition, particularly gaze behavior, remains unexplored. Understanding how cosmetic surgery alters visual attention to faces has implications for patient counseling and social interaction research.We hypothesized that postblepharoplasty patients would exhibit altered gaze patterns, specifically increased attention to eyes due to heightened self-awareness. Primary outcomes were fixation duration and time to first fixation on facial regions.Case-control study (STROBE guidelines) comparing 20 females who underwent upper blepharoplasty alone with 20 nonoperated controls.Participants viewed standardized AI-generated Asian faces while eye-tracking recorded fixation metrics. ANOVA compared groups (IRB-approved). AI was used solely for image generation.Patients after upper blepharoplasty alone showed longer eye fixation (male: p = 0.03; female: p = 0.041) and faster female eye fixation (p = 0.029). Male forehead fixation increased (p = 0.004). Other regions showed no difference.Blepharoplasty modifies visual attention, potentially reflecting postsurgical self-perception changes. Findings suggest cosmetic procedures may influence social cognition.

An interaction-centric approach for quantifying eye-to-eye reciprocal interaction

This study presents an interaction-centric framework for analytically investigating brain-to-brain dynamics during eye contact, advancing beyond the traditional spectator model. The foundation of the interactor approach is to delineate the interaction. To achieve this, simultaneous brain activity engaged in eye contact was captured using hyperscanning fMRI. The BOLD responses were first divided into eye-to-eye reciprocal interaction and eye-to-face non-reciprocal communication based on the experimental design; then the reciprocal interaction response was further differentiated into sensory-based (exogenous) and mind-based (endogenous) components to characterize agentic interaction. The proposed interactor approach not only determines interaction from dyadic brain states but also computes emergent interactive brain states arising from the interaction. To achieve these, reciprocal interactive fMRI responses were quantified into an interaction matrix, from which interaction-induced communication channels were identified using Correspondence Analysis, and information flow within those channels was measured with Mutual Information. The advantage of the interactor approach is its ability to reveal emergent dyadic brain states that a spectator approach cannot fully unravel. When applied to parent-child eye contact, this method confirmed existing developmental findings, clarified previous inconsistencies, and uncovered new insights into how reciprocal social engagement shapes brain function.

Attention to direct gaze in young and older adulthood

Attention to others' direct gaze supports many social-cognitive processes (e.g., emotion recognition, joint attention) that are known to decline with age, but it remains to be established whether attention to direct gaze itself is associated with age-related changes. We address this question across two studies. In Study 1, young (n = 42) and older (n = 45) adults completed response time tasks with non-predictive direct gaze cues and predictive direct gaze cues, designed to index reflexive and volitional covert attentional orienting to direct gaze, respectively. The results showed that young and older adults equivalently shifted their attention to predictive direct gaze cues but did not shift their attention to non-predictive direct gaze cues. Study 2 was designed to assess whether this orienting to predictive direct gaze was unique to direct gaze. A separate independent sample of young (n = 43) and older (n = 44) adults completed response time tasks with predictive direct gaze cues, predictive averted gaze cues, and predictive non-social (line orientation) cues. Attention was shifted to direct gaze but neither averted gaze nor line orientation, suggesting direct gaze was unique in being voluntarily attended-to. Pooling the predictive direct gaze task data across Studies 1 and 2, we found that young and older adults both oriented to the direct gaze cues, but that this orienting effect was reduced among older adults. The findings presented here provide novel insights into how direct gaze cues uniquely capture attention in younger and older age, and show for the first time that voluntary orienting to direct gaze is reduced in older adults. Theoretical implications are discussed.

Direct and averted gaze modulate the event-related brain responses to social exclusion signals

Social exclusion is a negative experience in social interaction which can be modulated by the perceived eye gaze. In our Cyberball study, we asked how gaze direction - direct versus averted - affects the processing of social exclusion by using electroencephalogram (EEG) methods. Participants encountered neutral gazes in the inclusion phase (Block1) and then either direct or averted gazes during the exclusion phase (Block2). We measured self-reports on Need-Threat Questionnaires (belonging, control, meaningful existence, self-esteem) and negative mood, along with event-related potentials (ERPs), specifically the P3 component (P300) - an indicator of expectation violation. Findings demonstrated that the P3 amplitude showed differential changes between gaze conditions during the transition from inclusion to exclusion, with direct gaze eliciting stronger neural responses. This difference signals that direct gaze enhances the expected participation, thus sensitizing participants for exclusionary signals. Simultaneously, self-reports indicated that the transition evoked weaker negative emotions in the direct gaze group and stronger negative emotions in the averted gaze group, signalling that direct gaze also serves as an affiliative signal. These results illuminate how gaze directions shape cognitive and emotional reactions to social exclusion. However, further research is necessary to unravel these effects amidst other non-verbal cues and fully comprehend their impact on neural and behavioural responses to social exclusion.

Eye configuration influences the detection advantage of direct gaze

Research has shown that individuals detect direct eyes (those directed to the observer) more quickly and accurately than averted eyes (those directed elsewhere), a phenomenon known as the direct-gaze advantage. However, the underlying mechanisms of this advantage remain poorly understood. The current study employed a visual search task to investigate whether the direct-gaze advantage in capturing attention is contingent upon a specific configuration (face configuration or eyes configuration). In two experiments, participants were presented with four images and asked to judge whether there was a target with a direct or averted gaze. Experiment 1 revealed that participants showed the direct-gaze advantage across three image types: intact faces (maintaining both two-eye and face configuration), scrambled faces with intact eyes (disrupting the face configuration while preserving the two-eye configuration), and fully scrambled faces (preserving only the single-eye configuration). Experiment 2 further demonstrated that participants showed the direct-gaze advantage for scrambled faces with intact eyes and fully scrambled faces under the upright condition. Interestingly, under the inverted condition, participants only showed the direct-gaze advantage for scrambled faces with intact eyes. These findings indicate that the direct-gaze advantage is influenced by the configuration of two eyes and the configuration of a single eye, but it is not dependent on facial contexts.

Automated Autism Assessment With Multimodal Data and Ensemble Learning: A Scalable and Consistent Robot-Enhanced Therapy Framework

Navigating the complexities of Autism Spectrum Disorder (ASD) diagnosis and intervention requires a nuanced approach that addresses both the inherent variability in therapeutic practices and the imperative for scalable solutions. This paper presents a transformative Robot-Enhanced Therapy (RET) framework, leveraging an intricate amalgamation of an Adaptive Boosted 3D biomarker approach and Saliency Maps generated through Kernel Density Estimation. By seamlessly integrating these methodologies through majority voting, the framework pioneers a new frontier in automating the assessment of ASD levels and Autism Diagnostic Observation Schedule (ADOS) scores, offering unprecedented precision and efficiency. Drawing upon the rich tapestry of the DREAM Dataset, encompassing data from 61 children, this study meticulously crafts novel features derived from diverse modalities including body skeleton, head movement, and eye gaze data. Our 3D bio-marker approach achieves a remarkable predictive prowess, boasting a staggering 95.59% accuracy and an F1 score of 92.75% for ASD level prediction, alongside an RMSE of 1.78 and an R-squared value of 0.74 for ADOS score prediction. Furthermore, the introduction of a pioneering saliency map generation method, harnessing gaze data, further enhances predictive models, elevating ASD level prediction accuracy to an impressive 97.36%, with a corresponding F1 score of 95.56%. Beyond technical achievements, this study underscores RET's transformative potential in reshaping ASD intervention paradigms, offering a promising alternative to Standard Human Therapy (SHT) by mitigating therapist variability and providing scalable therapeutic approaches. While acknowledging limitations in the research, such as sample constraints and model generalizability, our findings underscore RET's capacity to revolutionize ASD management.

Synaptic-dependent developmental dysconnectivity in 22q11.2 deletion syndrome

Chromosome 22q11.2 deletion increases the risk of neuropsychiatric disorders like autism and schizophrenia. Disruption of large-scale functional connectivity in 22q11 deletion syndrome (22q11DS) has been widely reported, but the biological factors driving these changes remain unclear. We used a cross-species design to uncover the developmental trajectory and neural underpinnings of brain dysconnectivity in 22q11DS. In LgDel mice, a model for 22q11DS, we found age-specific patterns of brain dysconnectivity, with widespread fMRI hyperconnectivity in juvenile mice reconfiguring to hippocampal hypoconnectivity over puberty. These changes correlated with developmental alterations in dendritic spine density, and both were transiently normalized by GSK3β inhibition, suggesting a synaptic origin for this phenomenon. Notably, analogous pubertal hyperconnectivity-to-hypoconnectivity reconfiguration occurs in human 22q11DS, affecting cortical regions enriched for GSK3β-associated synaptic genes and autism-relevant transcripts. This dysconnectivity also predicts age-dependent social alterations in 22q11DS individuals. These results suggest that synaptic mechanisms underlie developmental brain dysconnectivity in 22q11DS.

Eyebrow movements as signals of communicative problems in human face-to-face interaction

Repair is a core building block of human communication, allowing us to address problems of understanding in conversation. Past research has uncovered the basic mechanisms by which interactants signal and solve such problems. However, the focus has been on verbal interaction, neglecting the fact that human communication is inherently multimodal. Here, we focus on a visual signal particularly prevalent in signalling problems of understanding: eyebrow furrows and raises. We present, first, a corpus study showing that differences in eyebrow actions (furrows versus raises) were systematically associated with differences in the format of verbal repair initiations. Second, we present a follow-up study using an avatar that allowed us to test the causal consequences of addressee eyebrow movements, zooming into the effect of eyebrow furrows as signals of trouble in understanding in particular. The results revealed that addressees' eyebrow furrows have a striking effect on speakers' speech, leading speakers to produce answers to questions several seconds longer than when not perceiving addressee eyebrow furrows while speaking. Together, the findings demonstrate that eyebrow movements play a communicative role in initiating repair during conversation rather than being merely epiphenomenal and that their occurrence can critically influence linguistic behaviour. Thus, eyebrow movements should be considered core coordination devices in human conversational interaction.

Correlation Between Gaze Behaviors and Social Communication Skills of Young Autistic Children: A Meta-Analysis of Eye-Tracking Studies

This meta-analysis examined correlations between eye-tracking measures of gaze behaviors manifested during dynamic salient social stimuli and behavioral assessment measures of social communication skills of young autistic children. We employed a multilevel model with random effects to perform three separate meta-analyses for correlation between social communication skills and (a) all gaze behaviors, (b) gaze duration, and (c) gaze transition. Subsequently, we performed meta-regression to assess the role of four moderators, including age, continuum of naturalness of stimuli, gaze metric, and area of interest, on correlation effect sizes that were heterogeneous at the population level. A total of 111 correlation coefficients from 17 studies for 1132 young autistic children or children with high-likelihood for autism (Mage range = 6-95 months) were included in this meta-analysis. The correlation effect sizes for all three meta-analyses were significant, supporting the relation between improved gaze behaviors and better social communication skills. In addition, age, gaze metric, and area of interest were significant moderators. This suggests the importance of identifying meaningful gaze behaviors related to social communication skills and the increasingly influential role of gaze behaviors in shaping social communication skills as young autistic children progress through the early childhood stage. The continuum of naturalness of stimuli, however, was revealed to trend towards having a significant moderating effect. Lastly, it is important to note the evidence of potential publication bias. Our findings are discussed in the context of early identification and intervention and unraveling the complex nature of autism.

Altered interactive dynamics of gaze behavior during face-to-face interaction in autistic individuals: a dual eye-tracking study

BACKGROUND

Previous eye-tracking research on autistic individuals has mostly examined the gaze behavior of one individual in response to social stimuli presented on a computer screen, suggesting that there is atypical gaze behavior. However, it is unknown how these findings translate to the interactive dynamics of gaze behavior during "face-to-face" encounters between two individuals. Only by analyzing the gaze behaviour of both interaction partners is it possible to determine the frequency of actual eye-contact and who initiates or breaks such periods of mutual eye gaze. The knowledge gained from this analysis could contribute to theorizing about the psychological mechanisms (e.g., gaze avoidance vs. gaze indifference) underlying autism.

METHODS

The present study applied a novel dual eye-tracking setup that allows the assessment and analysis of the interactive dynamics of gaze behavior regarding (i) mutual eye gaze (i.e., eye contact), (ii) initiations, and (iii) break-ups of eye contact. Participants (37 autistic individuals, 37 age- and IQ-matched neurotypical individuals) performed a semi-standardized social interaction (i.e., Fast Friends Procedure) with a confederate (trained to interact in a standardized manner).

RESULTS

Eye contact was reduced in interactions involving autistic individuals. Additional analyses revealed that this reduction was primarily due to the more frequent breaking of eye contact by these individuals. We also found considerable heterogeneity among autistic individuals, with atypical gaze behavior present in only about half of the sample.

LIMITATIONS

Further research is required to determine whether the interactive dynamics of gaze behavior observed in this dual eye-tracking setup can be generalized to real-world situations. Future studies could also include arousal-related physiological measures.

CONCLUSIONS

By tracking the gaze behavior of two interacting individuals, this study reveals specific atypicalities in the interactive dynamics of gaze behavior in a subset of autistic individuals, potentially informing diagnostic and therapeutic decisions. More broadly, our study highlights the added value of dual eye-tracking in elucidating the interactive nature of social encounters in both neurodiverse and neurotypical individuals.

TRIAL REGISTRATION

The study was registered as a clinical trial before starting data collection ( https://drks.de/search/en/trial/DRKS00018957 ; Registration Date: 12/17/2019).

Multimodal analysis of mother-child interaction using hyperscanning and diffusion maps

The current work aims to reveal mother-child synchronization patterns using several interaction modalities and combining them using the diffusion maps method. Twenty-two Hebrew-speaking toddlers (ages = 33 ± 5.38 months, 17 males) and their mothers (ages = 35 ± 5.79 years) participated in two interaction conditions while data was collected from several modalities, i.e. EEG, joint attention (measured through video coding of looking behavior), and motion analysis. Dimension reduction and data fusion of these modalities were performed using diffusion maps to enable a comprehensive assessment of mother-child synchronization dynamics. This multimodal approach allows better characterization of mother-child interaction and examining the associations between interaction patterns and maternal parenting style and their importance to the child's long-term language abilities.

How eccentricity modulates attention capture by direct face/gaze and sudden onset motion

We investigated how processing benefits for direct face/gaze and sudden onset motion depend on stimulus presentation location, specifically eccentricity from fixation. Participants responded to targets that were presented on one of four stimuli that displayed a direct or averted face and gaze either statically or suddenly. Between participants, stimuli were presented at different eccentricities relative to central fixation, spanning 3.3°, 4.3°, 5.5° or 6.5° of the visual field. Replicating previous studies, we found processing advantages for direct (vs. averted) face/gaze and motion onset (vs. static stimuli). Critically, while the motion-onset advantage increased with increasing distance to the center, the face/gaze direction advantage was not significantly modulated by target eccentricity. Results from a control experiment with eye tracking indicate that face/gaze direction could be accurately discriminated even at the largest eccentricity. These findings demonstrate a distinction between the processing of basic facial and gaze signals and exogenous motion cues, which may be based on functional differences between central and peripheral retinal regions. Moreover, the results highlight the importance of taking specific stimulus properties into account when studying perception and attention in the periphery.

The fundamentals of eye tracking part 2: From research question to operationalization

In this article, we discuss operationalizations and examples of experimental design in eye-tracking research. First, we distinguish direct operationalization for entities like saccades, which are closely aligned with their original concepts, and indirect operationalization for concepts not directly measurable, such as attention or mind-wandering. The latter relies on selecting a measurable proxy. Second, we highlight the variability in algorithmic operationalizations and emphasize that changing parameters can affect outcome measures. Transparency in reporting these parameters and algorithms is crucial for comparisons across studies. Third, we provide references to studies for common operationalizations in eye-tracking research and discuss key operationalizations in reading research. Fourth, the IO-model is introduced as a tool to help researchers operationalize difficult concepts. Finally, we present three example experiments with useful methods for eye-tracking research, encouraging readers to consider these examples for inspiration in their own experiments.

Task difficulty modulates the effect of eye contact on word memory in females

BACKGROUND

The influence of eye contact on memory has been a topic of extensive study, yet its effects remain ambiguous. This inconsistency may be attributed to the varying levels of task difficulty encountered when conducting this type of research.

METHODS

To explore this possibility, our study used a word memory task that also integrated eye gaze as a means of examining how task difficulty (easy or difficult) modulates the effect of eye contact on word memory. A total of 41 participants engaged in the memory task under varying eye contact conditions.

RESULTS

Our findings revealed a significant interaction between task difficulty and eye contact: For easy tasks, memory accuracy was lower with eye contact, whereas for difficult tasks, accuracy was improved with eye contact. Intriguingly, this effect was predominantly observed in female participants. In easy tasks, eye contact appeared to hinder memory performance in females, whereas it enhanced performance in difficult tasks.

CONCLUSIONS

These results suggest that the impact of eye contact on memory is not uniformly positive or negative, but is instead contingent on task complexity and influenced by gender differences. This study contributes new insights into the fluctuating effects of eye contact on memory, thereby enriching our understanding of the relationship between nonverbal social cues and cognitive processes.

Neural correlates of facial recognition deficits in autism spectrum disorder: a comprehensive review

Autism spectrum disorder (ASD) is a neurodevelopmental condition characterized by significant impairments in social interaction, often manifested in facial recognition deficits. These deficits hinder individuals with ASD from recognizing facial identities and interpreting emotions, further complicating social communication. This review explores the neural mechanisms underlying these deficits, focusing on both functional anomalies and anatomical differences in key brain regions such as the fusiform gyrus (FG), amygdala, superior temporal sulcus (STS), and prefrontal cortex (PFC). It has been found that the reduced activation in the FG and atypical activation of the amygdala and STS contribute to difficulties in processing facial cues, while increased reliance on the PFC for facial recognition tasks imposes a cognitive load. Additionally, disrupted functional and structural connectivity between these regions further exacerbates facial recognition challenges. Future research should emphasize longitudinal, multimodal neuroimaging approaches to better understand developmental trajectories and design personalized interventions, leveraging AI and machine learning to optimize therapeutic outcomes for individuals with ASD.

Big brother: the effects of surveillance on fundamental aspects of social vision

Despite the dramatic rise of surveillance in our societies, only limited research has examined its effects on humans. While most research has focused on voluntary behaviour, no study has examined the effects of surveillance on more fundamental and automatic aspects of human perceptual awareness and cognition. Here, we show that being watched on CCTV markedly impacts a hardwired and involuntary function of human sensory perception-the ability to consciously detect faces. Using the method of continuous flash suppression (CFS), we show that when people are surveilled (N = 24), they are quicker than controls (N = 30) to detect faces. An independent control experiment (N = 42) ruled out an explanation based on demand characteristics and social desirability biases. These findings show that being watched impacts not only consciously controlled behaviours but also unconscious, involuntary visual processing. Our results have implications concerning the impacts of surveillance on basic human cognition as well as public mental health.

The emotion of sound target modulates the auditory gaze cueing effect

The auditory gaze cueing effect (auditory-GCE) is a faster response to auditory targets at an eye-gaze cue location than at a non-cue location. Previous research has found that auditory-GCE can be influenced by the integration of both gaze direction and emotion conveyed through facial expressions. However, it is unclear whether the emotional information of auditory targets can be cross-modally integrated with gaze direction to affect auditory-GCE. Here, we set neutral faces with different gaze directions as cues and three emotional sounds (fearful, happy, and neutral) as targets to investigate how the emotion of sound target modulates the auditory-GCE. Moreover, we conducted a controlled experiment using arrow cues. The results show that the emotional content of sound targets influences the auditory-GCE but only for those induced by facial cues. Specifically, fearful sounds elicit a significantly larger auditory-GCE compared to happy and neutral sounds, indicating that the emotional content of auditory targets plays a modulating role in the auditory-GCE. Furthermore, this modulation appears to occur only at a higher level of social meaning, involving the integration of emotional information from a sound with social gaze direction, rather than at a lower level, which involves the integration of direction and auditory emotion.

Atypical prefrontal neural activity during an emotional interference control task in adolescents with autism spectrum disorder: A functional near-infrared spectroscopy study

Autism spectrum disorder (ASD) is typically characterized by impairments in social interaction and communication, which may be associated with a failure to naturally orient to social stimuli, particularly in recognizing and responding to facial emotions. As most previous studies have used nonsocial stimuli to investigate inhibitory control in children and adults with ASD, little is known about the behavioral and neural activation patterns of emotional inhibitory control in adolescent with ASD. Functional neuroimaging studies have underscored the key role of the prefrontal cortex (PFC) in inhibitory control and emotional face processing. Thus, this study aimed to examine whether adolescent with ASD exhibited altered PFC processing during an emotional Flanker task by using non-invasive functional near-infrared spectroscopy (fNIRS). Twenty-one adolescents with high-functioning ASD and 26 typically developing (TD) adolescents aged 13-16 years were recruited. All participants underwent an emotional Flanker task, which required to decide whether the centrally positioned facial emotion is consistent with the laterally positioned facial emotion. TD adolescents exhibited larger RT and mean O2Hb level in the incongruent condition than the congruent condition, evoking cortical activations primarily in right PFC regions in response to the emotional Flanker effect. In contrast, ASD adolescents failed to exhibit the processing advantage for congruent versus incongruent emotional face in terms of RT, but showed cortical activations primarily in left PFC regions in response to the emotional Flanker effect. These findings suggest that adolescents with ASD rely on different neural strategies to mobilize PFC neural resources to address the difficulties they experience when inhibiting the emotional face.

Pupil size and iris brightness interact to affect prosocial behaviour and affective responses

Despite the tight link between the visibility of the iris and pupil, the perceived effects of these two have been studied largely in isolation. We demonstrate, across two experimental studies, that the effects of perceived pupil size are dependent on the visibility of the iris. In a first study, our participants donated more and had more positive impressions of portraits of non-human primates when these were manipulated to appear having larger pupils. Post-hoc inspection of our data suggested that the difference was greater for species with more conspicuous irises. In a second study, we concomitantly manipulated iris brightness and pupil size. Brighter irises and larger pupils elicited greater donations. Participants rated photographs with brighter irises as cuter, more attractive and friendlier, but only when they had dilated pupils. Our results have methodological implications for studies manipulating eye appearance, and help interpret results from previous studies.

Nearsighted empathy: exploring the effect of empathy on distance perception, with eye movements as modulators

Empathy, a cornerstone of social interaction, involves shared representation, eliciting vicarious emotions. However, its influence on shared perceptual representations, particularly in foundational domains such as distance perception, remains unexplored. In this study, we introduce a novel adaptation of the empathy for pain task to investigate empathy's influence on distance perception. We also examine how two personality traits, trait empathy and alexithymia, modulate this relationship. Utilizing eye-tracking technology, we examine how attention allocation to different facial and bodily features affects empathy's impact on distance perception. Our findings indicate that empathy biases individuals to perceive targets as closer, with trait empathy reinforcing this effect and alexithymia attenuating it. Furthermore, we demonstrate that heightened attention to eyes and face correlates with perceiving targets as closer, while attention to hand shows the opposite trend. These results underscore the broader influence of empathy beyond shared emotions, revealing its capacity to alter perceptual processes. By elucidating the interplay between personality traits and visual inputs in shaping these alterations, our study offers valuable insights for future research exploring the role of shared representation in empathy across various perceptual domains.

Gaze behavior in response to affect during natural social interactions

Attention in social interactions is directed by social cues such as the face or eye region of an interaction partner. Several factors that influence these attentional biases have been identified in the past. However, most findings are based on paradigms with static stimuli and no interaction potential. Therefore, the current study investigated the influence of one of these factors, namely facial affect in natural social interactions using an evaluated eye-tracking setup. In a sample of 35 female participants, we examined how individuals' gaze behavior responds to changes in the facial affect of an interaction partner trained in affect modulation. Our goal was to analyze the effects on attention to facial features and to investigate their temporal dynamics in a natural social interaction. The study results, obtained from both aggregated and dynamic analyses, indicate that facial affect has only subtle influences on gaze behavior during social interactions. In a sample with high measurement precision, these findings highlight the difficulties of capturing the subtleties of social attention in more naturalistic settings. The methodology used in this study serves as a foundation for future research on social attention differences in more ecologically valid scenarios.

Prioritization of social information processing: Eye gaze elicits earlier vMMN than arrows

Numerous research studies have demonstrated that eye gaze and arrows act as cues that automatically guide spatial attention. However, it remains uncertain whether the attention shifts triggered by these two types of stimuli vary in terms of automatic processing mechanisms. In our current investigation, we employed an equal probability paradigm to explore the likenesses and distinctions in the neural mechanisms of automatic processing for eye gaze and arrows in non-attentive conditions, using visual mismatch negative (vMMN) as an indicator of automatic processing. The sample size comprised 17 participants. The results indicated a significant interaction between time duration, stimulus material, and stimulus type. The findings demonstrated that both eye gaze and arrows were processed automatically, triggering an early vMMN, although with temporal variations. The vMMN for eye gaze occurred between 180 and 220 ms, whereas for arrows it ranged from 235 to 275 ms. Moreover, arrow stimuli produced a more pronounced vMMN amplitude. The earlier vMMN response to eye gaze compared with arrows implies the specificity and precedence of social information processing associated with eye gaze over the processing of nonsocial information with arrows. However, arrow could potentially elicit a stronger vMMN because of their heightened salience compared to the background, and the expansion of attention focusing might amplify the vMMN impact. This study offers insights into the similarities and differences in attention processing of social and non-social information under unattended conditions from the perspective of automatic processing.

Interacting with autistic virtual characters: intrapersonal synchrony of nonverbal behavior affects participants' perception

Temporal coordination of communicative behavior is not only located between but also within interaction partners (e.g., gaze and gestures). This intrapersonal synchrony (IaPS) is assumed to constitute interpersonal alignment. Studies show systematic variations in IaPS in individuals with autism, which may affect the degree of interpersonal temporal coordination. In the current study, we reversed the approach and mapped the measured nonverbal behavior of interactants with and without ASD from a previous study onto virtual characters to study the effects of the differential IaPS on observers (N = 68), both with and without ASD (crossed design). During a communication task with both characters, who indicated targets with gaze and delayed pointing gestures, we measured response times, gaze behavior, and post hoc impression formation. Results show that character behavior indicative of ASD resulted in overall enlarged decoding times in observers and this effect was even pronounced in observers with ASD. A classification of observer's gaze types indicated differentiated decoding strategies. Whereas non-autistic observers presented with a rather consistent eyes-focused strategy associated with efficient and fast responses, observers with ASD presented with highly variable decoding strategies. In contrast to communication efficiency, impression formation was not influenced by IaPS. The results underline the importance of timing differences in both production and perception processes during multimodal nonverbal communication in interactants with and without ASD. In essence, the current findings locate the manifestation of reduced reciprocity in autism not merely in the person, but in the interactional dynamics of dyads.

Infants' psychophysiological responses to eye contact with a human and with a humanoid robot

Eye contact with a human and with a humanoid robot elicits attention- and affect-related psychophysiological responses. However, these responses have mostly been studied in adults, leaving their developmental origin poorly understood. In this study, 114 infants (6-8 months old) viewed direct and averted gaze directions of a live human and an embodied humanoid robot while their heart rate deceleration (attention orienting), skin conductance (affective arousal), and facial muscle activity (affective valence) were measured. In addition, a non-humanoid object (a vase) was used as a control stimulus. Infants' attention orienting was stronger to averted versus direct gaze of a human and a robot, but indifferent to the averted versus direct orientation of the non-humanoid object. Moreover, infants' attention orienting was equally intensive toward a human and a robot, but less intensive toward a non-humanoid object. Affective arousal was insensitive to gaze direction and did not differ between the human, the robot, and the non-humanoid object. Facial muscle responses showed sensitivity to the gaze direction of a human and of a robot but not to the orientation of the non-humanoid object. These results suggest that infants recognize the attentional and affective/affiliative significance not only in a human's gaze but also in a robot's gaze.

Variations in the Appearance and Interpretation of Interpersonal Eye Contact in Social Categorizations and Psychiatric Populations Worldwide: A Scoping Review with a Critical Appraisal of the Literature

BACKGROUND

Eye contact is one of the most fundamental forms of interhuman communication. However, to date, there has been no comprehensive research comparing how eye contact is made and interpreted in all possible populations worldwide. This study presents a summary of the existing literature on these modalities stratified to social categorizations and psychiatric disorders.

METHOD

A scoping review with critical appraisal of the literature according to the Joanna Briggs Institute (JBI) methodology. Databases AnthroSource, Medline, CINAHL, the Psychology and Behavioral Sciences Collection (EBSCO) and PsychInfo were searched.

RESULTS

7068 articles were screened for both the grey literature and reference lists, of which 385 were included, 282 for social categorizations and 103 for psychiatric disorders. In total, 603 thematic clustered outcomes of variations were included. Methodological quality was generally moderate to good.

CONCLUSIONS

There is a great degree of variation in the presentation and interpretation of eye contact between and within populations. It remains unclear why specific variations occur in populations. Additionally, no gold standard for how eye contact should be used or interpreted emerged from the studies. Further research into the reason for differences in eye contact between and within populations is recommended.

Utilizing deep learning models in an intelligent eye-tracking system for autism spectrum disorder diagnosis

Timely and unbiased evaluation of Autism Spectrum Disorder (ASD) is essential for providing lasting benefits to affected individuals. However, conventional ASD assessment heavily relies on subjective criteria, lacking objectivity. Recent advancements propose the integration of modern processes, including artificial intelligence-based eye-tracking technology, for early ASD assessment. Nonetheless, the current diagnostic procedures for ASD often involve specialized investigations that are both time-consuming and costly, heavily reliant on the proficiency of specialists and employed techniques. To address the pressing need for prompt, efficient, and precise ASD diagnosis, an exploration of sophisticated intelligent techniques capable of automating disease categorization was presented. This study has utilized a freely accessible dataset comprising 547 eye-tracking systems that can be used to scan pathways obtained from 328 characteristically emerging children and 219 children with autism. To counter overfitting, state-of-the-art image resampling approaches to expand the training dataset were employed. Leveraging deep learning algorithms, specifically MobileNet, VGG19, DenseNet169, and a hybrid of MobileNet-VGG19, automated classifiers, that hold promise for enhancing diagnostic precision and effectiveness, was developed. The MobileNet model demonstrated superior performance compared to existing systems, achieving an impressive accuracy of 100%, while the VGG19 model achieved 92% accuracy. These findings demonstrate the potential of eye-tracking data to aid physicians in efficiently and accurately screening for autism. Moreover, the reported results suggest that deep learning approaches outperform existing event detection algorithms, achieving a similar level of accuracy as manual coding. Users and healthcare professionals can utilize these classifiers to enhance the accuracy rate of ASD diagnosis. The development of these automated classifiers based on deep learning algorithms holds promise for enhancing the diagnostic precision and effectiveness of ASD assessment, addressing the pressing need for prompt, efficient, and precise ASD diagnosis.

Gaze detection as a social cue to initiate natural human-robot collaboration in an assembly task

Introduction: In this work we explore a potential approach to improve human-robot collaboration experience by adapting cobot behavior based on natural cues from the operator. Methods: Inspired by the literature on human-human interactions, we conducted a wizard-of-oz study to examine whether a gaze towards the cobot can serve as a trigger for initiating joint activities in collaborative sessions. In this study, 37 participants engaged in an assembly task while their gaze behavior was analyzed. We employed a gaze-based attention recognition model to identify when the participants look at the cobot. Results: Our results indicate that in most cases (83.74%), the joint activity is preceded by a gaze towards the cobot. Furthermore, during the entire assembly cycle, the participants tend to look at the cobot mostly around the time of the joint activity. Given the above results, a fully integrated system triggering joint action only when the gaze is directed towards the cobot was piloted with 10 volunteers, of which one characterized by high-functioning Autism Spectrum Disorder. Even though they had never interacted with the robot and did not know about the gaze-based triggering system, most of them successfully collaborated with the cobot and reported a smooth and natural interaction experience. Discussion: To the best of our knowledge, this is the first study to analyze the natural gaze behavior of participants working on a joint activity with a robot during a collaborative assembly task and to attempt the full integration of an automated gaze-based triggering system.

Differential Effects of a Behavioral Treatment Probe on Social Gaze Behavior in Fragile X Syndrome and Non-Syndromic Autism Spectrum Disorder

The purpose of this study was to examine potential differences in social learning between individuals with fragile X syndrome (FXS), the leading known inherited cause of intellectual disability, and individuals with non-syndromic autism spectrum disorder (ASD). Thirty school-aged males with FXS and 26 age and symptom-matched males with non-syndromic ASD, were administered a behavioral treatment probe designed to improve levels of social gaze during interactions with others. The treatment probe was administered by a trained behavior therapist over two days in our laboratory and included reinforcement of social gaze in two alternating training conditions - looking while listening and looking while speaking. Prior to each session, children in each group were taught progressive muscle relaxation and breathing techniques to counteract potential increased hyperarousal. Measures included the rate of learning in each group during treatment, in addition to levels of social gaze and heart rate obtained during administration of a standardized social conversation task administered prior to and following the treatment probe. Results showed that learning rates obtained during administration of the treatment probe were significantly less steep and less variable for males with FXS compared to males with non-syndromic ASD. Significant improvements in social gaze were also observed for males with FXS during the social conversation task. There was no effect of the treatment probe on heart rate in either group. These data reveal important differences in social learning between the two groups and have implications for early interventions in the two conditions.

Infant responses to direct gaze and associations to autism: A live eye-tracking study

LAY ABSTRACT

When other people look directly towards us, we often respond by looking back at them, and such direct-gaze responses are important for establishing eye contact. Atypical eye contact is common in autism, but how and when this aspect of autism develops is not well understood. Here, we studied whether how much and how quickly infants respond to others' direct gaze is associated with autism in toddlerhood. We did this by measuring direct-gaze responses in a playful social interaction using live eye tracking. The study included 169 infants, of whom 129 had an elevated likelihood of developing autism due to having a first-degree family member with the condition, and 40 with typical likelihood of autism. In the elevated likelihood group, 35 were diagnosed with autism spectrum disorder at 3 years of age, and 94 were not. The results showed that infants in all three groups tended to increase their looking towards the adult's face after the adult looked directly at them. However, neither how much nor how quickly the infants responded to direct gaze by looking back at the adult reliably differentiated the infants with or without subsequent autism. While infants in the elevated likelihood of autism and subsequent diagnosis group tended to look away quicker from faces with direct gaze than infants in the typical likelihood group, this measure did not differentiate between the two elevated likelihood groups. We interpret the results as supporting the view that atypical direct-gaze responses are not early markers of autism.

Eye gaze is not unique: The reversed congruency effect on gaze and tongue targets

In the spatial Stroop task, an arrow target produces a spatial Stroop effect, whereas a gaze target elicits a reversed congruency effect. The reversed congruency effect has been explained by the unique attentional mechanisms of eye gaze. However, recent studies have shown that not only gaze but arrow targets produced a reversed congruency effect when embedded in a complex background. The present study investigated whether non-gaze targets produce a reversed congruency effect. In Experiments 1 and 2, we used the tongue, which is not commonly used to indicate spatial directions in daily life, as a target in the spatial Stroop task, in addition to the conventional gaze and arrows. In Experiment 3, we used arrow stimuli embedded in a complex background as a target. Participants judged the left/right direction of the target presented in the left or right visual field. Although arrow and gaze targets replicated previous findings (spatial Stroop and reversed congruency effect, respectively), the tongue target produced a reversed congruency effect (Experiments 1 and 2). The spatial Stroop effect of arrow targets disappeared when they were in a complex background (Experiment 3). These results are inconsistent with previous accounts emphasising the unique status of eye gaze. We propose that temporal decay of the location code and response inhibition are responsible for the reversal of spatial interference.

Sensorimotor regulation of facial expression - An untouched frontier

Facial expression is a critical form of nonverbal social communication which promotes emotional exchange and affiliation among humans. Facial expressions are generated via precise contraction of the facial muscles, guided by sensory feedback. While the neural pathways underlying facial motor control are well characterized in humans and primates, it remains unknown how tactile and proprioceptive information reaches these pathways to guide facial muscle contraction. Thus, despite the importance of facial expressions for social functioning, little is known about how they are generated as a unique sensorimotor behavior. In this review, we highlight current knowledge about sensory feedback from the face and how it is distinct from other body regions. We describe connectivity between the facial sensory and motor brain systems, and call attention to the other brain systems which influence facial expression behavior, including vision, gustation, emotion, and interoception. Finally, we petition for more research on the sensory basis of facial expressions, asserting that incomplete understanding of sensorimotor mechanisms is a barrier to addressing atypical facial expressivity in clinical populations.

The Role of Pathways Early Autism Intervention in Improving Social Skills and Respeto for Young Hispanic Autistic Children

PURPOSE

We know very little about Hispanic autistic children's response to intervention as, historically, Hispanic children are underrepresented in intervention studies. Pathways parent-mediated early autism intervention is one of the few naturalistic developmental behavioral interventions (NDBIs) that is contextually and linguistically responsive to Hispanic families. However, some child-centered NDBI strategies do not align with the Hispanic caregiving value of respeto. A child exhibiting respeto demonstrates affiliative obedience by displaying deference and respect toward adults. Furthermore, theories of the ontogeny of cultural learning suggest that certain levels of social development may be necessary to learn cultural values. The current study investigates (1) the relationship between Hispanic autistic children's social skills and affiliative obedience and (2) the efficacy of Pathways in improving affiliative obedience in Hispanic children.

METHODS

This quasi-experimental design study used preexisting standardized test data and video recordings from 26 Hispanic participants who took part in a previous Pathways efficacy study. Recordings were coded for affiliative obedience and social connectedness. Residual change variables were used to measure progress from baseline to post-intervention, and correlation and hierarchical regression analyses were conducted to analyze the data.

RESULTS

We found significant positive correlations between social skills and children's affiliative obedience for baseline and change variables. In addition, we found Pathways had a significant medium-large magnitude effect on change in affiliative obedience skills.

CONCLUSION

This study highlights the benefits of NDBI interventions that advance social development in autistic children and support Hispanic parents in enculturating their children in the value of respeto.

Neural and affective responses to prolonged eye contact with parents in depressed and nondepressed adolescents

Eye contact improves mood, facilitates connectedness, and is assumed to strengthen the parent-child bond. Adolescent depression is linked to difficulties in social interactions, the parent-child bond included. Our goal was to elucidate adolescents' affective and neural responses to prolonged eye contact with one's parent in nondepressed adolescents (HC) and how these responses are affected in depressed adolescents. While in the scanner, 59 nondepressed and 19 depressed adolescents were asked to make eye contact with their parent, an unfamiliar peer, an unfamiliar adult, and themselves by using videos of prolonged direct and averted gaze, as an approximation of eye contact. After each trial, adolescents reported on their mood and feelings of connectedness, and eye movements and BOLD-responses were assessed. In HCs, eye contact boosted mood and feelings of connectedness and increased activity in inferior frontal gyrus (IFG), temporal pole, and superior frontal gyrus. Unlike HCs, eye contact did not boost the mood of depressed adolescents. While HCs reported increased mood and feelings of connectedness to the sight of their parent versus others, depressed adolescents did not. Depressed adolescents exhibited blunted overall IFG activity. These findings show that adolescents are particularly sensitive to eye contact and respond strongly to the sight of their parents. This sensitivity seems to be blunted in depressed adolescents. For clinical purposes, it is important to gain a better understanding of how the responsivity to eye contact in general and with their parents in particular, can be restored in adolescents with depression.

Designing and Evaluating an Emotionally Responsive Virtual Patient Simulation

INTRODUCTION

Virtual patient (VP) simulations have been widely used for healthcare training, education, and assessment. However, few VP systems have integrated emotion sensing and analyzed how a user's emotions may influence the overall training experience. This article presents a VP that can recognize and respond to 5 human emotions (anger, disgust, fear, joy, and sadness), as well as 2 facial expressions (smiling and eye contact).

METHODS

The VP was developed by combining the capabilities of a facial recognition system, a tone analyzer, a cloud-based artificial intelligence chatbot, and interactive 3-dimensional avatars created in a high-fidelity game engine (Unity). The system was tested with healthcare professionals at Changzhou Traditional Chinese Medicine Hospital.

RESULTS

A total of 65 participants (38 females and 27 males) aged between 23 and 57 years (mean = 38.35, SD = 11.48) completed the survey, and 19 participants were interviewed. Most participants perceived that the VP was useful in improving their communication skills, particularly their nonverbal communication skills. They also reported that adding users' affective states as an additional interaction increased engagement of the VP and helped them build connections with the VP.

CONCLUSIONS

The emotionally responsive VP seemed to be functionally complete and usable. However, some technical limitations need to be addressed before the system's official implementation in real-world clinical practice. Future development will include improving the accuracy of the speech recognition system, using more sophisticated emotion sensing software, and developing a natural user interface.

Autistic young people adaptively use gaze to facilitate joint attention during multi-gestural dyadic interactions

LAY ABSTRACT

Autistic people have been said to have 'problems' with joint attention, that is, looking where someone else is looking. Past studies of joint attention have used tasks that require autistic people to continuously look at and respond to eye-gaze cues. But joint attention can also be done using other social cues, like pointing. This study looked at whether autistic and non-autistic young people use another person's eye gaze during joint attention in a task that did not require them to look at their partner's face. In the task, each participant worked together with their partner to find a computer-generated object in virtual reality. Sometimes the participant had to help guide their partner to the object, and other times, they followed their partner's lead. Participants were told to point to guide one another but were not told to use eye gaze. Both autistic and non-autistic participants often looked at their partner's face during joint attention interactions and were faster to respond to their partner's hand-pointing when the partner also looked at the object before pointing. This shows that autistic people can and do use information from another person's eyes, even when they don't have to. It is possible that, by not forcing autistic young people to look at their partner's face and eyes, they were better able to gather information from their partner's face when needed, without being overwhelmed. This shows how important it is to design tasks that provide autistic people with opportunities to show what they can do.

Off-camera gaze decreases evaluation scores in a simulated online job interview

During the pandemic, digital communication became paramount. Due to the discrepancy between the placement of the camera and the screen in typical smartphones, tablets and laptops, mutual eye contact cannot be made in standard video communication. Although the positive effect of eye contact in traditional communication has been well-documented, its role in virtual contexts remains less explored. In this study, we conducted experiments to gauge the impact of gaze direction during a simulated online job interview. Twelve university students were recruited as interviewees. The interview consisted of two recording sessions where they delivered the same prepared speech: in the first session, they faced the camera, and in the second, they directed their gaze towards the screen. Based on the recorded videos, we created three stimuli: one where the interviewee's gaze was directed at the camera (CAM), one where the interviewee's gaze was skewed downward (SKW), and a voice-only stimulus without camera recordings (VO). Thirty-eight full-time workers participated in the study and evaluated the stimuli. The results revealed that the SKW condition garnered significantly less favorable evaluations than the CAM condition and the VO condition. Moreover, a secondary analysis indicated a potential gender bias in evaluations: the female evaluators evaluated the interviewees of SKW condition more harshly than the male evaluators did, and the difference in some evaluation criteria between the CAM and SKW conditions was larger for the female interviewees than for the male interviewees. Our findings emphasize the significance of gaze direction and potential gender biases in online interactions.

Visual attention patterns during a gaze following task in neurogenetic syndromes associated with unique profiles of autistic traits: Fragile X and Cornelia de Lange syndromes

BACKGROUND

Gaze following difficulties are considered an early marker of autism, thought likely to cumulatively impact the development of social cognition, language and social skills. Subtle differences in gaze following abilities may contribute to the diverse range social and communicative autistic characteristics observed across people with genetic syndromes, such as Cornelia de Lange (CdLS) and fragile X (FXS) syndromes.

AIMS

To compare profiles of 1) visual attention to the eye region at critical points of the attention direction process, 2) whether children follow the gaze cue to the object, and 3) participant looking time to the target object following the gaze cue between groups and conditions.

MATERIALS AND METHODS

Children with CdLS (N = 11) and FXS (N = 8) and autistic (N = 22) and neurotypical (N = 15) children took part in a passive viewing paradigm adapted from Senju and Csibra (2008), in which videos of a central cue (ball/cartoon face/human face) directed attention towards one of two objects. Visual attention patterns were recorded via eye tracking technology.

RESULTS

Neurotypical children were used as a reference group against which the autistic, CdLS and FXS groups were compared. Although autistic children looked at the eye region for significantly less time, they looked at the target object as frequently and for a similar duration as neurotypical children. Children with FXS looked at the target as frequently as neurotypical children but looked at it for comparatively less time. Both neurotypical children and children with CdLS frequently looked at the eye region, but children with CdLS were less likely to look at the target than neurotypical children.

CONCLUSIONS

Findings provide preliminary evidence of unique patterns of visual attention and gaze following strategies in children with CdLS, children with FXS and autistic children. These unique gaze following patterns may underpin the distinct profiles of social and communication autistic traits observed between these groups.

Synaptic-dependent developmental dysconnectivity in 22q11.2 deletion syndrome

Chromosome 22q11.2 deletion is among the strongest known genetic risk factors for neuropsychiatric disorders, including autism and schizophrenia. Brain imaging studies have reported disrupted large-scale functional connectivity in people with 22q11 deletion syndrome (22q11DS). However, the significance and biological determinants of these functional alterations remain unclear. Here, we use a cross-species design to investigate the developmental trajectory and neural underpinnings of brain dysconnectivity in 22q11DS. We find that LgDel mice, an established mouse model of 22q11DS, exhibit age-specific patterns of functional MRI (fMRI) dysconnectivity, with widespread fMRI hyper-connectivity in juvenile mice reverting to focal hippocampal hypoconnectivity over puberty. These fMRI connectivity alterations are mirrored by co-occurring developmental alterations in dendritic spine density, and are both transiently normalized by developmental GSK3β inhibition, suggesting a synaptic origin for this phenomenon. Notably, analogous hyper- to hypoconnectivity reconfiguration occurs also in human 22q11DS, where it affects hippocampal and cortical regions spatially enriched for synaptic genes that interact with GSK3β, and autism-relevant transcripts. Functional dysconnectivity in somatomotor components of this network is predictive of age-dependent social alterations in 22q11.2 deletion carriers. Taken together, these findings suggest that synaptic-related mechanisms underlie developmentally mediated functional dysconnectivity in 22q11DS.

Callous-Unemotional Traits and Emotion Perception Accuracy and Bias in Youths

This study investigated the associations among conduct problems, callous-unemotional (CU) traits, and indices of emotion recognition accuracy and emotion recognition bias obtained from human faces. Impairments in emotion recognition were considered within broader, impaired emotional and social functioning. The sample consisted of 293 middle-school students (51.19% girls; M age = 12.97 years, SD = 0.88 years). In general, CU traits were associated with less accuracy in recognizing emotions, especially fearful and angry faces, and such deficits in emotional recognition were not associated with conduct problems independent of CU traits. These results support the importance of studying potential deficits in the recognition of emotions other than fear. Furthermore, our results support the importance of considering the role of CU traits when studying emotional correlates of conduct problems. For children scoring high on CU traits, the emotion recognition accuracy of anger was low irrespective of the level of conduct problems, whereas in children scoring low on CU traits, less accuracy in recognizing emotions was related to increases in conduct problems. Finally, our results support the need for research to not only focus on accuracy of emotional recognition but also test whether there are specific biases leading to these inaccuracies. Specifically, CU traits were associated not only with lower accuracy in recognizing fearful faces but also with a tendency to interpret fearful faces as angry. This suggests that the emotional deficit associated with CU traits is not just a deficit in empathic concern toward others distress but also includes a tendency to overinterpret emotions as potential threats to oneself.

Depressive symptoms and visual attention to others' eyes in healthy individuals

BACKGROUND

Eye contact is a fundamental part of social interaction. In clinical studies, it has been observed that patients suffering from depression make less eye contact during interviews than healthy individuals, which could be a factor contributing to their social functioning impairments. Similarly, results from mood induction studies with healthy persons indicate that attention to the eyes diminishes as a function of sad mood. The present screen-based eye-tracking study examined whether depressive symptoms in healthy individuals are associated with reduced visual attention to other persons' direct gaze during free viewing.

METHODS

Gaze behavior of 44 individuals with depressive symptoms and 49 individuals with no depressive symptoms was analyzed in a free viewing task. Grouping was based on the Beck Depression Inventory using the cut-off proposed by Hautzinger et al. (2006). Participants saw pairs of faces with direct gaze showing emotional or neutral expressions. One-half of the face pairs was shown without face masks, whereas the other half was presented with face masks. Participants' dwell times and first fixation durations were analyzed.

RESULTS

In case of unmasked facial expressions, participants with depressive symptoms looked shorter at the eyes compared to individuals without symptoms across all expression conditions. No group difference in first fixation duration on the eyes of masked and unmasked faces was observed. Individuals with depressive symptoms dwelled longer on the mouth region of unmasked faces. For masked faces, no significant group differences in dwell time on the eyes were found. Moreover, when specifically examining dwell time on the eyes of faces with an emotional expression there were also no significant differences between groups. Overall, participants gazed significantly longer at the eyes in masked compared to unmasked faces.

CONCLUSIONS

For faces without mask, our results suggest that depressiveness in healthy individuals goes along with less visual attention to other persons' eyes but not with less visual attention to others' faces. When factors come into play that generally amplify the attention directed to the eyes such as face masks or emotions then no relationship between depressiveness and visual attention to the eyes can be established.

Lower maternal emotional availability is related to increased attention toward fearful faces during infancy

It has been suggested that infants' age-typical attention biases for faces and facial expressions have an inherent connection with the parent-infant interaction. However, only a few previous studies have addressed this topic. To investigate the association between maternal caregiving behaviors and an infant's attention for emotional faces, 149 mother-infant dyads were assessed when the infants were 8 months. Caregiving behaviors were observed during free-play interactions and coded using the Emotional Availability Scales. The composite score of four parental dimensions, that are sensitivity, structuring, non-intrusiveness, and non-hostility, was used in the analyses. Attention disengagement from faces was measured using eye tracking and face-distractor paradigm with neutral, happy, and fearful faces and scrambled-face control pictures as stimuli. The main finding was that lower maternal emotional availability was related to an infant's higher attention to fearful faces (p = .042), when infant sex and maternal age, education, and concurrent depressive and anxiety symptoms were controlled. This finding indicates that low maternal emotional availability may sensitize infants' emotion processing system for the signals of fear at least during this specific age around 8 months. The significance of the increased attention toward fearful faces during infancy is an important topic for future research.

Sharing and Receiving Eye-Contact Predicts Mate Choice After a 5-Minute Conversation: Evidence from a Speed-Dating Study

In popular narratives, the first date with a potential mate often centers on their gaze as embodiment of interest and attraction. However, evidence is still lacking on the role of eye-contact as a potent signal in human social interaction in the context of dating. In addition, behavioral mechanisms of mate selection are not well understood. In the present study, we therefore examined mutual eye-contact and its influence on mate choice by applying dual mobile eye-tracking during naturalistic speed-dates. A total of 30 male and 30 female subjects attended four speed-dates each (N = 240). Subjects were more likely to choose those dating partners with whom they shared more eye-contact with. In addition, perceived attractiveness played an important role for mate choice. Interestingly, receiving but not giving eye-contact also predicted individual mate choice. Eye-contact thus acts as an important signal of romantic attraction when encountering a dating partner.

The semantics of gaze in person perception: a novel qualitative-quantitative approach

Interpreting gaze behavior is essential in evaluating interaction partners, yet the 'semantics of gaze' in dynamic interactions are still poorly understood. We aimed to comprehensively investigate effects of gaze behavior patterns in different conversation contexts, using a two-step, qualitative-quantitative procedure. Participants watched video clips of single persons listening to autobiographic narrations by another (invisible) person. The listener's gaze behavior was manipulated in terms of gaze direction, frequency and direction of gaze shifts, and blink frequency; emotional context was manipulated through the valence of the narration (neutral/negative). In Experiment 1 (qualitative-exploratory), participants freely described which states and traits they attributed to the listener in each condition, allowing us to identify relevant aspects of person perception and to construct distinct rating scales that were implemented in Experiment 2 (quantitative-confirmatory). Results revealed systematic and differential meanings ascribed to the listener's gaze behavior. For example, rapid blinking and fast gaze shifts were rated more negatively (e.g., restless and unnatural) than slower gaze behavior; downward gaze was evaluated more favorably (e.g., empathetic) than other gaze aversion types, especially in the emotionally negative context. Overall, our study contributes to a more systematic understanding of flexible gaze semantics in social interaction.

Autonomic and facial electromyographic responses to watching eyes

We measured participants' psychophysiological responses and gaze behavior while viewing a stimulus person's direct and averted gaze in three different conditions manipulating the participants' experience of being watched. The results showed that skin conductance responses and heart rate deceleration responses were greater to direct than averted gaze only in the condition in which the participants had the experience of being watched by the other individual. In contrast, gaze direction had no effects on these responses when the participants were manipulated to believe that the other individual could not watch them or when the stimulus person was presented in a pre-recorded video. Importantly, the eye tracking measures showed no differences in participants' looking behavior between these stimulus presentation conditions. The results of facial electromyography responses suggested that direct gaze elicited greater zygomatic and periocular responses than averted gaze did, independent of the presentation condition. It was concluded that the affective arousal and attention-orienting indexing autonomic responses to eye contact are driven by the experience of being watched. In contrast, the facial responses seem to reflect automatized affiliative responses which can be elicited even in conditions in which seeing another's direct gaze does not signal that the self is being watched.

Partner's emotions are associated with preschoolers' prefrontal activation under joint attention: An fNIRS evidence

Emotions and joint attention are highly associated and mutually influenced during preschool, the critical period for early emotional and cognitive development. However, few studies have explored the neuropsychological mechanism of joint attention with preschoolers and their partners under different emotions. This study has examined the prefrontal activation under a comprehensive emotional joint attention task in 45 preschoolers (25 boys, Mage  = 58 ± 9.02 months) to compare the different influences of partners' positive, neutral, and negative emotions. Analysis of the functional near-infrared spectroscopy data indicated that the participants' prefrontal activation triggered by joint attention in positive and negative emotions was significantly higher than in neutral emotions. Moreover, their brain synchronization intensity was significantly higher in positive emotions of joint attention than in negative emotions. These findings advance our understanding of the neural mechanism of early childhood emotional processing under joint attention and provide a neural perspective to explain the effects of different emotions on preschoolers' social cognition.

Evidence for the adaptive parsing of non-communicative eye movements during joint attention interactions

During social interactions, the ability to detect and respond to gaze-based joint attention bids often involves the evaluation of non-communicative eye movements. However, very little is known about how much humans are able to track and parse spatial information from these non-communicative eye movements over time, and the extent to which this influences joint attention outcomes. This was investigated in the current study using an interactive computer-based joint attention game. Using a fully within-subjects design, we specifically examined whether participants were quicker to respond to communicative joint attention bids that followed predictive, as opposed to random or no, non-communicative gaze behaviour. Our results suggest that in complex, dynamic tasks, people adaptively use and dismiss non-communicative gaze information depending on whether it informs the locus of an upcoming joint attention bid. We also went further to examine the extent to which this ability to track dynamic spatial information was specific to processing gaze information. This was achieved by comparing performance to a closely matched non-social task where eye gaze cues were replaced with dynamic arrow stimuli. Whilst we found that people are also able to track and use dynamic non-social information from arrows, there was clear evidence for a relative advantage for tracking gaze cues during social interactions. The implications of these findings for social neuroscience and autism research are discussed.

Neural basis of social attention: common and distinct mechanisms for social and nonsocial orienting stimuli

Social and nonsocial directional stimuli (such as gaze and arrows, respectively) share their ability to trigger attentional processes, although the issue of whether social stimuli generate other additional (and unique) attentional effects is still under debate. In this study, we used the spatial interference paradigm to explore, using functional magnetic resonance imaging, shared and dissociable brain activations produced by gaze and arrows. Results showed a common set of regions (right parieto-temporo-occipital) similarly involved in conflict resolution for gaze and arrows stimuli, which showed stronger co-activation for incongruent than congruent trials. The frontal eye field showed stronger functional connectivity with occipital regions for congruent as compared with incongruent trials, and this effect was enhanced for gaze as compared with arrow stimuli in the right hemisphere. Moreover, spatial interference produced by incongruent (as compared with congruent) arrows was associated with increased functional coupling between the right frontal eye field and a set of regions in the left hemisphere. This result was not observed for incongruent (as compared with congruent) gaze stimuli. The right frontal eye field also showed greater coupling with left temporo-occipital regions for those conditions in which larger conflict was observed (arrow incongruent vs. gaze incongruent trials, and gaze congruent vs. arrow congruent trials). These findings support the view that social and nonsocial stimuli share some attentional mechanisms, while at the same time highlighting other differential effects. Highlights Attentional orienting triggered by social (gaze) and nonsocial (arrow) cues is comparable. When social and nonsocial stimuli are used as targets, qualitatively different behavioral effects are observed. This study explores the neural bases of shared and dissociable neural mechanisms for social and nonsocial stimuli. Shared mechanisms were found in the functional coupling between right parieto-temporo-occipital regions. Dissociable mechanisms were found in the functional coupling between right frontal eye field and ipsilateral and contralateral occipito-temporal regions.

Brain mechanisms of social signalling in live social interactions with autistic and neurotypical adults

The simple act of watching another person can change a person's behaviour in subtle but important ways; the individual being watched is now capable of signalling to the watcher, and may use this opportunity to communicate to the watcher. Recent data shows that people will spontaneously imitate more when being watched. Here, we examine the neural and cognitive mechanisms of being watched during spontaneous social imitation in autistic and neurotypical adults using fNIRS brain imaging. Participants (n = 44) took part in a block-moving task where they were instructed only to copy the block sequence which people normally do using a straight low action trajectory. Here, the demonstrator sometimes used an atypical 'high' action trajectory, giving participants the opportunity to spontaneously copy the high trajectory even if this slowed their performance. The confederate who demonstrated each block sequence could watch the participant's actions or close her eyes, giving a factorial design with factors of trajectory (high/low) and watched (watched/unwatched). Throughout the task, brain signals were captured from bilateral temporal/parietal/occipital cortex using fNIRS. We found that all participants performed higher actions when being watched by the confederate than when not being watched, with no differences between autistic and neurotypical participants. The unwatched conditions were associated with higher activity of the right inferior parietal lobule in all participants and also engagement of left STS only in autistic participants. These findings are consistent with the claim that people engage different neural mechanisms when watched and unwatched and that participants with autism may engage additional brain mechanisms to match neurotypical behaviour and compensate for social difficulties. However, further studies will be needed to replicate these results in a larger sample of participants.

No transfer of arousal from other's eyes in Williams syndrome

Typically developing humans automatically synchronize their arousal levels, resulting in pupillary contagion, or spontaneous adaptation of pupil size to that of others. This phenomenon emerges in infancy and is believed to facilitate social interaction. Williams syndrome (WS) is a genetic condition characterized by a hyper-social personality and social interaction challenges. Pupillary contagion was examined in individuals with WS (n = 44), age-parallel-matched typically developing children and adults (n = 65), and infants (n = 79). Bayesian statistics were used. As a group, people with WS did not show pupillary contagion (Bayes factors supporting the null: 25-50) whereas control groups did. This suggests a very early emerging atypical developmental trajectory. In WS, higher pupillary contagion was associated with lower autistic symptoms of social communication. Diminished synchronization of arousal may explain why individuals with WS have social challenges, whereas synchronization of arousal is not a necessary correlate of high social motivation.