Gaze cueing of attention: visual attention, social cognition, and individual differences

Gaze dynamics during natural scene memorization and recognition

Humans can rapidly memorize numerous images, which is surprising considering the limited visual sampling of each image. To enhance the probability of recognition, it is crucial to focus on previously sampled locations most likely to support memory. How does the visuomotor system achieve this? To study this, we analyzed the eye movements of a group of neurotypical observers while they performed a natural scene memorization task. Using comprehensive gaze analysis and computational modeling, we show that observers traded off visual exploration for exploiting information at the most memorable scene locations with repeated viewing. Furthermore, both the explore-exploit trade-off and gaze consistency predicted accurate recognition memory. Finally, false alarms were predicted by confusion of the incoming visual information at fixated locations with previously sampled information from other images. Together, our findings shed light on the symbiotic relationship between attention and memory in facilitating accurate natural scene memory.

Toward a neuroaesthetics of interactions: Insights from dance on the aesthetics of individual and interacting bodies

Neuroaesthetics has advanced our understanding of the neural processes underlying human aesthetic evaluation of crafted and natural entities, including the human body. While much research has examined the neurocognitive mechanisms behind evaluating "single-body" forms and movements, the perception and aesthetic evaluation of multiple individuals moving together have only recently gained attention. This review examines the neural foundations of static and dynamic body perception and how neural representations of observed and executed movements influence their aesthetic evaluation. Focusing on dance, it describes the role of stimulus features and individual characteristics in movement aesthetics. We review neural systems supporting visual processing of social interactions and propose a role for these systems in the aesthetic evaluation of interpersonal interactions, defined as the neuroaesthetics of interactions. Our goal is to highlight the benefits of integrating insights and methods from social cognition, neuroscience, and neuroaesthetics to understand mechanisms underlying interaction aesthetics, while addressing future challenges.

The effect of social anxiety on social attention in naturalistic situations

BACKGROUND AND OBJECTIVES

This multimodal two-phase study investigated the impact of trait social anxiety on exploration, social attention, and autonomic responses in a naturalistic setting. We expected higher avoidance of potentially crowded spaces, reduced visual attention on other people, and heightened physiological arousal in social situations for participants with higher social anxiety levels.

DESIGN AND METHODS

Eighty-seven participants, pre-screened for high variance in trait social anxiety, first completed a half-hour walk on a freely chosen route and subsequently had a staged social interaction with a confederate consisting of a non-interactive waiting phase and a short conversation.

RESULTS

While social anxiety did not modulate the choice of route during the walk phase, socially anxious participants avoided gazing at other individuals in non-interactive situations, i.e., during the walk and the waiting phase. In contrast, during actual interaction, they showed increased visual attention towards the confederate's face. Across all experimental phases, highly socially anxious individuals showed elevated heart rates, but this effect was independent of the social context.

CONCLUSIONS

This study showed that social anxiety affects social exploration behavior not in a way of general avoidance, but rather in nuanced adaptations depending on the concrete situation, likelihood of interaction and associated socio-evaluative threat.

Attention deficits in Amblyopia: A narrative review

Amblyopia has effects on vision that extend from the processing of low-level visual features to higher level functions such as visual attention. In this narrative review, we focus on the impact of amblyopia on visual attention. A structured literature search revealed 28 articles reporting comparisons between amblyopia and normal vision control groups for a variety of visual attention tasks. Several of these articles also included neuroimaging measures. A review of these articles suggested that amblyopia does not affect behavioral performance of tasks with a low attentional load, such as cuing tasks, but deficits emerge for tasks with high demands on visual attention such as multiple object tracking. Deficits are not limited to the amblyopic eye but are also evident under fellow eye and binocular viewing conditions suggesting that abnormal early binocular visual experience can fundamentally alter the development of visual attention. Overall, the current literature suggests that amblyopia is associated with reduced visual attention resources. We raise the possibility that this attention resource deficit may be partially associated with an attentional demand for suppression of the amblyopic eye.

Direct and averted gaze modulate the event-related brain responses to social exclusion signals

Social exclusion is a negative experience in social interaction which can be modulated by the perceived eye gaze. In our Cyberball study, we asked how gaze direction - direct versus averted - affects the processing of social exclusion by using electroencephalogram (EEG) methods. Participants encountered neutral gazes in the inclusion phase (Block1) and then either direct or averted gazes during the exclusion phase (Block2). We measured self-reports on Need-Threat Questionnaires (belonging, control, meaningful existence, self-esteem) and negative mood, along with event-related potentials (ERPs), specifically the P3 component (P300) - an indicator of expectation violation. Findings demonstrated that the P3 amplitude showed differential changes between gaze conditions during the transition from inclusion to exclusion, with direct gaze eliciting stronger neural responses. This difference signals that direct gaze enhances the expected participation, thus sensitizing participants for exclusionary signals. Simultaneously, self-reports indicated that the transition evoked weaker negative emotions in the direct gaze group and stronger negative emotions in the averted gaze group, signalling that direct gaze also serves as an affiliative signal. These results illuminate how gaze directions shape cognitive and emotional reactions to social exclusion. However, further research is necessary to unravel these effects amidst other non-verbal cues and fully comprehend their impact on neural and behavioural responses to social exclusion.

Impact of Conversational and Animation Features of a Mental Health App Virtual Agent on Depressive Symptoms and User Experience Among College Students: Randomized Controlled Trial

Background

Numerous mental health apps purport to alleviate depressive symptoms. Strong evidence suggests that brief cognitive behavioral therapy (bCBT)-based mental health apps can decrease depressive symptoms, yet there is limited research elucidating the specific features that may augment its therapeutic benefits. One potential design feature that may influence effectiveness and user experience is the inclusion of virtual agents that can mimic realistic, human face-to-face interactions.

Objective

The goal of the current experiment was to determine the effect of conversational and animation features of a virtual agent within a bCBT-based mental health app on depressive symptoms and user experience in college students with and without depressive symptoms.

Methods

College students (N=209) completed a 2-week intervention in which they engaged with a bCBT-based mental health app with a customizable therapeutic virtual agent that varied in conversational and animation features. A 2 (time: baseline vs 2-week follow-up) × 2 (conversational vs non-conversational agent) × 2 (animated vs non-animated agent) randomized controlled trial was used to assess mental health symptoms (Patient Health Questionnaire-8, Perceived Stress Scale-10, and Response Rumination Scale questionnaires) and user experience (mHealth App Usability Questionnaire, MAUQ) in college students with and without current depressive symptoms. The mental health app usability and qualitative questions regarding users' perceptions of their therapeutic virtual agent interactions and customization process were assessed at follow-up.

Results

Mixed ANOVA (analysis of variance) results demonstrated a significant decrease in symptoms of depression (P=.002; mean [SD]=5.5 [4.86] at follow-up vs mean [SD]=6.35 [4.71] at baseline), stress (P=.005; mean [SD]=15.91 [7.67] at follow-up vs mean [SD]=17.02 [6.81] at baseline), and rumination (P=.03; mean [SD]=40.42 [12.96] at follow-up vs mean [SD]=41.92 [13.61] at baseline); however, no significant effect of conversation or animation was observed. Findings also indicate a significant increase in user experience in animated conditions. This significant increase in animated conditions is also reflected in the user's ease of use and satisfaction (F(1, 201)=102.60, P<.001), system information arrangement (F(1, 201)=123.12, P<.001), and usefulness of the application (F(1, 201)=3667.62, P<.001).

Conclusions

The current experiment provides support for bCBT-based mental health apps featuring customizable, humanlike therapeutic virtual agents and their ability to significantly reduce negative symptomology over a brief timeframe. The app intervention reduced mental health symptoms, regardless of whether the agent included conversational or animation features, but animation features enhanced the user experience. These effects were observed in both users with and without depressive symptoms.

A new psychometric tool for evaluating nonverbal social cue-following: regression-based normative data for children 6 to 10 years old

The ability to follow nonverbal social cues is impaired in several disorders. Our aim was to collect normative data for the first psychometric test (TooN) that assesses this skill in children. The normative sample consisted of 339 typically developing children aged 6 to 10. TooN is a computerized tool that includes 120 trials in which children must press a button as soon as possible when an object appears on the right or left side of the screen. Each object is preceded by a video of a model gazing and/or pointing to the side where the object appears (i.e. congruent condition) or the opposite side (i.e. incongruent condition). Linear regression analyses were conducted for reaction times (RTs) and for gaze and pointing cuing effects (i.e. the difference between RTs in incongruent and congruent conditions). Regression analyses showed that age, sex and parental education significantly predicted RTs. Age and sex, but not parental education, were significant predictors of gaze cuing effects. However, age was the only significant predictor of pointing cuing effects. Based on these analyses, we provided the equations to calculate the z-scores for RTs and cuing effects. Accuracy scores, stratified by age and/or sex, are reported as percentiles. Based on the performances of typically developing children, we present the normative data of a new psychometric tool designed to assess nonverbal social cue-following. This tool can be valuable for evaluating children with neurodevelopmental disorders. To support this claim, its validity should be tested across various clinical populations.

The perception of eye contact is associated with men's need to belong, self-esteem, and loneliness

The present study (N =  367) investigated the association of the cone of direct gaze (CoDG; a range within which slightly averted gaze is accepted as direct gaze) width with the need to belong (NTB) and the possible further influence of NTB on self-esteem and loneliness. Results showed that: (i) men's CoDG width predicted the NTB, self-esteem, and loneliness; (ii) men's narrow CoDG predicted high loneliness via a high NTB and low self-esteem; (iii) a narrow CoDG was associated with low self-esteem via high loneliness only in high-NTB men. Among women, the CoDG width was not associated with the NTB, self-esteem, and loneliness. The findings are discussed considering the formation and maintenance of relationships together with gender differences.

Gaze cues (repeatedly) fail to influence person evaluation

Eye gaze is an important social signal that people generally cannot help but follow, leading to joint attention. Joint attention has been shown to speed basic processing of objects, enhance memory for them, and even affect immediate value-based appraisal by increasing object likability. Here, across 8 experiments, we investigate for the first time whether jointly attending to other faces positively affects their longer-term social value (liking, trust) and attentional value (attention allocation and prioritisation). Emanating the basic gaze cuing paradigm, a central cue face looked towards or away from a 'target' face, which the participant had to respond to. Unbeknownst to participants, some target faces were always looked at (jointly attended - high value) and others were never looked at ('ignored' - low value). In studies 1 to 6, we investigated how these gaze-induced value conditions positively affected subsequent liking and trust social judgements of a person. Then, in studies 7 and 8, we additionally investigated whether effects of gaze on others may occur implicitly, affecting subsequent attentional engagement with others by using the target faces as gaze cues, or attentional targets in a dot probe task. Confirmed through mini meta-analysis, we found no significant effect of being jointly attended versus ignored on either the social (N = 214) or attentional (N = 77) value of faces. We discuss whether faces are different from objects in this context.

Girls with higher levels of suicidal ideation experienced less parental reciprocity of eye-contact and positive facial affect during conflictual interactions: A pilot study

Although ample research links social factors and suicidality, there remains a gap in understanding how distinct processes within social communication relate to suicidality. We demonstrate how reciprocity of eye-gaze and facial expressions of happiness differ during parent-adolescent conflict based on adolescents' future suicidal ideation (SI). Facial affect analyses were based on 103 girls (ages 11-13; M = 12.28; 75% White) and their parents. Eye-gaze analyses were conducted in subset of these dyads (N = 70). Participants completed a conflict discussion during which gaze to their partners' eyes was assessed using mobile eye-tracking glasses and facial affect was coded using FaceReader Observer XT. Adolescents' SI was assessed 12-months later. Actor-partner interdependence models tested whether participants' gaze and affect predicted their own and their partners' gaze and affect one second later and if these intra and interpersonal dynamics differed based on adolescents' future levels of SI. Girls from dyads with less parental reciprocity of eye-gaze and happiness reported higher levels of SI 12-months later. During early adolescence, girls whose parents reciprocate their eye-contact or positive affect less during conflict may be at heightened risk for SI. If replicated, social communication could provide a promising intervention target to reduce suicidality prospectively.

Examining holistic processing strategies in dogs and humans through gaze behavior

Extensive studies have shown that humans process faces holistically, considering not only individual features but also the relationships among them. Knowing where humans and dogs fixate first and the longest when they view faces is highly informative, because the locations can be used to evaluate whether they use a holistic face processing strategy or not. However, the conclusions reported by previous eye-tracking studies appear inconclusive. To address this, we conducted an experiment with humans and dogs, employing experimental settings and analysis methods that can enable direct cross-species comparisons. Our findings reveal that humans, unlike dogs, preferentially fixated on the central region, surrounded by the inner facial features, for both human and dog faces. This pattern was consistent for initial and sustained fixations over seven seconds, indicating a clear tendency towards holistic processing. Although dogs did not show an initial preference for what to look at, their later fixations may suggest holistic processing when viewing faces of their own species. We discuss various potential factors influencing species differences in our results, as well as differences compared to the results of previous studies.

An analysis of the role of different levels of exchange of explicit information in human-robot cooperation

For smooth human-robot cooperation, it is crucial that robots understand social cues from humans and respond accordingly. Contextual information provides the human partner with real-time insights into how the robot interprets social cues and what action decisions it makes as a result. We propose and implement a novel design for a human-robot cooperation framework that uses augmented reality and user gaze to enable bidirectional communication. Through this framework, the robot can recognize the objects in the scene that the human is looking at and infer the human's intentions within the context of the cooperative task. We proposed three levels of exchange of explicit information designs, each providing increasingly more information. These designs enable the robot to offer contextual information about what user actions it has identified and how it intends to respond, which is in line with the goal of cooperation. We report a user study (n = 24) in which we analyzed the performance and user experience with the three different levels of exchange of explicit information. Results indicate that users preferred an intermediate level of exchange of information, in which users knew how the robot was interpreting their intentions, but where the robot was autonomous to take unsupervised action in response to gaze input from the user, needing a less informative action from the human's side.

How eccentricity modulates attention capture by direct face/gaze and sudden onset motion

We investigated how processing benefits for direct face/gaze and sudden onset motion depend on stimulus presentation location, specifically eccentricity from fixation. Participants responded to targets that were presented on one of four stimuli that displayed a direct or averted face and gaze either statically or suddenly. Between participants, stimuli were presented at different eccentricities relative to central fixation, spanning 3.3°, 4.3°, 5.5° or 6.5° of the visual field. Replicating previous studies, we found processing advantages for direct (vs. averted) face/gaze and motion onset (vs. static stimuli). Critically, while the motion-onset advantage increased with increasing distance to the center, the face/gaze direction advantage was not significantly modulated by target eccentricity. Results from a control experiment with eye tracking indicate that face/gaze direction could be accurately discriminated even at the largest eccentricity. These findings demonstrate a distinction between the processing of basic facial and gaze signals and exogenous motion cues, which may be based on functional differences between central and peripheral retinal regions. Moreover, the results highlight the importance of taking specific stimulus properties into account when studying perception and attention in the periphery.

The fundamentals of eye tracking part 2: From research question to operationalization

In this article, we discuss operationalizations and examples of experimental design in eye-tracking research. First, we distinguish direct operationalization for entities like saccades, which are closely aligned with their original concepts, and indirect operationalization for concepts not directly measurable, such as attention or mind-wandering. The latter relies on selecting a measurable proxy. Second, we highlight the variability in algorithmic operationalizations and emphasize that changing parameters can affect outcome measures. Transparency in reporting these parameters and algorithms is crucial for comparisons across studies. Third, we provide references to studies for common operationalizations in eye-tracking research and discuss key operationalizations in reading research. Fourth, the IO-model is introduced as a tool to help researchers operationalize difficult concepts. Finally, we present three example experiments with useful methods for eye-tracking research, encouraging readers to consider these examples for inspiration in their own experiments.

Social attention in the wild - fixations to the eyes and autistic traits during a naturalistic interaction in a healthy sample

Attention to social stimuli is a key component of social behavior and facilitates the development of fundamental social skills. Studies investigating social attention in neurotypical or neurodiverse populations have often relied on screen-based experiments using static images or videos, which lack the sensory richness and reciprocity present in real-life social interactions. This can possibly be attributed to the challenges one encounters when creating naturalistic experiments, such as dealing with dynamically moving areas of interest (AOIs), which require either time-intensive manual coding or restraining of participants. Here, we present findings from an experimental paradigm using unrestrained mobile eye-tracking and a face detection algorithm (MTCNN) to measure fixation rates during a semi-structured, face-to-face interview. Data from N = 62 healthy adult participants was analyzed for gaze behavior and related to participants' autistic traits. We observed a significant negative correlation between fixation rates on the eye region averaged over the entire interaction and scores on the autism spectrum quotient (AQ) (r = -0.14), indicating participants with high autistic traits fixated less frequently on the eye region. We also compared different types of interview questions (open vs. closed) to explore whether the reduction in fixation rates was more pronounced for specific time intervals during the interview. Lastly, we discuss both possibilities for extensions as well as limitations of the presented paradigm that could serve as inspiration for future research.

Social context and drug cues modulate inhibitory control in cocaine addiction: involvement of the STN evidenced through functional MRI

Addictions often develop in a social context, although the influence of social factors did not receive much attention in the neuroscience of addiction. Recent animal studies suggest that peer presence can reduce cocaine intake, an influence potentially mediated, among others, by the subthalamic nucleus (STN). However, there is to date no neurobiological study investigating this mediation in humans. This study investigated the impact of social context and drug cues on brain correlates of inhibitory control in individuals with and without cocaine use disorder (CUD) using functional Magnetic Resonance Imaging (fMRI). Seventeen CUD participants and 17 healthy controls (HC) performed a novel fMRI "Social" Stop-Signal Task (SSST) in the presence or absence of an observer while being exposed to cocaine-related (vs. neutral) cues eliciting craving in drug users. The results showed that CUD participants, while slower at stopping with neutral cues, recovered control level stopping abilities with cocaine cues, while HC did not show any difference. During inhibition (Stop Correct vs Stop Incorrect), activity in the right STN, right inferior frontal gyrus (IFG), and bilateral orbitofrontal cortex (OFC) varied according to the type of cue. Notably, the presence of an observer reversed this effect in most areas for CUD participants. These findings highlight the impact of social context and drug cues on inhibitory control in CUD and the mediation of these effects by the right STN and bilateral OFC, emphasizing the importance of considering the social context in addiction research. They also comfort the STN as a potential addiction treatment target.

Diverse Face Images (DFI): Validated for racial representation and eye gaze

Face processing is a central component of human communication and social engagement. The present investigation introduces a set of racially and ethnically inclusive faces created for researchers interested in perceptual and socio-cognitive processes linked to human faces. The Diverse Face Images (DFI) stimulus set includes high-quality still images of female faces that are racially and ethnically representative, include multiple images of direct and indirect gaze for each model and control for low-level perceptual variance between images. The DFI stimuli will support researchers interested in studying face processing throughout the lifespan as well as other questions that require a diversity of faces or gazes. This report includes a detailed description of stimuli development and norming data for each model. Adults completed a questionnaire rating each image in the DFI stimuli set on three major qualities relevant to face processing: (1) strength of race/ethnicity group associations, (2) strength of eye gaze orientation, and (3) strength of emotion expression. These validation data highlight the presence of rater variability within and between individual model images as well as within and between race and ethnicity groups.

Not to follow because of distrust: perceived trust modulates the gaze cueing effect

In social life, people spontaneously form stable trustworthiness impressions from faces. However, the precise role of extracting trustworthiness information remains unclear. This study aims to elucidate whether discerning facial trustworthiness influences social interactions. Specifically, it explores the gaze cueing effect (GCE), wherein individuals exhibit quicker responses to targets appearing in the direction of gaze compared to other locations. Given conflicting perspectives in existing literature regarding the potential modulation of trustworthiness on the GCE, two plausible hypotheses are proposed to explain divergent result patterns. The reflexive hypothesis posits that the GCE operates automatically. In contrast, the flexible hypothesis underscores the potential modulatory role of trustworthiness in the GCE. To provide a comprehensive understanding of whether trustworthiness modulates the GCE, we employed face stimuli incorporating trustworthiness information within Posner' s cue-target task. The findings of Experiment 1 revealed that the perception of trustworthiness indeed influenced the GCE. Specifically, when facial stimuli were perceived as trustworthy, they elicited a more pronounced GCE compared to untrustworthy stimuli. This modulation effect was replicated using a different stimulus set in Experiment 2. In Experiment 3, we employed the same stimuli as in Experiment 2, setting the trustworthiness information to baseline as a control experiment. The results demonstrated that the trustworthiness modulation effect disappeared, indicating its specificity to the trustworthiness attribute of the stimuli rather than other characteristics. Collectively, these findings lend support to the flexible hypothesis, highlighting that the extraction of trustworthiness information plays a pivotal role in modulating the GCE, consequently influencing social interactions.

A common and specialized neural code for social attention triggered by eye gaze and biological motion

Humans appear to be endowed with the ability to readily share attention with interactive partners through the utilization of social direction cues, such as eye gaze and biological motion (BM). Here, we investigated the specialized brain mechanism underlying this fundamental social attention ability by incorporating different types of social (i.e., BM, gaze) and non-social (arrow) cues and combining functional magnetic resonance imaging (fMRI) with a modified central cueing paradigm. Using multi-voxel pattern analysis (MVPA), we found that although gaze- and BM-mediated attentional orienting could be decoded from neural activity in a wide range of brain areas, only the right anterior and posterior superior temporal sulcus (aSTS and pSTS) could specifically decode attentional orienting triggered by social but not non-social cues. Critically, cross-category MVPA further revealed that social attention could be decoded across BM and gaze cues in the right STS and the right superior temporal gyrus (STG). However, these regions could not decode attentional orienting across social and non-social cues. These findings together provide evidence for the existence of a specialized social attention module in the human brain, with the right STS/STG being the critical neural site dedicated to social attention.

Social face processing in chronic severe traumatic brain injury: Altered decoding of emotions and mental states but preserved gaze cueing of attention

The processing of social information transmitted by facial stimuli is altered in individuals with traumatic brain injury (TBI). This study investigated whether these alterations also affect the mechanisms underlying the orienting of visual attention in response to eye-gaze signals. TBI patients and a control group of healthy individuals matched on relevant criteria completed a spatial cueing task. In this task, a lateral visual target was presented along with a task-irrelevant face, with the gaze averted to the left or right. Arrows pointing towards the left or right were also used as non-social control stimuli. Social cognition abilities were further investigated through tests based on decoding emotional expressions and mental states conveyed by facial stimuli. The decoding of emotions and mental states was worse in the TBI group than in the control group. However, both groups demonstrated reliable and comparable orienting of attention to both eye-gaze and arrow stimuli. Despite impairments in certain aspects of social face processing among TBI patients, gaze cueing of attention appears to be preserved in this neuropsychological population.

Prioritization of social information processing: Eye gaze elicits earlier vMMN than arrows

Numerous research studies have demonstrated that eye gaze and arrows act as cues that automatically guide spatial attention. However, it remains uncertain whether the attention shifts triggered by these two types of stimuli vary in terms of automatic processing mechanisms. In our current investigation, we employed an equal probability paradigm to explore the likenesses and distinctions in the neural mechanisms of automatic processing for eye gaze and arrows in non-attentive conditions, using visual mismatch negative (vMMN) as an indicator of automatic processing. The sample size comprised 17 participants. The results indicated a significant interaction between time duration, stimulus material, and stimulus type. The findings demonstrated that both eye gaze and arrows were processed automatically, triggering an early vMMN, although with temporal variations. The vMMN for eye gaze occurred between 180 and 220 ms, whereas for arrows it ranged from 235 to 275 ms. Moreover, arrow stimuli produced a more pronounced vMMN amplitude. The earlier vMMN response to eye gaze compared with arrows implies the specificity and precedence of social information processing associated with eye gaze over the processing of nonsocial information with arrows. However, arrow could potentially elicit a stronger vMMN because of their heightened salience compared to the background, and the expansion of attention focusing might amplify the vMMN impact. This study offers insights into the similarities and differences in attention processing of social and non-social information under unattended conditions from the perspective of automatic processing.

Visual mental imagery of nonpredictive central social cues triggers automatic attentional orienting

Previous research has demonstrated that social cues (e.g., eye gaze, walking direction of biological motion) can automatically guide people's focus of attention, a well-known phenomenon called social attention. The current research shows that voluntarily generated social cues via visual mental imagery, without being physically presented, can produce robust attentional orienting similar to the classic social attentional orienting effect. Combining a visual imagery task with a dot-probe task, we found that imagining a non-predictive gaze cue could orient attention towards the gazed-at hemifield. Such attentional effect persisted even when the imagery gaze cue was counter-predictive of the target hemifield, and could be generalized to biological motion cue. Besides, this effect could not be simply attributed to low-level motion signal embedded in gaze cues. More importantly, an eye-tracking experiment carefully monitoring potential eye movements demonstrated the imagery-induced attentional orienting effect induced by social cues, but not by non-social cues (i.e., arrows), suggesting that such effect is specialized to visual imagery of social cues. These findings accentuate the demarcation between social and non-social attentional orienting, and may take a preliminary step in conceptualizing voluntary visual imagery as a form of internally directed attention.

The ownership memory self-reference effect shifts recognition criterion but not recognition sensitivity

Information referenced to the self is retrieved more accurately than information referenced to others, known as the memory self-reference effect. It is unclear, however, whether social context (identity of the other) or task factors alter decision-making processes. In a virtual object allocation task, female participants sorted objects into their own or another's (stranger or mother) basket based on a colour cue. Subsequently, they performed a recognition memory task in which they first indicated whether each object was old or new, and then whether it had been allocated to themselves or to the other. We obtained owner-specific hit rates and false-alarm rates and applied signal detection theory to derive separate recognition sensitivity (d') and recognition criterion parameters (c) for self- and other-owned objects. While there was no clear evidence of a recognition self-reference effect, or a change in sensitivity, participants adopted a more conservative recognition criterion for self- compared with other-owned objects, and particularly when the other-referent was the participant's mother compared with the stranger. Moreover, when discriminating whether the originally presented objects were self- or other-owned, participants were biased toward ascribing ownership to the 'other'. We speculate that these findings reflect ownership-based changes in decisional processing during the recognition memory self-reference paradigm.

Intentional looks facilitate faster responding in observers

Humans construct rich representations of other people's mental states. Here we investigated how intentionality in eye gaze affected perception and responses to gaze. Observers viewed videos of human gazers looking left or right. Unbeknownst to the observers, the gazers could either choose where to look (self-chosen gaze) or were explicitly instructed where to look (computer-instructed gaze). In Experiment 1, observers reported the direction of the gazer's upcoming look before the eye movement was initiated. Faster responses were found for self-chosen relative to computer-instructed gaze. In Experiments 2 and 3, observers responded by reporting the location of a peripheral target that appeared at the gazed-at or not gazed-at location. Faster responses were found for gazed-at relative to not gazed-at targets and at longer cue-target intervals for self-chosen relative to computer-instructed gaze. The examination of the eye movement kinematics indicated that self-chosen gaze shifts were marked by a larger magnitude of motion within the eye region prior to the eye movement occurring relative to computer-instructed ones. Thus, perceived intentionality in eye gaze facilitates responses in observers with the information about mental states communicated via subtle properties of eye motion.

The Impact of Cues on Joint Attention in Children with Autism Spectrum Disorder: An Eye-Tracking Study in Virtual Games

Joint attention (JA), a core deficit in children with autism spectrum disorder (ASD), is crucial for social interaction, emotional understanding, and cognitive development. This study aims to compare and analyze the eye-tracking data of ASD and typically developing children (TDC) during virtual games, exploring how different cue types affect JA performance in ASD children. A total of 31 TDC and 40 ASD children participated in the study. Using eye-tracking devices, we recorded the children's eye movements as they played virtual games, selecting the correct target based on cues provided by virtual characters. Our findings revealed that different cue types significantly impacted the game scores of ASD children but had no significant effect on TDC, highlighting a notable disparity between the two groups. ASD children showed a lower fixation frequency, irregular fixation paths, and increased attention to non-target objects compared to TDC. Interestingly, among the three cue types, ASD children exhibited a preference for the third type, leading to longer fixation on the region of interest and higher game scores. These results underscore the importance of cue selection in enhancing JA in ASD children. This study provides novel insights into the JA deficits in ASD children and offers a scientific basis for the development of targeted and individualized intervention programs.

Infant sensorimotor decoupling from 4 to 9 months of age: Individual differences and contingencies with maternal actions

Triadic interactions, wherein infants coordinate attention between caregivers and objects of shared focus, are believed to facilitate infant learning, and emerge around 9-12 months of age (Carpenter et al., 1998). Sensorimotor decoupling, wherein infants look at one percept while manipulating another, or use each hand for different actions, was hypothesized (de Barbaro et al., 2016) to contribute to triadic skills by allowing infants to smoothly shift attention between objects and social partners. We explored the development of Hand-Hand (H-H) and Gaze-Hand (G-H) decoupling in 38 infants at 4, 6, and 9 months. We also tested contingencies between maternal behaviors and infant decoupling: i.e., whether decoupling events followed maternal object-directed actions. Both overall and contingent infant decoupling increased from 4 to 9 months. Decoupling rates (both G-H and H-H) predicted variance in infants' fine and gross motor scores. Contingent G-H decoupling at 6 months predicted BSID-III communication scores at 18 months. Thus the development of infant sensorimotor skills, including decoupling, allows infants to smoothly shift attention and participate in triadic interactions.

Intact gesture cueing of attention but attenuated sensitivity to peripheral social targets in autistic children: An eye-tracking and pupillometric study

BACKGROUND

Altered automatic attention cueing has been reported in autistic children. Yet less is known about how autistic children would respond when the social cue that directs attention occurs in an implied social interaction.

METHODS

By using eye-tracking, the current study examined orienting responses to a socially-relevant target or a nonsocial target cued by a goal-directed social gesture in autistic children. Saccadic reaction time and pupillary responses were employed to measure gaze behavior and physiological arousal of autistic children.

RESULTS

Both groups of children showed reflexive orienting to the target regardless of its sociality, whereas typically developing (TD) children exhibited faster gaze shift than autistic children when the target was a social stimulus. An increased pupil dilation was observed in autistic children in response to stimuli relative to TD children. Further, autistic children showed larger baseline pupil response.

CONCLUSIONS

Autistic children show attenuated sensitivity to social targets and atypical pupil responses, which may be due to the dysfunction of locus coeruleus (LC) - norepinephrine (NE) system.

Behavioral Intervention for Adults With Autism on Distribution of Attention in Triadic Conversations: A/B-Tested Pre-Post Study

BACKGROUND

Cross-neurotype differences in social communication patterns contribute to high unemployment rates among adults with autism. Adults with autism can be unsuccessful in job searches or terminated from employment due to mismatches between their social attention behaviors and society's expectations on workplace communication.

OBJECTIVE

We propose a behavioral intervention concerning distribution of attention in triadic (three-way) conversations. Specifically, the objective is to determine whether providing personalized feedback to each individual with autism based on an analysis of their attention distribution behavior during an initial conversation session would cause them to modify their orientation behavior in a subsequent conversation session.

METHODS

Our system uses an unobtrusive head orientation estimation model to track the focus of attention of each individual. Head orientation sequences from a conversation session are analyzed based on five statistical domains (eg, maximum exclusion duration and average contact duration) representing different types of attention distribution behavior. An intervention is provided to a participant if they exceeded the nonautistic average for that behavior by at least 2 SDs. The intervention uses data analysis and video modeling along with a constructive discussion about the targeted behaviors. Twenty-four individuals with autism with no intellectual disabilities participated in the study. The participants were divided into test and control groups of 12 participants each.

RESULTS

Based on their attention distribution behavior in the initial conversation session, 11 of the 12 participants in the test group received an intervention in at least one domain. Of the 11 participants who received the intervention, 10 showed improvement in at least one domain on which they received feedback. Independent t tests for larger test groups (df>15) confirmed that the group improvements are statistically significant compared with the corresponding controls (P<.05). Crawford-Howell t tests confirmed that 78% of the interventions resulted in significant improvements when compared individually against corresponding controls (P<.05). Additional t tests comparing the first conversation sessions of the test and control groups and comparing the first and second conversation sessions of the control group resulted in nonsignificant differences, pointing to the intervention being the main effect behind the behavioral changes displayed by the test group, as opposed to confounding effects or group differences.

CONCLUSIONS

Our proposed behavioral intervention offers a useful framework for practicing social attention behavior in multiparty conversations that are common in social and professional settings.

Working memory for gaze benefits from the face context

Retaining gaze in working memory (WM) is essential for successfully navigating through the social world. In the current study, we investigated how WM stores gaze direction by focusing on the role of face context in gaze WM. To address this question, we propose two competing hypotheses. The independence hypothesis predicts that eye gaze is stored independently and is not susceptible to the influence of the surrounding face context. Conversely, the embedding hypothesis claims that gaze WM involves face context and that disruption of holistic face processing would also impair memory for embedded gaze. In three experiments, we adopted different manipulations to disrupt holistic face processing and compared WM performance for gaze within and without face context. In Experiments 1 and 2, we tested WM for gaze direction with schematic upright or inverted faces. We found better performance for gaze within upright faces (vs. inverted faces) by increasing the probability of being remembered. In Experiment 3, we replaced schematic faces with photographic faces, and disrupted holistic processing by using scrambled faces. Results replicated our previous findings, showing that photographic gaze within intact faces was better remembered than gaze presented alone or gaze within scrambled faces. These findings indicate that gaze memory is face-dependent and support the embedding hypothesis.

Unmasking social attention: The key distinction between social and non-social attention emerges in disengagement, not engagement

The debate surrounding whether social and non-social attention share the same mechanism has been contentious. While prior studies predominantly focused on engagement, we examined the potential disparity between social and non-social attention from both perspectives of engagement and disengagement, respectively. We developed a two-stage attention-shifting paradigm to capture both attention engagement and disengagement. Combining results from five eye-tracking experiments, we supported that the disengagement of social attention markedly outpaces that of non-social attention, while no significant discrepancy emerges in engagement. We uncovered that the faster disengagement of social attention came from its social nature by eliminating alternative explanations including broader fixation distribution width, reduced directional salience in the peripheral visual field, decreased cue-object categorical consistency, reduced perceived validity, and faster processing time. Our study supported that the distinction between social and non-social attention is rooted in attention disengagement, not engagement.

The bigger your pupils, the better my comprehension: an ERP study of how pupil size and gaze of the speaker affect syntactic processing

Gaze direction and pupil dilation play a critical role in communication and social interaction due to their ability to redirect and capture our attention and their relevance for emotional information. The present study aimed to explore whether the pupil size and gaze direction of the speaker affect language comprehension. Participants listened to sentences that could be correct or contain a syntactic anomaly, while the static face of a speaker was manipulated in terms of gaze direction (direct, averted) and pupil size (mydriasis, miosis). Left anterior negativity (LAN) and P600 linguistic event-related potential components were observed in response to syntactic anomalies across all conditions. The speaker's gaze did not impact syntactic comprehension. However, the amplitude of the LAN component for mydriasis (dilated pupil) was larger than for miosis (constricted pupil) condition. Larger pupils are generally associated with care, trust, interest, and attention, which might facilitate syntactic processing at early automatic stages. The result also supports the permeable and context-dependent nature of syntax. Previous studies also support an automatic nature of syntax (fast and efficient), which combined with the permeability to relevant sources of communicative information, such as pupil size and emotions, is highly adaptive for language comprehension and social interaction.

Unconscious and Conscious Gaze-Triggered Attentional Orienting: Distinguishing Innate and Acquired Components of Social Attention in Children and Adults with Autistic Traits and Autism Spectrum Disorders

Typically developing (TD) individuals can readily orient attention according to others' eye-gaze direction, an ability known as social attention, which involves both innate and acquired components. To distinguish between these two components, we used a critical flicker fusion technique to render gaze cues invisible to participants, thereby largely reducing influences from consciously acquired strategies. Results revealed that both visible and invisible gaze cues could trigger attentional orienting in TD adults (aged 20 to 30 years) and children (aged 6 to 12 years). Intriguingly, only the ability to involuntarily respond to invisible gaze cues was negatively correlated with autistic traits among all TD participants. This ability was substantially impaired in adults with autism spectrum disorder (ASD) and in children with high autistic traits. No such association or reduction was observed with visible gaze cues. These findings provide compelling evidence for the functional demarcation of conscious and unconscious gaze-triggered attentional orienting that emerges early in life and develops into adulthood, shedding new light on the differentiation of the innate and acquired aspects of social attention. Moreover, they contribute to a comprehensive understanding of social endophenotypes of ASD.

Investigating the impact of schizophrenia traits on attention: the role of the theta band in a modified Posner cueing paradigm

Joint attention is an indispensable tool for daily communication. Abnormalities in joint attention may be a key reason underlying social impairment in schizophrenia spectrum disorders. In this study, we aimed to explore the attentional orientation mechanism related to schizotypal traits in a social situation. Here, we employed a Posner cueing paradigm with social attentional cues. Subjects needed to detect the location of a target that is cued by gaze and head orientation. The power in the theta frequency band was used to examine the attentional process in the schizophrenia spectrum. There were four main findings. First, a significant association was found between schizotypal traits and attention orientation in response to invalid gaze cues. Second, individuals with schizotypal traits exhibited significant activation of neural oscillations and synchrony in the theta band, which correlated with their schizotypal tendencies. Third, neural oscillations and synchrony demonstrated a synergistic effect during social tasks, particularly when processing gaze cues. Finally, the relationship between schizotypal traits and attention orientation was mediated by neural oscillations and synchrony in the theta frequency band. These findings deepen our understanding of the impact of theta activity in schizotypal traits on joint attention and offer new insights for future intervention strategies.

The mechanism for the specificity of gaze direction: Inhibiting background location

The experiment combined the spatial Stroop paradigm to examine the effect of background location on the perception of arrow or gaze direction in the vertical dimension by manipulating the congruence between the target direction and background location, and to validate a possible cognitive mechanism for gaze direction specificity - inhibiting background location. The results showed that when subjects were required to identify the target direction in a Stroop task (Experiment 1), the gaze cue failed to induce the Stroop effect. However, when subjects were required to judge the congruence between the target direction and the background location (Experiment 2), the gaze cue and the arrow cue both induced the Stroop effect. This suggests that " inhibiting background location" is responsible for the elimination of the spatial Stroop effect by gaze direction, which may one of the mechanisms for gaze direction specificity.

Attentional Orienting and Disfluency-Related Memory Boost Are Intact in Adults With Moderate-Severe Traumatic Brain Injury

PURPOSE

Traumatic brain injury (TBI) is associated with a range of cognitive-communicative deficits that interfere with everyday communication and social interaction. Considerable effort has been directed at characterizing the nature and scope of cognitive-communication disorders in TBI, yet the underlying mechanisms of impairment are largely unspecified. The present research examines sensitivity to a common communicative cue, disfluency, and its impact on memory for spoken language in TBI.

METHOD

Fifty-three participants with moderate-severe TBI and 53 noninjured comparison participants listened to a series of sentences, some of which contained disfluencies. A subsequent memory test probed memory for critical words in the sentences.

RESULTS

Participants with TBI successfully remembered the spoken words (b = 1.57, p < .0001) at a similar level to noninjured comparison participants. Critically, participants with TBI also exhibited better recognition memory for words preceded by disfluency compared to words from fluent sentences (b = 0.57, p = .02).

CONCLUSIONS

These findings advance mechanistic accounts of cognitive-communication disorder by revealing that, when isolated for experimental study, individuals with moderate-severe TBI are sensitive to attentional orienting cues in speech and exhibit enhanced recognition of individual words preceded by disfluency. These results suggest that some aspects of cognitive-communication disorders may not emerge from an inability to perceive and use individual communication cues, but rather from disruptions in managing (i.e., attending, weighting, integrating) multiple cognitive, communicative, and social cues in complex and dynamic interactions. This hypothesis warrants further investigation.

Social excluder's face reduces gaze-triggered attention orienting

Social ostracism, a negative affective experience in interpersonal interactions, is thought to modulate the gaze-cueing effect (GCE). However, it is unclear whether the impact of social exclusion on the GCE is related to the identity of the cueing face. Therefore, the present study employed a two-phase paradigm to address this issue. In the first phase, two groups of participants were instructed to complete a Cyberball game with two virtual avatars to establish a binding relationship between a specific face's identity and the emotions of social exclusion or inclusion. In the second phase, these two virtual avatars (exclusion faces/inclusion faces) and two new faces (control faces) were used as cueing faces in the gaze-cueing task. The results found that, for the exclusion group, the magnitudes of the GCEs for the exclusion and exclusion-control faces were similar in the 200 ms stimulus onset asynchrony (SOA) condition, while the exclusion face's GCE was significantly smaller than that of the exclusion-control face in the 700 ms SOA condition. In contrast, for the inclusion group, the GCEs for inclusion and inclusion-control faces in both the 200 ms SOA and 700 ms SOA conditions did not significantly differ. This study reveals that the effect of social exclusion on the GCE is related to the identity of the cueing face, with individuals more reluctant to follow the gaze direction of excluder and shift their attention and provides experimental evidence that the perception of higher social relations can exert a top-down impact on the processing of social spatial cues.

Covert and overt automatic imitation are correlated

Most theoretical accounts of imitation assume that covert and overt measures of automatic imitation tap into the same underlying construct. Despite this widespread assumption, it is not well supported by empirical evidence. In fact, the only study investigating the relation between covert and overt automatic imitation failed to find a correlation between them (Genschow et al., 2017, PLOS ONE, 12[9], Article e0183784). However, because overt and covert imitation were measured using two very different tasks, and because the measure of overt imitation was found to be unreliable, it is still not clear whether a correlation between both measures exists. Here, we address this question by reanalyzing the results of a previous virtual reality study in which automatic imitation was indexed with an overt and covert measure of gaze following, both obtained within one and the same task (Cracco et al., 2022, IScience, Article 104891). The results show that, in this situation, both types of imitation do correlate. As such, our results provide support for the idea that overt and covert measures of automatic imitation measure the same underlying construct.

Perceived gaze dynamics in social interactions can alter (and even reverse) the perceived temporal order of events

Here's an all-too-familiar scenario: Person A is staring at person B, and then B turns toward A, and A immediately looks away (a phenomenon we call 'gaze deflection'). Beyond perceiving lower-level properties here - such as the timing of the eye/head turns - you can also readily perceive seemingly higher-level social dynamics: A got caught staring, and frantically looked away in embarrassment! It seems natural to assume that such social impressions are based on more fundamental representations of what happened when - but here we show that social gaze dynamics are unexpectedly powerful in that they can actually alter (and even reverse) the perceived temporal order of the underlying events. Across eight experiments, observers misperceived B as turning before A, when in fact they turned simultaneously - and even when B was turning after A. Additional controls confirmed that this illusion depends on visual processing (vs. being driven solely by higher-level interpretations), and that it is specific to the perception of social agents (vs. non-social objects). This demonstrates how social perception is tightly integrated into our perceptual experience of the world, and can have powerful consequences for one of the most basic properties that we can perceive: what happens when.

Psychopathy and gaze cueing

BACKGROUND AND OBJECTIVES

Psychopathic traits - and especially callous affective features - have been linked to altered processing of others' emotional expressions, and to reduced attention to the eyes. Despite the importance of gaze cueing (i.e., the tendency to orient attention toward where someone else is looking) for social functioning, few studies have investigated relationships between psychopathic traits and gaze cueing, and whether facial emotional expression influence these relationships, obtaining mixed results. To address this gap, the present study aimed to evaluate associations between psychopathic traits and gaze cueing for emotional and neutral expressions.

METHODS

65 non-clinical male participants (Mage = 27.3 years) completed two self-report measures of psychopathy and performed laboratory tasks to assess gaze-cueing for emotional vs. neutral faces and an arrow-cueing task as a comparison.

RESULTS

Linear mixed models showed no significant associations of emotional (versus neutral) expressions, or psychopathy trait dimensions, with either gaze cueing or arrow cueing.

LIMITATIONS

Reliance on a convenience sample of non-clinical men, assessed with self-reports measures of psychopathy, and using static emotional stimuli limit the generalizability of our findings.

CONCLUSIONS

Findings suggest that psychopathic traits are not associated with individual differences in following others' gaze to direct attention, and that there was no advantage for affective relative to neutral expressions.

No effect of autistic traits on social attention: evidence based on single-cue and conflicting-cues scenarios

Individuals often use others' gaze and head directions to direct their attention. To investigate the influence of autistic traits on social attention, we conducted two experiments comparing groups with high and low autistic traits in single-cue (Experiment 1) and conflicting-cue (Experiment 2) scenarios. Our findings indicate that individuals responded more rapidly to the direction of a single social cue or the consensus of multiple cues. However, we did not observe significant differences in social attention between individuals with high and low autistic traits. Notably, as the stimulus onset asynchrony (SOA) increased, individuals with low autistic traits exhibited greater improvements in reaction speed compared to those with high autistic traits. This suggests that individuals with low autistic traits excel at leveraging temporal information to optimize their behavioral readiness over time, hinting at potential variations in cognitive flexibility related to autistic traits.

Social Communication in Young Children With Sex Chromosome Trisomy (XXY, XXX, XYY): A Study With Eye Tracking and Heart Rate Measures

OBJECTIVE

Children with sex chromosome trisomy (SCT) have an increased risk for suboptimal development. Difficulties with language are frequently reported, start from a very young age, and encompass various domains. This cross-sectional study examined social orientation with eye tracking and physiological arousal responses to gain more knowledge on how children perceive and respond to communicative bids and evaluated the associations between social orientation and language outcomes, concurrently and 1 year later.

METHOD

In total, 107 children with SCT (33 XXX, 50 XXY, and 24 XYY) and 102 controls (58 girls and 44 boys) aged between 1 and 7 years were included. Assessments took place in the USA and Western Europe. A communicative bids eye tracking paradigm, physiological arousal measures, and receptive and expressive language outcomes were used.

RESULTS

Compared to controls, children with SCT showed reduced attention to the face and eyes of the on-screen interaction partner and reduced physiological arousal sensitivity in response to direct versus averted gaze. In addition, social orientation to the mouth was related to concurrent receptive and expressive language abilities in 1-year-old children with SCT.

CONCLUSIONS

Children with SCT may experience difficulties with social communication that extend past the well-recognized risk for early language delays. These difficulties may underlie social-behavioral problems that have been described in the SCT population and are an important target for early monitoring and support.

Gaze Orienting in the Social World: An Exploration of the Role Played by Caregiving Vocal and Tactile Behaviors in Infants with Visual Impairment and in Sighted Controls

Infant attention is a cognitive function that underlines sensory-motor integration processes at the interface between the baby and the surrounding physical and socio-relational environment, mainly with the caregivers. The investigation of the role of non-visual inputs (i.e., vocal and tactile) provided by the caregivers in shaping infants' attention in the context of visual impairment is relevant from both a theoretical and clinical point of view. This study investigated the social attention (i.e., gaze orientation) skills in a group of visually impaired (VI) and age-matched sighted controls (SCs) between 9 and 12 months of age. Moreover, the role of VI severity and maternal vocalizations and touch in shaping the social attention were investigated. Overall, 45 infants and their mothers participated in a video-recorded 4 min interaction procedure, including a play and a still-face episode. The infants' gaze orientation (i.e., mother-directed, object-directed, or unfocused) and the types of maternal vocalizations and touch (i.e., socio-cognitive, affective) were micro-analytically coded. Maternal vocalizations and touch were found to influence gaze orientation differently in VI infants compared SCs. Moreover, the group comparisons during the play episode showed that controls were predominantly oriented to the mothers, while VI infants were less socially oriented. Visual impairment severity did not emerge as linked with social attention. These findings contribute to our understanding of socio-cognitive developmental trajectories in VI infants and highlight the need for tailored interventions to promote optimal outcomes for VI populations.

Grandiose narcissism associates with higher cognitive performance under stress through more efficient attention distribution: An eye-tracking study

Narcissism is a part of the Dark Triad that consists also of the traits of Machiavellianism and psychopathy. Two main types of narcissism exist: grandiose and vulnerable narcissism. Being a Dark Triad trait, narcissism is typically associated with negative outcomes. However, recent research suggests that at least the grandiose type may be linked (directly or indirectly) to positive outcomes including lower levels of psychopathology, higher school grades in adolescents, deeper and more strategic learning in university students and higher cognitive performance in experimental settings. The current pre-registered, quasi-experimental study implemented eye-tracking to assess whether grandiose narcissism indirectly predicts cognitive performance through wider distribution of attention on the Raven's Progressive Matrices task. Fifty-four adults completed measures of the Dark Triad, self-esteem and psychopathology. Eight months to one year later, participants completed the Raven's, while their eye-movements were monitored during high stress conditions. When controlling for previous levels of psychopathology, grandiose narcissism predicted higher Raven's scores indirectly, through increased variability in the number of fixations across trials. These findings suggest that grandiose narcissism predicts higher cognitive performance, at least in experimental settings, and call for further research to understand the implications of this seemingly dark trait for performance across various settings.

I prefer what you can see: The role of visual perspective-taking on the gaze-liking effect

Individuals' gaze on an object usually leads others to prefer that object, which is called the gaze-liking effect. However, it is still unclear whether this effect is driven by social factors (i.e., visual perspective-taking) or the domain-general processing (i.e., attention cueing). This research explored the mechanism of the gaze-liking effect by manipulating the objects' visibility to an avatar in six online one-shot experiments. The results showed that participants' affective evaluation for the object was modulated by the avatar's visual perspective. Specifically, the visible object to the avatar received a higher rating of liking degree. However, when the avatar was replaced with a non-social stimulus, the experimental effect was absent. Furthermore, the gaze-liking effect was robust while controlling for confounding factors such as the distance between the object and the avatar or type of stimuli. These findings provided convincing evidence that the gaze-liking effect involves a process of the other's visual experience and is not merely a by-product of the gaze-cueing effect.

Impaired recognition of interactive intentions in adults with autism spectrum disorder not attributable to differences in visual attention or coordination via eye contact and joint attention

Altered nonverbal communication patterns especially with regard to gaze interactions are commonly reported for persons with autism spectrum disorder (ASD). In this study we investigate and differentiate for the first time the interplay of attention allocation, the establishment of shared focus (eye contact and joint attention) and the recognition of intentions in gaze interactions in adults with ASD compared to control persons. Participants interacted via gaze with a virtual character (VC), who they believed was controlled by another person. Participants were instructed to ascertain whether their partner was trying to interact with them. In fact, the VC was fully algorithm-controlled and showed either interactive or non-interactive gaze behavior. Participants with ASD were specifically impaired in ascertaining whether their partner was trying to interact with them or not as compared to participants without ASD whereas neither the allocation of attention nor the ability to establish a shared focus were affected. Thus, perception and production of gaze cues seem preserved while the evaluation of gaze cues appeared to be impaired. An additional exploratory analysis suggests that especially the interpretation of contingencies between the interactants' actions are altered in ASD and should be investigated more closely.

The infant-doctor relationship: an examination of infants' distress reactions in the presence of a doctor

Fear of doctors is a common source of distress among infants; however, the underlying sources of this distress are unknown. To investigate the doctor-infant relationship, the behaviors of 61 healthy infants (176-617 days old) were observed in a simulated examination room. Their behaviors and electrocardiograms were recorded. Two groups of infants were analyzed: those who cried and those who did not. When an experimenter dressed in the doctor's attire entered the room, all 9 infants who were crying (14.8% of all infants) stopped crying, all infants gazed at the experimenter, and their mean heart rate (HR) decreased. After the auscultation started, 29.5% of all infants cried, and the HRs of infants who cried were higher than those of infants who did not cry. During the auscultation, 80.0% of infants who cried averted from the experimenter, while 34.4% of infants who did not cry. Within 5 s of gazing at the stethoscope, the number of infants who cried increased from 3 to 12, and their mean HR also increased. Our findings suggest that the fear of doctors is not due to the appearance of doctors but rather to specific actions performed by doctors, such as auscultation. Infants may regard a doctor's appearance as a source of interest. Furthermore, a stethoscope is a possible trigger for infants' crying. These behavioral observations suggest the potential for patient-centered care for infants.

The integration of head and body cues during the perception of social interactions

Humans spend a large proportion of time participating in social interactions. The ability to accurately detect and respond to human interactions is vital for social functioning, from early childhood through to older adulthood. This detection ability arguably relies on integrating sensory information from the interactants. Within the visual modality, directional information from a person's eyes, head, and body are integrated to inform where another person is looking and who they are interacting with. To date, social cue integration research has focused largely on the perception of isolated individuals. Across two experiments, we investigated whether observers integrate body information with head information when determining whether two people are interacting, and manipulated frame of reference (one of the interactants facing observer vs. facing away from observer) and the eye-region visibility of the interactant. Results demonstrate that individuals integrate information from the body with head information when perceiving dyadic interactions, and that integration is influenced by the frame of reference and visibility of the eye-region. Interestingly, self-reported autistics traits were associated with a stronger influence of body information on interaction perception, but only when the eye-region was visible. This study investigated the recognition of dyadic interactions using whole-body stimuli while manipulating eye visibility and frame of reference, and provides crucial insights into social cue integration, as well as how autistic traits affect cue integration, during perception of social interactions.

Uncovering the cognitive mechanisms underlying the gaze cueing effect

The gaze cueing effect is the tendency for people to respond faster to targets appearing at locations gazed at by others, compared with locations gazed away from by others. The effect is robust, widely studied, and is an influential finding within social cognition. Formal evidence accumulation models provide the dominant theoretical account of the cognitive processes underlying speeded decision-making, but they have rarely been applied to social cognition research. In this study, using a combination of individual-level and hierarchical computational modelling techniques, we applied evidence accumulation models to gaze cueing data (three data sets total, N = 171, 139,001 trials) for the first time to assess the relative capacity that an attentional orienting mechanism and information processing mechanisms have for explaining the gaze cueing effect. We found that most participants were best described by the attentional orienting mechanism, such that response times were slower at gazed away from locations because they had to reorient to the target before they could process the cue. However, we found evidence for individual differences, whereby the models suggested that some gaze cueing effects were driven by a short allocation of information processing resources to the gazed at location, allowing for a brief period where orienting and processing could occur in parallel. There was exceptionally little evidence to suggest any sustained reallocation of information processing resources neither at the group nor individual level. We discuss how this individual variability might represent credible individual differences in the cognitive mechanisms that subserve behaviourally observed gaze cueing effects.

TAT-HUM: Trajectory analysis toolkit for human movements in Python

Human movement trajectories can reveal useful insights regarding the underlying mechanisms of human behaviors. Extracting information from movement trajectories, however, can be challenging because of their complex and dynamic nature. The current paper presents a Python toolkit developed to help users analyze and extract meaningful information from the trajectories of discrete rapid aiming movements executed by humans. This toolkit uses various open-source Python libraries, such as NumPy and SciPy, and offers a collection of common functionalities to analyze movement trajectory data. To ensure flexibility and ease of use, the toolkit offers two approaches: an automated approach that processes raw data and generates relevant measures automatically, and a manual approach that allows users to selectively use different functions based on their specific needs. A behavioral experiment based on the spatial cueing paradigm was conducted to illustrate how one can use this toolkit in practice. Readers are encouraged to access the publicly available data and relevant analysis scripts as an opportunity to learn about kinematic analysis for human movements.

Eyes meet, hands greet: The art of timing in social interactions

Shaking hands is a fundamental form of social interaction. The current study used high-definition cameras during a university graduation ceremony to examine the temporal sequencing of eye contact and shaking hands. Analyses revealed that mutual gaze always preceded shaking hands. A follow up investigation manipulated gaze when shaking hands, and found that participants take significantly longer to accept a handshake when an outstretched hand precedes eye contact. These findings demonstrate that the timing between a person's gaze and their offer to shake hands is critical to how their action is interpreted.