The "where" of social attention: Head and body direction aftereffects arise from representations specific to cue type and not direction alone

Precision-dependent modulation of social attention

Social attention, guided by cues like gaze direction, is crucial for effective social interactions. However, how dynamic environmental context modulates this process remains unclear. Integrating a hierarchical Bayesian model with fMRI, this study investigated how individuals adjusted attention based on the predictions about cue validity (CV). Thirty-three participants performed a modified Posner location-cueing task with varying CV. Behaviorally, individuals' allocation of social attention was finely tuned to the precision (inverse variance) of CV predictions, with the predictions updated by precision-weighted prediction errors (PEs) about the occurrence of target locations. Neuroimaging results revealed that the interaction between allocation of social attention and CV influenced activity in regions involved in spatial attention and/or social perception. Precision-weighted PEs about target locations specifically modulated activity in the temporoparietal junction (TPJ), superior temporal sulcus (STS), and primary visual cortex (V1), underscoring their roles in refining attentional predictions. Dynamic causal modeling (DCM) further demonstrated that enhanced absolute precision-weighted PEs about target locations strengthened the effective connectivity from V1 and STS to TPJ, emphasizing their roles in conveying residual error signals upwards to high-level critical attention areas. These findings emphasized the pivotal role of precision in attentional modulation, enhancing our understanding of context-dependent social attention.

No effect of autistic traits on social attention: evidence based on single-cue and conflicting-cues scenarios

Individuals often use others' gaze and head directions to direct their attention. To investigate the influence of autistic traits on social attention, we conducted two experiments comparing groups with high and low autistic traits in single-cue (Experiment 1) and conflicting-cue (Experiment 2) scenarios. Our findings indicate that individuals responded more rapidly to the direction of a single social cue or the consensus of multiple cues. However, we did not observe significant differences in social attention between individuals with high and low autistic traits. Notably, as the stimulus onset asynchrony (SOA) increased, individuals with low autistic traits exhibited greater improvements in reaction speed compared to those with high autistic traits. This suggests that individuals with low autistic traits excel at leveraging temporal information to optimize their behavioral readiness over time, hinting at potential variations in cognitive flexibility related to autistic traits.

The roles of gaze and head orientation in face categorization during rapid serial visual presentation

Little is known about how perceived gaze direction and head orientation may influence human categorization of visual stimuli as faces. To address this question, a sequence of unsegmented natural images, each containing a random face or a non-face object, was presented in rapid succession (stimulus duration: 91.7 ms per image) during which human observers were instructed to respond immediately to every face presentation. Faces differed in gaze and head orientation in 7 combinations - full-front views with perceived gaze (1) directed to the observer, (2) averted to the left, or (3) averted to the right, left ¾ side views with (4) direct gaze or (5) averted gaze, and right ¾ side views with (6) direct gaze or (7) averted gaze - were presented randomly throughout the sequence. We found highly accurate and rapid behavioural responses to all kinds of faces. Crucially, both perceived gaze direction and head orientation had comparable, non-interactive effects on response times, where direct gaze was responded faster than averted gaze by 48 ms and full-front view faster than ¾ side view also by 48 ms on average. Presentations of full-front faces with direct gaze led to an additive speed advantage of 96 ms to ¾ faces with averted gaze. The results reveal that the effects of perceived gaze direction and head orientation on the speed of face categorization probably depend on the degree of social relevance of the face to the viewer.

Adaptation to the Direction of Others' Gaze: A Review

The direction of another person’s gaze provides us with a strong cue to their intentions and future actions, and, correspondingly, the human visual system has evolved to extract information about others’ gaze from the sensory stream. The perception of gaze is a remarkably plastic process: adaptation to a particular direction of gaze over a matter of seconds or minutes can cause marked aftereffects in our sense of where other people are looking. In this review, we first discuss the measurement, specificity, and neural correlates of gaze aftereffects. We then examine how studies that have explored the perceptual and neural determinants of gaze aftereffects have provided key insights into the nature of how other people’s gaze direction is represented within the visual hierarchy. This includes the level of perceptual representation of gaze direction (e.g., relating to integrated vs. local facial features) and the interaction of this system with higher-level social-cognitive functions, such as theory of mind. Moreover, computational modeling of data from behavioral studies of gaze adaptation allows us to make inferences about the functional principles that govern the neural encoding of gaze direction. This in turn provides a foundation for testing computational theories of neuropsychiatric conditions in which gaze processing is compromised, such as autism.

Functional Mechanisms Encoding Others' Direction of Gaze in the Human Nervous System

The direction of others' gaze is a strong social signal to their intentions and future behavior. Pioneering electrophysiological research identified cell populations in the primate visual cortex that are tuned to specific directions of observed gaze, but the functional architecture of this system is yet to be precisely specified. Here, we develop a computational model of how others' gaze direction is flexibly encoded across sensory channels within the gaze system. We incorporate the divisive normalization of sensory responses—a computational mechanism that is thought to be widespread in sensory systems but has not been examined in the context of social vision. We demonstrate that the operation of divisive normalization in the gaze system predicts a surprising and distinctive pattern of perceptual changes after sensory adaptation to gaze stimuli and find that these predictions closely match the psychophysical effects of adaptation in human observers. We also find that opponent coding, broadband multichannel, and narrowband multichannel models of sensory coding make distinct predictions regarding the effects of adaptation in a normalization framework and find evidence in favor of broadband multichannel coding of gaze. These results reveal the functional principles that govern the neural encoding of gaze direction and support the notion that divisive normalization is a canonical feature of nervous system function. Moreover, this research provides a strong foundation for testing recent computational theories of neuropsychiatric conditions in which gaze processing is compromised, such as autism and schizophrenia.

Adaptation of social and non-social cues to direction in adults with autism spectrum disorder and neurotypical adults with autistic traits

Perceptual constancy strongly relies on adaptive gain control mechanisms, which shift perception as a function of recent sensory history. Here we examined the extent to which individual differences in magnitude of adaptation aftereffects for social and non-social directional cues are related to autistic traits and sensory sensitivity in healthy participants (Experiment 1); and also whether adaptation for social and non-social directional cues is differentially impacted in adults with Autism Spectrum Disorder (ASD) relative to neurotypical (NT) controls (Experiment 2). In Experiment 1, individuals with lower susceptibility to adaptation aftereffects, i.e. more 'veridical' perception, showed higher levels of autistic traits across social and non-social stimuli. Furthermore, adaptation aftereffects were predictive of sensory sensitivity. In Experiment 2, only adaptation to eye-gaze was diminished in adults with ASD, and this was related to difficulties categorizing eye-gaze direction at baseline. Autism Diagnostic Observation Schedule (ADOS) scores negatively predicted lower adaptation for social (head and eye-gaze direction) but not non-social (chair) stimuli. These results suggest that the relationship between adaptation and the broad socio-cognitive processing style captured by 'autistic traits' may be relatively domain-general, but in adults with ASD diminished adaptation is only apparent where processing is most severely impacted, such as the perception of social attention cues.

Point Me in the Right Direction: Same and Cross Category Visual Aftereffects to Directional Cues

Of the many hand gestures that we use in communication pointing is one of the most common and powerful in its role as a visual referent that directs joint attention. While numerous studies have examined the developmental trajectory of pointing production and comprehension, very little consideration has been given to adult visual perception of hand pointing gestures. Across two studies, we use a visual adaptation paradigm to explore the mechanisms underlying the perception of proto-declarative hand pointing. Twenty eight participants judged whether 3D modeled hands pointed, in depth, at or to the left or right of a target (test angles of 0°, 0.75° and 1.5° left and right) before and after adapting to either hands or arrows which pointed 10° to the right or left of the target. After adaptation, the perception of the pointing direction of the test hands shifted with respect to the adapted direction, revealing separate mechanisms for coding right and leftward pointing directions. While there were subtle yet significant differences in the strength of adaptation to hands and arrows, both cues gave rise to a similar pattern of aftereffects. The considerable cross category adaptation found when arrows were used as adapting stimuli and the asymmetry in aftereffects to left and right hands suggests that the adaptation aftereffects are likely driven by simple orientation cues, inherent in the morphological structure of the hand, and not dependent on the biological status of the hand pointing cue. This finding provides evidence in support of a common neural mechanism that processes these directional social cues, a mechanism that may be blind to the biological status of the stimulus category.