Separate coding of different gaze directions in the superior temporal sulcus and inferior parietal lobule

Metacognitive evaluation of postdecisional perceptual representations

Perceptual confidence is thought to arise from metacognitive processes that evaluate the underlying perceptual decision evidence. We investigated whether metacognitive access to perceptual evidence is constrained by the hierarchical organization of visual cortex, where high-level representations tend to be more readily available for explicit scrutiny. We found that the ability of human observers to evaluate their confidence did depend on whether they performed a high-level or low-level task on the same stimuli, but was also affected by manipulations that occurred long after the perceptual decision. Confidence in low-level perceptual decisions degraded with more time between the decision and the response cue, especially when backward masking was present. Confidence in high-level tasks was immune to backward masking and benefitted from additional time. These results can be explained by a model assuming confidence heavily relies on postdecisional internal representations of visual stimuli that degrade over time, where high-level representations are more persistent.

The semantics of gaze in person perception: a novel qualitative-quantitative approach

Interpreting gaze behavior is essential in evaluating interaction partners, yet the 'semantics of gaze' in dynamic interactions are still poorly understood. We aimed to comprehensively investigate effects of gaze behavior patterns in different conversation contexts, using a two-step, qualitative-quantitative procedure. Participants watched video clips of single persons listening to autobiographic narrations by another (invisible) person. The listener's gaze behavior was manipulated in terms of gaze direction, frequency and direction of gaze shifts, and blink frequency; emotional context was manipulated through the valence of the narration (neutral/negative). In Experiment 1 (qualitative-exploratory), participants freely described which states and traits they attributed to the listener in each condition, allowing us to identify relevant aspects of person perception and to construct distinct rating scales that were implemented in Experiment 2 (quantitative-confirmatory). Results revealed systematic and differential meanings ascribed to the listener's gaze behavior. For example, rapid blinking and fast gaze shifts were rated more negatively (e.g., restless and unnatural) than slower gaze behavior; downward gaze was evaluated more favorably (e.g., empathetic) than other gaze aversion types, especially in the emotionally negative context. Overall, our study contributes to a more systematic understanding of flexible gaze semantics in social interaction.

Gray matter density changes in children with congenital severe sensorineural deafness: a voxel-based morphometric study

Early hearing loss could cause abnormal brain development, which has been linked to the complex process known as cross-modal neuroplasticity. However, previous studies investigating the brain structure of infants with congenital severe sensorineural hearing loss (CSSHL) are scarce and have yielded inconsistent results. This study aimed to further explore the gray matter (GM) density changes in children with CSSHL. Fifteen children aged 0-5 years with CSSHL and 11 healthy children as controls (aged 0-5 years) were recruited. Each participant underwent a structural MRI scan. The voxel-based morphometry method was performed to evaluate GM density for each participant and analyze their characteristics. It was discovered that: (1) GM density of the right superior temporal gyrus and caudate in the CSSHL group was smaller than that of healthy controls (HC). However, GM density was larger in the left posterior central gyrus, superior frontal gyrus, inferior parietal lobule and right cerebellum in the CSSHL group compared with HC. (2) The GM density value of the left superior frontal gyrus and inferior parietal lobule was negatively correlated with age. However, the GM density value of the right superior temporal gyrus in the CSSHL group was positively correlated with age. Compared with HC, the GM density of CSSHL children was larger in somatosensory areas (including left superior frontal gyrus, posterior central gyrus, inferior parietal lobule and right cerebellum), whereas GM density was smaller in auditory-related areas (such as the right superior temporal gyrus and caudate). Moreover, GM density change was influenced by the duration of hearing deprivation.

Identifying the cortical face network with dynamic face stimuli: A large group fMRI study

Functional magnetic resonance imaging (fMRI) studies have identified a network of face-selective regions distributed across the human brain. In the present study, we analyzed data from a large group of gender-balanced participants to investigate how reliably these face-selective regions could be identified across both cerebral hemispheres. Participants ( N =52) were scanned with fMRI while viewing short videos of faces, bodies, and objects. Results revealed that five face-selective regions: the fusiform face area (FFA), posterior superior temporal sulcus (pSTS), anterior superior temporal sulcus (aSTS), inferior frontal gyrus (IFG) and the amygdala were all larger in the right than in the left hemisphere. The occipital face area (OFA) was larger in the right hemisphere as well, but the difference between the hemispheres was not significant. The neural response to moving faces was also greater in face-selective regions in the right than in the left hemisphere. An additional analysis revealed that the pSTS and IFG were significantly larger in the right hemisphere compared to other face-selective regions. This pattern of results demonstrates that moving faces are preferentially processed in the right hemisphere and that the pSTS and IFG appear to be the strongest drivers of this laterality. An analysis of gender revealed that face-selective regions were typically larger in females ( N =26) than males ( N =26), but this gender difference was not statistically significant.

Cognitive dysfunctions in high myopia: An overview of potential neural morpho-functional mechanisms

Dementia and cognitive impairment (CIM) carry high levels of mortality. Visual impairment (VI) is linked with CIM risk. High myopia (HM) is a chronic disease frequently leading to irreversible blindness. Current opinion has shifted from retinal injury as the cause of HM to the condition being considered an eye-brain disease. However, the pathogenesis of this disease and the manner in which neural structures are damaged are poorly understood. This review comprehensively discusses the relationship between HM, the central nervous system, and CIM, together with the novel concept of three visual pathways, and possible research perspectives.

Social Attention: Developmental Foundations and Relevance for Autism Spectrum Disorder

The use of the term "social attention" (SA) in the cognitive neuroscience and developmental psychopathology literature has increased exponentially in recent years, in part motivated by the aim to understand the early development of autism spectrum disorder (ASD). Unfortunately, theoretical discussions around the term have lagged behind its various uses. Here, we evaluate SA through a review of key candidate SA phenotypes emerging early in life, from newborn gaze cueing and preference for face-like configurations to later emerging skills such as joint attention. We argue that most of the considered SA phenotypes are unlikely to represent unique socioattentional processes and instead have to be understood in the broader context of bottom-up and emerging top-down (domain-general) attention. Some types of SA behaviors (e.g., initiation of joint attention) are linked to the early development of ASD, but this may reflect differences in social motivation rather than attention per se. Several SA candidates are not linked to ASD early in life, including the ones that may represent uniquely socioattentional processes (e.g., orienting to faces, predicting others' manual action goals). Although SA may be a useful superordinate category under which one can organize certain research questions, the widespread use of the term without proper definition is problematic. Characterizing gaze patterns and visual attention in social contexts in infants at elevated likelihood of ASD may facilitate early detection, but conceptual clarity regarding the underlying processes at play is needed to sharpen research questions and identify potential targets for early intervention.

Spatial selectivity in adaptation to gaze direction

A person's focus of attention is conveyed by the direction of their eyes and face, providing a simple visual cue fundamental to social interaction. A growing body of research examines the visual mechanisms that encode the direction of another person's gaze as we observe them. Here we investigate the spatial receptive field properties of these mechanisms, by testing the spatial selectivity of sensory adaptation to gaze direction. Human observers were adapted to faces with averted gaze presented in one visual hemifield, then tested in their perception of gaze direction for faces presented in the same or opposite hemifield. Adaptation caused strong, repulsive perceptual aftereffects, but only for faces presented in the same hemifield as the adapter. This occurred even though adapting and test stimuli were in the same external location across saccades. Hence, there was clear evidence for retinotopic adaptation and a relative lack of either spatiotopic or spatially invariant adaptation. These results indicate that adaptable representations of gaze direction in the human visual system have retinotopic spatial receptive fields. This strategy of coding others' direction of gaze with positional specificity relative to one's own eye position may facilitate key functions of gaze perception, such as socially cued shifts in visual attention.

Normal gaze processing in developmental prosopagnosia

Two key functions in human face perception are gaze discrimination and identity recognition. Here we examine whether gaze discrimination can be intact when identity recognition is impaired in developmental prosopagnosia (DP). We ran a large sample of developmental prosopagnosics (DPs) with a series of gaze discrimination tasks that assess various mechanisms in gaze processing. Experiment 1 (N = 101 DP participants) investigates spatial processing using an abnormal eye gaze detection task and a Wollaston illusion task that measures perceptual integration of eye and head direction. Experiment 2 (N = 45 DP participants) investigates temporal processing using an adaptation task and a serial dependence task. Despite their deficits with identity recognition, DPs performed in the normal range across both experiments. These results demonstrate that gaze discrimination can be normal in DP, and that various mechanisms of gaze processing can be spared when identity recognition is impaired. Our findings clarify the highly selective nature of impairments in DP and provide support for neurocognitive models of face perception with distinct mechanisms for gaze and identity processing.

Holistic processing of gaze cues during interocular suppression

Direct eye contact is preferentially processed over averted gaze and has been shown to gain privileged access to conscious awareness during interocular suppression. This advantage might be driven by local features associated with direct gaze, such as the amount of visible sclera. Alternatively, a holistic representation of gaze direction, which depends on the integration of head and eye information, might drive the effects. Resolving this question is interesting because it speaks to whether the processing of higher-level social information in the visual system, such as facial characteristics that rely on holistic processing, is dependent on conscious awareness. The Wollaston Illusion is a visual illusion that allows researchers to manipulate perceived gaze direction while keeping local eye features constant. Here we used this illusion to elucidate the driving factor facilitating the direct gaze advantage during interocular suppression. Using continuous flash suppression, we rendered Wollaston faces with direct and averted gaze (initially) invisible. These faces conveyed different gaze directions but contained identical eye regions. Our results showed clear evidence for a direct gaze advantage with Wollaston faces, indicating that holistic representations of gaze direction may drive the direct gaze advantage during interocular suppression.

The Neurobiological Correlates of Gaze Perception in Healthy Individuals and Neurologic Patients

The ability to adaptively follow conspecific eye movements is crucial for establishing shared attention and survival. Indeed, in humans, interacting with the gaze direction of others causes the reflexive orienting of attention and the faster object detection of the signaled spatial location. The behavioral evidence of this phenomenon is called gaze-cueing. Although this effect can be conceived as automatic and reflexive, gaze-cueing is often susceptible to context. In fact, gaze-cueing was shown to interact with other factors that characterize facial stimulus, such as the kind of cue that induces attention orienting (i.e., gaze or non-symbolic cues) or the emotional expression conveyed by the gaze cues. Here, we address neuroimaging evidence, investigating the neural bases of gaze-cueing and the perception of gaze direction and how contextual factors interact with the gaze shift of attention. Evidence from neuroimaging, as well as the fields of non-invasive brain stimulation and neurologic patients, highlights the involvement of the amygdala and the superior temporal lobe (especially the superior temporal sulcus (STS)) in gaze perception. However, in this review, we also emphasized the discrepancies of the attempts to characterize the distinct functional roles of the regions in the processing of gaze. Finally, we conclude by presenting the notion of invariant representation and underline its value as a conceptual framework for the future characterization of the perceptual processing of gaze within the STS.

Developmental brain structural atypicalities in autism: a voxel-based morphometry analysis

BACKGROUND

Structural magnetic resonance imaging (sMRI) studies have shown atypicalities in structural brain changes in individuals with autism spectrum disorder (ASD), while a noticeable discrepancy in their results indicates the necessity of conducting further researches.

METHODS

The current study investigated the atypical structural brain features of autistic individuals who aged 6-30 years old. A total of 52 autistic individuals and 50 age-, gender-, and intelligence quotient (IQ)-matched typically developing (TD) individuals were included in this study, and were assigned into three based cohorts: childhood (6-12 years old), adolescence (13-18 years old), and adulthood (19-30 years old). Analyses of whole-brain volume and voxel-based morphometry (VBM) on the sMRI data were conducted.

RESULTS

No significant difference was found in the volumes of whole-brain, gray matter, and white matter between the autism and TD groups in the three age-based cohorts. For VBM analyses, the volumes of gray matter in the right superior temporal gyrus and right inferior parietal lobule in the autism group (6-12 years old) were smaller than those in the TD group; the gray matter volume in the left inferior parietal lobule in the autism group (13-18 years old) was larger than that in the TD group; the gray matter volume in the right middle occipital gyrus in the autism group (19-30 years old) was larger than that in the TD group, and the gray matter volume in the left posterior cingulate gyrus in the autism group was smaller than that in the TD group.

CONCLUSION

Autistic individuals showed different atypical regional gray matter volumetric changes in childhood, adolescence, and adulthood compared to their TD peers, indicating that it is essential to consider developmental stages of the brain when exploring brain structural atypicalities in autism.

Cognitive Impact of Anthropomorphized Robot Gaze

Attentional control does not have fix functioning and can be strongly impacted by the presence of other human beings or humanoid robots. In two studies, this phenomenon was investigated while focusing exclusively on robot gaze as a potential determinant of attentional control along with the role of participants’ anthropomorphic inferences toward the robot. In study 1, we expected and found higher interference in trials including a direct robot gaze compared to an averted gaze on a task measuring attentional control (Eriksen flanker task). Participants’ anthropomorphic inferences about the social robot mediated this interference. In study 2, we found that averted gazes congruent with the correct answer (same task as study 1) facilitated performance. Again, this effect was mediated by anthropomorphic inferences. These two studies show the importance of anthropomorphic robotic gaze on human cognitive processing, especially attentional control, and also open new avenues of research in social robotics.

Is there a 'zone of eye contact' within the borders of the face?

Eye contact is a salient feature of everyday interactions, yet it is not obvious what the physical conditions are under which we feel that we have eye contact with another person. Here we measure the range of locations that gaze can fall on a person's face to elicit a sense of eye contact. Participants made judgements about eye contact while viewing rendered images of faces with finely-varying gaze direction at a close interpersonal distance (50 cm). The 'zone of eye contact' tends to peak between the two eyes and is often surprisingly narrower than the observer's actual eye region. Indeed, the zone tends to extend further across the face in height than in width. This shares an interesting parallel with the 'cyclopean eye' of visual perspective - our sense of looking out from a single point in space despite the physical separation of our two eyes. The distribution of eye-contact strength across the face can be modelled at the individual-subject level as a 2D Gaussian function. Perception of eye contact is more precise than the sense of having one's face looked at, which captures a wider range of gaze locations in both the horizontal and vertical dimensions, at least at the close viewing distance used in the present study. These features of eye-contact perception are very similar cross-culturally, tested here in Australian and Japanese university students. However, the shape and position of the zone of eye contact does vary depending on recent sensory experience: adaptation to faces with averted gaze causes a pronounced shift and widening of the zone across the face, and judgements about eye contact also show a positive serial dependence. Together, these results provide insight into the conditions under which eye contact is felt, with respect to face morphology, culture, and sensory context.

Neural responses to facial attractiveness in the judgments of moral goodness and moral beauty

The judgments of moral goodness and moral beauty objectively refer to the perception and evaluation of moral traits, which are generally influenced by facial attractiveness. For centuries, people have equated beauty with the possession of positive qualities, but it is not clear whether the association between beauty and positive qualities exerts a similarly implicit influence on people's responses to moral goodness and moral beauty, how it affects those responses, and what is the neural basis for such an effect. The present study is the first to examine the neural responses to facial attractiveness in the judgments of moral goodness and moral beauty. We found that beautiful faces in both moral judgments activated the left ventral occipitotemporal cortices sensitive to the geometric configuration of the faces, demonstrating that both moral goodness and moral beauty required the automatic visual analysis of geometrical configuration of attractive faces. In addition, compared to beautiful faces during moral goodness judgment, beautiful faces during moral beauty judgment induced unique activity in the ventral medial prefrontal cortex and midline cortical structures involved in the emotional-valenced information about attractive faces. The opposite comparison elicited specific activity in the left superior temporal cortex and premotor area, which play a critical role in the recognition of facial identity. Our results demonstrated that the neural responses to facial attractiveness in the process of higher order moral decision-makings exhibit both task-general and task-specific characteristics. Our findings contribute to the understanding of the essence of the relationship between morality and aesthetics.

Eye Direction Detection and Perception as Premises of a Social Brain: A Narrative Review of Behavioral and Neural Data

The eyes and the gaze are important stimuli for social interaction in humans. Impaired recognition of facial identity, facial emotions, and inference of the intentions of others may result from difficulties in extracting information relevant to the eye region, mainly the direction of gaze. Therefore, a review of these data is of interest. Behavioral data demonstrating the importance of the eye region and how humans respond to gaze direction are reviewed narratively, and several theoretical models on how visual information on gaze is processed are discussed to propose a unified hypothesis. Several issues that have not yet been investigated are identified. The authors tentatively suggest experiments that might help progress research in this area. The neural aspects are subsequently reviewed to best describe the low-level and higher-level visual information processing stages in the targeted subcortical and cortical areas. A specific neural network is proposed on the basis of the literature. Various gray areas, such as the temporality of the processing of visual information, the question of salience priority, and the coordination between the two hemispheres, remain unclear and require further investigations. Finally, disordered gaze direction detection mechanisms and their consequences on social cognition and behavior are discussed as key deficiencies in several conditions, such as autism spectrum disorder, 22q11.2 deletion, schizophrenia, and social anxiety disorder. This narrative review provides significant additional data showing that the detection and perception of someone's gaze is an essential part of the development of our social brain.

Spontaneous recovery of adaptation aftereffects of natural facial categories

Adaptation to a natural face attribute such as a happy face can bias the perception of a subsequent face in this dimension such as a neutral face. Such face adaptation aftereffects have been widely found in many natural facial categories. However, how temporally tuned mechanisms could control the temporal dynamics of natural face adaptation aftereffects remains unknown. To address the question, we used a deadaptation paradigm to examine whether the spontaneous recovery of natural facial aftereffects would emerge in four natural facial categories including variable categories (emotional expressions in Experiment 1 and eye gaze in Experiment 2) and invariable categories (facial gender in Experiment 3 and facial identity in Experiment 4). In the deadaptation paradigm, participants adapted to a face with an extreme attribute (such as a 100% angry face in Experiment 1) for a relatively long duration, and then deadapted to a face with an opposite extreme attribute (such as a 100% happy face in Experiment 1) for a relatively short duration. The time courses of face adaptation aftereffects were measured using a top-up manner. Deadaptation only masked the effects of initial longer-lasting adaptation, and the spontaneous recovery of adaptation aftereffects was observed at the post-test stage for all four natural facial categories. These results likely indicate that the temporal dynamics of adaptation aftereffects of natural facial categories may be controlled by multiple temporally tuned mechanisms.

From Gaze Perception to Social Cognition: The Shared-Attention System

When two people look at the same object in the environment and are aware of each other's attentional state, they find themselves in a shared-attention episode. This can occur through intentional or incidental signaling and, in either case, causes an exchange of information between the two parties about the environment and each other's mental states. In this article, we give an overview of what is known about the building blocks of shared attention (gaze perception and joint attention) and focus on bringing to bear new findings on the initiation of shared attention that complement knowledge about gaze following and incorporate new insights from research into the sense of agency. We also present a neurocognitive model, incorporating first-, second-, and third-order social cognitive processes (the shared-attention system, or SAS), building on previous models and approaches. The SAS model aims to encompass perceptual, cognitive, and affective processes that contribute to and follow on from the establishment of shared attention. These processes include fundamental components of social cognition such as reward, affective evaluation, agency, empathy, and theory of mind.

Differential spatial computations in ventral and lateral face-selective regions are scaffolded by structural connections

Face-processing occurs across ventral and lateral visual streams, which are involved in static and dynamic face perception, respectively. However, the nature of spatial computations across streams is unknown. Using functional MRI and population receptive field (pRF) mapping, we measured pRFs in face-selective regions. Results reveal that spatial computations by pRFs in ventral face-selective regions are concentrated around the center of gaze (fovea), but spatial computations in lateral face-selective regions extend peripherally. Diffusion MRI reveals that these differences are mirrored by a preponderance of white matter connections between ventral face-selective regions and foveal early visual cortex (EVC), while connections with lateral regions are distributed more uniformly across EVC eccentricities. These findings suggest a rethinking of spatial computations in face-selective regions, showing that they vary across ventral and lateral streams, and further propose that spatial computations in high-level regions are scaffolded by the fine-grain pattern of white matter connections from EVC.

Emotion processing and regulation in major depressive disorder: A 7T resting-state fMRI study

Dysfunctions in bottom-up emotion processing (EP), as well as top-down emotion regulation (ER) are prominent features in pathophysiology of major depressive disorder (MDD). Nonetheless, it is not clear whether EP- and ER-related areas are regionally and/or connectively disturbed in MDD. In addition, it is yet to be known how EP- and ER-related areas are interactively linked to regulatory behavior, and whether this interaction is disrupted in MDD. In our study, regional amplitude of low frequency fluctuations (ALFF) and whole-brain functional connectivity (FC) of meta-analytic-driven EP- and ER-related areas were compared between 32 healthy controls (HC) and 20 MDD patients. Then, we aimed to investigate whether the EP-related areas can predict the ER-related areas and regulatory behavior in both groups. Finally, the brain-behavior correlations between the EP- and ER-related areas and depression severity were assessed. We found that: (a) affective areas are regionally and/or connectively disturbed in MDD; (b) EP-ER interaction seems to be disrupted in MDD; overburden of emotional reactivity in amygdala may inversely affect cognitive control processes in prefrontal cortices, which leads to diminished regulatory actions. (c) Depression severity is correlated with FC of affective areas. Our findings shed new lights on the neural underpinning of affective dysfunctions in depression.

Evidence for a Third Visual Pathway Specialized for Social Perception

Existing models propose that primate visual cortex is divided into two functionally distinct pathways. The ventral pathway computes the identity of an object; the dorsal pathway computes the location of an object, and the actions related to that object. Despite remaining influential, the two visual pathways model requires revision. Both human and non-human primate studies reveal the existence of a third visual pathway on the lateral brain surface. This third pathway projects from early visual cortex, via motion-selective areas, into the superior temporal sulcus (STS). Studies demonstrating that the STS computes the actions of moving faces and bodies (e.g., expressions, eye-gaze, audio-visual integration, intention, and mood) show that the third visual pathway is specialized for the dynamic aspects of social perception.

Face Pareidolia Recruits Mechanisms for Detecting Human Social Attention

Face pareidolia is the phenomenon of seeing facelike structures in everyday objects. Here, we tested the hypothesis that face pareidolia, rather than being limited to a cognitive or mnemonic association, reflects the activation of visual mechanisms that typically process human faces. We focused on sensory cues to social attention, which engage cell populations in temporal cortex that are susceptible to habituation effects. Repeated exposure to “pareidolia faces” that appear to have a specific direction of attention causes a systematic bias in the perception of where human faces are looking, indicating that overlapping sensory mechanisms are recruited when we view human faces and when we experience face pareidolia. These cross-adaptation effects are significantly reduced when pareidolia is abolished by removing facelike features from the objects. These results indicate that face pareidolia is essentially a perceptual phenomenon, occurring when sensory input is processed by visual mechanisms that have evolved to extract specific social content from human faces.

Dissociated deficits in attentional networks in social anxiety and depression

A critical cognitive symptom that is commonly involved in social anxiety and depression is attentional deficit. However, the functional relationship between attentional deficit and these two disorders remains poorly understood. Here, we behaviorally disentangled the three key attentional components (alerting, orienting, and executive control) using the established attentional network task (ANT) to investigate how social anxiety and depression are related to deficits in these attention components. We identified a double dissociation between the symptoms of social anxiety and depression and the attentional component deficits when processing non-emotional stimuli. While individuals vulnerable to social anxiety exhibited deficits in the orienting component, individuals vulnerable to depression were impaired in the executive control component. Our findings showed that social anxiety and depression were associated with deficits in different attentional components, which are not specific to emotional information.

Joint Attention During Live Person-to-Person Contact Activates rTPJ, Including a Sub-Component Associated With Spontaneous Eye-to-Eye Contact

Eye-to-eye contact is a spontaneous behavior between interacting partners that occurs naturally during social interactions. However, individuals differ with respect to eye gaze behaviors such as frequency of eye-to-eye contacts, and these variations may reflect underlying differences in social behavior in the population. While the use of eye signaling to indicate a shared object of attention in joint attention tasks has been well-studied, the effects of the natural variation in establishing eye contact during joint attention have not been isolated. Here, we investigate this question using a novel two-person joint attention task. Participants were not instructed regarding the use of eye contacts; thus all mutual eye contact events between interacting partners that occurred during the joint attention task were spontaneous and varied with respect to frequency. We predicted that joint attention systems would be modulated by differences in the social behavior across participant pairs, which could be measured by the frequency of eye contact behavior. We used functional near-infrared spectroscopy (fNIRS) hyperscanning and eye-tracking to measure the neural signals associated with joint attention in interacting dyads and to record the number of eye contact events between them. Participants engaged in a social joint attention task in which real partners used eye gaze to direct each other's attention to specific targets. Findings were compared to a non-social joint attention task in which an LED cue directed both partners' attention to the same target. The social joint attention condition showed greater activity in right temporoparietal junction than the non-social condition, replicating prior joint attention results. Eye-contact frequency modulated the joint attention activity, revealing bilateral activity in social and high level visual areas associated with partners who made more eye contact. Additionally, when the number of mutual eye contact events was used to classify each pair as either "high eye contact" or "low eye contact" dyads, cross-brain coherence analysis revealed greater coherence between high eye contact dyads than low eye contact dyads in these same areas. Together, findings suggest that variation in social behavior as measured by eye contact modulates activity in a subunit of the network associated with joint attention.

Are attitudinal and perceptual body image the same or different? Evidence from high-level adaptation

We used a high-level adaptation paradigm to distinguish between two hypotheses: (1) perceptual and attitudinal body image measurements reflect conceptually different mechanisms which are statistically independent of each other; (2) attitudinal (e.g., questionnaire) and perceptual (e.g., visual yes-no) body image tasks represent two different ways of measuring exactly the same construct. Forty women, with no history of eating disorders, carried out the experiment. Each participant carried out five adaptation blocks, with adapting stimuli representing female bodies at: extreme-low body mass index (BMI), mid-low BMI, actual BMI of the observer, mid-high BMI, and extreme-high BMI. Block order was randomized across participants. The main outcome variable was percentage error in participants' self-estimates of body size, measured post-adaption. In regressions of this percentage error on the strength of the adapting stimuli together with observers' attitudinal body image as a covariate, we found positive regression slopes and no evidence for any interaction between the fixed effects. Therefore, we conclude that perceptual and attitudinal body image mechanisms are indeed independent of each other. In the light of this evidence, we discuss how people with eating disorders, like anorexia nervosa, may come to over-estimate their body size.

Seeing eye-to-eye: Social gaze interactions influence gaze direction identification

We tested whether gaze direction identification of individual faces can be modulated by prior social gaze encounters. In two experiments, participants first completed a joint-gaze learning task using a saccade/antisaccade paradigm. Participants would encounter some ‘joint-gaze faces’ that would consistently look at the participants saccade goal before participants looked there (Experiment 1) or would follow the participants gaze to the target (Experiment 2). ‘Non-joint-gaze faces’ would consistently look in the opposite direction. Participants then completed a second task in which they judged the gaze direction of the faces they had previously encountered. Participants were less likely to erroneously report faces with slightly deviated gaze as looking directly at them if the face had previously never engaged in joint gaze with them. However, this bias was only present when those faces had looked first (Experiment 1) and not when the faces looked after participants (Experiment 2). Comparing these data with gaze identification responses of a control group that did not complete any joint-gaze learning phase revealed that the difference in gaze identification in Experiment 1 is likely driven by a lowering of direct gaze bias in response to non-joint-gaze faces. Thus, previous joint-gaze experiences can affect gaze direction judgements at an identity-specific level. However, this modulation may rely on the socio-cognitive information available from viewing other’s initiation behaviours, especially when they fail to engage in social contact.

The Role of Emotional Expression and Eccentricity on Gaze Perception

The perception of another’s gaze direction and facial expression complements verbal communication and modulates how we interact with other people. However, our perception of these two cues is not always accurate, even when we are looking directly at the person. In addition, in many cases social communication occurs within groups of people where we can’t always look directly at every person in the group. Here, we sought to examine how the presence of other people influences our perception of a target face. We asked participants to judge the direction of gaze of the target face as either looking to their left, to their right or directly at them, when the face was viewed on its own or viewed within a group of other identity faces. The target face either had an angry or a neutral expression and was viewed directly (foveal experiment), or within peripheral vision (peripheral experiment). When the target was viewed within a group, the flanking faces also had either neutral or angry expressions and their gaze was in one of five different directions (from averted leftwards to averted rightwards in steps of 10°). When the target face was viewed foveally there was no effect of target emotion on participants’ judgments of its gaze direction. There was also no effect of the presence of flankers (regardless of expression) on the perception of the target gaze. When the target face was viewed peripherally, participants judged its direction of gaze to be direct over a wider range of gaze deviations than when viewed foveally, and more so for angry faces than neutral faces. We also find that flankers (regardless of emotional expression) did not influence performance. This suggests that observers judge that angry faces were looking at them over a broad range of gaze deviations in the periphery only, possibly resulting from increased uncertainty about the stimulus.

Assumptions about the positioning of virtual stimuli affect gaze direction estimates during Augmented Reality based interactions

We investigated gaze direction determination in dyadic interactions mediated by an Augmented Reality (AR) head-mounted-display. With AR, virtual content is overlaid on top of the real-world scene, offering unique data visualization and interaction opportunities. A drawback of AR however is related to uncertainty regarding the AR user’s focus of attention in social-collaborative settings: an AR user looking in our direction might either be paying attention to us or to augmentations positioned somewhere in between. In two psychophysical experiments, we assessed what impact assumptions concerning the positioning of virtual content attended by an AR user have on other people’s sensitivity to their gaze direction. In the first experiment we found that gaze discrimination was better when the participant was aware that the AR user was focusing on stimuli positioned on their depth plane as opposed to being positioned halfway between the AR user and the participant. In the second experiment, we found that this modulatory effect was explained by participants’ assumptions concerning which plane the AR user was focusing on, irrespective of these being correct. We discuss the significance of AR reduced gaze determination in social-collaborative settings as well as theoretical implications regarding the impact of this technology on social behaviour.

A Qualitative Systematic Review of Effects of Provider Characteristics and Nonverbal Behavior on Pain, and Placebo and Nocebo Effects

Background: Previous research has indicated that the sex, status, and nonverbal behaviors of experimenters or clinicians can contribute to reported pain, and placebo and nocebo effects in patients or research participants. However, no systematic review has been published. Objective: The aim of this study was to investigate the effects of experimenter/clinician characteristics and nonverbal behavior on pain, placebo, and nocebo effects. Methods: Using EmBase, Web of Knowledge, and PubMed databases, several literature searches were conducted to find studies that investigated the effects of the experimenter's/clinician's sex, status, and nonverbal behaviors on pain, placebo, and nocebo effects. Results: Thirty-four studies were included, 20 on the effects of characteristics of the experimenter/clinician, 11 on the role of nonverbal behaviors, and 3 on the effects of both nonverbal behaviors and characteristics of experimenters/clinicians on pain and placebo/nocebo effects. There was a tendency for experimenters/clinicians to induce lower pain report in participants of the opposite sex. Furthermore, higher confidence, competence, and professionalism of experimenters/clinicians resulted in lower pain report and higher placebo effects, whereas lower status of experimenters/clinicians such as lower confidence, competence, and professionalism generated higher reported pain and lower placebo effects. Positive nonverbal behaviors (e.g., smiling, strong tone of voice, more eye contact, more leaning toward the patient/participant, and more body gestures) contributed to lower reported pain and higher placebo effects, whereas negative nonverbal behaviors (i.e., no smile, monotonous tone of voice, no eye contact, leaning backward from the participant/patient, and no body gestures) contributed to higher reported pain and nocebo effects. Conclusion: Characteristics and nonverbal behaviors of experimenters/clinicians contribute to the elicitation and modulation of pain, placebo, and nocebo effects.

Visual attention and action: How cueing, direct mapping, and social interactions drive orienting

Despite considerable interest in both action perception and social attention over the last 2 decades, there has been surprisingly little investigation concerning how the manual actions of other humans orient visual attention. The present review draws together studies that have measured the orienting of attention, following observation of another's goal-directed action. Our review proposes that, in line with the literature on eye gaze, action is a particularly strong orienting cue for the visual system. However, we additionally suggest that action may orient visual attention using mechanisms, which gaze direction does not (i.e., neural direct mapping and corepresentation). Finally, we review the implications of these gaze-independent mechanisms for the study of attention to action. We suggest that our understanding of attention to action may benefit from being studied in the context of joint action paradigms, where the role of higher level action goals and social factors can be investigated.

Adaptive sensory coding of gaze direction in schizophrenia

Schizophrenia has been associated with differences in how the visual system processes sensory input. A fundamental mechanism that regulates sensory processing in the brain is gain control, whereby the responses of sensory neurons to a given stimulus are modulated in accordance with the spatial and temporal context. Some studies indicate an impairment of certain cortical gain control mechanisms in schizophrenia in low-level vision, reflected, for instance, in how the visual appearance of a stimulus is affected by the presence of other stimuli around it. In the present study, we investigated higher-level, social vision in schizophrenia, namely the perception of other people's direction of gaze (i.e. a type of face processing). Recent computational modelling work indicates that perceptual aftereffects-changes in perception that occur following repeated exposure to faces that display a specific direction of gaze-are indicative of two distinct forms of gain control involved in the coding of gaze direction across sensory neurons. We find that individuals with schizophrenia display strong perceptual aftereffects following repeated exposure to faces with averted gaze, and a modelling analysis indicates similarly robust gain control in the form of (i) short-term adjustment of channel sensitivities in response to the recent sensory history and (ii) divisive normalization of the encoded gaze direction. Together, this speaks to the typical coding of other people's direction of gaze in the visual system in schizophrenia, including flexible gain control, despite the social-cognitive impairments that can occur in this condition.

Perceptual integration of head and eye cues to gaze direction in schizophrenia

The perceptual mechanisms that underlie social experience in schizophrenia are increasingly becoming a target of empirical research. In the context of low-level vision, there is evidence for a reduction in the integration of sensory features in schizophrenia (e.g. increased thresholds for contour detection and motion coherence). In the context of higher-level vision, comparable differences in the integration of sensory features of the face could in theory impair the recognition of important social cues. Here we examine how the sense of where other people are looking relies upon the integration of eye-region cues and head-region cues. Adults with schizophrenia viewed face images designed to elicit the 'Wollaston illusion', a perceptual phenomenon in which the perceived gaze direction associated with a given pair of eyes is modulated by the surrounding sensory context. We performed computational modelling of these psychophysical data to quantify individual differences in the use of facial cues to gaze direction. We find that adults with schizophrenia exhibit a robust perceptual effect whereby their sense of other people's direction of gaze is strongly biased by sensory cues relating to head orientation in addition to eye region information. These results indicate that the visual integration of facial cues to gaze direction in schizophrenia is intact, helping to constrain theories of reduced integrative processing in higher-level and lower-level vision. In addition, robust gaze processing was evident in the tested participants despite reduced performance on a theory of mind task designed to assess higher-level social cognition.

Functional organization of face processing in the human superior temporal sulcus: a 7T high-resolution fMRI study

The superior temporal sulcus (STS) is a major component of the human face perception network, implicated in processing dynamic changeable aspects of faces. However, it remains unknown whether STS holds functionally segregated subdivisions for different categories of facial movements. We used high-resolution functional magnetic resonance imaging (fMRI) at 7T in 16 volunteers to compare STS activation with faces displaying angry or happy expressions, eye-gaze shifts and lip-speech movements. Combining univariate and multivariate analyses, we show a systematic topological organization within STS, with gaze-related activity predominating in the most posterior and superior sector, speech-related activity in the anterior sector and emotional expressions represented in the intermediate middle STS. Right STS appeared to hold a finer functional segregation between all four types of facial movements, and best discriminative abilities within the face-selective posterior STS (pSTS). Conversely, left STS showed greater overlap between conditions, with a lack of distinction between mouth movements associated to speech or happy expression and better discriminative abilities (for gaze and speech vs emotion conditions) outside pSTS. Differential sensitivity to upper (eye) or lower (mouth) facial features may contribute to, but does not appear to fully account for, these response patterns.

Adaptation to the Direction of Others' Gaze: A Review

The direction of another person’s gaze provides us with a strong cue to their intentions and future actions, and, correspondingly, the human visual system has evolved to extract information about others’ gaze from the sensory stream. The perception of gaze is a remarkably plastic process: adaptation to a particular direction of gaze over a matter of seconds or minutes can cause marked aftereffects in our sense of where other people are looking. In this review, we first discuss the measurement, specificity, and neural correlates of gaze aftereffects. We then examine how studies that have explored the perceptual and neural determinants of gaze aftereffects have provided key insights into the nature of how other people’s gaze direction is represented within the visual hierarchy. This includes the level of perceptual representation of gaze direction (e.g., relating to integrated vs. local facial features) and the interaction of this system with higher-level social-cognitive functions, such as theory of mind. Moreover, computational modeling of data from behavioral studies of gaze adaptation allows us to make inferences about the functional principles that govern the neural encoding of gaze direction. This in turn provides a foundation for testing computational theories of neuropsychiatric conditions in which gaze processing is compromised, such as autism.

Rostro-caudal organization of the human posterior superior temporal sulcus revealed by connectivity profiles

The posterior superior temporal sulcus (pSTS) plays an important role in biological motion perception but is also thought to be essential for speech and facial processing. However, although there are many previous investigations of distinct functional modules within the pSTS, the functional organization of the pSTS in its full functional heterogeneity has not yet been established. Here we applied a connectivity-based parcellation strategy to delineate the human pSTS subregions based on distinct anatomical connectivity profiles and divided it into rostral and caudal subregions using diffusion tensor imaging. Subsequent multimodal connection pattern analyses revealed distinct subregional connectivity profiles. From this we inferred that the two subregions are involved in distinct functional circuits, the language processing loop and the cognition attention network. These results indicate a convergent functional architecture of the pSTS that can be revealed based on different types of connectivity and is reflected in different functions and interactions. In addition, when the subregions were performing their processing in the different functional circuits, we found asymmetry in the bilateral pSTS. Our findings may improve the understanding of the functional organization of the pSTS and provide new insights into its interactions and integration of information at the subregional level.

Autistic adults show preserved normalisation of sensory responses in gaze processing

Progress in our understanding of autism spectrum disorder (ASD) has recently been sought by characterising how systematic differences in canonical neural computations employed across the sensory cortex might contribute to clinical symptoms in diverse sensory, cognitive, and social domains. A key proposal is that ASD is characterised by reduced divisive normalisation of sensory responses. This provides a bridge between genetic and molecular evidence for an increased ratio of cortical excitation to inhibition in ASD and the functional characteristics of sensory coding that are relevant for understanding perception and behaviour. Here we tested this hypothesis in the context of gaze processing (i.e., the perception of other people's direction of gaze), a domain with direct relevance to the core diagnostic features of ASD. We show that reduced divisive normalisation in gaze processing is associated with specific predictions regarding the psychophysical effects of sensory adaptation to gaze direction, and test these predictions in adults with ASD. We report compelling evidence that both divisive normalisation and sensory adaptation occur robustly in adults with ASD in the context of gaze processing. These results have important theoretical implications for defining the types of divisive computations that are likely to be intact or compromised in this condition (e.g., relating to local vs distal control of cortical gain). These results are also a strong testament to the typical sensory coding of gaze direction in ASD, despite the atypical responses to others' gaze that are a hallmark feature of this diagnosis.

Perceived Gaze Direction Modulates Neural Processing of Prosocial Decision Making

Gaze direction is a common social cue implying potential interpersonal interaction. However, little is known about the neural processing of social decision making influenced by perceived gaze direction. Here, we employed functional magnetic resonance imaging (fMRI) method to investigate 27 females when they were engaging in an economic exchange game task during which photos of direct or averted eye gaze were shown. We found that, when averted but not direct gaze was presented, prosocial vs. selfish choices were associated with stronger activations in the right superior temporal gyrus (STG) as well as larger functional couplings between right STG and the posterior cingulate cortex (PCC). Moreover, stronger activations in right STG was associated with quicker actions for making prosocial choice accompanied with averted gaze. The findings suggest that, when the cue implying social contact is absent, the processing of understanding others’ intention and the relationship between self and others is more involved for making prosocial than selfish decisions. These findings could advance our understanding of the roles of subtle cues in influencing prosocial decision making, as well as shedding lights on deficient social cue processing and functioning among individuals with autism spectrum disorder (ASD).

Neurodynamics and connectivity during facial fear perception: The role of threat exposure and signal congruity

Fearful faces convey threat cues whose meaning is contextualized by eye gaze: While averted gaze is congruent with facial fear (both signal avoidance), direct gaze (an approach signal) is incongruent with it. We have previously shown using fMRI that the amygdala is engaged more strongly by fear with averted gaze during brief exposures. However, the amygdala also responds more to fear with direct gaze during longer exposures. Here we examined previously unexplored brain oscillatory responses to characterize the neurodynamics and connectivity during brief (~250 ms) and longer (~883 ms) exposures of fearful faces with direct or averted eye gaze. We performed two experiments: one replicating the exposure time by gaze direction interaction in fMRI (N = 23), and another where we confirmed greater early phase locking to averted-gaze fear (congruent threat signal) with MEG (N = 60) in a network of face processing regions, regardless of exposure duration. Phase locking to direct-gaze fear (incongruent threat signal) then increased significantly for brief exposures at ~350 ms, and at ~700 ms for longer exposures. Our results characterize the stages of congruent and incongruent facial threat signal processing and show that stimulus exposure strongly affects the onset and duration of these stages.

The Effect of Eye Contact Is Contingent on Visual Awareness

The present study explored how eye contact at different levels of visual awareness influences gaze-induced joint attention. We adopted a spatial-cueing paradigm, in which an averted gaze was used as an uninformative central cue for a joint-attention task. Prior to the onset of the averted-gaze cue, either supraliminal (Experiment 1) or subliminal (Experiment 2) eye contact was presented. The results revealed a larger subsequent gaze-cueing effect following supraliminal eye contact compared to a no-contact condition. In contrast, the gaze-cueing effect was smaller in the subliminal eye-contact condition than in the no-contact condition. These findings suggest that the facilitation effect of eye contact on coordinating social attention depends on visual awareness. Furthermore, subliminal eye contact might have an impact on subsequent social attention processes that differ from supraliminal eye contact. This study highlights the need to further investigate the role of eye contact in implicit social cognition.

Functional Mechanisms Encoding Others' Direction of Gaze in the Human Nervous System

The direction of others' gaze is a strong social signal to their intentions and future behavior. Pioneering electrophysiological research identified cell populations in the primate visual cortex that are tuned to specific directions of observed gaze, but the functional architecture of this system is yet to be precisely specified. Here, we develop a computational model of how others' gaze direction is flexibly encoded across sensory channels within the gaze system. We incorporate the divisive normalization of sensory responses—a computational mechanism that is thought to be widespread in sensory systems but has not been examined in the context of social vision. We demonstrate that the operation of divisive normalization in the gaze system predicts a surprising and distinctive pattern of perceptual changes after sensory adaptation to gaze stimuli and find that these predictions closely match the psychophysical effects of adaptation in human observers. We also find that opponent coding, broadband multichannel, and narrowband multichannel models of sensory coding make distinct predictions regarding the effects of adaptation in a normalization framework and find evidence in favor of broadband multichannel coding of gaze. These results reveal the functional principles that govern the neural encoding of gaze direction and support the notion that divisive normalization is a canonical feature of nervous system function. Moreover, this research provides a strong foundation for testing recent computational theories of neuropsychiatric conditions in which gaze processing is compromised, such as autism and schizophrenia.

The Functional Neuroanatomy of Human Face Perception

Face perception is critical for normal social functioning and is mediated by a network of regions in the ventral visual stream. In this review, we describe recent neuroimaging findings regarding the macro- and microscopic anatomical features of the ventral face network, the characteristics of white matter connections, and basic computations performed by population receptive fields within face-selective regions composing this network. We emphasize the importance of the neural tissue properties and white matter connections of each region, as these anatomical properties may be tightly linked to the functional characteristics of the ventral face network. We end by considering how empirical investigations of the neural architecture of the face network may inform the development of computational models and shed light on how computations in the face network enable efficient face perception.

Temporal Order Judgements of Dynamic Gaze Stimuli Reveal a Postdictive Prioritisation of Averted Over Direct Shifts

We studied temporal order judgements (TOJs) of gaze shift behaviours and evaluated the impact of gaze direction (direct and averted gaze) and face context information (both eyes set within a single face or each eye within two adjacent hemifaces) on TOJ performance measures. Avatar faces initially gazed leftwards or rightwards (Starting Gaze Direction). This was followed by sequential and independent left and right eye gaze shifts with various amounts of stimulus onset asynchrony. Gaze shifts could be either Matching (both eyes end up pointing direct or averted) or Mismatching (one eye ends up pointing direct, the other averted). Matching shifts revealed an attentional cueing mechanism, where TOJs were biased in favour of the eye lying in the hemispace cued by the avatar’s Starting Gaze Direction. For example, the left eye was more likely to be judged as shifting first when the avatar initially gazed toward the left side of the screen. Mismatching shifts showed biased TOJs in favour of the eye performing the averted shift, but only in the context of two separate hemifaces that does not violate expectations of directional gaze shift congruency. This suggests a postdictive inferential strategy that prioritises eye movements based on the type of gaze shift, independently of where attention is initially allocated. Averted shifts are prioritised over direct, as these might signal the presence of behaviourally relevant information in the environment.

Saccades and smooth pursuit eye movements trigger equivalent gaze-cued orienting effects

Research has established that a perceived eye gaze produces a concomitant shift in a viewer's spatial attention in the direction of that gaze. The two experiments reported here investigate the extent to which the nature of the eye movement made by the gazer contributes to this orienting effect. On each trial in these experiments, participants were asked to make a speeded response to a target that could appear in a location toward which a centrally presented face had just gazed (a cued target) or in a location that was not the recipient of a gaze (an uncued target). The gaze cues consisted of either fast saccadic eye movements or slower smooth pursuit movements. Cued targets were responded to faster than uncued targets, and this gaze-cued orienting effect was found to be equivalent for each type of gaze shift both when the gazes were un-predictive of target location (Experiment 1) and counterpredictive of target location (Experiment 2). The results offer no support for the hypothesis that motion speed modulates gaze-cued orienting. However, they do suggest that motion of the eyes per se, regardless of the type of movement, may be sufficient to trigger an orienting effect.

Development of Neural Sensitivity to Face Identity Correlates with Perceptual Discriminability

Face perception is subserved by a series of face-selective regions in the human ventral stream, which undergo prolonged development from childhood to adulthood. However, it is unknown how neural development of these regions relates to the development of face-perception abilities. Here, we used functional magnetic resonance imaging (fMRI) to measure brain responses of ventral occipitotemporal regions in children (ages, 5-12 years) and adults (ages, 19-34 years) when they viewed faces that parametrically varied in dissimilarity. Since similar faces generate lower responses than dissimilar faces due to fMRI adaptation, this design objectively evaluates neural sensitivity to face identity across development. Additionally, a subset of subjects participated in a behavioral experiment to assess perceptual discriminability of face identity. Our data reveal three main findings: (1) neural sensitivity to face identity increases with age in face-selective but not object-selective regions; (2) the amplitude of responses to faces increases with age in both face-selective and object-selective regions; and (3) perceptual discriminability of face identity is correlated with the neural sensitivity to face identity of face-selective regions. In contrast, perceptual discriminability is not correlated with the amplitude of response in face-selective regions or of responses of object-selective regions. These data suggest that developmental increases in neural sensitivity to face identity in face-selective regions improve perceptual discriminability of faces. Our findings significantly advance the understanding of the neural mechanisms of development of face perception and open new avenues for using fMRI adaptation to study the neural development of high-level visual and cognitive functions more broadly.

SIGNIFICANCE STATEMENT

Face perception, which is critical for daily social interactions, develops from childhood to adulthood. However, it is unknown what developmental changes in the brain lead to improved performance. Using fMRI in children and adults, we find that from childhood to adulthood, neural sensitivity to changes in face identity increases in face-selective regions. Critically, subjects' perceptual discriminability among faces is linked to neural sensitivity: participants with higher neural sensitivity in face-selective regions demonstrate higher perceptual discriminability. Thus, our results suggest that developmental increases in face-selective regions' sensitivity to face identity improve perceptual discrimination of faces. These findings significantly advance understanding of the neural mechanisms underlying the development of face perception and have important implications for assessing both typical and atypical development.

Pupil response hazard rates predict perceived gaze durations

We investigated the mechanisms for evaluating perceived gaze-shift duration. Timing relies on the accumulation of endogenous physiological signals. Here we focused on arousal, measured through pupil dilation, as a candidate timing signal. Participants timed gaze-shifts performed by face stimuli in a Standard/Probe comparison task. Pupil responses were binned according to “Longer/Shorter” judgements in trials where Standard and Probe were identical. This ensured that pupil responses reflected endogenous arousal fluctuations opposed to differences in stimulus content. We found that pupil hazard rates predicted the classification of sub-second intervals (steeper dilation = “Longer” classifications). This shows that the accumulation of endogenous arousal signals informs gaze-shift timing judgements. We also found that participants relied exclusively on the 2^nd stimulus to perform the classification, providing insights into timing strategies under conditions of maximum uncertainty. We observed no dissociation in pupil responses when timing equivalent neutral spatial displacements, indicating that a stimulus-dependent timer exploits arousal to time gaze-shifts.

Detecting and identifying offset gaze

A number of experiments have demonstrated that observers can accurately identify stimuli that they fail to detect (Rollman and Nachmias, 1972; Harris and Fahle, 1995; Allik et al. 1982, 2014). Using a 2x2AFC double judgements procedure, we demonstrated an analogous pattern of performance in making judgements about the direction of eye gaze. Participants were shown two faces in succession: one with direct gaze and one with gaze offset to the left or right. We found that they could identify the direction of gaze offset (left/right) better than they could detect which face contained the offset gaze. A simple Thurstonian model, under which the detection judgement is shown to be more computationally complex, was found to explain the empirical data. A further experiment incorporated metacognitive ratings into the double judgements procedure to measure observers' metacognitive awareness (Meta-d') across the two judgements and to assess whether observers were aware of the evidence for offset gaze when detection performance was at and below threshold. Results suggest that metacognitive awareness is tied to performance, with approximately equal Meta-d' across the two judgements, when sensitivity is taken into account. These results show that both performance and metacognitive awareness rely not only on the strength of sensory evidence but also on the computational complexity of the decision, which determines the relative distance of that evidence from the decision axes.

Processing of gaze direction within the N170/M170 time window: A combined EEG/MEG study

Gaze direction is an important social signal for human beings. Beside the role of gaze in attention orienting, direct gaze (that is, gaze directed toward an observer) is a highly relevant biological stimulus that elicits attention capture and increases face encoding. Brain imaging studies have emphasized the role of the superior temporal sulcus (STS) in the coding of gaze direction and in the integration of gaze and head cues of social attention. The dynamics of the processing and integration of these cues remains, however, unclear. In order to address this question, we used deviated and frontal faces with averted and direct gaze in a combined electro- and magneto- encephalography (EEG-MEG) study. We showed distinct effects of gaze direction on the N170 and M170 responses. There was an interaction between gaze direction and head orientation between 134 and 162ms in MEG and a main effect of gaze direction between 171 and 186ms in EEG. These effects involved the posterior and anterior regions of the STS respectively. Both effects also emphasized the sensitivity to direct gaze. These data highlight the central role of the STS in gaze processing.