Person knowledge shapes face identity perception

The effect of approach and avoidance motivation on self-perception

This work addresses the link between motivation and self-perception by systematically studying visual self-representations. We propose that the way individuals perceive themselves may be associated with dispositional and situationally induced approach and avoidance motivation. First, we investigate how dispositional differences in approach/avoidance motivation and self-esteem relate to self-perception. Second, we investigate how state differences in approach/avoidance motivation relate to self-perception. Based on motivation literature, we predicted that self-perception would reflect psychological equanimity at the dispositional level (seeing the self in a favorable light), and motivational flexibility at the situational level (situational avoidance motivation results in a more realistic view of one's qualities). We use up-to-date face modeling methods to measure individuals' self-perceptions in a systematic, nuanced, and implicit way: Participants are repeatedly asked to indicate which of two portrait versions better represents themselves. Then we relate distortions in self-perceptions to agency and communion dimensions. We demonstrate that (1) participants low in self-esteem show more communion enhancement than participants high in self-esteem; (2) participants in an avoidance state show less agency enhancement (i.e., more realistic self-perceptions) than participants in an approach state. This research is first to demonstrate regularities in visual self-perception that are linked to approach and avoidance motivation.

The importance of conceptual knowledge when becoming familiar with faces during naturalistic viewing

Although the ability to recognise familiar faces is a critical part of everyday life, the process by which a face becomes familiar in the real world is not fully understood. Previous research has focussed on the importance of perceptual experience. However, in natural viewing, perceptual experience with faces is accompanied by increased knowledge about the person and the context in which they are encountered. Although conceptual information is known to be crucial for the formation of new episodic memories, it requires a period of consolidation. It is unclear, however, whether a similar process occurs when we learn new faces. Using a natural viewing paradigm, we investigated how the context in which events are presented influences our understanding of those events and whether, after a period of consolidation, this has a subsequent effect on face recognition. The context was manipulated by presenting events in 1) the original sequence, or 2) a scrambled sequence. Although this manipulation was predicted to have a significant effect on conceptual understanding of events, it had no effect on overall visual experience with the faces. Our prediction was that this contextual manipulation would affect face recognition after the information has been consolidated into memory. We found that understanding of the narrative was greater for participants who viewed the movie in the original sequence compared to those that viewed the movie in a scrambled order. To determine if the context in which the movie was viewed had an effect on face recognition, we compared recognition in the original and scrambled condition. We found an overall effect of conceptual knowledge on face recognition. That is, participants who viewed the original sequence had higher face recognition compared to participants who viewed the scrambled sequence. However, our planned comparisons did not reveal a greater effect of conceptual knowledge on face recognition after consolidation. In an exploratory analysis, we found that overlap in conceptual knowledge between participants was significantly correlated with the overlap in face recognition. We also found that this relationship was greater after a period of consolidation. Together, these findings provide new insights into the role of non-visual, conceptual knowledge for face recognition during natural viewing.

Differences in the link between social trait judgment and socio-emotional experience in neurotypical and autistic individuals

Neurotypical (NT) individuals and individuals with autism spectrum disorder (ASD) make different judgments of social traits from others' faces; they also exhibit different social emotional responses in social interactions. A common hypothesis is that the differences in face perception in ASD compared with NT is related to distinct social behaviors. To test this hypothesis, we combined a face trait judgment task with a novel interpersonal transgression task that induces measures social emotions and behaviors. ASD and neurotypical participants viewed a large set of naturalistic facial stimuli while judging them on a comprehensive set of social traits (e.g., warm, charismatic, critical). They also completed an interpersonal transgression task where their responsibility in causing an unpleasant outcome to a social partner was manipulated. The purpose of the latter task was to measure participants' emotional (e.g., guilt) and behavioral (e.g., compensation) responses to interpersonal transgression. We found that, compared with neurotypical participants, ASD participants' self-reported guilt and compensation tendency was less sensitive to our responsibility manipulation. Importantly, ASD participants and neurotypical participants showed distinct associations between self-reported guilt and judgments of criticalness from others' faces. These findings reveal a novel link between perception of social traits and social emotional responses in ASD.

Neural mechanisms of face familiarity and learning in the human amygdala and hippocampus

Recognizing familiar faces and learning new faces play an important role in social cognition. However, the underlying neural computational mechanisms remain unclear. Here, we record from single neurons in the human amygdala and hippocampus and find a greater neuronal representational distance between pairs of familiar faces than unfamiliar faces, suggesting that neural representations for familiar faces are more distinct. Representational distance increases with exposures to the same identity, suggesting that neural face representations are sharpened with learning and familiarization. Furthermore, representational distance is positively correlated with visual dissimilarity between faces, and exposure to visually similar faces increases representational distance, thus sharpening neural representations. Finally, we construct a computational model that demonstrates an increase in the representational distance of artificial units with training. Together, our results suggest that the neuronal population geometry, quantified by the representational distance, encodes face familiarity, similarity, and learning, forming the basis of face recognition and memory.

A human single-neuron dataset for face perception

The human amygdala and hippocampus have long been associated with face perception. Here, we present a dataset of single-neuron activity in the human amygdala and hippocampus during face perception. We recorded 2082 neurons from the human amygdala and hippocampus when neurosurgical patients with intractable epilepsy performed a one-back task using natural face stimuli, which mimics natural face perception. Specifically, our data include (1) single-neuron activity from the amygdala (996 neurons) and hippocampus (1086 neurons), (2) eye movements (gaze position and pupil), (3) psychological assessment of the patients, and (4) social trait judgment ratings from a subset of patients and a large sample of participants from the general population. Together, our comprehensive dataset with a large population of neurons can facilitate multifaceted investigation of face perception with the highest spatial and temporal resolution currently available in humans.

Distinct neurocognitive bases for social trait judgments of faces in autism spectrum disorder

Autism spectrum disorder (ASD) is characterized by difficulties in social processes, interactions, and communication. Yet, the neurocognitive bases underlying these difficulties are unclear. Here, we triangulated the 'trans-diagnostic' approach to personality, social trait judgments of faces, and neurophysiology to investigate (1) the relative position of autistic traits in a comprehensive social-affective personality space, and (2) the distinct associations between the social-affective personality dimensions and social trait judgment from faces in individuals with ASD and neurotypical individuals. We collected personality and facial judgment data from a large sample of online participants (N = 89 self-identified ASD; N = 307 neurotypical controls). Factor analysis with 33 subscales of 10 social-affective personality questionnaires identified a 4-dimensional personality space. This analysis revealed that ASD and control participants did not differ significantly along the personality dimensions of empathy and prosociality, antisociality, or social agreeableness. However, the ASD participants exhibited a weaker association between prosocial personality dimensions and judgments of facial trustworthiness and warmth than the control participants. Neurophysiological data also indicated that ASD participants had a weaker association with neuronal representations for trustworthiness and warmth from faces. These results suggest that the atypical association between social-affective personality and social trait judgment from faces may contribute to the social and affective difficulties associated with ASD.