Face versus non-face object perception and the 'other-race' effect: a spatio-temporal event-related potential study

The speed of race

When asked to categorize faces according to 'race', people typically categorize other-race faces faster than faces belonging to their own race. This 'Other Race Categorization Advantage' is thought to reflect enhanced sensitivity to early visual signals characteristic of other-race faces, and can manifest within 200 ms of face presentation. However, recent research has highlighted the importance of signal intensity in this effect, where visual-degradation of the face images significantly enhances the effect and exposes a behavioural threshold at very low levels of visual quality where other-race visual signals are able to be perceived while same-race signals are not. The current study investigated the effect of signal intensity in race categorization processes in the brain through electroencephalography and in accuracy/reaction times. While replicating the previously observed enhancement of the other-race categorization advantage, we also found enhanced sensitivity to other-race faces in early P1 peaks, as well as later N170 and N250 peaks. These effects, however, related to the varying levels of signal intensity in the face stimuli, suggesting that race categorization may involve different types of perceptual and neural processes rather than one discrete process. The speed at which race is perceived depends on the intensity of the face signal.

Evaluation of visual performance and eye movements in patients with blue light-filtering intraocular lenses versus ultraviolet light-filtering intraocular lenses

Background

Eye movement plays an important role in visual perception and provides essential visual information for everyday tasks. Our previous study indicated that the visual performance and eye movement pattern were impaired in age-related cataract patients and could be improved after cataract surgery, but the impact of different intraocular lens (IOL) types was obscure. Previous studies found that blue light might affect the eye movement pattern and cognitive function. In this study, we explored the visual performance and eye movement pattern in post-cataract surgery patients implanted with blue light-filtering IOLs or ultraviolet (UV) light-filtering IOLs to further understand the impact of different types of IOLs on and daily visual performance and eye movement pattern and to help ophthalmologists and patients make the personalized option of IOL types in future.

Methods

Patients after both-eye cataract surgeries were included in this study. Eye movement behaviors were automatically recorded by an eye tracker while performing three performance-based everyday tasks (non-social object search, face recognition, and reading). Visual performance and eye movement parameters were compared between participants with blue light-filtering IOLs and UV light-filtering IOLs. The correlation between visual performance and eye movement parameters was explored to determine which eye movement parameters had a significant influence on visual performance outcomes.

Results

A total of 30 patients (16 with blue light-filtering IOLs and 14 with UV light-filtering IOLs) were included. In this study, we found that the eye movement pattern was slightly different with these two IOLs: during non-social object visual search task, time to first fixation and fixation counts before first fixation were notably increased in yellow-tinted blue light-filtering IOL patients. During reading task, a higher total fixation count was also found in blue light-filtering IOL patients. However, the visual performance of these two IOLs was close, except for a quicker search of the target object with clear UV light-filtering IOLs.

Conclusion

Both blue light-filtering and UV light-filtering IOLs were able to successfully restore visual function and yield satisfactory outcomes after cataract surgery. Although subtle, yellow-tinted IOLs did have a slight but significant impact on visual performance and the eye movement pattern of elderly patients when handling everyday tasks.

Face motion form at learning influences the time course of face spatial frequency processing during test

Studies that use static faces suggest that facial processing follows a coarse-to-fine sequence; i.e., holistic precedes featural processing, due to low and high spatial frequencies (LSF, HSF) transmitting holistic/global and featural/local information respectively. Although recent studies have focused on the role of facial movement in holistic facial processing, it is unclear whether moving faces have the same processing mechanism as static ones, especially in the time course of processing. The current study uses the event-related potential technique to investigate this issue by manipulating the facial format at study and face spatial frequency during the test. ERP results showed that the P1 amplitude was increased by LSF faces relative to HSF ones, using both moving and static study faces, with the former larger than the latter. The N170 amplitude was more sensitive to HSF than LSF faces when only static study faces were used, while the P2 amplitude was more sensitive to LSF faces regardless of the facial study format. The above results were not modulated by the race of the faces. These results favor the view that regardless of face race, moving study faces promote holistic processing during the earliest stage of face recognition. Furthermore, holistic processing is observed to be the same for both static and moving study faces at a later stage associated with more in-depth processing. It is evident that facial motion should be factored into further studies of face recognition, given the distinctions between holistic and featural processing for moving and static study faces.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Multimodal deep neural decoding reveals highly resolved spatiotemporal profile of visual object representation in humans

Perception and categorization of objects in a visual scene are essential to grasp the surrounding situation. Recently, neural decoding schemes, such as machine learning in functional magnetic resonance imaging (fMRI), has been employed to elucidate the underlying neural mechanisms. However, it remains unclear as to how spatially distributed brain regions temporally represent visual object categories and sub-categories. One promising strategy to address this issue is neural decoding with concurrently obtained neural response data of high spatial and temporal resolution. In this study, we explored the spatial and temporal organization of visual object representations using concurrent fMRI and electroencephalography (EEG), combined with neural decoding using deep neural networks (DNNs). We hypothesized that neural decoding by multimodal neural data with DNN would show high classification performance in visual object categorization (faces or non-face objects) and sub-categorization within faces and objects. Visualization of the fMRI DNN was more sensitive than that in the univariate approach and revealed that visual categorization occurred in brain-wide regions. Interestingly, the EEG DNN valued the earlier phase of neural responses for categorization and the later phase of neural responses for sub-categorization. Combination of the two DNNs improved the classification performance for both categorization and sub-categorization compared with fMRI DNN or EEG DNN alone. These deep learning-based results demonstrate a categorization principle in which visual objects are represented in a spatially organized and coarse-to-fine manner, and provide strong evidence of the ability of multimodal deep learning to uncover spatiotemporal neural machinery in sensory processing.

Understanding racial bias through electroencephalography

Research on racial bias in social and cognitive psychology has focused on automatic cognitive processes such as categorisation or stereotyping. Neuroimaging has revealed differences in the neural circuit when processing social information about one's own or another's ethnicity. This review investigates the influence of racial bias on human behaviour by reviewing studies that examined changes in neural circuitry (i.e. ERP responses) during automatic and controlled processes elicited by specific tasks. This systematic analysis of specific ERP components across different studies provides a greater understanding of how social contexts are perceived and become associated with specific stereotypes and behavioural predictions. Therefore, investigating these related cognitive and neurobiological functions can further our understanding of how racial bias affects our cognition more generally and guide more effective programs and policies aimed at its mitigation.

Neural Basis of Prejudice and Prejudice Reduction

Social prejudices, based on race, ethnicity, gender, or other identities, pervade how we perceive, think about, and act toward others. Research on the neural basis of prejudice seeks to illuminate its effects by investigating the neurocognitive processes through which prejudice is formed, represented in the mind, expressed in behavior, and potentially reduced. In this article, we review current knowledge about the social neuroscience of prejudice regarding its influence on rapid social perception, representation in memory, emotional expression and relation to empathy, and regulation, and we discuss implications of this work for prejudice reduction interventions.

Cortical Source Analysis of the Face Sensitive N290 ERP Component in Infants at High Risk for Autism

Appropriate head models for cortical source analysis were investigated and applied to source analyses examining the neural bases of the face-sensitive N290 event-related potential (ERP) component in infants at high risk for autism spectrum disorder (ASD). This included infant siblings of children with ASD (ASIBs) and infants with fragile X syndrome (FXS). First, alternative head models for use with ASIBs and FXS were investigated. Head models created from the infant's own MRI were examined in relation to five head models based on average MRI templates. The results of the head model comparison identified group-specific (i.e., ASIB or FXS) head models created from a large collection of structural MRIs as the best substitution for the head model created from the participant's own structural MRI. Second, the cortical source analysis was completed on N290 data collected from a previous study to investigate brain areas associated with face sensitive ERP responses. Participants' own MRIs were used for head models when available, and the group-specific head model was used when the participants' own MRIs were not available. The results provide evidence for unique patterns of neural activation during face processing across infants at high and low risk for ASD and across etiologically distinct high-risk groups. All infants demonstrated greater activation to faces than toys in brain areas most associated with specialized face processing. Infants with FXS displayed higher levels of activation to faces across all areas analyzed, while ASIBs show more muted levels of activation. Overall, the results of the current study demonstrate the importance of group-specific head models for accurate cortical source analysis in infants at high risk for ASD. This also allows for further research on early distinctions in brain function based on risk status.

Rapid saccadic categorization of other-race faces

The human visual system is very fast and efficient at extracting socially relevant information from faces. Visual studies employing foveated faces have consistently reported faster categorization by race response times for other-race compared with same-race faces. However, in everyday life we typically encounter faces outside the foveated visual field. In study 1, we explored whether and how race is categorized extrafoveally in same- and other-race faces normalized for low-level properties by tracking eye movements of Western Caucasian and East Asian observers in a saccadic response task. The results show that not only are people sensitive to race in faces presented outside of central vision, but the speed advantage in categorizing other-race faces occurs astonishingly quickly in as little as 200 ms. Critically, this visual categorization process was approximately 300 ms faster than the typical button press responses on centrally presented foveated faces. Study 2 investigated the genesis of the extrafoveal saccadic response speed advantage by comparing the influences of the response modality (button presses and saccadic responses), as well as the potential contribution of the impoverished low-spatial frequency spectrum characterizing extrafoveal visual information processing. Button press race categorization was not significantly faster with reconstructed retinal-filtered low spatial frequency faces, regardless of the visual field presentation. The speed of race categorization was significantly boosted only by extrafoveal saccades and not centrally foveated faces. Race is a potent, rapid, and effective visual signal transmitted by faces used for the categorization of ingroup/outgroup members. This fast universal visual categorization can occur outside central vision, igniting a cascade of social processes.

Electrophysiological correlates of unconscious processes of race

The study aimed to examine the neural mechanisms underlying implicit other-race face processing by the use of the masked and unmasked priming manipulation. Two types of prime-target pairs were presented while recording Event-related potentials (ERPs): Same face pairs (prime-target were identical faces), and Different face pairs (prime-target were different faces). Prime-target pairs were half Asian (other-race) and half Caucasian (own-race) faces. The face stimuli on each pair were of the same gender and race. Participants (all Caucasians) had to decide whether the target was a male or a female face (gender task). The prime face could be unmasked or masked. On the behavioral side, our findings showed a race effect, that is slower reaction times (RTs) for other-race than own-race face stimuli, regardless of masking. On the ERPs side, our data showed a race effect across all components analyzed (P100, N100, N200, P300), under both the unmasked and masked manipulations. Besides, we found, in the unmasked condition, a priming effect as a function of race on the N100, N200, and P300 components; but, interestingly, in the masked condition, only on the P300. Overall, our findings provide evidence that race information is available very early in the brain and can strongly activate and influence people's behaviors even without conscious awareness.

Effects of high and low power on the visual encoding of faces

The experience of power is typically associated with social disengagement, yet power has also been shown to facilitate configural visual encoding - a process that supports the initial perception of a human face. To investigate this apparent contradiction, we directly tested whether power influences the visual encoding of faces. Two experiments, using neural and psychophysical assessments, revealed that low power impeded both first-order configural processing (the encoding of a stimulus as a face, assessed by the N170 event-related potential) and second-order configural processing (the encoding of feature distances within configuration, assessed using the face inversion paradigm), relative to high-power and control conditions. Power did not significantly affect facial feature encoding. Results reveal an early and automatic effect of low power on face perception, characterized primarily by diminished face processing. These findings suggest a novel interplay between visual and cognitive processes in power's influence on social behavior.

Enhanced N170 to outgroup faces: Perceptual novelty or prejudice?

Habituation to ethnic ingroup members has been reported to be greater than to ethnic outgroup members. This pattern could be due to the lack of perceptive experience (familiarity) with outgroup facial morphs or, alternatively, to the prejudice held toward that outgroup. We explored this disjunctive in 71 participants, all Spanish, who were experimentally habituated to faces from their Ingroup and to faces from two unfamiliar outgroups, one for which there is low probability of prejudice in this population (Non-prejudiced Outgroup), and one for which the probability of prejudice is higher (Prejudiced Outgroup). We indexed habituation through event-related potentials, concretely as the differential amplitude of the face-sensitive N170 component from Initial to Final trials of each group. Afterward, participants completed several prejudice measures. N170 showed significant habituation to all faces, though it did not differ among groups. However, a regression analysis revealed that individual habituation to the Outgroup faces was inversely related to implicit prejudice scores. Importantly, N170 amplitudes were maximal for the Prejudiced Outgroup in both Initial and Final trials. We conclude that these effects are explained by the prejudice held toward a specific outgroup rather than perceptive experience.

The Social Neuroscience of Prejudice

The social neuroscience approach to prejudice investigates the psychology of intergroup bias by integrating models and methods of neuroscience with the social psychology of prejudice, stereotyping, and discrimination. Here, we review major contemporary lines of inquiry, including current accounts of group-based categorization; formation and updating of prejudice and stereotypes; effects of prejudice on perception, emotion, and decision making; and the self-regulation of prejudice. In each section, we discuss key social neuroscience findings, consider interpretational challenges and connections with the behavioral literature, and highlight how they advance psychological theories of prejudice. We conclude by discussing the next-generation questions that will continue to guide the social neuroscience approach toward addressing major societal issues of prejudice and discrimination.

Explicit Categorization Goals Affect Attention-Related Processing of Race and Gender During Person Construal

Faces are categorized by gender and race very quickly, seemingly without regard to perceivers' goals or motivations, suggesting an automaticity to these judgments that has downstream consequences for evaluations, stereotypes, and social interactions. The current study investigated the extent to which early neurocognitive processes involved in the categorization of faces vary when participants' tasks goals were to categorize faces by race or by gender. In contrast to previous findings, task-related differences were found, such that differentiation in the P2 event-related potential (ERP) according to perceived gender was facilitated by having an explicit task goal of categorizing faces by gender; however, the P2 was sensitive to race regardless of task goals. Use of principal components analysis (PCA) revealed two underlying components that comprised the P2 and that were differentially sensitive to the gender and race of the faces, depending on participants' top-down task goals. Results suggest that top-down task demands facilitate discrimination of faces along the attended dimension within less than 200 ms, but that the effect of top-down task demands may not be evident when examining early ERP components that reflect more than one distinct underlying process.

Prejudice drives exogenous attention to outgroups

Exogenous attention allows the automatic detection of relevant stimuli and the reorientation of our current focus of attention towards them. Faces from an ethnic outgroup tend to capture exogenous attention to a greater extent than faces from an ethnic ingroup. We explored whether prejudice toward the outgroup, rather than lack of familiarity, is driving this effect. Participants (N = 76) performed a digit categorization task while distractor faces were presented. Faces belonged to (i) a prejudiced outgroup, (ii) a non-prejudiced outgroup and (iii) their ingroup. Half of the faces were previously habituated in order to increase their familiarity. Reaction times, accuracy and event-related potentials (ERPs) were recorded to index exogenous attention to distractor faces. Additionally, different indexes of explicit and implicit prejudice were measured, the latter being significantly greater towards prejudiced outgroup. N170 amplitude was greater to prejudiced outgroup-regardless of their habituation status-than to both non-prejudiced outgroup and ingroup faces and was associated with implicit prejudice measures. No effects were observed at the behavioral level. Our results show that implicit prejudice, rather than familiarity, is under the observed attention-related N170 effects and that this ERP component may be more sensitive to prejudice than behavioral measures under certain circumstances.

Face-sensitive brain responses in the first year of life

Cortical areas in the ventral visual pathway become selectively tuned towards the processing of faces compared to non-face stimuli beginning around 3 months of age and continuing over the first year. Studies using event-related potentials in the EEG (ERPs) have found an ERP component, the N290, that displays specificity for human faces. Other components, such as the P1, P400, and Nc have been studied to a lesser degree in their responsiveness to human faces. However, little is known about the systematic changes in the neural responses to faces during the first year of life, and the localization of these responses in infants' brain. We examined ERP responses to pictures of faces and objects in infants from 4.5 months through 12 months in a cross-sectional study. We investigated the activity of all the components reported to be involved in infant face processing, with particular interest to their amplitude variation and cortical localization. We identified neural regions responsible for the component through the application of cortical source localization methods. We found larger P1 and N290 responses to faces than objects, and these components were localized in the lingual and middle/posterior fusiform gyri, respectively. The amplitude of the P400 was not differentially sensitive to faces over objects. The Nc component was different for faces and objects, was influenced by the infant's attentional state, and localized in medial-anterior brain areas. The implications of these results are discussed in the identification of developmental ERP precursors to face processing.

Grappling With Implicit Social Bias: A Perspective From Memory Research

There is now widespread consensus that social biases often influence actions independently of the actor's intention or awareness. The notion that we are sometimes blind to the origins of our thoughts, attitudes, and behaviors also features prominently in research into domain-general human memory systems, which has a long history of distinguishing between implicit and explicit repercussions of past experience. A shared challenge across these fields of study is thus to identify techniques for effectively managing the contents of our memory stores, particularly those aspects into which we have limited metacognitive insight. In the present review, we examine recent developments in the cognitive neuroscience of human memory that speak to this challenge as it applies to the social domain. One area of progress pertains to the role of individuation, the process of attending to and representing in memory unique characteristics of individuals, which can limit the influence of generalizations based on social categories. A second body of work concerns breakthroughs in understanding memory consolidation, which determines the fate of newly encoded memories. We discuss the promise of each of these developments for identifying ways to become better stewards of our social minds. More generally, we suggest that, as with other forms of learning and memory, intentional practice and rehearsal may be critical in learning to minimize unwanted biases.

Attention and Working Memory Biases to Black and Asian Faces During Intergroup Contexts

Categorizing and individual as a racial ingroup or outgroup member results in processing and memory differences. However, despite processing differences for racial ingroups and outgroups, very little is known about processing of racial ingroup and outgroup members during intergroup contexts. Thus, the present research investigated attention and memory differences for racial ingroup and outgroup members during competition for attention (i.e., intergroup contexts). In experiment 1, event-related potentials (ERPs) were obtained while participants completed a working memory task that presented 4 faces (2 Black, 2 White) at once then, following a short delay, were probed to indicate the spatial location of one of the faces. Participants showed better location memory for Black than White faces. During encoding, ERP results revealed differences based on the race of the face in P300 amplitudes, such that there was greater motivated processing when attending to Black faces. At probe, the N170 indicated enhanced early processing of Black faces and greater LPCs were associated with better recollection of Black face location. In a follow-up study using the same task, we examined attention and working memory biases for Asian and White faces in Caucasian and Asian participants. Results for both Caucasian and Asian participants indicated better working memory for Asian relative to White faces. Together, results indicate that during intergroup contexts, racial minority faces capture attention, resulting in better memory for those faces. The study underscores that examining racial biases with single stimuli paradigms obscures important aspects of attention and memory biases during intergroup contexts.

How occupational status influences the processing of faces: An EEG study

This study examines the influence of social hierarchy on the neural electrophysiological responses to faces. In contrast with earlier EEG studies that typically manipulate social rank through competitive situations, we implemented hierarchy through occupational status and thus contrasted faces associated with high- vs. low-status (e.g. lawyer vs. waiter). Since social hierarchies are largely intertwined with gender, both female and male faces were used as stimuli, and both female and male participants were tested. The procedure consisted in presenting a status label before the face it was associated with. The analyses focused mainly on two components that have been shown to be modulated by competitive hierarchies and other social contexts, namely the N170 and the Late Positive Potential (LPP). The results indicated that gender, but not status, modulated the N170 amplitude. Moreover, high-status faces elicited larger LPP amplitude than low-status faces but this difference was driven by female participants. This gender effect is discussed in line with research showing that women and men are sensitive to different kinds of hierarchy. Methodological differences are considered to account for the discrepancy between studies that find an effect of hierarchy on the N170 and those that do not.

Ethnic effects when facing children: An ERP study

Abundant research has highlighted a disadvantage experienced by children of ethnic minority groups in, for example, educational and health care settings. In order to understand implicit attitudes that contribute to ethnic disparities, underlying neural correlates have been widely studied. However, this has been limited to the context of adults. Using a sample of nulliparous Caucasian females (N = 46), the current study is the first to examine how early attentional and facial perceptual processing stages, assessed with event-related brain potentials (ERPs), differentiate for stimuli of young ingroup (of the same ethnicity) or outgroup (of a different ethnicity) children. Additionally, we assessed how a differentiation in ERPs may relate to subsequent adult responsiveness to children by measuring both cuteness ratings and motivation to view child faces. Similar to previous findings for adult facial stimuli, we found significant differences in attentional (N200) and facial perceptual (N170) processing when adults were faced with children of different ethnicities. Furthermore, increased differentiation in attentional processing (N200) for ingroup and outgroup children was associated with reduced cuteness ratings of outgroup children. Importantly however, participants showed no overall preference for ingroup child faces, as motivation to view child faces was even greater towards outgroup child faces. In addition, increased self-reported motivation for parental care was related to enhanced cuteness appraisals of outgroup child faces. Taken together, these findings reveal how early social categorization processes may lead to biased behavior when interacting with children of ethnic minorities.

Event-related potential (ERP) correlates of face processing in verbal children with autism spectrum disorders (ASD) and their first-degree relatives: a family study

Background

Inherited abnormalities of perception, recognition, and attention to faces have been implicated in the etiology of autism spectrum disorders (ASD) including abnormal components of event-related brain potentials (ERP) elicited by faces.

Methods

We examined familial aggregation of face processing ERP abnormalities previously implicated in ASD in 49 verbal individuals with ASD, 36 unaffected siblings (US), 18 unaffected fathers (UF), and 53 unrelated controls (UC). The ASD, US, and UC groups ranged in age from 12 to 21 years, the UF group ranged in age from 30 to 56 years. ERP responses to images of upright and inverted faces and houses were analyzed under disparate EEG reference schemes.

Results

Face-sensitive features of N170 and P1 were readily observed in all groups. Differences between ASD and control groups depended upon the EEG reference scheme. Notably, the superiority of face over object for N170 latency was attenuated in ASD subjects, but not their relatives; this occurred exclusively with the average reference. The difference in N170 amplitude between inverted and upright faces was reduced in both ASD and US groups relative to UC, but this effect was significant only with the vertex reference. Furthermore, similar group differences were observed for both inverted faces and inverted houses, suggesting a lack of face specificity for the attenuation of the N170 inversion effect in ASD.

Conclusion

The present findings refine understanding of face processing ERPs in ASD. These data provide only modest evidence for highly-selective ASD-sensitive ERP features, and underscore the sensitivity of these biomarkers to ERP reference scheme. These schemes have varied across published studies and must be accounted for in future studies of the relationship between these commonly acquired ERP characteristics, genotype, and ASD.

Distinct neural processes for the perception of familiar versus unfamiliar faces along the visual hierarchy revealed by EEG

Humans recognize faces with ease, despite the complexity of the task and of the visual system which underlies it. Different spatial regions, including both the core and extended face processing networks, and distinct temporal stages of processing have been implicated in face recognition, but there is ongoing controversy regarding the extent to which the mechanisms for recognizing a familiar face differ from those for an unfamiliar face. Here, we used electroencephalogram (EEG) and flicker SSVEP, a high signal-to-noise approach, and searchlight decoding methods to elucidate the mechanisms mediating the processing of familiar and unfamiliar faces in the time domain. Familiar and unfamiliar faces were presented periodically at 15 Hz, 6 Hz and 3.75 Hz either upright or inverted in separate blocks, with the rationale that faster frequencies require shorter processing times per image and tap into fundamentally different levels of visual processing. The 15 Hz trials, likely to reflect early visual processing, exhibited enhanced neural responses for familiar over unfamiliar face trials, but only when the faces were upright. In contrast, decoding methods revealed similar classification accuracies for upright and inverted faces for both familiar and unfamiliar faces. For the 6 Hz frequency, familiar faces had lower amplitude responses than unfamiliar faces, and decoding familiarity was more accurate for upright compared with inverted faces. Finally, the 3.75 Hz frequency revealed no main effects of familiarity, but decoding showed significant correlations with behavioral ratings of face familiarity, suggesting that activity evoked by this slow presentation frequency reflected higher-level, cognitive aspects of familiarity processing. This three-way dissociation between frequencies reveals that fundamentally different stages of the visual hierarchy are modulated by face familiarity. The combination of experimental and analytical approaches used here represent a novel method for elucidating spatio-temporal characteristics within the visual system.

Using trial-level data and multilevel modeling to investigate within-task change in event-related potentials

EEG data, and specifically the ERP, provide psychologists with the power to examine quickly occurring cognitive processes at the native temporal resolution at which they occur. Despite the advantages conferred by ERPs to examine processes at different points in time, ERP researchers commonly ignore the trial-to-trial temporal dimension by collapsing across trials of similar types (i.e., the signal averaging approach) because of constraints imposed by repeated measures ANOVA. Here, we present the advantages of using multilevel modeling (MLM) to examine trial-level data to investigate change in neurocognitive processes across the course of an experiment. Two examples are presented to illustrate the usefulness of this technique. The first demonstrates decreasing differentiation in N170 amplitude to faces of different races across the course of a race categorization task. The second demonstrates attenuation of the ERN as participants commit more errors within a task designed to measure implicit racial bias. Although the examples presented here are within the realm of social psychology, the use of MLM to analyze trial-level EEG data has the potential to contribute to a number of different theoretical domains within psychology.

Emotional responding in NSSI: examinations of appraisals of positive and negative emotional stimuli, with and without acute stress

Non-suicidal self-injury (NSSI) is commonly used by young adults to regulate emotional responses. Yet, experimental examination of how people who self-injure appraise and respond to emotional stimuli is limited. We examined appraisals of, and responses to, emotive images in young adults who did and did not self-injure, and assessed whether these were impacted by exposure to a stressor. Study 1 (N = 51) examined whether participants differed in their appraisals of emotional images. Study 2 (N = 78) assessed whether appraisals of images changed after exposure to the Trier Social Stress Test. Ratings of emotional valence and arousal were collected in both studies; skin conductance was measured as an indicator of physiological arousal in Study 2. In Study 1 participants reporting NSSI rated positively valenced images as less pleasant than participants not reporting NSSI. In Study 2, after acute stress, participants reporting NSSI displayed dampened physiological reactions to positive images whereas participants who did not self-injure displayed heightened physiological reactions to these and rated them as more pleasant. Individuals who self-injure seem less able to engage in strategic mood repair after exposure to stress compared to people who do not self-injure.

Fear boosts the early neural coding of faces

The rapid extraction of facial identity and emotional expressions is critical for adapted social interactions. These biologically relevant abilities have been associated with early neural responses on the face sensitive N170 component. However, whether all facial expressions uniformly modulate the N170, and whether this effect occurs only when emotion categorization is task-relevant, is still unclear. To clarify this issue, we recorded high-resolution electrophysiological signals while 22 observers perceived the six basic expressions plus neutral. We used a repetition suppression paradigm, with an adaptor followed by a target face displaying the same identity and expression (trials of interest). We also included catch trials to which participants had to react, by varying identity (identity-task), expression (expression-task) or both (dual-task) on the target face. We extracted single-trial Repetition Suppression (stRS) responses using a data-driven spatiotemporal approach with a robust hierarchical linear model to isolate adaptation effects on the trials of interest. Regardless of the task, fear was the only expression modulating the N170, eliciting the strongest stRS responses. This observation was corroborated by distinct behavioral performance during the catch trials for this facial expression. Altogether, our data reinforce the view that fear elicits distinct neural processes in the brain, enhancing attention and facilitating the early coding of faces.

The other-race effect does not apply to infant faces: An ERP attentional study

It is known that paedomorphic characteristics, called "baby schema" by Lorenz, trigger an orienting response in adults, are judged as attractive and stimulate parental care. On the other hand, it is known that ethnicity may influence face encoding, with an advantage in recognizing faces of their own ethnicity (called own-race effect). Some have argued that this effect holds also for infant faces, which conflicts with the "baby schema" phenomenon. The aim of the study was to investigate the possible presence of the own-race effect on infant vs. adult face processing. Seventeen Caucasian students participated to the study. Their EEG/ERPs were recorded as they watched 400 pictures of adult and infant faces of different ethnicity (half Caucasian, half non-Caucasian), and subsequently responded to a target orientation. The behavioral results showed that responses were faster when the target was preceded by a child face, which enhanced the arousal level, regardless of ethnicity. The electrophysiological results showed an enhanced anterior N2 response to infant than adult faces, and a lack of ORE effect only for infant faces. Overall, the data indicate that baby faces automatically attract the adult viewer's attention and that face ethnicity has no effect on this innate response.

The Effects of Face Inversion and Face Race on the P100 ERP

Research about the neural basis of face recognition has investigated the timing and anatomical substrates of different stages of face processing. Scalp-recorded ERP studies of face processing have focused on the N170, an ERP with a peak latency of ∼170 msec that has long been associated with the initial structural encoding of faces. However, several studies have reported earlier ERP differences related to faces, suggesting that face-specific processes might occur before N170. Here, we examined the influence of face inversion and face race on the timing of face-sensitive scalp-recorded ERPs by examining neural responses to upright and inverted line-drawn and luminance-matched white and black faces in a sample of white participants. We found that the P100 ERP evoked by inverted faces was significantly larger than that evoked by upright faces. Although this inversion effect was statistically significant at 100 msec, the inverted-upright ERP difference peaked at 138 msec, suggesting that it might represent an activity in neural sources that overlap with P100. Inverse modeling of the inversion effect difference waveform suggested possible neural sources in pericalcarine extrastriate visual cortex and lateral occipito-temporal cortex. We also found that the inversion effect difference wave was larger for white faces. These results are consistent with behavioral evidence that individuals process the faces of their own races more configurally than faces of other races. Taken together, the inversion and race effects observed in the current study suggest that configuration influences face processing by at least 100 msec.

Facing the edible. The effects of edibility information on the neural encoding of animal faces

Animals perceived as edible are often denied more complex mental capacities or emotions. The process of categorizing and perceiving edible species as distant from humans has been extensively studied on the level of deliberate judgments of animals and humans. In the present study we wanted to determine whether information about the edibility of an artificially created species can affect one of the most automatic processes in humanity ascription: face perception. We focused on early perceptual stages of face processing as manifested in EEG signals by N170 Event Related Potentials. In an experimental study participants were assigned into two conditions, in which they were presented a series of human-animal morphed images. In one of the conditions participants were informed that the images present an edible species. Additionally, we measured participant judgments of the animals' capacity to suffer. Animal faces, which were perceived as non-edible, elicited larger N170 amplitudes than edible animal faces, suggesting that people recognize faces of non-edible animals as a face to a greater extent than edible ones. Importantly, this effect was significant only for those participants who perceived animals' capacity to suffer as relatively low. We discuss the obtained effects as a primary evidence for the very basic and automatic character of the "meat paradox", visible already in the initial stages of face perception.

The Neurological Traces of Look-Alike Avatars

We designed an observational study where participants (n = 17) were exposed to pictures and look-alike avatars pictures of themselves, a familiar friend or an unfamiliar person. By measuring participants’ brain activity with electroencephalography (EEG), we found face-recognition event related potentials (ERPs) in the visual cortex, around 200–250 ms, to be prominent for the different familiarity levels. A less positive component was found for self-recognized pictures (P200) than pictures of others, showing similar effects in both real faces and look-alike avatars. A rapid adaptation in the same component was found when comparing the neural processing of avatar faces vs. real faces, as if avatars in general were assimilated as real face representations over time. ERP results also showed that in the case of the self-avatar, the P200 component correlated with more complex conscious encodings of self-representation, i.e., the difference in voltage in the P200 between the self-avatar and the self-picture was reduced in participants that felt the avatar looked like them. This study is put into context within the literature of self-recognition and face recognition in the visual cortex. Additionally, the implications of these results on look-alike avatars are discussed both for future virtual reality (VR) and neuroscience studies.

Tracking the Timecourse of Social Perception: The Effects of Racial Cues on Event-Related Brain Potentials

Event-related potentials were used to track social perception processes associated with viewing faces of racial ingroup and outgroup members. Activity associated with three distinct processes was detected. First, peaking at approximately 170 ms, faces were distinguished from nonface stimuli. Second, peaking at approximately 250 ms, ingroup members were differentiated from outgroup members, with a larger component suggesting greater attention to ingroup members. This effect may reflect the spontaneous application of a deeper level of processing to ingroup members. Third, peaking at approximately 520 ms, evaluative differentiation of ingroup and outgroup members occurred, with greater ingroup bias displayed by those with higher levels of prejudice on an explicit measure. Together, the results demonstrate the promise of using neural processes to track the presence, timing, and degree of activation of components relevant to social perception, prejudice, and stereotyping.

Power effects on implicit prejudice and stereotyping: The role of intergroup face processing

Power is thought to increase discrimination toward subordinate groups, yet its effect on different forms of implicit bias remains unclear. We tested whether power enhances implicit racial stereotyping, in addition to implicit prejudice (i.e., evaluative associations), and examined the effect of power on the automatic processing of faces during implicit tasks. Study 1 showed that manipulated high power increased both forms of implicit bias, relative to low power. Using a neural index of visual face processing (the N170 component of the ERP), Study 2 revealed that power affected the encoding of White ingroup vs. Black outgroup faces. Whereas high power increased the relative processing of outgroup faces during evaluative judgments in the prejudice task, it decreased the relative processing of outgroup faces during stereotype trait judgments. An indirect effect of power on implicit prejudice through enhanced processing of outgroup versus ingroup faces suggested a potential link between face processing and implicit bias. Together, these findings demonstrate that power can affect implicit prejudice and stereotyping as well as early processing of racial ingroup and outgroup faces.

The Role of Configural Processing in Face Classification by Race: An ERP Study

The current study investigated the time course of the other-race classification advantage (ORCA) in the subordinate classification of normally configured faces and distorted faces by race. Slightly distorting the face configuration delayed the categorization of own-race faces and had no conspicuous effects on other-race faces. The N170 was sensitive neither to configural distortions nor to faces' races. The P3 was enhanced for other-race than own-race faces and reduced by configural manipulation only for own-race faces. We suggest that the source of ORCA is the configural analysis applied by default while processing own-race faces.

Human sex differences in emotional processing of own-race and other-race faces

There is evidence that women and men show differences in the perception of affective facial expressions. However, none of the previous studies directly investigated sex differences in emotional processing of own-race and other-race faces. The current study addressed this issue using high time resolution event-related potential techniques. In total, data from 25 participants (13 women and 12 men) were analyzed. It was found that women showed increased N170 amplitudes to negative White faces compared with negative Chinese faces over the right hemisphere electrodes. This result suggests that women show enhanced sensitivity to other-race faces showing negative emotions (fear or disgust), which may contribute toward evolution. However, the current data showed that men had increased N170 amplitudes to happy Chinese versus happy White faces over the left hemisphere electrodes, indicating that men show enhanced sensitivity to own-race faces showing positive emotions (happiness). In this respect, men might use past pleasant emotional experiences to boost recognition of own-race faces.

Is empathy necessary to comprehend the emotional faces? The empathic effect on attentional mechanisms (eye movements), cortical correlates (N200 event-related potentials) and facial behaviour (electromyography) in face processing

The present research explored the effect of social empathy on processing emotional facial expressions. Previous evidence suggested a close relationship between emotional empathy and both the ability to detect facial emotions and the attentional mechanisms involved. A multi-measure approach was adopted: we investigated the association between trait empathy (Balanced Emotional Empathy Scale) and individuals' performance (response times; RTs), attentional mechanisms (eye movements; number and duration of fixations), correlates of cortical activation (event-related potential (ERP) N200 component), and facial responsiveness (facial zygomatic and corrugator activity). Trait empathy was found to affect face detection performance (reduced RTs), attentional processes (more scanning eye movements in specific areas of interest), ERP salience effect (increased N200 amplitude), and electromyographic activity (more facial responses). A second important result was the demonstration of strong, direct correlations among these measures. We suggest that empathy may function as a social facilitator of the processes underlying the detection of facial emotion, and a general "facial response effect" is proposed to explain these results. We assumed that empathy influences cognitive and the facial responsiveness, such that empathic individuals are more skilful in processing facial emotion.

Configural processing advantage for Mongoloid than Caucasian faces during the structure coding stage

Configural processing is considered to be the hallmark of face expertise, which has been widely investigated by face global inversion (inversion effect) and local inversion (Thatcher effect). Using a passive detection task in which face stimuli are task-irrelevant, both the face inversion effect and the Thatcher effect on race perception of faces were investigated. We found that although the N170 inversion effect (enhanced and delayed N 170 for inverted than upright condition) was similar across races of faces, Chinese participants showed a larger N 170 Thatcher effect (enhanced N 170 to Thatcherized faces than normal faces) for Mongoloid faces. The present data indicates the perceptual advantage of configural changes for in-group than out-group faces.

The neuroscience of prejudice and stereotyping

Despite global increases in diversity, social prejudices continue to fuel intergroup conflict, disparities and discrimination. Moreover, as norms have become more egalitarian, prejudices seem to have 'gone underground', operating covertly and often unconsciously, such that they are difficult to detect and control. Neuroscientists have recently begun to probe the neural basis of prejudice and stereotyping in an effort to identify the processes through which these biases form, influence behaviour and are regulated. This research aims to elucidate basic mechanisms of the social brain while advancing our understanding of intergroup bias in social behaviour.

Situation-based social anxiety enhances the neural processing of faces: evidence from an intergroup context

Social anxiety is the intense fear of negative evaluation by others, and it emerges uniquely from a social situation. Given its social origin, we asked whether an anxiety-inducing social situation could enhance the processing of faces linked to the situational threat. While past research has focused on how individual differences in social anxiety relate to face processing, we tested the effect of manipulated social anxiety in the context of anxiety about appearing racially prejudiced in front of a peer. Visual processing of faces was indexed by the N170 component of the event-related potential. Participants viewed faces of Black and White males, along with nonfaces, either in private or while being monitored by the experimenter for signs of prejudice in a 'public' condition. Results revealed a difference in the N170 response to Black and Whites faces that emerged only in the public condition and only among participants high in dispositional social anxiety. These results provide new evidence that anxiety arising from the social situation modulates the earliest stages of face processing in a way that is specific to a social threat, and they shed new light on how anxiety effects on perception may contribute to the regulation of intergroup responses.

Infants' experience-dependent processing of male and female faces: insights from eye tracking and event-related potentials

The goal of the present study was to investigate infants' processing of female and male faces. We used an event-related potential (ERP) priming task, as well as a visual-paired comparison (VPC) eye tracking task to explore how 7-month-old "female expert" infants differed in their responses to faces of different genders. Female faces elicited larger N290 amplitudes than male faces. Furthermore, infants showed a priming effect for female faces only, whereby the N290 was significantly more negative for novel females compared to primed female faces. The VPC experiment was designed to test whether infants could reliably discriminate between two female and two male faces. Analyses showed that infants were able to differentiate faces of both genders. The results of the present study suggest that 7-month olds with a large amount of female face experience show a processing advantage for forming a neural representation of female faces, compared to male faces. However, the enhanced neural sensitivity to the repetition of female faces is not due to the infants' inability to discriminate male faces. Instead, the combination of results from the two tasks suggests that the differential processing for female faces may be a signature of expert-level processing.

Face the hierarchy: ERP and oscillatory brain responses in social rank processing

Recognition of social hierarchy is a key feature that helps us navigate through our complex social environment. Neuroimaging studies have identified brain structures involved in the processing of hierarchical stimuli but the precise temporal dynamics of brain activity associated with such processing remains largely unknown. Here, we used electroencephalography to examine the effect of social hierarchy on neural responses elicited by faces. In contrast to previous studies, the key manipulation was that a hierarchical context was constructed, not by varying facial expressions, but by presenting neutral-expression faces in a game setting. Once the performance-based hierarchy was established, participants were presented with high-rank, middle-rank and low-rank player faces and had to evaluate the rank of each face with respect to their own position. Both event-related potentials and task-related oscillatory activity were investigated. Three main findings emerge from the study. First, the experimental manipulation had no effect on the early N170 component, which may suggest that hierarchy did not modulate the structural encoding of neutral-expression faces. Second, hierarchy significantly modulated the amplitude of the late positive potential (LPP) within a 400-700 ms time-window, with more a prominent LPP occurring when the participants processed the face of the highest-rank player. Third, high-rank faces were associated with the highest reduction of alpha power. Taken together these findings provide novel electrophysiological evidence for enhanced allocation of attentional resource in the presence of high-rank faces. At a broader level, this study brings new insights into the neural processing underlying social categorization.

Do neural correlates of face expertise vary with task demands? Event-related potential correlates of own- and other-race face inversion

We are typically more accurate at remembering own- than other-race faces. This “own-race bias” has been suggested to result from enhanced expertise with and more efficient perceptual processing of own-race than other-race faces. In line with this idea, the N170, an event-related potential correlate of face perception, has been repeatedly found to be larger for other-race faces. Other studies, however, found no difference in N170 amplitude for faces from diverse ethnic groups. The present study tested whether these seemingly incongruent findings can be explained by varying task demands. European participants were presented with upright and inverted European and Asian faces (as well as European and Asian houses), and asked to either indicate the ethnicity or the orientation of the stimuli. Larger N170s for other-race faces were observed in the ethnicity but not in the orientation task, suggesting that the necessity to process facial category information is a minimum prerequisite for the occurrence of the effect. In addition, N170 inversion effects, with larger amplitudes for inverted relative to upright stimuli, were more pronounced for own- relative to other-race faces in both tasks. Overall, the present findings suggest that the occurrence of ethnicity effects in N170 for upright faces depends on the amount of facial detail required for the task at hand. At the same time, the larger inversion effects for own- than other-race faces occur independent of task and may reflect the fine-tuning of perceptual processing to faces of maximum expertise.