Event-related brain potential correlates of the other-race effect: A review

Revealing the neural representations underlying other-race face perception

The other-race effect (ORE) refers to poorer recognition for faces of other races than one's own. This study investigates the neural and representational basis of ORE in East Asian and White participants using behavioral measures, neural decoding, and image reconstruction based on electroencephalography (EEG) data. Our investigation identifies a reliable neural counterpart of ORE, with reduced decoding accuracy for other-race faces, and it relates this result to higher density of other-race face representations in face space. Then, we characterize the temporal dynamics and the prominence of ORE for individual variability at the neural level. Importantly, we use a data-driven image reconstruction approach to reveal visual biases underlying other-race face perception, including a tendency to perceive other-race faces as more typical, younger, and more expressive. These findings provide neural evidence for a classical account of ORE invoking face space compression for other-race faces. Further, they indicate that ORE involves not only reduced identity information but also broader, systematic distortions in visual representation with considerable cognitive and social implications.

Outgroup homogeneity perception as a precursor to the generalization of threat across racial outgroup individuals

People who look different from oneself are often categorized as homogeneous members of another racial group. We examined whether the relationship between such categorization and the tendency to generalize across outgroup individuals is explained by perceived visual similarity, leading to an all-look-alike misperception. To address this question at the neural level, White participants perceived sequences of White and Black faces while event-related electrocortical activity was recorded. Prior to each face sequence, one specific ingroup or outgroup face was instructed as a cue for receiving unpleasant electric shocks (threat cue), and we were interested in the extent to which such threat effects generalize to other non-instructed faces (safety cues). Face stimuli were presented in adaptor-target pairs, consisting of two ingroup faces or two outgroup faces, which could depict either the same or different identities. Results show less identity processing of outgroup compared to ingroup faces in early visual processing, i.e., N170 repetition suppression was sensitive only to ingroup face identities. Subsequently, as indicated by enhanced Late Positive Potentials to both threat and safety faces, instructed threat generalized stronger across outgroup compared to ingroup faces. These findings and their interaction suggest that the misperception of outgroup homogeneity may be an early precursor to the tendency to generalize threat associations across outgroup individuals.

Other ethnicity effects in ensemble coding of facial expressions

Cultural difference in ensemble emotion perception is an important research question, providing insights into the complexity of human cognition and social interaction. Here, we conducted two experiments to investigate how emotion perception would be affected by other ethnicity effects and ensemble coding. In Experiment 1, two groups of Asian and Caucasian participants were tasked with assessing the average emotion of faces from their ethnic group, other ethnic group, and mixed ethnicity groups. Results revealed that participants exhibited relatively accurate yet amplified emotion perception of their group faces, with a tendency to overestimate the weight of the faces from the other ethnic group. In Experiment 2, Asian participants were instructed to discern the emotion of a target face surrounded by faces from Caucasian and Asian faces. Results corroborated earlier findings, indicating that while participants accurately perceived emotions in faces of their ethnicity, their perception of Caucasian faces was noticeably influenced by the presence of surrounding Asian faces. These findings collectively support the notion that the other ethnicity effect stems from differential emotional amplification inherent in ensemble coding of emotion perception.

Asymmetries in event-related potentials part 1: A systematic review of face processing studies

The human brain shows distinct lateralized activation patterns for a range of cognitive processes. One such function, which is thought to be lateralized to the right hemisphere (RH), is human face processing. Its importance for social communication and interaction has led to a plethora of studies investigating face processing in health and disease. Temporally highly resolved methods, like event-related potentials (ERPs), allow for a detailed characterization of different processing stages and their specific lateralization patterns. This systematic review aimed at disentangling some of the contradictory findings regarding the RH specialization in face processing focusing on ERP research in healthy participants. Two databases were searched for studies that investigated left and right electrodes while participants viewed (mostly neutral) facial stimuli. The included studies used a variety of different tasks, which ranged from passive viewing to memorizing faces. The final data selection highlights, that strongest lateralization to the RH was found for the N170, especially for right-handed young male participants. Left-handed, female, and older participants showed less consistent lateralization patterns. Other ERP components like the P1, P2, N2, P3, and the N400 were overall less clearly lateralized. The current review highlights that many of the assumed lateralization patterns are less clear than previously thought and that the variety of stimuli, tasks, and EEG setups used, might contribute to the ambiguous findings.

Face motion form at learning influences the time course of face spatial frequency processing during test

Studies that use static faces suggest that facial processing follows a coarse-to-fine sequence; i.e., holistic precedes featural processing, due to low and high spatial frequencies (LSF, HSF) transmitting holistic/global and featural/local information respectively. Although recent studies have focused on the role of facial movement in holistic facial processing, it is unclear whether moving faces have the same processing mechanism as static ones, especially in the time course of processing. The current study uses the event-related potential technique to investigate this issue by manipulating the facial format at study and face spatial frequency during the test. ERP results showed that the P1 amplitude was increased by LSF faces relative to HSF ones, using both moving and static study faces, with the former larger than the latter. The N170 amplitude was more sensitive to HSF than LSF faces when only static study faces were used, while the P2 amplitude was more sensitive to LSF faces regardless of the facial study format. The above results were not modulated by the race of the faces. These results favor the view that regardless of face race, moving study faces promote holistic processing during the earliest stage of face recognition. Furthermore, holistic processing is observed to be the same for both static and moving study faces at a later stage associated with more in-depth processing. It is evident that facial motion should be factored into further studies of face recognition, given the distinctions between holistic and featural processing for moving and static study faces.

Default categorization of outgroup faces and the other race effect: Commentary on the special issue

This commentary addresses how studies examining the neurophysiological correlates of racial categorization can provide insight into the neurocognitive mechanisms of the other-race effect in recognition memory. Several articles in the special issue describe how event-related potentials (ERPs) have been used to examine processing of faces that vary according to race, some of which have concluded that larger ERP amplitudes elicited by other-race (relative to own-race) faces indicates less efficient visual processing of other-race faces. I describe findings from ERP studies of race categorization that suggest an alternative interpretation-that other-race faces elicit stronger categorization, which impedes individuation of other-race faces. Suggestions for future research are offered.

Neural timing of the other-race effect across the lifespan: A review

Face race influences the way we process faces, so that faces of a different ethnic group are processed for identity less efficiently than faces of one's ethnic group - a phenomenon known as the Other-Race Effect (ORE). Although widely replicated, the ORE is still poorly characterized in terms of its development and the underlying mechanisms. In the last two decades, the Event-Related Potential (ERP) technique has brought insight into the mechanisms underlying the ORE and has demonstrated potential to clarify its development. Here, we review the ERP evidence for a differential neural processing of own-race and other-race faces throughout the lifespan. In infants, race-related processing differences emerged at the N290 and P400 (structural encoding) stages. In children, race affected the P100 (early processing, attention) perceptual stage and was implicitly encoded at the N400 (semantic processing) stage. In adults, processing difficulties for other-race faces emerged at the N170 (structural encoding), P200 (configuration processing) and N250 (accessing individual representations) perceptual stages. Early in processing, race was implicitly encoded from other-race faces (N100, P200 attentional biases) and in-depth processing preferentially applied to own-race faces (N200 attentional bias). Encoding appeared less efficient (Dm effects) and retrieval less recollection-based (old/new effects) for other-race faces. Evidence admits the contribution of perceptual, attentional, and motivational processes to the development and functioning of the ORE, offering no conclusive support for perceptual or socio-cognitive accounts. Cross-racial and non-cross-racial studies provided convergent evidence. Future research would need to include less represented ethnic populations and the developmental population.

The role of attention control in visual mismatch negativity (vMMN) studies

The detection of unattended visual changes is investigated by the visual mismatch negativity (vMMN) component of event-related potentials (ERPs). The vMMN is measured as the difference between the ERPs to infrequent (deviant) and frequent (standard) stimuli irrelevant to the ongoing task. In the present study, we used human faces expressing different emotions as deviants and standards. In such studies, participants perform various tasks, so their attention is diverted from the vMMN-related stimuli. If such tasks vary in their attentional demand, they might influence the outcome of vMMN studies. In this study, we compared four kinds of frequently used tasks: (1) a tracking task that demanded continuous performance, (2) a detection task where the target stimuli appeared at any time, (3) a detection task where target stimuli appeared only in the inter-stimulus intervals, and (4) a task where target stimuli were members of the stimulus sequence. This fourth task elicited robust vMMN, while in the other three tasks, deviant stimuli elicited moderate posterior negativity (vMMN). We concluded that the ongoing task had a marked influence on vMMN; thus, it is important to consider this effect in vMMN studies.

Understanding the mechanisms underlying the other-'race' effect: An attempt at integrating different perspectives

Although different human races do not exist from the perspective of biology and genetics, ascribed 'race' influences psychological processing, such as memory and perception of faces. Research from this Special Issue, as well as a wealth of previous research, shows that other-'race' faces are more difficult to recognize compared to own-'race' faces, a phenomenon known as the other-'race' effect. Theories of expertise attribute the cause of the other-'race' effect to less efficient visual representations of other-'race' faces, which results from reduced visual expertise with other-'race' faces compared to own-'race' faces due to limited contact with individuals from other 'racial' groups. By contrast, social-cognitive accounts attribute the cause of the other-'race' effect to reduced motivation to individuate other-'race' faces compared to own-'race' faces. Evidence for both types of theories is still mixed, but progress in understanding the phenomenon has also been hampered by the fact that there has been little crosstalk between these accounts, which tend to be rooted in separate domains of experimental perception science and social psychology, respectively. To promote an integrative perspective on current knowledge on own- versus other-'race' face processing, the present Special Issue bridges different psychological subdisciplines, showcasing research using a large variety of methodological approaches and measures. In this guest editorial, we briefly highlight individual contributions to this Special Issue and offer what we see as important avenues for future research on the other-'race' effect.