Why the other-race effect matters: Poor recognition of other-race faces impacts everyday social interactions

Bias in perceptual learning

Perceptual learning is commonly understood as conferring some benefit to the learner, such as allowing for the extraction of more information from the environment. However, perceptual learning can be biased in several different ways, some of which do not appear to provide such a benefit. Here we outline a systematic framework for thinking about bias in perceptual learning and discuss how several cases fit into this framework. We argue these biases are compatible with an understanding in which perceptual learning is beneficial, but that its benefits are tied to both a person's narrow interests and the training environment or domain, and so if there are changes to either of these, then benefits can turn into liabilities, though these are often temporary. This article is categorized under: Psychology > Learning Philosophy > Value Linguistics > Language Acquisition.

Vienna Talking Faces (ViTaFa): A multimodal person database with synchronized videos, images, and voices

Social perception relies on different sensory channels, including vision and audition, which are specifically important for judgements of appearance. Therefore, to understand multimodal integration in person perception, it is important to study both face and voice in a synchronized form. We introduce the Vienna Talking Faces (ViTaFa) database, a high-quality audiovisual database focused on multimodal research of social perception. ViTaFa includes different stimulus modalities: audiovisual dynamic, visual dynamic, visual static, and auditory dynamic. Stimuli were recorded and edited under highly standardized conditions and were collected from 40 real individuals, and the sample matches typical student samples in psychological research (young individuals aged 18 to 45). Stimuli include sequences of various types of spoken content from each person, including German sentences, words, reading passages, vowels, and language-unrelated pseudo-words. Recordings were made with different emotional expressions (neutral, happy, angry, sad, and flirtatious). ViTaFa is freely accessible for academic non-profit research after signing a confidentiality agreement form via https://osf.io/9jtzx/ and stands out from other databases due to its multimodal format, high quality, and comprehensive quantification of stimulus features and human judgements related to attractiveness. Additionally, over 200 human raters validated emotion expression of the stimuli. In summary, ViTaFa provides a valuable resource for investigating audiovisual signals of social perception.

Event-related potential correlates of implicit processing of own- and other-race faces in children

Human adults typically experience difficulties in recognizing and discriminating individual faces belonging to racial groups other than their own. The origin of this "other-race" effect is set in infancy, but the understanding of its developmental course is fragmented. We aimed to access the mechanisms of the other-race effect in childhood by unraveling the neural time course of own- and other-race face processing during a masked priming paradigm. White 6- and 7-year-old children (N = 19) categorized fully visible Asian (other-race) or White (own-race) target faces according to gender. Target faces were preceded by masked same-identity or different-identity prime faces, matching the target for race and gender. We showed an early priming effect on the N100 component, with larger amplitude to different-face pairs than to same-face pairs, and a later race effect on the N200 component, with larger amplitude to own-race face pairs than to other-race face pairs. Critically, race did not interact with priming at any processing stage (P100, N100, P200, N200, or P300). Our results suggest that race could have a temporally limited impact on face processing and that the implicit and unconscious identity processing of own- and other-race faces could be similar in 6- and 7-year-olds, depicting an immature other-race effect during childhood.

Cultural facial expressions dynamically convey emotion category and intensity information

Communicating emotional intensity plays a vital ecological role because it provides valuable information about the nature and likelihood of the sender's behavior.1,2,3 For example, attack often follows signals of intense aggression if receivers fail to retreat.4,5 Humans regularly use facial expressions to communicate such information.6,7,8,9,10,11 Yet how this complex signaling task is achieved remains unknown. We addressed this question using a perception-based, data-driven method to mathematically model the specific facial movements that receivers use to classify the six basic emotions-"happy," "surprise," "fear," "disgust," "anger," and "sad"-and judge their intensity in two distinct cultures (East Asian, Western European; total n = 120). In both cultures, receivers expected facial expressions to dynamically represent emotion category and intensity information over time, using a multi-component compositional signaling structure. Specifically, emotion intensifiers peaked earlier or later than emotion classifiers and represented intensity using amplitude variations. Emotion intensifiers are also more similar across emotions than classifiers are, suggesting a latent broad-plus-specific signaling structure. Cross-cultural analysis further revealed similarities and differences in expectations that could impact cross-cultural communication. Specifically, East Asian and Western European receivers have similar expectations about which facial movements represent high intensity for threat-related emotions, such as "anger," "disgust," and "fear," but differ on those that represent low threat emotions, such as happiness and sadness. Together, our results provide new insights into the intricate processes by which facial expressions can achieve complex dynamic signaling tasks by revealing the rich information embedded in facial expressions.

Behavioral, neurological, and psychiatric frailty of autobiographical memory

Autobiographical-episodic memory is considered to be the most complex of the five long-term memory systems. It is autonoetic, which means, self-reflective, relies on emotional colorization, and needs the features of place and time; it allows mental time traveling. Compared to the other four long-term memory systems-procedural memory, priming, perceptual, and semantic memory-it develops the latest in phylogeny and ontogeny, and is the most vulnerable of the five systems, being easily impaired by brain damage and psychiatric disorders. Furthermore, it is characterized by its fragility and proneness to distortion due to environmental influences and subsequent information. On the brain level, a distinction has to be made between memory encoding and consolidating, memory storage, and memory retrieval. For encoding, structures of the limbic system, with the hippocampus in its center, are crucial, for storage of widespread cortical networks, and for retrieval again a distributed recollection network, in which the prefrontal cortex plays a crucial role, is engaged. Brain damage and psychiatric diseases can lead to what is called "focal retrograde amnesia." In this context, the clinical picture of dissociative or functional or psychogenic amnesia is central, as it may result in autobiographical-emotional amnesia of the total past with the consequence of an impairment of the self as well. The social environment therefore can have a major impact on the brain and on autobiographical-episodic memory processing. This article is categorized under: Psychology > Memory.

Default categorization of outgroup faces and the other race effect: Commentary on the special issue

This commentary addresses how studies examining the neurophysiological correlates of racial categorization can provide insight into the neurocognitive mechanisms of the other-race effect in recognition memory. Several articles in the special issue describe how event-related potentials (ERPs) have been used to examine processing of faces that vary according to race, some of which have concluded that larger ERP amplitudes elicited by other-race (relative to own-race) faces indicates less efficient visual processing of other-race faces. I describe findings from ERP studies of race categorization that suggest an alternative interpretation-that other-race faces elicit stronger categorization, which impedes individuation of other-race faces. Suggestions for future research are offered.

Recommendations for Investigating the Cross-Category Effect Among Hispanic and Latino Populations

Individuals who are Hispanic or Latino make up a substantial portion of the U.S. and world population yet are vastly underrepresented as both participants and stimuli in the face-perception literature. Perceiving and recognizing faces are critical components of everyday social interactions, but cross-category effects (difficulty recognizing faces from other races or ethnicities) can hinder social interactions. Cross-category effects are the most commonly studied face-perception topic with these ethnic groups, but this empirical knowledge should be expanded via culturally relevant considerations. In this article, I describe (a) errors individuals display when categorizing target faces, (b) how social status influences identity and cross-category effects, (c) the potential impact of flexible and heterogeneous social identities on face processing, (d) a critical need for more developmental research, and (e) methodological expansions and generalizability concerns. Thus, I propose important directions for future studies to address these issues and advance knowledge in the field.

The influence of gaze direction on time perception: From the perspective of social perception

Gazing is important during communication, which is a type of body language that differs from culture to culture. The present study investigated the influence of direct and averted gaze directions on the perceived duration of gazing among same-race and other-race faces. The gaze direction effect, in which direct-gazing faces were perceived to be longer than averted-gazing faces were, was found in the same-race condition but not in the other-race condition. The results could promote our understanding of the underlying mechanism of the gaze direction effect based on the perception of interpersonal social interaction.

Quantifying social performance: A review with implications for further work

Human social performance has been a focus of theory and investigation for more than a century. Attempts to quantify social performance have focused on self-report and non-social performance measures grounded in intelligence-based theories. An expertise framework, when applied to individual differences in social interaction performance, offers novel insights and methods of quantification that could address limitations of prior approaches. The purposes of this review are 3-fold. First, to define the central concepts related to individual differences in social performance, with a particular focus on the intelligence-based framework that has dominated the field. Second, to make an argument for a revised conceptualization of individual differences in social-emotional performance as a social expertise. In support of this second aim, the putative components of a social-emotional expertise and the potential means for their assessment will be outlined. To end, the implications of an expertise-based conceptual framework for the application of computational modeling approaches in this area will be discussed. Taken together, expertise theory and computational modeling methods have the potential to advance quantitative assessment of social interaction performance.

Understanding the mechanisms underlying the other-'race' effect: An attempt at integrating different perspectives

Although different human races do not exist from the perspective of biology and genetics, ascribed 'race' influences psychological processing, such as memory and perception of faces. Research from this Special Issue, as well as a wealth of previous research, shows that other-'race' faces are more difficult to recognize compared to own-'race' faces, a phenomenon known as the other-'race' effect. Theories of expertise attribute the cause of the other-'race' effect to less efficient visual representations of other-'race' faces, which results from reduced visual expertise with other-'race' faces compared to own-'race' faces due to limited contact with individuals from other 'racial' groups. By contrast, social-cognitive accounts attribute the cause of the other-'race' effect to reduced motivation to individuate other-'race' faces compared to own-'race' faces. Evidence for both types of theories is still mixed, but progress in understanding the phenomenon has also been hampered by the fact that there has been little crosstalk between these accounts, which tend to be rooted in separate domains of experimental perception science and social psychology, respectively. To promote an integrative perspective on current knowledge on own- versus other-'race' face processing, the present Special Issue bridges different psychological subdisciplines, showcasing research using a large variety of methodological approaches and measures. In this guest editorial, we briefly highlight individual contributions to this Special Issue and offer what we see as important avenues for future research on the other-'race' effect.

The impact of social motivation on the other-race effect under high and low social status

The other-race effect refers to the phenomenon in which the chance of individuals misidentifying faces from other races more than their own race is significantly higher. This study explored the effect of motivation on the other-race effect by manipulating the social status of faces. The results showed that: (1) compared to other-race faces with low social status, when individuals' perceptions of the social status of other-race faces increased, individuals' recognition scores for high social status other-race faces increased, and the other-race effect disappeared, and (2) when individuals' perceptions of the social status of other-race faces decreased, there was no significant difference in individuals' recognition scores of other-race faces, of either high or low social status. These findings suggest that motivation has a significant impact on the other-race effect.

Real-life outgroup exposure, self-reported outgroup contact and the other-race effect

People are better at recognizing faces from their own racial or ethnic group compared with faces from other racial or ethnic groups, known as the other-'race' effect (ORE). Several theories of the ORE assume that memory for other-race faces is impaired because people have less contact with members of other racial or ethnic groups, resulting in lower visual expertise. The present research investigates contact theories of the ORE, using self-report contact measures and objective measures of potential outgroup exposure (estimated from participants' residential location and from GPS tracking). Across six studies (total N = 2660), we observed that White American and White German participants displayed better memory for White faces compared with Black or Middle Eastern faces, whereas Black American participants displayed similarly equal or better memory for White compared with Black faces. We did not observe any relations between the ORE and objective measures of potential outgroup exposure. Only in Studies 2a and 2b, we observed very small correlations (rs = -.08 to .06) between 4 out of 30 contact measures and the ORE. We discuss methodological limitations and implications for theories of the ORE.

The importance of internal and external features in recognizing faces that vary in familiarity and race

Familiar and unfamiliar faces are recognized in fundamentally different ways. One way in which recognition differs is in terms of the features that facilitate recognition: previous studies have shown that familiar face recognition depends more on internal facial features (i.e., eyes, nose and mouth), whereas unfamiliar face recognition depends more on external facial features (i.e., hair, ears and contour). However, very few studies have examined the recognition of faces that vary in both familiarity and race, and the reliance on different facial features, whilst also using faces that incorporate natural within-person variability. In the current study, we used an online version of the card sorting task to assess adults’ (n = 258) recognition of faces that varied in familiarity and race when presented with either the whole face, internal features only, or external features only. Adults better recognized familiar faces than unfamiliar faces in both the whole face and the internal features only conditions, but not in the external features only condition. Reasons why adults did not show an own-race advantage in recognition are discussed.

Event-related brain potential correlates of the other-race effect: A review

People are better at remembering own-race relative to other-race faces. Here, we review event-related brain potential (ERP) correlates of this so-called other-'race' effect (ORE) by discussing three critical aspects that characterize the neural signature of this phenomenon. First, difficulties with other-race faces initially emerge during perceptual processing, which is indexed by an increased N170. Second, as evidenced by 'difference due to subsequent memory' effects, more effortful processing of other-race faces is needed for successful encoding into long-term memory. Third, ERP old/new effects reveal that a stronger engagement of processing resources is also required for successful retrieval of other-race faces from memory. The ERP evidence available to date thus suggests widespread ethnicity-related modulations during both perceptual and mnemonic processing stages. We further discuss how findings from the ORE compared with potentially related memory biases (e.g. other-gender or other-age effects) and how ERP findings inform the ongoing debate regarding the mechanisms underlying the ORE. Finally, we outline open questions and potential future directions with an emphasis on using multiple, ecologically more valid 'ambient' images for each face to assess the ORE in paradigms that capture identity rather than image recognition.

Multi-cultural cities reduce disadvantages in recognizing naturalistic images of other-race faces: evidence from a novel face learning task

People often find it more difficult to recognize other- than own-race faces. This other-race effect is robust across numerous ethnic groups. Yet, it remains unclear how this effect changes in people who live in a multiracial environment, and in immigrants whose lifetime perceptual experience changes over time. In the present study, we developed a novel face recognition test that approximates face recognition in the real world. We tested five groups of White and East Asian adults (n = 120) living in racially homogeneous versus heterogeneous cities and East Asians who immigrated to a multiracial city between infancy and adulthood. Multiracial cities reduce the other-race effect. The magnitude of the other-race effect changes as a function of experience, mirroring the racial diversity in perceivers' living environment. Our study highlights the challenge of forming reliable face representations across naturalistic facial variability and suggests a facilitative role of multiracial environments in eliminating the other-race effect.

Facial expressions elicit multiplexed perceptions of emotion categories and dimensions

Human facial expressions are complex, multi-component signals that can communicate rich information about emotions,1-5 including specific categories, such as "anger," and broader dimensions, such as "negative valence, high arousal."6-8 An enduring question is how this complex signaling is achieved. Communication theory predicts that multi-component signals could transmit each type of emotion information-i.e., specific categories and broader dimensions-via the same or different facial signal components, with implications for elucidating the system and ontology of facial expression communication.9 We addressed this question using a communication-systems-based method that agnostically generates facial expressions and uses the receiver's perceptions to model the specific facial signal components that represent emotion category and dimensional information to them.10-12 First, we derived the facial expressions that elicit the perception of emotion categories (i.e., the six classic emotions13 plus 19 complex emotions3) and dimensions (i.e., valence and arousal) separately, in 60 individual participants. Comparison of these facial signals showed that they share subsets of components, suggesting that specific latent signals jointly represent-i.e., multiplex-categorical and dimensional information. Further examination revealed these specific latent signals and the joint information they represent. Our results-based on white Western participants, same-ethnicity face stimuli, and commonly used English emotion terms-show that facial expressions can jointly represent specific emotion categories and broad dimensions to perceivers via multiplexed facial signal components. Our results provide insights into the ontology and system of facial expression communication and a new information-theoretic framework that can characterize its complexities.

Introducing the female Cambridge face memory test - long form (F-CFMT+)

The Cambridge Face Memory Test (CFMT) is one of the most used assessments of face recognition abilities in the science of face processing. The original task, using White male faces, has been empirically evaluated for psychometric properties (Duchaine & Nakayama, 2006), while the longer and more difficult version (CFMT+; Russell et al., 2009) has not. Critically, no version exists using female faces. Here, we present the Female Cambridge Face Memory Test - Long Form (F-CFMT+) and evaluate the psychometric properties of this task in comparison to the Male Cambridge Face Memory Test - Long Form (M-CFMT+). We tested typically developing emerging adults (18 to 25 years old) in both Cambridge face recognition tasks, an old-new face recognition task, and a car recognition task. Results indicate that the F-CFMT+ is a valid, internally consistent measure of unfamiliar face recognition that can be used alone or in tandem with the M-CFMT+ to assess recognition abilities for young adult White faces. When used together, performance on the F-CFMT+ and M-CFMT+ can be directly compared, adding to the ability to understand face recognition abilities for different kinds of faces. The two tasks have high convergent validity and relatively good divergent validity with car recognition in the same task paradigm. The F-CFMT+ will be useful to researchers interested in evaluating a broad range of questions about face recognition abilities in both typically developing individuals and those with atypical social information processing abilities.

Serial dependence of facial identity for own- and other-race faces

It is well established that individuals are better at recognising faces of their own-race compared with other-races; however, there is ongoing debate regarding the perceptual mechanisms that may be involved and therefore sensitive to face-race. Here, we ask whether serial dependence of facial identity, a bias where the perception of a face's identity is biased towards a previously presented face, shows an other-race effect. Serial dependence is associated with face recognition ability and appears to operate on high-level, face-selective representations, like other candidate mechanisms (e.g., holistic processing). We therefore expected to find an other-race effect for serial dependence for our Caucasian and Asian participants. While participants showed robust effects of serial dependence for all faces, only Caucasian participants showed stronger serial dependence for own-race faces. Intriguingly, we found that individual variation in own-race, but not other-race, serial dependence was significantly associated with face recognition abilities. Preliminary evidence also suggested that other-race contact is associated with other-race serial dependence. In conclusion, though we did not find an overall difference in serial dependence for own- versus other-race faces in both participant groups, our results highlight that this bias may be functionally different for own- versus other-race faces and sensitive to racial experience.