Development of face scanning for own- and other-race faces in infancy

Altered development of face recognition among infants born amid the COVID-19 pandemic

To effectively contain the spread of COVID-19, public health agencies mandated special regulations. Although they protected us from COVID-19, these restrictions have inevitably changed the environment around us. It remains unclear how these changes may have affected early cognitive development among infants born during the pandemic. Thus, this study examined how the COVID-19 restrictions have affected infants' face recognition ability, a hallmark of their cognitive capacities. Specifically, we used the familiarization and visual pair comparison paradigm to examine face recognition performance among infants aged 6 to 14 months amid the second wave of the pandemic (February to July 2021). Experiment 1 investigated the recognition of unmasked faces and found that only younger infants, but not older infants, recognized faces by showing a novelty preference. Experiment 2 examined the recognition of faces wearing masks and found that only older infants, but not younger ones, recognized faces by exhibiting a familiarity preference. These results suggest that with limited interactions during the pandemic, infants could have developed an overly specialized face processing ability that failed to recognize the faces of strangers. Moreover, infants could have obtained more information on masked faces during the pandemic and adapted to the current situation. In Expreiment 3, we further confirmed the restriction on infants' interpersonal experiences with a survey conducted both before and during the pandemic. Overall, these findings demonstrated how the pandemic altered early perceptual development and further confirmed that interpersonal experiences during infancy are critical in their cognitive development.

Face race and sex impact visual fixation strategies for upright and inverted faces in 3- to 6-year-old children

Everyday face experience tends to be biased, such that infants and young children interact more often with own-race and female faces leading to differential processing of faces within these groups relative to others. In the present study, visual fixation strategies were recorded using eye tracking to determine the extent to which face race and sex/gender impact a key index of face processing in 3- to 6-year-old children (n = 47). Children viewed male and female upright and inverted White and Asian faces while visual fixations were recorded. Face orientation was found to have robust effects on children's visual fixations, such that children exhibited shorter first fixation and average fixation durations and a greater number of fixations for inverted compared to upright face trials. First fixations to the eye region were also greater for upright compared to inverted faces. Fewer fixations and longer duration fixations were found for trials with male compared to female faces and for upright compared to inverted unfamiliar-race faces, but not familiar-race faces. These findings demonstrate evidence of differential fixation strategies toward different types of faces in 3- to 6-year-old children, illustrating the importance of experience in the development of visual attention to faces.

Do they 'look' different(ly)? Dynamic face recognition in Malaysians: Chinese, Malays and Indians compared

Previous cross-cultural eye-tracking studies examining face recognition discovered differences in the eye movement strategies that observers employ when perceiving faces. However, it is unclear (1) the degree to which this effect is fundamentally related to culture and (2) to what extent facial physiognomy can account for the differences in looking strategies when scanning own- and other-race faces. In the current study, Malay, Chinese and Indian young adults who live in the same multiracial country performed a modified yes/no recognition task. Participants' recognition accuracy and eye movements were recorded while viewing muted face videos of own- and other-race individuals. Behavioural results revealed a clear own-race advantage in recognition memory, and eye-tracking results showed that the three ethnic race groups adopted dissimilar fixation patterns when perceiving faces. Chinese participants preferentially attended more to the eyes than Indian participants did, while Indian participants made more and longer fixations on the nose than Malay participants did. In addition, we detected statistically significant, though subtle, differences in fixation patterns between the faces of the three races. These findings suggest that the racial differences in face-scanning patterns may be attributed both to culture and to variations in facial physiognomy between races.

Asymmetrical responding to male versus female other-race categories in 9- to 12-month-old infants

Faces can be categorized along various dimensions including gender or race, an ability developing in infancy. Infant categorization studies have focused on facial attributes in isolation, but the interaction between these attributes remains poorly understood. Experiment 1 examined gender categorization of other-race faces in 9- and 12-month-old White infants. Nine- and 12-month-olds were familiarized with Asian male or female faces, and tested with a novel exemplar from the familiarized category paired with a novel exemplar from a novel category. Both age groups showed novel category preferences for novel Asian female faces after familiarization with Asian male faces, but showed no novel category preference for novel Asian male faces after familiarization with Asian female faces. This categorization asymmetry was not due to a spontaneous preference hindering novel category reaction (Experiment 2), and both age groups displayed difficulty discriminating among male, but not female, other-race faces (Experiment 3). These results indicate that category formation for male other-race faces is mediated by categorical perception. Overall, the findings suggest that even by 12 months of age, infants are not fully able to form gender category representations of other-race faces, responding categorically to male, but not female, other-race faces.

Perceiving ingroup and outgroup faces within and across nations

The human face is arguably the most important of all social stimuli because it provides so much valuable information about others. Therefore, one critical factor for successful social communication is the ability to process faces. In general, a wide body of social cognitive research has demonstrated that perceivers are better at extracting information from their own-race compared to other-race faces and that these differences can be a barrier to positive cross-race relationships. The primary objective of the present paper was to provide an overview of how people process faces in diverse contexts, focusing on racial ingroup and outgroup members within one nation and across nations. To achieve this goal, we first broadly describe social cognitive research on categorization processes related to ingroups vs. outgroups. Next, we briefly examine two prominent mechanisms (experience and motivation) that have been used to explain differences in recognizing facial identities and identifying emotions when processing ingroup and outgroup racial faces within nations. Then, we explore research in this domain across nations and cultural explanations, such as norms and practices, that supplement the two proposed mechanisms. Finally, we propose future cross-cultural research that has the potential to help us better understand the role of these key mechanisms in processing ingroup and outgroup faces.

Infants' visual exploration strategies for adult and child faces

By the end of the first year of life, infants' discrimination abilities tune to frequently experienced face groups. Little is known about the exploration strategies adopted to efficiently discriminate frequent, familiar face types. The present eye-tracking study examined the distribution of visual fixations produced by 10-month-old and 4-month-old singletons while learning adult (i.e., familiar) and child (i.e., unfamiliar) White faces. Infants were tested in an infant-controlled visual habituation task, in which post-habituation preference measured successful discrimination. Results confirmed earlier evidence that, without sibling experience, 10-month-olds discriminate only among adult faces. Analyses of gaze movements during habituation showed that infants' fixations were centered in the upper part of the stimuli. The mouth was sampled longer in adult faces than in child faces, while the child eyes were sampled longer and more frequently than the adult eyes. At 10 months, but not at 4 months, global measures of scanning behavior on the whole face also varied according to face age, as the spatiotemporal distribution of scan paths showed larger within- and between-participants similarity for adult faces than for child faces. Results are discussed with reference to the perceptual narrowing literature, and the influence of age-appropriate developmental tasks on infants' face processing abilities.

Infant Eye Gaze While Viewing Dynamic Faces

Research using eye tracking methods has revealed that when viewing faces, between 6 to 10 months of age, infants begin to shift visual attention from the eye region to the mouth region. Moreover, this shift varies with stimulus characteristics and infants’ experience with faces and languages. The current study examined the eye movements of a racially diverse sample of 98 infants between 7.5 and 10.5 months of age as they viewed movies of White and Asian American women reciting a nursery rhyme (the auditory component of the movies was replaced with music to eliminate the influence of the speech on infants’ looking behavior). Using an analytic approach inspired by the multiverse analysis approach, several measures from infants’ eye gaze were examined to identify patterns that were robust across different analyses. Although in general infants preferred the lower regions of the faces, i.e., the region containing the mouth, this preference depended on the stimulus characteristics and was stronger for infants whose typical experience included faces of more races and for infants who were exposed to multiple languages. These results show how we can leverage the richness of eye tracking data with infants to add to our understanding of the factors that influence infants’ visual exploration of faces.

Cultural influences on face scanning are consistent across infancy and adulthood

The emergence of cultural differences in face scanning is thought to be shaped by social experience. However, previous studies mainly investigated eye movements of adults and little is known about early development. The current study recorded eye movements of British and Japanese infants (aged 10 and 16 months) and adults, who were presented with static and dynamic faces on screen. Cultural differences were observed across all age groups, with British participants exhibiting more mouth scanning, and Japanese individuals showing increased central face (nose) scanning for dynamic stimuli. Age-related influences independent of culture were also revealed, with a shift from eye to mouth scanning between 10 and 16 months, while adults distributed their gaze more flexibly. Against our prediction, no age-related increases in cultural differences were observed, suggesting the possibility that cultural differences are largely manifest by 10 months of age. Overall, the findings suggest that individuals adopt visual strategies in line with their cultural background from early in infancy, pointing to the development of a highly adaptive face processing system that is shaped by early sociocultural experience.

The development of race effects in face processing from childhood through adulthood: Neural and behavioral evidence

Most adults are better at recognizing recently encountered faces of their own race, relative to faces of other races. In adults, this race effect in face recognition is associated with differential neural representations of own- and other-race faces in the fusiform face area (FFA), a high-level visual region involved in face recognition. Previous research has linked these differential face representations in adults to viewers' implicit racial associations. However, despite the fact that the FFA undergoes a gradual development which continues well into adulthood, little is known about the developmental time-course of the race effect in FFA responses. Also unclear is how this race effect might relate to the development of face recognition or implicit associations with own- or other-races during childhood and adolescence. To examine the developmental trajectory of these race effects, in a cross-sectional study of European American (EA) children (ages 7-11), adolescents (ages 12-16) and adults (ages 18-35), we evaluated responses to adult African American (AA) and EA face stimuli, using functional magnetic resonance imaging and separate behavioral measures outside the scanner. We found that FFA responses to AA and EA faces differentiated during development from childhood into adulthood; meanwhile, the magnitudes of race effects increased in behavioral measures of face-recognition and implicit racial associations. These three race effects were positively correlated, even after controlling for age. These findings suggest that social and perceptual experiences shape a protracted development of the race effect in face processing that continues well into adulthood.

PERSISTENT CONCERNS: QUESTIONS FOR RESEARCH ON ETHNIC-RACIAL IDENTITY DEVELOPMENT

Research on ethnic-racial identity (ERI) and its development has increased exponentially over the past decade. In this paper we discuss five questions that the Lifespan ERI Study Group grappled with in our effort propose a lifespan model of ERI: (1) When does ERI development begin and end? (2) How do we account for age-dependent and contextually-initiated factors in ERI? (3) Should there be a reference point for healthy ERI, and if so, what is it? (4) How do the multiplicities of identity (intersectionality, multiracialism, whiteness) figure into our conceptualization of ERI? (5) How do we understand the role of ERI in pursuit of equity, diversity, and social justice? We note that these are persistent questions in ERI research, and thus our goal is to present our collective reckoning with these issues as well as our ponderings about why they persist. We conclude with recommendations forthe kinds of research questions, designs, and methods that developmental science, in particular, needs to pursue.

How does gaze to faces support face-to-face interaction? A review and perspective

Gaze-where one looks, how long, and when-plays an essential part in human social behavior. While many aspects of social gaze have been reviewed, there is no comprehensive review or theoretical framework that describes how gaze to faces supports face-to-face interaction. In this review, I address the following questions: (1) When does gaze need to be allocated to a particular region of a face in order to provide the relevant information for successful interaction; (2) How do humans look at other people, and faces in particular, regardless of whether gaze needs to be directed at a particular region to acquire the relevant visual information; (3) How does gaze support the regulation of interaction? The work reviewed spans psychophysical research, observational research, and eye-tracking research in both lab-based and interactive contexts. Based on the literature overview, I sketch a framework for future research based on dynamic systems theory. The framework holds that gaze should be investigated in relation to sub-states of the interaction, encompassing sub-states of the interactors, the content of the interaction as well as the interactive context. The relevant sub-states for understanding gaze in interaction vary over different timescales from microgenesis to ontogenesis and phylogenesis. The framework has important implications for vision science, psychopathology, developmental science, and social robotics.

Individual Differences in Infants' Temperament Affect Face Processing

Infants show an advantage in processing female and familiar race faces, but the effect sizes are often small, suggesting individual differences in their discrimination abilities. This research assessed whether differences in 6-10-month-olds' temperament (surgency and orienting) predicted how they scanned individual faces varying in race and gender during familiarization and whether and how long it took them to locate the face during a visual search task. This study also examined whether infants viewing faces posing pleasant relative to neutral expressions would facilitate their discrimination of male and unfamiliar race faces. Results showed that infants' surgency on its own or in conjunction with their orienting regularly interacted with facial characteristics to predict their scanning and location of faces. Furthermore, infants' scanning patterns (dwell times and internal-external fixation shifts) correlated with their ability and time to locate a familiarized face. Moreover, infants who viewed faces with pleasant expressions showed better discrimination of unfamiliar race and male faces compared with infants who viewed neutral faces. Including temperament in the analyses consistently demonstrated its significance for understanding infant face processing. Findings suggest that positive interactions with other-race individuals and men might reduce processing disadvantages for those face types. Locating familiar adults in a timely manner is a crucial skill for infants to develop and these data elucidate factors influencing this ability.

Infants' Gaze Patterns for Same-Race and Other-Race Faces, and the Other-Race Effect

The other-race effect (ORE) can be described as difficulties in discriminating between faces of ethnicities other than one's own, and can already be observed at approximately 9 months of age. Recent studies also showed that infants visually explore same-and other-race faces differently. However, it is still unclear whether infants' looking behavior for same- and other-race faces is related to their face discrimination abilities. To investigate this question we conducted a habituation-dishabituation experiment to examine Caucasian 9-month-old infants' gaze behavior, and their discrimination of same- and other-race faces, using eye-tracking measurements. We found that infants looked longer at the eyes of same-race faces over the course of habituation, as compared to other-race faces. After habituation, infants demonstrated a clear other-race effect by successfully discriminating between same-race faces, but not other-race faces. Importantly, the infants' ability to discriminate between same-race faces significantly correlated with their fixation time towards the eyes of same-race faces during habituation. Thus, our findings suggest that for infants old enough to begin exhibiting the ORE, gaze behavior during habituation is related to their ability to differentiate among same-race faces, compared to other-race faces.

Beyond fixation durations: Recurrence quantification analysis reveals spatiotemporal dynamics of infant visual scanning

Standard looking-duration measures in eye-tracking data provide only general quantitative indices, while details of the spatiotemporal structuring of fixation sequences are lost. To overcome this, various tools have been developed to measure the dynamics of fixations. However, these analyses are only useful when stimuli have high perceptual similarity and they require the previous definition of areas of interest (AOIs). Although these methods have been widely applied in adult studies, relatively little is known about the temporal structuring of infant gaze-foraging behaviors such as variability of scanning over time or individual scanning patterns. Thus, to shed more light on the spatiotemporal characteristics of infant fixation sequences we apply for the first time a new methodology for nonlinear time-series analysis-the recurrence quantification analysis (RQA). We present how the dynamics of infant scanning varies depending on the scene content during a "pop-out" search task. Moreover, we show how the normalization of RQA measures with average fixation durations provides a more detailed account of the dynamics of fixation sequences. Finally, we link the RQA measures of temporal dynamics of scanning with the spatial information about the stimuli using heat maps of recurrences without the need for defining a priori AOIs and present how infants' foraging strategies are driven by the image content. We conclude from our findings that the RQA methodology has potential applications in the analysis of the temporal dynamics of infant visual foraging offering advantages over existing methods.

Infants' Daily Experience With Pets and Their Scanning of Animal Faces

Very little is known about the effect of pet experience on cognitive development in infancy. In Experiment 1, we document in a large sample (N = 1270) that 63% of families with infants under 12 months have at least one household pet. The potential effect on development is significant as the first postnatal year is a critically important time for changes in the brain and cognition. Because research has revealed how experience shapes early development, it is likely that the presence of a companion dog or cat in the home influences infants' development. In Experiment 2, we assess differences between infants who do and do not have pets (N = 171) in one aspect of cognitive development: their processing of animal faces. We examined visual exploration of images of dog, cat, monkey, and sheep faces by 4-, 6-, and 10-month-old infants. Although at the youngest ages infants with and without pets exhibited the same patterns of visual inspection of these animals faces, by 10 months infants with pets spent proportionately more time looking at the region of faces that contained the eyes than did infants without pets. Thus, exposure to pets contributes to how infants look at and learn about animal faces.

The development of the own-race advantage in school-age children: A morphing face paradigm

Previous studies examining the other-race effect in school-age children mostly focused on recognition memory performance. Here we investigated perceptual discriminability for Asian-like versus Caucasian-like morph faces in school-age Taiwanese children and adults. One-hundred-and-two 5- to 12-year-old children and twenty-three adults performed a sequential same/different face matching task, where they viewed an Asian- or a Caucasian-parent face followed by either the same parent face or a different morphed face (containing 15%, 30%, 45%, or 60% contribution from the other parent face) and judged if the two faces looked the same. We computed the d’ as the sensitivity index for each age groups. We also analyzed the group mean rejection rates as a function of the morph level and fitted with a cumulative normal distribution function. Results showed that the adults and the oldest 11-12-year-old children exhibited a greater sensitivity (d’) and a smaller discrimination threshold (μ) in the Asian-parent condition than those in the Caucasian-parent condition, indicating the presence of an own-race advantage. On the contrary, 5- to 10-year-old children showed an equal sensitivity and similar discrimination thresholds for both conditions, indicating an absence of the own-race advantage. Moreover, a gradual development in enhancing the discriminability for the Asian-parent condition was observed from age 5 to 12; however, the progression in the Caucasian-parent condition was less apparent. In sum, our findings suggest that expertise in face processing may take the entire childhood to develop, and supports the perceptual learning view of the other-race effect—the own-race advantage seen in adulthood likely reflects a result of prolonged learning specific to faces most commonly seen in one’s visual environment such as own-race faces.

The Development of Attentional Biases for Faces in Infancy: A Developmental Systems Perspective

We present an integrative review of research and theory on major factors involved in the early development of attentional biases to faces. Research utilizing behavioral, eye-tracking, and neuroscience measures with infant participants as well as comparative research with animal subjects are reviewed. We begin with coverage of research demonstrating the presence of an attentional bias for faces shortly after birth, such as newborn infants' visual preference for face-like over non-face stimuli. The role of experience and the process of perceptual narrowing in face processing are examined as infants begin to demonstrate enhanced behavioral and neural responsiveness to mother over stranger, female over male, own- over other-race, and native over non-native faces. Next, we cover research on developmental change in infants' neural responsiveness to faces in multimodal contexts, such as audiovisual speech. We also explore the potential influence of arousal and attention on early perceptual preferences for faces. Lastly, the potential influence of the development of attention systems in the brain on social-cognitive processing is discussed. In conclusion, we interpret the findings under the framework of Developmental Systems Theory, emphasizing the combined and distributed influence of several factors, both internal (e.g., arousal, neural development) and external (e.g., early social experience) to the developing child, in the emergence of attentional biases that lead to enhanced responsiveness and processing of faces commonly encountered in the native environment.

Overcoming the other-race effect in infancy with multisensory redundancy: 10-12-month-olds discriminate dynamic other-race faces producing speech

We tested 4-6- and 10-12-month-old infants to investigate whether the often-reported decline in infant sensitivity to other-race faces may reflect responsiveness to static or dynamic/silent faces rather than a general process of perceptual narrowing. Across three experiments, we tested discrimination of either dynamic own-race or other-race faces which were either accompanied by a speech syllable, no sound, or a non-speech sound. Results indicated that 4-6- and 10-12-month-old infants discriminated own-race as well as other-race faces accompanied by a speech syllable, that only the 10-12-month-olds discriminated silent own-race faces, and that 4-6-month-old infants discriminated own-race and other-race faces accompanied by a non-speech sound but that 10-12-month-old infants only discriminated own-race faces accompanied by a non-speech sound. Overall, the results suggest that the ORE reported to date reflects infant responsiveness to static or dynamic/silent faces rather than a general process of perceptual narrowing.

Scanning of own- versus other-race faces in infants from racially diverse or homogenous communities

We examined the role of community face experience on 6- and 8-month-old Caucasian infants' scanning of own- and other-race face scanning. We measured infants' proportional fixation time and scan path amplitudes as indices of face processing. Proportional fixation time to informationally rich face regions varied as a function of age and face race for infants living in a racially homogeneous community, whereas scan path amplitudes varied as a function of age and face race for infants living in a racially diverse community. In both communities 6-month-old infants did not show different responding to own- and other-race faces, whereas 8-month-old infants responded differently to own- and other-race faces. However, 8-month-old infants from the two communities showed different patterns of cross-race face scanning. Therefore, experience in the community beyond the home appears to contribute to the development of differential scanning of own- versus other-race faces between 6 and 8 months of age.

Plasticity may change inputs as well as processes, structures, and responses

Significant work has documented neuroplasticity in development, demonstrating that developmental pathways are shaped by experience. Plasticity is often discussed in terms of the results of differences in input; differences in brain structures, processes, or responses reflect differences in experience. In this paper, I discuss how developmental plasticity also effectively changes input into the system. That is, structures and processes change in response to input, and those changed structures and processes influence future inputs. For example, plasticity may change the pattern of eye movements to a stimulus, thereby changing which part of the scene becomes the input. Thus, plasticity is not only seen in the structures and processes that result from differences in experience, but also is seen in the changes in the input as those structures and processes adapt. The systematic study of the nature of experience, and how differences in experience shape learning, can contribute to our understanding of neuroplasticity in general.

The area-of-interest problem in eyetracking research: A noise-robust solution for face and sparse stimuli

A problem in eyetracking research is choosing areas of interest (AOIs): Researchers in the same field often use widely varying AOIs for similar stimuli, making cross-study comparisons difficult or even impossible. Subjective choices while choosing AOIs cause differences in AOI shape, size, and location. On the other hand, not many guidelines for constructing AOIs, or comparisons between AOI-production methods, are available. In the present study, we addressed this gap by comparing AOI-production methods in face stimuli, using data collected with infants and adults (with autism spectrum disorder [ASD] and matched controls). Specifically, we report that the attention-attracting and attention-maintaining capacities of AOIs differ between AOI-production methods, and that this matters for statistical comparisons in one of three groups investigated (the ASD group). In addition, we investigated the relation between AOI size and an AOI's attention-attracting and attention-maintaining capacities, as well as the consequences for statistical analyses, and report that adopting large AOIs solves the problem of statistical differences between the AOI methods. Finally, we tested AOI-production methods for their robustness to noise, and report that large AOIs-using the Voronoi tessellation method or the limited-radius Voronoi tessellation method with large radii-are most robust to noise. We conclude that large AOIs are a noise-robust solution in face stimuli and, when implemented using the Voronoi method, are the most objective of the researcher-defined AOIs. Adopting Voronoi AOIs in face-scanning research should allow better between-group and cross-study comparisons.

Lateral presentation of faces alters overall viewing strategy

Eye tracking has been used during face categorisation and identification tasks to identify perceptually salient facial features and infer underlying cognitive processes. However, viewing patterns are influenced by a variety of gaze biases, drawing fixations to the centre of a screen and horizontally to the left side of face images (left-gaze bias). In order to investigate potential interactions between gaze biases uniquely associated with facial expression processing, and those associated with screen location, face stimuli were presented in three possible screen positions to the left, right and centre. Comparisons of fixations between screen locations highlight a significant impact of the screen centre bias, pulling fixations towards the centre of the screen and modifying gaze biases generally observed during facial categorisation tasks. A left horizontal bias for fixations was found to be independent of screen position but interacting with screen centre bias, drawing fixations to the left hemi-face rather than just to the left of the screen. Implications for eye tracking studies utilising centrally presented faces are discussed.

Visual selective attention biases contribute to the other-race effect among 9-month-old infants

During the first year of life, infants maintain their ability to discriminate faces from their own race but become less able to differentiate other-race faces. Though this is likely due to daily experience with own-race faces, the mechanisms linking repeated exposure to optimal face processing remain unclear. One possibility is that frequent experience with own-race faces generates a selective attention bias to these faces. Selective attention elicits enhancement of attended information and suppression of distraction to improve visual processing of attended objects. Thus attention biases to own-race faces may boost processing and discrimination of these faces relative to other-race faces. We used a spatial cueing task to bias attention to own- or other-race faces among Caucasian 9-month-old infants. Infants discriminated faces in the focus of the attention bias, regardless of race, indicating that infants remained sensitive to differences among other-race faces. Instead, efficacy of face discrimination reflected the extent of attention engagement.

Initial eye movements during face identification are optimal and similar across cultures

Culture influences not only human high-level cognitive processes but also low-level perceptual operations. Some perceptual operations, such as initial eye movements to faces, are critical for extraction of information supporting evolutionarily important tasks such as face identification. The extent of cultural effects on these crucial perceptual processes is unknown. Here, we report that the first gaze location for face identification was similar across East Asian and Western Caucasian cultural groups: Both fixated a featureless point between the eyes and the nose, with smaller between-group than within-group differences and with a small horizontal difference across cultures (8% of the interocular distance). We also show that individuals of both cultural groups initially fixated at a slightly higher point on Asian faces than on Caucasian faces. The initial fixations were found to be both fundamental in acquiring the majority of information for face identification and optimal, as accuracy deteriorated when observers held their gaze away from their preferred fixations. An ideal observer that integrated facial information with the human visual system's varying spatial resolution across the visual field showed a similar information distribution across faces of both races and predicted initial human fixations. The model consistently replicated the small vertical difference between human fixations to Asian and Caucasian faces but did not predict the small horizontal leftward bias of Caucasian observers. Together, the results suggest that initial eye movements during face identification may be driven by brain mechanisms aimed at maximizing accuracy, and less influenced by culture. The findings increase our understanding of the interplay between the brain's aims to optimally accomplish basic perceptual functions and to respond to sociocultural influences.

Visual scanning and recognition of Chinese, Caucasian, and racially ambiguous faces: contributions from bottom-up facial physiognomic information and top-down knowledge of racial categories

Recent studies have shown that participants use different eye movement strategies when scanning own- and other-race faces. However, it is unclear (1) whether this effect is related to face recognition performance, and (2) to what extent this effect is influenced by top-down or bottom-up facial information. In the present study, Chinese participants performed a face recognition task with Chinese, Caucasian, and racially ambiguous faces. For the racially ambiguous faces, we led participants to believe that they were viewing either own-race Chinese faces or other-race Caucasian faces. Results showed that (1) Chinese participants scanned the nose of the true Chinese faces more than that of the true Caucasian faces, whereas they scanned the eyes of the Caucasian faces more than those of the Chinese faces; (2) they scanned the eyes, nose, and mouth equally for the ambiguous faces in the Chinese condition compared with those in the Caucasian condition; (3) when recognizing the true Chinese target faces, but not the true target Caucasian faces, the greater the fixation proportion on the nose, the faster the participants correctly recognized these faces. The same was true when racially ambiguous face stimuli were thought to be Chinese faces. These results provide the first evidence to show that (1) visual scanning patterns of faces are related to own-race face recognition response time, and (2) it is bottom-up facial physiognomic information that mainly contributes to face scanning. However, top-down knowledge of racial categories can influence the relationship between face scanning patterns and recognition response time.

Both children and adults scan faces of own and other races differently

Extensive behavioral and neural evidence suggests that processing of own-race faces differs from that of other-race faces in both adults and infants. However, little research has examined whether and how children scan faces of own and other races differently for face recognition. In this eye-tracking study, Chinese children aged from 4 to 7 years and Chinese adults were asked to remember Chinese and Caucasian faces. None of the participants had any direct contact with foreign individuals. Multi-method analyses of eye-tracking data revealed that regardless of age group, proportional fixation duration on the eyes of Chinese faces was significantly lower than that on the eyes of Caucasian faces, whereas proportional fixation duration on the nose and mouth of Chinese faces was significantly higher than that on the nose and mouth of Caucasian faces. In addition, the amplitude of saccades on Chinese faces was significantly lower than that on Caucasian faces, potentially reflecting finer-grained processing for own-race faces. Moreover, adults' fixation duration/saccade numbers on the whole faces, proportional fixation percentage on the nose, proportional number of saccades between AOIs, and accuracy in recognizing faces were higher than those of children. These results together demonstrate that an abundance of visual experience with own-race faces and a lack of it with other-race faces may result in differential facial scanning in both children and adults. Furthermore, the increased experience of processing faces may result in a more holistic and advanced scanning strategy in Chinese adults.

The development of race-based perceptual categorization: skin color dominates early category judgments

Prior research on the development of race-based categorization has concluded that children understand the perceptual basis of race categories from as early as age 4 (e.g. Aboud, 1988). However, such work has rarely separated the influence of skin color from other physiognomic features considered by adults to be diagnostic of race categories. In two studies focusing on Black-White race categorization judgments in children between the ages of 4 and 9, as well as in adults, we find that categorization decisions in early childhood are determined almost entirely by attention to skin color, with attention to other physiognomic features exerting only a small influence on judgments as late as middle childhood. We further find that when skin color cues are largely eliminated from the stimuli, adults readily shift almost entirely to focus on other physiognomic features. However, 6- and 8-year-old children show only a limited ability to shift attention to facial physiognomy and so perform poorly on the task. These results demonstrate that attention to 'race' in younger children is better conceptualized as attention to skin color, inviting a reinterpretation of past work focusing on children's race-related cognition.

Facial expression training optimises viewing strategy in children and adults

This study investigated whether training-related improvements in facial expression categorization are facilitated by spontaneous changes in gaze behaviour in adults and nine-year old children. Four sessions of a self-paced, free-viewing training task required participants to categorize happy, sad and fear expressions with varying intensities. No instructions about eye movements were given. Eye-movements were recorded in the first and fourth training session. New faces were introduced in session four to establish transfer-effects of learning. Adults focused most on the eyes in all sessions and increased expression categorization accuracy after training coincided with a strengthening of this eye-bias in gaze allocation. In children, training-related behavioural improvements coincided with an overall shift in gaze-focus towards the eyes (resulting in more adult-like gaze-distributions) and towards the mouth for happy faces in the second fixation. Gaze-distributions were not influenced by the expression intensity or by the introduction of new faces. It was proposed that training enhanced the use of a uniform, predominantly eyes-biased, gaze strategy in children in order to optimise extraction of relevant cues for discrimination between subtle facial expressions.

Own- and other-race face scanning in infants: implications for perceptual narrowing

The present study investigated how 6- and 9-month-old Caucasian infants scan Caucasian and Chinese dynamic faces using eye-tracking methodology. Analyses of looking times revealed that with increased age, infants decreased their looking time to other-race noses, while maintaining their looking time for own-race noses. From 6 to 9 months, infants increased their looking time for the eyes of both races of faces. Analyses of scan paths showed that infants were no more likely to shift their fixation between the eyes of own-race faces than other-race faces. Similarity between participants' scan paths suggested that facial information was collected more efficiently for own- versus other-race faces at 9 months of age. Combined with previous eye-tracking studies of infants' face scanning (Liu et al. [2011] Journal of Experimental Child Psychology, 108, 180-189; Wheeler et al. [2011] PLoS ONE, 6, e18621. doi: 10.1371/journal.pone.0018621; Xiao et al. [2013] International Journal of Behavioral Development, 37, 100-105), the findings are interpreted in the context of perceptual narrowing and suggest differential contributions of visual experience, facial physiognomy, and culture in accounting for similarity and difference in infants scanning of own- and other-race faces.

Developing Race Categories in Infancy via Bayesian Face Recognition

The other-race effect emerges during infancy following the perceptual narrowing of face recognition. Other-race faces that were previously discriminable in early infancy cannot be distinguished by older infants. Presently, I discuss a Bayesian model of this process that posits that the other-race effect may be a consequence of learning to distinguish between intra-personal variation (changes to face appearance that preserve identity) and extra-personal variation (changes that do not preserve identity) in a visual environment in which a subset of race categories dominate. I demonstrate that race categories, which I have previously argued are a critical pre-cursor to the emergence of the other-race effect in infancy, are a natural by-product of this model. Perceptual narrowing for race may thus be a natural consequence of visual experience and the estimation of face variability based on a growing number of exemplars. I describe the basic architecture of the model, its applicability to a range of visual learning scenarios, and identify critical choices one faces in applying the model to a specific perceptual task. Despite the success of the model in accounting for these behavioral results, I conclude by identifying important shortcomings of the model and describe important challenges for future efforts to characterize the development of the other-race effect computationally.