Event-related potentials for category-specific information during passive viewing of faces and objects

Neural timing of the other-race effect across the lifespan: A review

Face race influences the way we process faces, so that faces of a different ethnic group are processed for identity less efficiently than faces of one's ethnic group - a phenomenon known as the Other-Race Effect (ORE). Although widely replicated, the ORE is still poorly characterized in terms of its development and the underlying mechanisms. In the last two decades, the Event-Related Potential (ERP) technique has brought insight into the mechanisms underlying the ORE and has demonstrated potential to clarify its development. Here, we review the ERP evidence for a differential neural processing of own-race and other-race faces throughout the lifespan. In infants, race-related processing differences emerged at the N290 and P400 (structural encoding) stages. In children, race affected the P100 (early processing, attention) perceptual stage and was implicitly encoded at the N400 (semantic processing) stage. In adults, processing difficulties for other-race faces emerged at the N170 (structural encoding), P200 (configuration processing) and N250 (accessing individual representations) perceptual stages. Early in processing, race was implicitly encoded from other-race faces (N100, P200 attentional biases) and in-depth processing preferentially applied to own-race faces (N200 attentional bias). Encoding appeared less efficient (Dm effects) and retrieval less recollection-based (old/new effects) for other-race faces. Evidence admits the contribution of perceptual, attentional, and motivational processes to the development and functioning of the ORE, offering no conclusive support for perceptual or socio-cognitive accounts. Cross-racial and non-cross-racial studies provided convergent evidence. Future research would need to include less represented ethnic populations and the developmental population.

Maturational trajectory of fusiform gyrus neural activity when viewing faces: From 4 months to 4 years old

Infant and young child electrophysiology studies have provided information regarding the maturation of face-encoding neural processes. A limitation of previous research is that very few studies have examined face-encoding processes in children 12-48 months of age, a developmental period characterized by rapid changes in the ability to encode facial information. The present study sought to fill this gap in the literature via a longitudinal study examining the maturation of a primary node in the face-encoding network-the left and right fusiform gyrus (FFG). Whole-brain magnetoencephalography (MEG) data were obtained from 25 infants with typical development at 4-12 months, and with follow-up MEG exams every ∼12 months until 3-4 years old. Children were presented with color images of Face stimuli and visual noise images (matched on spatial frequency, color distribution, and outer contour) that served as Non-Face stimuli. Using distributed source modeling, left and right face-sensitive FFG evoked waveforms were obtained from each child at each visit, with face-sensitive activity identified via examining the difference between the Non-Face and Face FFG timecourses. Before 24 months of age (Visits 1 and 2) the face-sensitive FFG M290 response was the dominant response, observed in the left and right FFG ∼250-450 ms post-stimulus. By 3-4 years old (Visit 4), the left and right face-sensitive FFG response occurred at a latency consistent with a face-sensitive M170 response ∼100-250 ms post-stimulus. Face-sensitive left and right FFG peak latencies decreased as a function of age (with age explaining greater than 70% of the variance in face-sensitive FFG latency), and with an adult-like FFG latency observed at 3-4 years old. Study findings thus showed face-sensitive FFG maturational changes across the first 4 years of life. Whereas a face-sensitive M290 response was observed under 2 years of age, by 3-4 years old, an adult-like face-sensitive M170 response was observed bilaterally. Future studies evaluating the maturation of face-sensitive FFG activity in infants at risk for neurodevelopmental disorders are of interest, with the present findings suggesting age-specific face-sensitive neural markers of a priori interest.

Doctors inhibit social threat empathy in the later stage of cognitive processing: Electrophysiological evidence

Previous studies have found that repeatedly exposed to a threatening situation may reduce doctors' level of empathy, reducing psychological stress and avoiding burnout and compassion fatigue. However, many essential studies found that it does not seem universal but rather modulated by group membership. In this study, we recorded event-related potentials (ERP) when doctors and controls watched visual stimuli describing patients attacking doctors (Threat events) or shaking hands with doctors (Neutral events). The present study showed an early N190 and a later centro-parietal P3 differential amplitude between threat stimuli and neutral stimuli were observed in the controls. For the doctors, there was such ERP differentiation in early N190. However, later stage P3 differential amplitude was not observed. The current research suggests that doctors could regulate empathy and avoid allocating more attention resources when processing social threats to ensure treatment efficiency and avoid burnout.

Maturation of hemispheric specialization for face encoding during infancy and toddlerhood

•

Using infant magnetoencephalography (MEG), study findings show maturational changes to fusiform gyrus (FFG) activity when viewing faces.

•

Earlier right FFG activity to face stimuli is associated with better social and cognitive ability.

•

Stronger right- than left-hemisphere FFG responses to face stimuli are most evident after 1 year of age.

Little is known about the neural processes associated with attending to social stimuli during infancy and toddlerhood. Using infant magnetoencephalography (MEG), fusiform gyrus (FFG) activity while processing Face and Non-Face stimuli was examined in 46 typically developing infants 3 to 24 months old (28 males). Several findings indicated FFG maturation throughout the first two years of life. First, right FFG responses to Face stimuli decreased as a function of age. Second, hemispheric specialization to the face stimuli developed somewhat slowly, with earlier right than left FFG peak activity most evident after 1 year of age. Right FFG activity to Face stimuli was of clinical interest, with an earlier right FFG response associated with better performance on tests assessing social and cognitive ability. Building on the above, clinical studies examining maturational change in FFG activity (e.g., lateralization and speed) in infants at-risk for childhood disorders associated with social deficits are of interest to identify atypical FFG maturation before a formal diagnosis is possible.

Neural basis of individual differences in the response to mental stress: a magnetoencephalography study

Stress is a risk factor for the onset of mental disorders. Although stress response varies across individuals, the mechanism of individual differences remains unclear. Here, we investigated the neural basis of individual differences in response to mental stress using magnetoencephalography (MEG). Twenty healthy male volunteers completed the Temperament and Character Inventory (TCI). The experiment included two types of tasks: a non-stress-inducing task and a stress-inducing task. During these tasks, participants passively viewed non-stress-inducing images and stress-inducing images, respectively, and MEG was recorded. Before and after each task, MEG and electrocardiography were recorded and subjective ratings were obtained. We grouped participants according to Novelty seeking (NS) - tendency to be exploratory, and Harm avoidance (HA) - tendency to be cautious. Participants with high NS and low HA (n = 10) assessed by TCI had a different neural response to stress than those with low NS and high HA (n = 10). Event-related desynchronization (ERD) in the beta frequency band was observed only in participants with high NS and low HA in the brain region extending from Brodmann's area 31 (including the posterior cingulate cortex and precuneus) from 200 to 350 ms after the onset of picture presentation in the stress-inducing task. Individual variation in personality traits (NS and HA) was associated with the neural response to mental stress. These findings increase our understanding of the psychological and neural basis of individual differences in the stress response, and will contribute to development of the psychotherapeutic approaches to stress-related disorders.

The N170 component is sensitive to face-like stimuli: a study of Chinese Peking opera makeup

The N170 component is considered a neural marker of face-sensitive processing. In the present study, the face-sensitive N170 component of event-related potentials (ERPs) was investigated with a modified oddball paradigm using a natural face (the standard stimulus), human- and animal-like makeup stimuli, scrambled control images that mixed human- and animal-like makeup pieces, and a grey control image. Nineteen participants were instructed to respond within 1000 ms by pressing the 'F' or 'J' key in response to the standard or deviant stimuli, respectively. We simultaneously recorded ERPs, response accuracy, and reaction times. The behavioral results showed that the main effect of stimulus type was significant for reaction time, whereas there were no significant differences in response accuracies among stimulus types. In relation to the ERPs, N170 amplitudes elicited by human-like makeup stimuli, animal-like makeup stimuli, scrambled control images, and a grey control image progressively decreased. A right hemisphere advantage was observed in the N170 amplitudes for human-like makeup stimuli, animal-like makeup stimuli, and scrambled control images but not for grey control image. These results indicate that the N170 component is sensitive to face-like stimuli and reflect configural processing in face recognition.

Experiments with a Hollow Mask and a Reverspective: Top-down Influences in the Inversion Effect for 3-D Stimuli

Earlier psychophysical and physiological studies, obtained mostly with two-dimensional (2-D) stimuli, provided evidence for the hypothesis that the processing of faces differs from that of scenes. We report on our experiments, employing realistic three-dimensional (3-D) stimuli of a hollow mask and a scene, that offer further evidence for this hypothesis. The stimuli used for both faces and scenes were bistable, namely they could elicit either the veridical or an illusory volumetric percept. Our results indicate that the illusion is weakened when the stimuli are inverted, suggesting the involvement of top-down processes. This inversion effect is statistically significant for the facial stimulus, but the trend did not reach statistical significance for the scene stimulus. These results support the hypothesis that configural processing is stronger for the 3-D perception of faces than it is for scenes, and extend the conclusions of earlier studies on 2-D stimuli.

Brain Network Activation (BNA) reveals scopolamine-induced impairment of visual working memory

The overarching goal of this event-related potential (ERP) study was to examine the effects of scopolamine on the dynamics of brain network activation using a novel ERP network analysis method known as Brain Network Activation (BNA). BNA was used for extracting group-common stimulus-activated network patterns elicited to matching probe stimuli in the context of a delayed matching-to-sample task following placebo and scopolamine treatments administered to healthy participants. The BNA extracted networks revealed the existence of two pathophysiological mechanisms following scopolamine, disconnection, and compensation. Specifically, weaker frontal theta and parietal alpha coupling was accompanied with enhanced fronto-centro-parietal theta activation relative to placebo. In addition, using the characteristic BNA network of each treatment as well as corresponding literature-guided selective subnetworks as combined biomarkers managed to differentiate between individual responses to each of the treatments. Behavioral effects associated with scopolamine included delayed response time and impaired response accuracy. These results indicate that the BNA method is sensitive to the effects of scopolamine on working memory and that it may potentially enable diagnosis and treatment assessment of dysfunctions associated with cholinergic deficiency.

Three stages of emotional word processing: an ERP study with rapid serial visual presentation

Rapid responses to emotional words play a crucial role in social communication. This study employed event-related potentials to examine the time course of neural dynamics involved in emotional word processing. Participants performed a dual-target task in which positive, negative and neutral adjectives were rapidly presented. The early occipital P1 was found larger when elicited by negative words, indicating that the first stage of emotional word processing mainly differentiates between non-threatening and potentially threatening information. The N170 and the early posterior negativity were larger for positive and negative words, reflecting the emotional/non-emotional discrimination stage of word processing. The late positive component not only distinguished emotional words from neutral words, but also differentiated between positive and negative words. This represents the third stage of emotional word processing, the emotion separation. Present results indicated that, similar with the three-stage model of facial expression processing; the neural processing of emotional words can also be divided into three stages. These findings prompt us to believe that the nature of emotion can be analyzed by the brain independent of stimulus type, and that the three-stage scheme may be a common model for emotional information processing in the context of limited attentional resources.

Early holistic face-like processing of Arcimboldo paintings in the right occipito-temporal cortex: evidence from the N170 ERP component

The properties of the face-sensitive N170 component of the event-related brain potential (ERP) were explored through an orientation discrimination task using natural faces, objects, and Arcimboldo paintings presented upright or inverted. Because Arcimboldo paintings are composed of non-face objects but have a global face configuration, they provide great control to disentangle high-level face-like or object-like visual processes at the level of the N170, and may help to examine the implication of each hemisphere in the global/holistic processing of face formats. For upright position, N170 amplitudes in the right occipito-temporal region did not differ between natural faces and Arcimboldo paintings but were larger for both of these categories than for objects, supporting the view that as early as the N170 time-window, the right hemisphere is involved in holistic perceptual processing of face-like configurations irrespective of their features. Conversely, in the left hemisphere, N170 amplitudes differed between Arcimboldo portraits and natural faces, suggesting that this hemisphere processes local facial features. For upside-down orientation in both hemispheres, N170 amplitudes did not differ between Arcimboldo paintings and objects, but were reduced for both categories compared to natural faces, indicating that the disruption of holistic processing with inversion leads to an object-like processing of Arcimboldo paintings due to the lack of local facial features. Overall, these results provide evidence that global/holistic perceptual processing of faces and face-like formats involves the right hemisphere as early as the N170 time-window, and that the local processing of face features is rather implemented in the left hemisphere.

Thatcherization impacts the processing of own-race faces more so than other-race faces: an ERP study

It has been suggested that differential use of configural processing strategies may underlie racially based recognition deficits (known as the "other-race effect"). By employing a well-known configural manipulation (Thatcherization, i.e., rotating the eyes and mouth by 180°), we aimed to demonstrate, electrophysiologically, that configural processing is used to a greater extent when viewing same-race faces than when viewing other-race faces. Face-related event-related potential (ERP) responses were measured for participants viewing normal and Thatcherized faces of their own race (Caucasian) and of another race (African-American). The P1 and N170 components were modulated to a greater extent by Thatcherization for same-race faces, suggesting that the processing of these faces is, in fact, more reliant on configural information than other-race faces. Thatcherization also affected the P250 component more so for same-race faces independently of orientation. The race-dependent effects of Thatcherization as early as P1 suggest that configural encoding may be occurring much earlier than the well-cited N170.

Facial and semantic emotional interference: a pilot study on the behavioral and cortical responses to the Dual Valence Association Task

Background

Integration of compatible or incompatible emotional valence and semantic information is an essential aspect of complex social interactions. A modified version of the Implicit Association Test (IAT) called Dual Valence Association Task (DVAT) was designed in order to measure conflict resolution processing from compatibility/incompatibly of semantic and facial valence. The DVAT involves two emotional valence evaluative tasks which elicits two forms of emotional compatible/incompatible associations (facial and semantic).

Methods

Behavioural measures and Event Related Potentials were recorded while participants performed the DVAT.

Results

Behavioural data showed a robust effect that distinguished compatible/incompatible tasks. The effects of valence and contextual association (between facial and semantic stimuli) showed early discrimination in N170 of faces. The LPP component was modulated by the compatibility of the DVAT.

Conclusions

Results suggest that DVAT is a robust paradigm for studying the emotional interference effect in the processing of simultaneous information from semantic and facial stimuli.

Early Neural Markers of Implicit Attitudes: N170 Modulated by Intergroup and Evaluative Contexts in IAT

The Implicit Association Test (IAT) is the most popular measure to evaluate implicit attitudes. Nevertheless, its neural correlates are not yet fully understood. We examined event related potentials (ERPs) in response to face- and word processing while indigenous and non-indigenous participants performed an IAT displaying faces (ingroup and outgroup members) and words (positive and negative valence) as targets of category judgments. The N170 component was modulated by valence of words and by ingroup/outgroup face categorization. Contextual effects (face–words implicitly associated in the task) had an influence on the N170 amplitude modulation. On the one hand, in face categorization, right N170 showed differences according to the association between social categories of faces and affective valence of words. On the other, in word categorization, left N170 presented a similar modulation when the task implied a negative-valence associated with ingroup faces. Only indigenous participants showed a significant IAT effect and N170 differences. Our results demonstrate an early ERP blending of stimuli processing with both intergroup and evaluative contexts, suggesting an integration of contextual information related to intergroup attitudes during the early stages of word and face processing. To our knowledge, this is the first report of early ERPs during an ethnicity IAT, opening a new branch of exchange between social neuroscience and social psychology of attitudes.

Configural processing of different topologically structured figures: an ERP study

According to Chen's theory, topological differences are perceived faster than feature differences in early visual perception. We hypothesized that topological perception is caused by the sensitivity in discriminating figures with and without "holes". An ERP experiment was conducted utilizing a passive paradigm to investigate the differences in perceiving figures with "hole" and with "no-hole". The results showed differences in N170 components between figures with "holes" and with "no-holes". The inversion of the "hole" could influence the latency of N170, but the inversion of the "no-hole" could not, which indicated that global features are processed first in the "hole" perception whilst local features are given priority to the "no-hole" perception. This result was similar to studies concerning face and non-face objects, suggesting a configural processing of the "hole".

Atypical face versus object processing and hemispheric asymmetries in 10-month-old infants at risk for autism

BACKGROUND

Previous studies have documented atypicalities in face/object processing in children and adults with autism spectrum disorders (ASDs). To investigate whether such atypicalities may reflect a genetically mediated risk factor present early in development, we measured face/object processing in 10-month-old high-risk infants who carry some of the genes associated with ASD because they have an older sibling diagnosed with the disorder.

METHODS

We employed event-related potentials (ERPs) to measure cortical responses to pictures of faces and objects, the objects being toys. Latencies and amplitudes of four ERP components (P100, N290, P400, and Nc) were compared between 20 high-risk infants and 20 low-risk control subjects (infants with no family history of ASD).

RESULTS

Responses to faces versus objects differed between high- and low-risk infants for the latencies of the N290 and P400. Differences were driven by faster responses to faces than objects in low-risk, but not high-risk, infants (P400) and, conversely, faster responses to objects than faces in high-risk, but not low-risk, infants (N290). Object responses were also faster in high-risk than low-risk infants (both N290 and P400). Left versus right hemisphere responses also differed between high- and low-risk infants for the amplitudes of the P100, N290, and P400; collapsed across faces/objects, low-risk, but not high-risk, infants exhibited hemisphere asymmetries.

CONCLUSIONS

Genetic risk for ASD is associated with atypical face versus object processing and an atypical lack of hemispheric asymmetry early in life. These atypicalities might contribute to development of the disorder.

Contextual blending of ingroup/outgroup face stimuli and word valence: LPP modulation and convergence of measures

Background

Several event related potential (ERP) studies have investigated the time course of different aspects of evaluative processing in social bias research. Various reports suggest that the late positive potential (LPP) is modulated by basic evaluative processes, and some reports suggest that in-/outgroup relative position affects ERP responses. In order to study possible LPP blending between facial race processing and semantic valence (positive or negative words), we recorded ERPs while indigenous and non-indigenous participants who were matched by age and gender performed an implicit association test (IAT). The task involved categorizing faces (ingroup and outgroup) and words (positive and negative). Since our paradigm implies an evaluative task with positive and negative valence association, a frontal distribution of LPPs similar to that found in previous reports was expected. At the same time, we predicted that LPP valence lateralization would be modulated not only by positive/negative associations but also by particular combinations of valence, face stimuli and participant relative position.

Results

Results showed that, during an IAT, indigenous participants with greater behavioral ingroup bias displayed a frontal LPP that was modulated in terms of complex contextual associations involving ethnic group and valence. The LPP was lateralized to the right for negative valence stimuli and to the left for positive valence stimuli. This valence lateralization was influenced by the combination of valence and membership type relevant to compatibility with prejudice toward a minority. Behavioral data from the IAT and an explicit attitudes questionnaire were used to clarify this finding and showed that ingroup bias plays an important role. Both ingroup favoritism and indigenous/non-indigenous differences were consistently present in the data.

Conclusion

Our results suggest that frontal LPP is elicited by contextual blending of evaluative judgments of in-/outgroup information and positive vs. negative valence association and confirm recent research relating in-/outgroup ERP modulation and frontal LPP. LPP modulation may cohere with implicit measures of attitudes. The convergence of measures that were observed supports the idea that racial and valence evaluations are strongly influenced by context. This result adds to a growing set of evidence concerning contextual sensitivity of different measures of prejudice.

Abnormal spatiotemporal processing of emotional facial expressions in childhood autism: dipole source analysis of event-related potentials

Previous studies of face processing in autism suggest abnormalities in anatomical development, functioning and connectivity/coordination of distributed brain systems involved in social cognition, but the spatial sequence and time course of rapid (sub-second) neural responses to emotional facial expressions have not been examined in detail. Source analysis of high-density event-related potentials (ERPs) is an optimal means to examine both the precise temporal profile and spatial location of early electrical brain activity in response to emotionally salient stimuli. Therefore, we recorded 128-channel ERPs from high-functioning males with autism (aged 6-10 years), and age-, sex- and IQ-matched typically developing controls during explicit and implicit processing of emotion from pictures showing happy, angry, fearful, sad and neutral facial expressions. Children with autism showed normal patterns of behavioural and ERP (P1, N170 and P2) responses. However, dipole source analysis revealed that ERP responses relating to face detection (visual cortex) and configural processing of faces (fusiform gyrus), as well as mental state decoding (medial prefrontal lobe), were significantly weaker and/or slower in autism compared with controls during both explicit and implicit emotion-processing tasks. Slower- and larger-amplitude ERP source activity in the parietal somatosensory cortices possibly reflected more effortful compensatory analytical strategies used by the autism group to process facial gender and emotion. Such aberrant neurophysiological processing of facial emotion observed in children with autism within the first 300 ms of stimulus presentation suggests abnormal cortical specialization within social brain networks, which would likely disrupt the development of normal social-cognitive skills.

Does physical interstimulus variance account for early electrophysiological face sensitive responses in the human brain? Ten lessons on the N170

A recent event-related potential (ERP) study (Thierry G., Martin, C.D., Downing, P., Pegna, A.J. 2007. Controlling for interstimulus perceptual variance abolishes N170 face selectivity. Nature Neuroscience, 10, 505-11) claimed that the larger occipito-temporal N170 response to pictures of faces than other categories -- the N170 effect -- is due to a methodological artifact in stimulus selection, specifically, a greater interstimulus physical variance between pictures of objects than faces in previous ERP studies which, when controlled, eliminates this N170 effect. This statement casts doubts on the validity of the conclusions reached by a whole tradition of electrophysiological experiments published over the past 15 years and questions the very interest of using the N170 to probe the time course of face processes in the human brain. Here we claim that this physical variance factor is ill-defined by Thierry et al. and cannot account for previous observations of a smaller N170 amplitude to nonface objects than faces without latency increase and component "smearing". Most importantly, this factor was controlled in previous studies that reported robust N170 effects. We demonstrate that the absence of N170 effect in the study of Thierry et al. is due to methodological flaws in the reported experiments, most notably measuring the N170 at the wrong electrode sites. Moreover, the authors attributed a modulation of N170 amplitude in their study to a differential interstimulus physical variance while it probably reflects a biased comparison of different quality sets of individual images. Here, by taking Thierry et al.'s study as an exemplar case of what should not be done in ERP research of visual categorization processes, we provide clarifications on a number of methodological and theoretical issues about the N170 and its largest amplitude to faces. More generally, we discuss the potential role of differential visual homogeneity of object categories as well as low-level visual properties versus high-level visual processes in accounting for early face-preferential responses and the question of the speed at which visual stimuli are categorized as faces. This survey of the literature points to the N170 as a critical event in the time course of face processes in the human brain.

How does the brain process upright and inverted faces?

The face inversion effect (FIE) is defined as the larger decrease in recognition performance for faces than for other mono-oriented objects when they are presented upside down. Behavioral studies suggest the FIE takes place at the perceptual encoding stage and is mainly due to the decrease in ability to extract relational information when discriminating individual faces. Recently, functional magnetic resonance imaging and scalp event-related potentials studies found that turning faces upside down slightly but significantly decreases the response of face-selective brain regions, including the so-called fusiform face area (FFA), and increases activity of other areas selective for nonface objects. Face inversion leads to a significantly delayed (sometimes larger) N170 component, an occipito-temporal scalp potential associated with the perceptual encoding of faces and objects. These modulations are in agreement with the perceptual locus of the FIE and reinforce the view that the FFA and N170 are sensitive to individual face discrimination.

Early electrophysiological responses to multiple face orientations correlate with individual discrimination performance in humans

Picture-plane inversion dramatically impairs face recognition. Behavioral and event-related potential (ERP) studies suggest that this effect takes place during perceptual encoding of the face stimulus. However, the relationship between early electrophysiological responses to upright and inverted faces and the behavioral face inversion effect remains unclear. To address this question, we recorded ERPs while presenting 10 subjects with face photographs at 12 different orientations around the clock (30 degrees steps) during an individual face matching task. Using the variability in the electrophysiological responses introduced by the multiple orientations of the target face, we found a correlation between the ERP signal at 130-170 ms on occipito-temporal channels, and the behavioral performance measured on the probe stimulus. Correlations between ERP signal and behavioral performance started about 10 ms earlier in the right hemisphere. Significant effects of orientation were observed already at the level of the visual P1 (peaking at 100 ms), but the ERP signal was not correlated with behavior until the face-sensitive N170 time window. Overall, these observations indicate that plane-inversion affects the perceptual encoding of faces as early as 130 ms in occipito-temporal regions, leading directly to an increase in error rates and RTs during individual face recognition.

N170 ERPs could represent a logographic processing strategy in visual word recognition

BACKGROUND

Occipito-temporal N170 component represents the first step where face, object and word processing are discriminated along the ventral stream of the brain. N170 leftward asymmetry observed during reading has been often associated to prelexical orthographic visual word form activation. However, some studies reported a lexical frequency effect for this component particularly during word repetition that appears in contradiction with this prelexical orthographic step. Here, we tested the hypothesis that under word repetition condition, discrimination between words would be operated on visual rather than orthographic basis. In this case, N170 activity may correspond to a logographic processing where a word is processed as a whole.

METHODS

To test such an assumption, frequent words, infrequent words and pseudowords were presented to the subjects that had to complete a visual lexical decision task. Different repetition conditions were defined 1--weak repetition, 2--massive repetition and 3--massive repetition with font alternation. This last condition was designed to change visual word shape during repetition and therefore to interfere with a possible visual strategy during word recognition.

RESULTS

Behavioral data showed an important frequency effect for the weak repetition condition, a lower but significant frequency effect for massive repetition, and no frequency effect for the changing font repetition. Moreover alternating font repetitions slowed subject's responses in comparison to "simple" massive repetition.ERPs results evidenced larger N170 amplitude in the left hemisphere for frequent than both infrequent words and pseudowords during massive repetition. Moreover, when words were repeated with different fonts this N170 effect was not present, suggesting a visual locus for such a N170 frequency effect.

CONCLUSION

N170 represents an important step in visual word recognition, consisting probably in a prelexical orthographic processing. But during the reading of very frequent words or after a massive repetition of a word, it could represent a more holistic process where words are processed as a global visual pattern.

The effects of inversion and eye displacements of familiar and unknown faces on early and late-stage ERPs

OBJECTIVES

The objective of this study is to examine whether configural alterations of faces affect early or late processing stages as a function of their familiarity and their level of representation in memory. We then sought to verify whether the structural encoding stage is susceptible to top-down influences.

METHODS

Electrophysiologic and behavioral studies were undertaken, during which unknown and familiar faces were presented upright or upside-down with or without feature alterations. The subjects were asked to determine whether the faces were familiar or not.

RESULTS

N170 and N360 amplitudes were larger for familiar faces as well as altered ones. A higher degree of familiarity decreased reaction times (RTs) and N360 latencies, but increased N170 latencies, whereas face alterations increased RTs and latencies of both components examined. However, familiarity interacted with altered face configurations only for RTs and the N170.

SIGNIFICANCE

In the perceptual stage, familiar faces seem to develop a more elaborate type of processing because of top-down influences linked to the robust nature of their representations in memory. The more elaborate type of processing for familiar faces has advantageous consequences for the following steps of information processing, by facilitating access to structural representations in memory (N360) as well as the final step reflected by RTs. The fact that configural alterations cause different effects for familiar as opposed to unfamiliar faces indicate that these stimuli are processed in a qualitatively different manner and solicit different representations in memory.

Neurocognitive and electrophysiological evidence of altered face processing in parents of children with autism: implications for a model of abnormal development of social brain circuitry in autism

Neuroimaging and behavioral studies have shown that children and adults with autism have impaired face recognition. Individuals with autism also exhibit atypical event-related brain potentials to faces, characterized by a failure to show a negative component (N170) latency advantage to face compared to nonface stimuli and a bilateral, rather than right lateralized, pattern of N170 distribution. In this report, performance by 143 parents of children with autism on standardized verbal, visual-spatial, and face recognition tasks was examined. It was found that parents of children with autism exhibited a significant decrement in face recognition ability relative to their verbal and visual spatial abilities. Event-related brain potentials to face and nonface stimuli were examined in 21 parents of children with autism and 21 control adults. Parents of children with autism showed an atypical event-related potential response to faces, which mirrored the pattern shown by children and adults with autism. These results raise the possibility that face processing might be a functional trait marker of genetic susceptibility to autism. Discussion focuses on hypotheses regarding the neurodevelopmental and genetic basis of altered face processing in autism. A general model of the normal emergence of social brain circuitry in the first year of life is proposed, followed by a discussion of how the trajectory of normal development of social brain circuitry, including cortical specialization for face processing, is altered in individuals with autism. The hypothesis that genetic-mediated dysfunction of the dopamine reward system, especially its functioning in social contexts, might account for altered face processing in individuals with autism and their relatives is discussed.

Face, eye and object early processing: What is the face specificity?

We investigated the human face specificity by comparing the effects of inversion and contrast reversal, two manipulations known to disrupt configural face processing, on human and ape faces, isolated eyes and objects, using event-related potentials. The face sensitive marker, N170, was shortest to human faces and delayed by inversion and contrast reversal for all categories and not only for human faces. Most importantly, N170 to inverted or contrast-reversed faces was not different from N170 to eyes that did not differ across manipulations. This suggests the disruption of facial configuration by these manipulations isolates the eye region from the face context, to which eye neurons respond. Our data suggest that (i) the inversion and contrast reversal effects on N170 latency are not specific to human faces and (ii) the similar increase of N170 amplitude by inversion and contrast reversal is unique to human faces and is driven by the eye region. Thus, while inversion and contrast reversal effects on N170 latency are not category-specific, their effects on amplitude are face-specific and reflect mainly the contribution of the eye region.

The neurophysiological correlates of face processing in adults and children with Asperger’s syndrome

Past research has found evidence for face and emotional expression processing differences between individuals with Asperger's syndrome (AS) and neurotypical (NT) controls at both the neurological and behavioural levels. The aim of the present study was to examine the neurophysiological basis of emotional expression processing in children and adults with AS relative to age- and gender-matched NT controls. High-density event-related potentials were recorded during explicit processing of happy, sad, angry, scared, and neutral faces. Adults with AS were found to exhibit delayed P1 and N170 latencies and smaller N170 amplitudes in comparison to control subjects for all expressions. This may reflect impaired holistic and configural processing of faces in AS adults. However, these differences were not observed between AS and control children. This may result from incomplete development of the neuronal generators of these ERP components and/or early intervention.

Understanding the Nature of Face Processing Impairment in Autism: Insights From Behavioral and Electrophysiological Studies

This article reviews behavioral and electrophysiological studies of face processing and discusses hypotheses for understanding the nature of face processing impairments in autism. Based on results of behavioral studies, this study demonstrates that individuals with autism have impaired face discrimination and recognition and use atypical strategies for processing faces characterized by reduced attention to the eyes and piecemeal rather than configural strategies. Based on results of electrophysiological studies, this article concludes that face processing impairments are present early in autism, by 3 years of age. Such studies have detected abnormalities in both early (N170 reflecting structural encoding) and late (NC reflecting recognition memory) stages of face processing. Event-related potential studies of young children and adults with autism have found slower speed of processing of faces, a failure to show the expected speed advantage of processing faces versus nonface stimuli, and atypical scalp topography suggesting abnormal cortical specialization for face processing. Other electrophysiological studies have suggested that autism is associated with early and late stage processing impairments of facial expressions of emotion (fear) and decreased perceptual binding as reflected in reduced gamma during face processing. This article describes two types of hypotheses-cognitive/perceptual and motivational/affective--that offer frameworks for understanding the nature of face processing impairments in autism. This article discusses implications for intervention.

Effects of repetition and configural changes on the development of face recognition processes

We investigated the effect of repetition on recognition of upright, inverted and contrast-reversed target faces in children from 8 to 15 years when engaged in a learning phase/test phase paradigm with target and distractor faces. Early (P1, N170) and late ERP components were analysed Children across age groups performed equally well, and were better at recognizing upright faces. However, teenagers and adults were equally accurate for all three face types. The neurophysiological responses to upright, inverted and negative faces matured until adulthood and showed different effects at different ages. P1 and N170 components were affected by face type at all ages, suggesting early configural disruption on encoding processes regardless of age. Frontal ERPs reflected the difficulty of processing these stimuli. Distinct repetition effects were seen at frontal, temporal frontal and parietal sites, suggesting differential involvement of these brain regions underlying working memory and recognition processes. Thus, a learning phase was sufficient (a) for 8-year-olds to perform as accurately as 15-year-olds and (b) to eliminate face type effects in teenagers and adults, but not in younger children.

The emergence of the social brain network: evidence from typical and atypical development

Several research groups have identified a network of regions of the adult cortex that are activated during social perception and cognition tasks. In this paper we focus on the development of components of this social brain network during early childhood and test aspects of a particular viewpoint on human functional brain development: "interactive specialization." Specifically, we apply new data analysis techniques to a previously published data set of event-related potential (ERP) studies involving 3-, 4-, and 12-month-old infants viewing faces of different orientation and direction of eye gaze. Using source separation and localization methods, several likely generators of scalp recorded ERP are identified, and we describe how they are modulated by stimulus characteristics. We then review the results of a series of experiments concerned with perceiving and acting on eye gaze, before reporting on a new experiment involving young children with autism. Finally, we discuss predictions based on the atypical emergence of the social brain network.

Event-related brain potentials reveal anomalies in temporal processing of faces in autism spectrum disorder

BACKGROUND

Individuals with autism exhibit impairments in face recognition, and neuroimaging studies have shown that individuals with autism exhibit abnormal patterns of brain activity during face processing. The current study examined the temporal characteristics of face processing in autism and their relation to behavior.

METHOD

High-density event-related brain potentials (ERPs) were recorded to images of faces, inverted faces, and objects from 9 individuals with autism spectrum disorder (15-42 years old) and 14 typical individuals (16-37 years old).

RESULTS

With respect to a face-sensitive ERP component (N170), individuals with autism exhibited longer N170 latencies to faces than typical individuals but comparable latencies to objects. Typical individuals exhibited longer N170 latencies to inverted as compared to upright faces, whereas individuals with autism did not show differences in N170 latency to upright versus inverted faces. Neural speed of face processing, as reflected in N170 latency, correlated with performance on a face recognition task for individuals with autism.

CONCLUSIONS

These data provide evidence for slowed neural speed of face processing in autism and highlight the role of speed of processing in face processing impairments in autism.

Face-sensitive cortical processing in early infancy

BACKGROUND

Debates about the developmental origins of adult face processing could be directly addressed if a clear infant neural marker could be identified. Previous research with infants remains open to criticism regarding the control stimuli employed.

METHODS

We recorded ERPs from adults and 3-month-old infants while they watched faces and matched visual noise stimuli.

RESULTS

We observed similar amplitude enhancement for faces in the infant N290 and adult N170. In contrast, the infant P400 showed only a latency effect, making it unlikely to be the main precursor of the adult N170.

CONCLUSIONS

We conclude that there is some degree of specificity of cortical processing of faces as early as 3 months of age.

Spatiotemporal analysis of event-related potentials to upright, inverted, and contrast-reversed faces: Effects on encoding and recognition

In an n-back face recognition task where subjects responded to repeated stimuli, ERPs were recorded to upright, inverted, and contrast-reversed faces. The effects of inversion and contrast reversal on face encoding and recognition were investigated using the multivariate spatiotemporal partial least squares (PLS) analysis. The configural manipulations affected early processing (100-200 ms) at posterior sites: Inversion effects were parietal and lateral, whereas contrast-reversal effects were more occipital and medial, suggesting different underlying generators. A later reactivation of face processing areas was unique to inverted faces, likely due to processing difficulties. PLS also indicated that the "old-new" repetition effect was maximal for upright faces and likely involved frontotemporal areas. Marked processing differences between inverted and contrast-reversed faces were seen, but these effects were similar at encoding and recognition.

Face recognition memory and configural processing: a developmental ERP study using upright, inverted, and contrast-reversed faces

The effects of configural changes on faces were investigated in children to determine their role in encoding and recognition processes. Upright, inverted, and contrast-reversed unfamiliar faces were presented in blocks in which one-third of the pictures repeated immediately or after one intervening face. Subjects (8-16 years) responded to repeated faces; event-related potentials were recorded throughout the procedure. Recognition improved steadily with age and all components studied showed age effects reflecting differing maturation processes occurring until adulthood. All children were affected by inversion and contrast-reversal, and face-type effects were seen on latencies and amplitudes of early components (P1 and N170), as well as on later frontal amplitudes. The "old-new" repetition effects (larger amplitude for repeated stimuli) were found at frontal sites and were similar across age groups and face types, suggesting a general working memory system comparably involved in all age groups. These data demonstrate that (1) there is quantitative development in face processing, (2) both face encoding and recognition improve with age, but (3) only encoding is affected by configural changes. The data also suggest a gradual tuning of face processing towards the upright orientation.

A principled method for determining the functionality of brain responses

A challenging issue in relating brain function to perception and cognition concerns the functional interpretation of brain responses. For example, while there is agreement that the N170 component of event-related potentials is sensitive to face processing, there is considerable debate about whether its response reflects a structural encoder for faces, a feature (e.g. eye) detector, or something else. We introduce a principled approach to determine the stimulus features driving brain responses. Our analyses on two observers resolving different face categorization tasks (gender and expressive or not) reveal that the N170 responds to the eyes within a face irrespective of task demands. This suggests a new methodology to attribute function to different components of the neural system for perceiving complex stimuli.

Development of face-sensitive event-related potentials during infancy: a review

Event-related potential (ERP) studies in adults have identified a number of components related to encoding and recognition memory of faces. Although behavioural studies indicate that even very young infants are able to detect faces and recognise familiar individuals, very few ERP studies document the neural correlates of these early abilities. In this article, we review four components (P1, N290, P400, Nc) and slow wave activity that are elicited while infants view faces. Where possible we draw links between these components and their possible equivalents to those observed in children and adults, and we highlight areas where further investigation is required. The theoretical importance of ERP studies of face processing in infants for debates about the origins and domain specificity of the adult cortical face processing system are discussed.

Turn that frown upside down: ERP effects of thatcherization of misorientated faces

When inverted, thatcherized faces appear normal. This may be due to a decrease in configural and an increase in featural processing. It is not known whether this processing is continuous or reflects two distinct processing systems. Using event-related potentials (ERPs), we investigated the Thatcher effect on thatcherized and normal faces at varying orientations. The ERPs paralleled the perceptual illusion. The effect of thatcherization on upright faces was visible in P1 and N170 ERP components, possibly reflecting attentional engagement due to unpleasantness of thatcherized faces. Effects were also found over two later components, the P250 component, which has been related to configural recognition, and a late parietal component possibly reflecting featural processing. The effect of thatcherization on the two later components decreased gradually (for the P250 component) and abruptly (for the late parietal component) as the faces were rotated away from the upright.

Early lateralization and orientation tuning for face, word, and object processing in the visual cortex

Event-related potential (ERP) studies of the human brain have shown that object categories can be reliably distinguished as early as 130-170 ms on the surface of occipito-temporal cortex, peaking at the level of the N170 component. Consistent with this finding, neuropsychological and neuroimaging studies suggest major functional distinctions within the human object recognition system, particularly in hemispheric advantage, between the processing of words (left), faces (right), and objects (bilateral). Given these observations, our aim was to (1) characterize the differential response properties of the N170 to pictures of faces, objects, and words across hemispheres; and (2) test whether an effect of inversion for highly familiar and monooriented nonface stimuli such as printed words can be observed at the level of the N170. Scalp EEG (53 channels) was recorded in 15 subjects performing an orientation decision task with pictures of faces, words, and cars presented upright or inverted. All three categories elicited at the same latency a robust N170 component associated with a positive counterpart at centro-frontal sites (vertex-positive potential, VPP). While there were minor amplitude differences at the level of the occipital medial P1 between linguistic and nonlinguistic categories, scalp topographies and source analyses indicated strong hemispheric and orientation effects starting at the level of the N170, which was right lateralized for faces, smaller and bilateral for cars, and as large for printed words in the left hemisphere as for faces. The entire N170/VPP complex was accounted for by two dipolar sources located in the lateral inferior occipital cortex/posterior fusiform gyrus. These two locations were roughly equivalent across conditions but differed in strength and lateralization. Inversion delayed the N170 (and VPP) response for all categories, with an increasing delay for cars, words, and faces, respectively, as suggested by source modeling analysis. Such results show that early processes in object recognition respond to category-specific visual information, and are associated with strong lateralization and orientation bias.

Cortical specialisation for face processing: face-sensitive event-related potential components in 3- and 12-month-old infants

The adult N170 is considered to be an electrophysiological marker of specialised mechanisms for face processing, but little is known about its developmental origin. Previous work has identified two face-sensitive infant ERP components (N290 and P400) (J. Cog. Neurosci. 14 (2002), 199). In the present study, we assessed the specificity (to upright human faces) of these infant components at 3 and 12 months. At 12 months the degree of specificity observed in both components was similar to that seen in the adult N170. In contrast, at 3 months of age the N290 and P400 did not show the same level of specificity for human faces as that observed at 12 months. Our findings suggest that (1) both face-sensitive components increase in their specificity for upright human faces during development, and (2) the adult N170 is not preceded by a single developmental precursor, but rather emerges as a consequence of the integration of two functionally and morphologically distinct components (N290 and P400).

Spatial scale contribution to early visual differences between face and object processing

Event-related potential (ERP) studies have highlighted an occipito-temporal potential, the N170, which is larger for faces than for other categories and delayed by stimulus inversion of faces, but not of other objects. We examined how high-pass and low-pass filtering modulate such early differences between the processing of faces and objects. Sixteen grey-scale pictures of faces and cars were filtered to preserve only relatively low (LSF) or high (HSF) spatial frequencies and were presented upright or upside-down. Subjects reported the orientation of the faces and cars in broad-pass and filtered conditions. In the broad-pass condition, we replicated typical N170 face-specific effects of amplitude and delay with inversion. These effects were also present in the LSF condition. However, a completely different pattern was revealed by the HSF condition: (1). a similar N170 amplitude for cars as compared to faces and (2). an absence of N170 latency delay with face inversion. These results show that the source of early processing differences between faces and objects is related to the extraction of information contained mostly in the LSF, which conveys coarse configuration cues particularly salient for face processing.