The superior temporal sulcus and the N170 during face processing: single trial analysis of concurrent EEG-fMRI

A beautiful face is good when we're judged by others, a moral character is better

Moral beauty, reflected in one's actions, and facial beauty both affect how we are judged. Here, we investigated how moral and facial beauty interact to affect social judgments and emotional responses, employing event-related brain potentials (ERPs). All participants (female) associated positive, neutral, or negative verbal information with faces scoring high or low on attractiveness and performed ratings of the faces as manipulation checks. In a separate test phase, the faces were presented again, and participants made valenced social judgments of the persons. Results show a dominance of moral beauty in valenced social judgments as well as ERPs related to reflexive and evaluative emotional responses (early posterior negativity and late positive potential), whereas facial attractiveness mattered little. In contrast, facial attractiveness affected visual processing (N170). Similarly, relatively shallow impressions of attractiveness and likability that require no knowledge about the person were influenced by both facial attractiveness and social-emotional information. This pattern of dominant effects of social-emotional information regardless of attractiveness shows that when it comes to our emotional responses and social judgments, moral beauty is what matters most, even in the face of physical beauty.

Identifying P100 and N170 as electrophysiological markers for conscious and unconscious processing of emotional facial expressions

Introduction

Everyday life requires correct processing of emotions constantly, partly occurring unconsciously. This study aims to clarify the effect of emotion perception on different event-related potentials (ERP; P100, N170). The P100 and N170 are tested for their suitability as electrophysiological markers in unconscious processing.

Methods

Using a modified backward masking paradigm, 52 healthy participants evaluated emotional facial expressions (happy, sad, or neutral) during EEG recording. While varying primer presentation time (16.7 ms for unconscious; 150 ms for conscious perception), either congruent or incongruent primer / target emotions were displayed.

Results

The N170 was significantly larger in trials with conscious compared to unconscious primer presentation, while the P100 showed opposite results displaying higher amplitudes in unconscious versus conscious trials. The N170 amplitude was modulated by emotion.

Discussion

Both P100 and N170 were modulated by stimulus presentation time, demonstrating the suitability as potential biomarkers and for systematic research on conscious and unconscious face processing.

Neural dynamics of personality trait perception and interaction preferences

According to recent research, self-reported Big Five personality traits are associated with preferences for faces that are representative of certain Big Five traits. Previous research has primarily focused on either preference for distinct prototypical personality faces or the accuracy of trait ratings for these faces. However, the underlying neural correlates involved in the processing of prototypical personality faces are unknown. In the present study, we aim to bridge this gap by investigating whether participants' Big Five personality traits predict preferences to interact with individuals represented by prototypical personality faces, as well as the neural processing of these facial features. Based on theoretical considerations and previous research, we focus on trait extraversion, agreeableness and neuroticism, and corresponding prototypical faces. Participants were asked to classify prototypical faces as above or below average representative of a certain trait, and then provide an interaction preference rating while face-sensitive event-related potentials (N170 and late positive potential) were measured. In line with our hypotheses, the results showed an interaction preference for faces that were perceived as high (vs. low) extraverted and agreeable and low (vs. high) neurotic. In addition, the preference for agreeable faces interacted with personality characteristics of the perceiver: The higher a persons' score on trait agreeableness, the higher the face preference ratings for both prototypical and perceived high agreeable faces. Analyses of ERP data showed that an increase in preference ratings for prototypical agreeable faces was paralleled by an increase of the late positive potential. Notably, the N170 did not show any neural signature of the hypothesized effects of personality faces. Together, these results highlight the importance of considering both perceiver characteristics as well as perceived features of an interaction partner when it comes to preference for social interaction.Protocol registration The stage 1 protocol for this Registered Report was accepted in principle on the 8th of May 2023. The protocol, as accepted by the journal, can be found at: https://doi.org/10.17605/OSF.IO/G8SCY .

Neurophysiological Pathways of Unconscious Emotion Processing in Depression: Insights From a Simultaneous Electroencephalography-Functional Magnetic Resonance Imaging Measurement

BACKGROUND

Major depressive disorder (MDD) is characterized by strong emotional dysregulation. Mechanisms driving the negative affect in depression may be fast processes existing on an unconscious level.

METHODS

A priming task was conducted using simultaneous electroencephalography-functional magnetic resonance imaging measurement involving presentation of facial expressions (happy, sad, and neutral) to examine the neurophysiological pathway of biased unconscious emotion processing in MDD. Priming prior to a target emotion created unconscious (16.7-ms primer) and conscious (150-ms primer) trials. A large sample (N = 126) was recruited, containing healthy control participants (n = 66; 37 women) and participants with MDD (n = 60; 31 women).

RESULTS

The healthy control group showed a shorter reaction time in happy but not in sad or neutral trials compared with the MDD group. N170 amplitudes were lower in trials with unconscious than conscious primer presentation. N170 amplitudes correlated with cortical (right fusiform gyrus, right middle temporal gyrus, right inferior temporal gyrus, left supplementary motor area, right middle frontal gyrus) and subcortical brain regions (right amygdala). The strength of N170 and brain activity correlation increased when the stimulus was consciously presented. Presented emotions did not affect the correlation of N170 values and brain activity.

CONCLUSIONS

Our findings show that MDD may exhibit biased emotion regulation abilities at a behavioral and neurophysiological level. Face-sensitive event-related potentials demonstrate a correlation with heightened brain activity in regions associated with both face recognition (fusiform gyrus) and emotion processing (amygdala). These findings are evident in both MDD and healthy control groups, with lower effect sizes in the MDD group indicating reduced emotion recognition and processing abilities.

Reduced pre-attentive threat versus nonthreat signal discrimination in clinically healthy military personnel with recurrent combat exposure history: A preliminary event-related potential (ERP) study

Evidence now suggests that traumatic-stress impacts brain functions even in the absence of acute-onset post-traumatic stress disorder (PTSD) symptoms. These neurophysiological changes have also been suggested to account for increased risks of PTSD symptoms later developing in the aftermath of subsequent trauma. However, surprisingly few studies have explicitly examined brain function dynamics in high-risk populations, such as combat exposed military personnel without diagnosable PTSD. To extend available research, facial expression sensitive N170 event-related potential (ERP) amplitudes were examined in a clinically healthy sample of active service military personnel with recurrent combat exposure history. Consistent with several established theories of delayed-onset PTSD vulnerability, higher N170 amplitudes to backward-masked fearful and neutral facial expressions correlated with higher levels of past combat exposure. Significantly elevated amplitudes to nonthreatening neutral facial expressions also resulted in an absence of normal threat-versus-nonthreat signal processing specificity. While a modest sample size and cross-sectional design are key limitations here, ongoing prospective-longitudinal follow-ups may shed further light on the precise aetiology and prognostic utility of these preliminary findings in the near future.

Multimodal investigations of emotional face processing and social trait judgment of faces

Faces are among the most important visual stimuli that humans perceive in everyday life. While extensive literature has examined emotional processing and social evaluations of faces, most studies have examined either topic using unimodal approaches. In this review, we promote the use of multimodal cognitive neuroscience approaches to study these processes, using two lines of research as examples: ambiguity in facial expressions of emotion and social trait judgment of faces. In the first set of studies, we identified an event-related potential that signals emotion ambiguity using electroencephalography and we found convergent neural responses to emotion ambiguity using functional neuroimaging and single-neuron recordings. In the second set of studies, we discuss how different neuroimaging and personality-dimensional approaches together provide new insights into social trait judgments of faces. In both sets of studies, we provide an in-depth comparison between neurotypicals and people with autism spectrum disorder. We offer a computational account for the behavioral and neural markers of the different facial processing between the two groups. Finally, we suggest new practices for studying the emotional processing and social evaluations of faces. All data discussed in the case studies of this review are publicly available.

Using multi-modal neuroimaging to characterise social brain specialisation in infants

The specialised regional functionality of the mature human cortex partly emerges through experience-dependent specialisation during early development. Our existing understanding of functional specialisation in the infant brain is based on evidence from unitary imaging modalities and has thus focused on isolated estimates of spatial or temporal selectivity of neural or haemodynamic activation, giving an incomplete picture. We speculate that functional specialisation will be underpinned by better coordinated haemodynamic and metabolic changes in a broadly orchestrated physiological response. To enable researchers to track this process through development, we develop new tools that allow the simultaneous measurement of coordinated neural activity (EEG), metabolic rate, and oxygenated blood supply (broadband near-infrared spectroscopy) in the awake infant. In 4- to 7-month-old infants, we use these new tools to show that social processing is accompanied by spatially and temporally specific increases in coupled activation in the temporal-parietal junction, a core hub region of the adult social brain. During non-social processing, coupled activation decreased in the same region, indicating specificity to social processing. Coupling was strongest with high-frequency brain activity (beta and gamma), consistent with the greater energetic requirements and more localised action of high-frequency brain activity. The development of simultaneous multimodal neural measures will enable future researchers to open new vistas in understanding functional specialisation of the brain.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Reductions in regional theta power and fronto-parietal theta-gamma phase-amplitude coupling during gaze processing in bipolar disorder

Impaired social cognition is common in bipolar disorder (BD) and predicts poor functional outcomes. A critical determinant of social cognition is the ability to discriminate others' gaze direction, and its alteration may contribute to functional impairment in BD. However, the neural mechanisms underlying gaze processing in BD are unclear. Because neural oscillations are crucial neurobiological mechanisms supporting cognition, we aimed to understand their role in gaze processing in BD. Using electroencephalography (EEG) data recorded during a gaze discrimination task for 38 BD and 34 controls (HC), we examined: theta and gamma power over bilateral posterior and midline anterior locations associated with early face processing and higher-level cognitive processing, and theta-gamma phase-amplitude coupling (PAC) between locations. Compared to HC, BD showed reduced midline-anterior and left-posterior theta power, and diminished bottom-up/top-down theta-gamma PAC between anterior/posterior sites. Reduced theta power and theta-gamma PAC related to slower response times. These findings suggest that altered theta oscillations and anterior-posterior cross-frequency coupling between areas associated with higher-level cognition and early face processing may underlie impaired gaze processing in BD. This is a crucial step towards translational research that may inform novel social cognitive interventions (e.g., neuromodulation to target specific oscillatory dynamics) to improve functioning in BD.

Face pareidolia is enhanced by 40 Hz transcranial alternating current stimulation (tACS) of the face perception network

Pareidolia refers to the perception of ambiguous sensory patterns as carrying a specific meaning. In its most common form, pareidolia involves human-like facial features, where random objects or patterns are illusionary recognized as faces. The current study investigated the neurophysiological correlates of face pareidolia via transcranial alternating current stimulation (tACS). tACS was delivered at gamma (40 Hz) frequency over critical nodes of the "face perception" network (i.e., right lateral occipito-temporal and left prefrontal cortex) of 75 healthy participants while completing four face perception tasks ('Mooney test' for faces, 'Toast test', 'Noise pareidolia test', 'Pareidolia task') and an object perception task ('Mooney test' for objects). In this single-blind, sham-controlled between-subjects study, participants received 35 min of either Sham, Online, (40Hz-tACS_ON), or Offline (40Hz-tACS_PRE) stimulation. Results showed that face pareidolia was causally enhanced by 40Hz-tACS_PRE in the Mooney test for faces in which, as compared to sham, participants more often misperceived scrambled stimuli as faces. In addition, as compared to sham, participants receiving 40Hz-tACS_PRE showed similar reaction times (RTs) when perceiving illusory faces and correctly recognizing noise stimuli in the Toast test, thus not exhibiting hesitancy in identifying faces where there were none. Also, 40Hz-tACS_ON induced slower rejections of face pareidolia responses in the Noise pareidolia test. The current study indicates that 40 Hz tACS can enhance pareidolic illusions in healthy individuals and, thus, that high frequency (i.e., gamma band) oscillations are critical in forming coherent and meaningful visual perception.

Asynchronous neural oscillations associated with subliminal affective face priming in autism spectrum disorder

Autism spectrum disorder (ASD) is characterized by social communicative disturbance. Social communication requires rapid processing and accurate cognition regarding others' emotional expressions. Previous electrophysiological studies have attempted to elucidate the processes underlying atypical face-specific N170 responses to emotional faces in ASD. The present study explored subliminal affective priming effects (SAPEs) on the N170 response and time-frequency analysis of intertrial phase coherence (ITPC) for the N170 in ASD. Fifteen participants [seven participants with ASD and eight typically developing (TD) controls] were recruited for the experiment. Event-related potentials were recorded with a 128-channel electroencephalography device while participants performed an emotional face judgment task. The results revealed enhanced N170 amplitude for supraliminal target-face stimuli when they were preceded by subliminal fearful-face stimuli, in both the ASD and TD groups. Interestingly, TD participants exhibited higher alpha-ITPC in the subliminal fearful-face priming condition in the right face-specific area in the N170 time window. In contrast, there were no significant differences in ITPC in any frequency bands between the subliminal fearful and neutral priming conditions in the ASD group. Asynchronous phase-locking neural activities in the face-specific area may underlie impaired nonconscious face processing in ASD, despite the presence of common features of SAPEs for the N170 component in both the ASD and TD groups.

Modeling the Hemodynamic Response Function Using EEG-fMRI Data During Eyes-Open Resting-State Conditions and Motor Task Execution

Being able to accurately quantify the hemodynamic response function (HRF) that links the blood oxygen level dependent functional magnetic resonance imaging (BOLD-fMRI) signal to the underlying neural activity is important both for elucidating neurovascular coupling mechanisms and improving the accuracy of fMRI-based functional connectivity analyses. In particular, HRF estimation using BOLD-fMRI is challenging particularly in the case of resting-state data, due to the absence of information about the underlying neuronal dynamics. To this end, using simultaneously recorded electroencephalography (EEG) and fMRI data is a promising approach, as EEG provides a more direct measure of neural activations. In the present work, we employ simultaneous EEG-fMRI to investigate the regional characteristics of the HRF using measurements acquired during resting conditions. We propose a novel methodological approach based on combining distributed EEG source space reconstruction, which improves the spatial resolution of HRF estimation and using block-structured linear and nonlinear models, which enables us to simultaneously obtain HRF estimates and the contribution of different EEG frequency bands. Our results suggest that the dynamics of the resting-state BOLD signal can be sufficiently described using linear models and that the contribution of each band is region specific. Specifically, it was found that sensory-motor cortices exhibit positive HRF shapes, whereas the lateral occipital cortex and areas in the parietal cortex, such as the inferior and superior parietal lobule exhibit negative HRF shapes. To validate the proposed method, we repeated the analysis using simultaneous EEG-fMRI measurements acquired during execution of a unimanual hand-grip task. Our results reveal significant associations between BOLD signal variations and electrophysiological power fluctuations in the ipsilateral primary motor cortex, particularly for the EEG beta band, in agreement with previous studies in the literature.

An Event-Related Potential Investigation of Early Visual Processing Deficits During Face Perception in Youth at Clinical High Risk for Psychosis

Impairments in early visual face perception are well documented in patients with schizophrenia. Specifically, event-related potential (ERP) research in patients with schizophrenia has demonstrated deficits in early sensory processing of stimulus properties (P1 component) and the structural encoding of faces (N170 component). However, it is not well understood if similar impairments are present in individuals at clinical high risk (CHR) for psychosis (ie, those in the putative prodromal stage of the illness). Thus, it is unknown if face perception deficits are the result of illness onset or are present in the high-risk period for the illness. The present study used the ERP technique to examine neural activation when viewing facial emotion expressions and objects in 44 CHR and 47 control adolescents and young adults (N = 91). P1 amplitude was similar across groups, indicating that early sensory processing impairments did not substantially contribute to face perception deficits in CHR youth. CHR youth exhibited reduced N170 amplitude compared to controls when viewing faces but not objects, implicating a specific deficit in the structural encoding of faces rather than a general perceptual deficit. Further, whereas controls demonstrated the expected face-selective N170 effect (ie, larger amplitude for faces than objects), CHR youth did not, which suggests that facial emotion expressions do not elicit the expected preferential perceptual processing for critical social information in individuals at CHR for psychosis. Together, these findings provide valuable information regarding the specific impairments contributing to face perception deficits in the high-risk period where treatment stands to aid in preventing illness progression.

Sex-specific relationships between face memory and the N170 component in event-related potentials

At the group level, women consistently perform better in face memory tasks than men and also show earlier and larger N170 components of event-related brain potentials (ERP), considered to indicate perceptual structural encoding of faces. Here we investigated sex differences in the relationship between the N170 and face memory performance in 152 men and 141 women at group mean and individual differences levels. ERPs and performance were measured in separate tasks, avoiding statistical dependency between the two. We confirmed previous findings about superior face memory in women and a—sex-independent—negative relationship between N170 latency and face memory. However, whereas in men, better face memory was related to larger N170 components, face memory in women was unrelated with the amplitude or latency of the N170. These data provide solid evidence that individual differences in face memory within men are at least partially related to more intense structural face encoding.

Effects of high and low power on the visual encoding of faces

The experience of power is typically associated with social disengagement, yet power has also been shown to facilitate configural visual encoding - a process that supports the initial perception of a human face. To investigate this apparent contradiction, we directly tested whether power influences the visual encoding of faces. Two experiments, using neural and psychophysical assessments, revealed that low power impeded both first-order configural processing (the encoding of a stimulus as a face, assessed by the N170 event-related potential) and second-order configural processing (the encoding of feature distances within configuration, assessed using the face inversion paradigm), relative to high-power and control conditions. Power did not significantly affect facial feature encoding. Results reveal an early and automatic effect of low power on face perception, characterized primarily by diminished face processing. These findings suggest a novel interplay between visual and cognitive processes in power's influence on social behavior.

Gender differences in subliminal affective face priming: A high-density ERP study

INTRODUCTION

Subliminal affective priming effects (SAPEs) refer to the phenomenon by which the presentation of an affective prime stimulus influences the subsequent affective evaluation of a target stimulus. Previous studies have reported that unconsciously processed stimuli affect behavioral performance more than consciously processed stimuli. However, the impact of SAPEs on the face-specific N170 component is unclear. We studied how SAPEs for fearful faces affected the N170 for subsequent supraliminal target faces using event-related potentials (ERPs).

METHODS

Japanese adults (n = 44, 20 females) participated in this study. Subliminal prime faces (neutral or fearful) were presented for 17 ms, followed by a backward mask for 283 ms and 800 ms target faces (neutral, emotionally ambiguous, or fearful). 128-channel ERPs were recorded while participants judged the expression of target faces as neutral or fearful. Response rates and response times were also measured for assessing behavioral alterations.

RESULTS

Although the behavioral results revealed no evidence of SAPEs, we found gender-related SAPEs in right N170 amplitude. Specifically, female participants exhibited enhanced right N170 amplitude for emotionally neutral faces primed by fearful faces, while male participants exhibited decreased N170 amplitude in fearful prime trials with fearful target faces. Male participants exhibited significant correlations between N170 amplitude and behavioral response time in the fearful prime-neutral target condition.

CONCLUSIONS

Our ERP results suggest the existence of a gender difference in target-face processing preceded by subliminally presented face stimuli in the right occipito-temporal region.

The N170 event-related potential reflects delayed neural response to faces when visual attention is directed to the eyes in youths with ASD

Atypical neural response to faces is thought to contribute to social deficits in autism spectrum disorder (ASD). Compared to typically developing (TD) controls, individuals with ASD exhibit delayed brain responses to upright faces at a face-sensitive event-related potential (ERP), the N170. Given observed differences in patterns of visual attention to faces, it is not known whether slowed neural processing may simply reflect atypical looking to faces. The present study manipulated visual attention to facial features to examine whether directed attention to the eyes normalizes N170 latency in ASD. ERPs were recorded in 30 children and adolescents with ASD as well as 26 TD children and adolescents. Results replicated prior findings of shorter N170 latency to the eye region of the face in TD individuals. In contrast, those with ASD did not demonstrate modulation of N170 latency by point of regard to the face. Group differences in latency were most pronounced when attention was directed to the eyes. Results suggest that well-replicated findings of N170 delays in ASD do not simply reflect atypical patterns of visual engagement with experimental stimuli. These findings add to a body of evidence indicating that N170 delays are a promising marker of atypical neural response to social information in ASD. LAY SUMMARY: This study looks at how children's and adolescents' brains respond when looking at different parts of a face. Typically developing children and adolescents processed eyes faster than other parts of the face, whereas this pattern was not seen in ASD. Children and adolescents with ASD processed eyes more slowly than typically developing children. These findings suggest that observed inefficiencies in face processing in ASD are not simply reflective of failure to attend to the eyes.

Neural Oscillatory Abnormalities During Gaze Processing in Schizophrenia: Evidence of Reduced Theta Phase Consistency and Inter-areal Theta-Gamma Coupling

BACKGROUND

Abnormal gaze discrimination in schizophrenia (SZ) is associated with impairment in social functioning, but the neural mechanisms remain unclear. Evidence suggests that local neural oscillations and inter-areal communication through neural synchronization are critical physiological mechanisms supporting basic and complex cognitive processes. The roles of these mechanisms in abnormal gaze processing in SZ have not been investigated. The present study examined local neural oscillations and connectivity between anterior and bilateral posterior brain areas during gaze processing.

METHODS

During electroencephalography recording, 28 participants with SZ and 34 healthy control participants completed a gaze discrimination task. Time-frequency decomposition of electroencephalography data was used to examine neural oscillatory power and intertrial phase consistency at bilateral posterior and midline anterior scalp sites. In addition, connectivity between these anterior and posterior sites, in terms of cross-frequency coupling between theta phase and gamma amplitude, was examined using the Kullback-Leibler Modulation Index.

RESULTS

Participants with SZ showed reduced total power of theta-band activity relative to healthy control participants at all sites examined. This group difference could be accounted for by reduced intertrial phase consistency of theta activity in SZ participants, which was related to reduced gaze discrimination accuracy in SZ. In addition, SZ participants exhibited reduced Kullback-Leibler indexing, both feedforward and feedback connectivity, between the posterior and anterior sites.

CONCLUSIONS

These findings suggest that abnormal theta phase consistency and dysconnection between posterior face processing and anterior areas may underlie gaze processing deficits in SZ.

Identification of White Matter Networks Engaged in Object (Face) Recognition Showing Differential Responses to Modulated Stimulus Strength

Blood-oxygenation-level-dependent (BOLD) signals in magnetic resonance imaging indirectly reflect neural activity in cortex, but they are also detectable in white matter (WM). BOLD signals in WM exhibit strong correlations with those in gray matter (GM) in a resting state, but their interpretation and relationship to GM activity in a task are unclear. We performed a parametric visual object recognition task designed to modulate the BOLD signal response in GM regions engaged in higher order visual processing, and measured corresponding changes in specific WM tracts. Human faces embedded in different levels of random noise have previously been shown to produce graded changes in BOLD activation in for example, the fusiform gyrus, as well as in electrophysiological (N170) evoked potentials. The magnitudes of BOLD responses in both GM regions and selected WM tracts varied monotonically with the stimulus strength (noise level). In addition, the magnitudes and temporal profiles of signals in GM and WM regions involved in the task coupled strongly across different task parameters. These findings reveal the network of WM tracts engaged in object (face) recognition and confirm that WM BOLD signals may be directly affected by neural activity in GM regions to which they connect.

The bottom-up and top-down processing of faces in the human occipitotemporal cortex

Although face processing has been studied extensively, the dynamics of how face-selective cortical areas are engaged remains unclear. Here, we uncovered the timing of activation in core face-selective regions using functional Magnetic Resonance Imaging and Magnetoencephalography in humans. Processing of normal faces started in the posterior occipital areas and then proceeded to anterior regions. This bottom-up processing sequence was also observed even when internal facial features were misarranged. However, processing of two-tone Mooney faces lacking explicit prototypical facial features engaged top-down projection from the right posterior fusiform face area to right occipital face area. Further, face-specific responses elicited by contextual cues alone emerged simultaneously in the right ventral face-selective regions, suggesting parallel contextual facilitation. Together, our findings chronicle the precise timing of bottom-up, top-down, as well as context-facilitated processing sequences in the occipital-temporal face network, highlighting the importance of the top-down operations especially when faced with incomplete or ambiguous input.

Non-Invasive, Cost-Effective, Early Diagnosis of Mild Cognitive Impairment in an Outpatient Setting: Pilot Study

Mild cognitive impairment (MCI) and Alzheimer's Disease (AD) affect millions worldwide, yet no curative treatments for these neuro-degenerative disorders have been developed to date. The current study aims to propose a noninvasive, cost-effective, early diagnostic protocol for individuals suffering with MCI in an outpatient setting. Elderly participants (n=11) were screened for MCI utilizing the Montreal Cognitive Assessment (MoCA) questionnaire preceding a visual stimuli task. Participants were presented with facial stimuli to elicit event related potentials (ERP) while their cortical activity was recorded utilizing electroencephalogram (EEG). Combining regional neurophysiological biomarkers into a multidimensional feature space allowed for differentiation between healthy and MCI participants based on their respective MoCA scores. This study illustrates the feasibility of recording reliable EEG in an outpatient setting while presenting a novel method for diagnosing MCI in elderly (age >60) populations.

Facial Recognition Task for the Classification of Mild Cognitive Impairment with Ensemble Sparse Classifier

Conventional methods for detecting mild cognitive impairment (MCI) require cognitive exams and follow-up neuroimaging, which can be time-consuming and expensive. A great need exists for objective and cost-effective biomarkers for the early detection of MCI. This study uses a sequential imaging oddball paradigm to determine if familiar, unfamiliar, or inverted faces are effective visual stimuli for the early detection of MCI. Unlike the traditional approach where the amplitude and latency of certain deflection points of event-related potentials (ERPs) are selected as electrophysiological biomarkers (or features) of MCI, we used the entire ERPs as potential biomarkers and relied on an advanced machine-learning technique, i.e. an ensemble of sparse classifier (ESC), to choose the set of features to best discriminate MCI from healthy controls. Five MCI subjects and eight age-matched controls were given the MoCA exam before EEG recordings in a sensory-deprived room. Traditional time-domain comparisons of averaged ERPs between the two groups did not yield any statistical significance. However, ESC was able to discriminate MCI from controls with 95% classification accuracy based on the averaged ERPs elicited by familiar faces. By adopting advanced machine-learning techniques such as ESC, it may be possible to accurately diagnose MCI based on the ERPs that are specifically elicited by familiar faces.

The neural sources of N170: Understanding timing of activation in face-selective areas

The N170 ERP component has been widely identified as a face-sensitive neural marker. Despite extensive investigations conducted to examine the neural sources of N170, there are two issues in prior literature: (a) few studies used individualized anatomy as head model for the cortical source analysis of the N170, and (b) the relationship between the N170 and face-selective regions from fMRI studies is unclear. Here, we addressed these questions by presenting pictures of faces and houses to the same group of healthy adults and recording structural MRI, fMRI, and high-density ERPs in separate sessions. Source analysis based on the participant's anatomy showed that the middle and posterior fusiform gyri were the primary neural sources for the face-sensitive aspects of the N170. Source analysis based on regions of interest from the fMRI revealed that the fMRI-defined fusiform face area was the major contributor to the N170. The current study suggests that the fusiform gyrus is a major neural contributor to the N170 ERP component and provides further insights about the spatiotemporal characteristics of face processing.

Early processing (N170) of infant faces in mothers of children with autism spectrum disorder and its association with maternal sensitivity

Individuals with autism spectrum disorder (ASD) exhibit impaired adult facial processing, as shown by the N170 event-related potential. However, few studies explore such processing in mothers of children with ASD, and none has assessed the early processing of infant faces in these women. Moreover, whether processing of infant facial expressions in mothers of children with ASD is related to their response to their child's needs (maternal sensitivity [MS]) remains unknown. This study explored the N170 related to infant faces in a group of mothers of children with ASD (MA) and a reference group of mothers of children without ASD. For both emotional (crying, smiling) and neutral expressions, the MA group exhibited larger amplitudes of N170 in the right hemisphere, while the reference group showed similar interhemispheric amplitudes. This lateralization effect within the MA group was not present for nonfaces and was stronger in the mothers with higher MS. We propose that mothers of ASD children use specialized perceptual resources to process infant faces, and this specialization is mediated by MS. Our findings suggest that having an ASD child modulates mothers' early neurophysiological responsiveness to infant cues. Whether this modulation represents a biological marker or a response given by experience remains to be explored. Autism Research 2019, 12: 744-758. © 2019 International Society for Autism Research, Wiley Periodicals, Inc. LAY SUMMARY: When mothers of children with autism spectrum disorder (ASD) see baby faces expressing emotions, they show a right-sided electrical response in the brain. This lateralization was stronger in mothers who were more sensitive to their children's needs. We conclude that having a child with ASD and being more attuned to their behavior generates a specialized pattern of brain activity when processing infant faces. Whether this pattern is biological or given by experience remains to be explored.

Rapid stream stimulation can enhance the stimulus selectivity of early evoked responses to written characters but not faces

The recognition potential (RP) is an early visually evoked response (~250 ms) whose magnitude is sensitive to object recognizability and related factors. The RP is often measured when objects are embedded in a rapid stream of masking stimuli (the RSS paradigm), especially in reading research. The idea is that RSS provides greater stimulus-dependent variations in RP, compared to the corresponding variations without RSS. However, this idea has never been subject to systematic evaluation. We directly test whether RSS can enhance 2 types of RP stimulus selectivity, by measuring the RP in conditions that only differ in the presence or absence of a masking stream and in the type of stimulus shown. We measure the effect of image inversion on RP for Chinese characters (experiment 1); the effect of orthographical correctness on RP for Chinese characters (experiment 3); and as a control study, the effect of image inversion on the N170 response to faces (experiment 2). To ensure a fair comparison, the earliest negative deflections (RP/N170) measured with and without RSS should at least have similar channel ranges, and topographical distributions of both amplitude and selectivity. Our first set of results clearly supports this. Our main results clearly show an increase in stimulus-selectivity for RSS over non-RSS in both of the RP (Chinese character) experiments, but no such enhancement in the N170 (face) experiment. This provides incentive for investigations into the underlying mechanisms of selectivity enhancement. Our findings may also help to explain contradictory findings between RP/N170 studies that differ only in the use of noise masks, which is sometimes treated as trivial detail in papers that do not reference the RP/RSS literature.

The inferior occipital gyrus is a major cortical source of the face-evoked N170: Evidence from simultaneous scalp and intracerebral human recordings

The sudden onset of a face image leads to a prominent face-selective response in human scalp electroencephalographic (EEG) recordings, peaking 170 ms after stimulus onset at occipito-temporal (OT) scalp sites: the N170 (or M170 in magnetoencephalography). According to a widely held view, the main cortical source of the N170 lies in the fusiform gyrus (FG), whereas the posteriorly located inferior occipital gyrus (IOG) would rather generate earlier face-selective responses. Here, we report neural responses to upright and inverted faces recorded in a unique patient using multicontact intracerebral electrodes implanted in the right IOG and in the OT sulcus above the right lateral FG (LFG). Simultaneous EEG recordings on the scalp identified the N170 over the right OT scalp region. The latency and amplitude of this scalp N170 were correlated at the single-trial level with the N170 recorded in the lateral IOG, close to the scalp lateral occipital surface. In addition, a positive component maximal around the latency of the N170 (a P170) was prominent above the internal LFG, whereas this region typically generates an N170 (or "N200") over its external/ventral surface. This suggests that electrophysiological responses in the LFG manifest as an equivalent dipole oriented mostly along the vertical axis with likely minimal projection to the lateral OT scalp region. Altogether, these observations provide evidence that the IOG is a major cortical generator of the face-selective scalp N170, qualifying the potential contribution of the FG and questioning a strict serial spatiotemporal organization of the human cortical face network.

Coarse-to-fine information integration in human vision

Coarse-to-fine theories of vision propose that the coarse information carried by the low spatial frequencies (LSF) of visual input guides the integration of finer, high spatial frequency (HSF) detail. Whether and how LSF modulates HSF processing in naturalistic broad-band stimuli is still unclear. Here we used multivariate decoding of EEG signals to separate the respective contribution of LSF and HSF to the neural response evoked by broad-band images. Participants viewed images of human faces, monkey faces and phase-scrambled versions that were either broad-band or filtered to contain LSF or HSF. We trained classifiers on EEG scalp-patterns evoked by filtered scrambled stimuli and evaluated the derived models on broad-band scrambled and intact trials. We found reduced HSF contribution when LSF was informative towards image content, indicating that coarse information does guide the processing of fine detail, in line with coarse-to-fine theories. We discuss the potential cortical mechanisms underlying such coarse-to-fine feedback.

Neural Correlates of Conscious Motion Perception

The nature of the proper neural signature of conscious perception remains a topic of active debate. Theoretical support from integrative theories of consciousness is consistent with such signature being P3b, one of the main candidates in the literature. Recent work has also put forward a mid-latency and more localized component, the Visual Awareness Negativity (VAN), as a proper Neural Correlate of Consciousness (NCC). Early local components like P1 have also been proposed. However, experiments exploring visual NCCs are conducted almost exclusively using static images as the content to be consciously perceived, favoring ventral stream processing, therefore limiting the scope of the NCCs that have been identified. Here we explored the visual NCCs isolating local motion, a dorsally processed feature, as the primary feature being consciously perceived. Physical equality between Seen and Unseen conditions in addition to a minimal contrast difference between target and no-target displays was employed. In agreement with previous literature, we found a P3b with a wide centro-parietal distribution that strongly correlated with the detection of the stimuli. P3b magnitude was larger for Seen vs. Unseen conditions, a result that was consistently observed at the single subject level. In contrast, we were unable to detect VAN in our data, regardless of whether the subject perceived or not the stimuli. In the 200-300 ms time window we found a N2pc component, consistent with the high attentional demands of our task. Early components like P1 were not observed in our data, in agreement with their proposed role in the processing of visual features, but not as proper NCCs. Our results extend the role of P3b as a content independent NCC to conscious visual motion perception.

How attention gates social interactions

Social interactions are at the core of social life. However, humans selectively choose their exchange partners and do not engage in all available opportunities for social encounters. In this review, we argue that attentional systems play an important role in guiding the selection of social interactions. Supported by both classic and emerging literature, we identify and characterize the three core processes-perception, interpretation, and evaluation-that interact with attentional systems to modulate selective responses to social environments. Perceptual processes facilitate attentional prioritization of social cues. Interpretative processes link attention with understanding of cues' social meanings and agents' mental states. Evaluative processes determine the perceived value of the source of social information. The interplay between attention and these three routes of processing places attention in a powerful role to manage the selection of the vast amount of social information that individuals encounter on a daily basis and, in turn, gate the selection of social interactions.

Manifold decoding for neural representations of face viewpoint and gaze direction using magnetoencephalographic data

The main challenge in decoding neural representations lies in linking neural activity to representational content or abstract concepts. The transformation from a neural-based to a low-dimensional representation may hold the key to encoding perceptual processes in the human brain. In this study, we developed a novel model by which to represent two changeable features of faces: face viewpoint and gaze direction. These features are embedded in spatiotemporal brain activity derived from magnetoencephalographic data. Our decoding results demonstrate that face viewpoint and gaze direction can be represented by manifold structures constructed from brain responses in the bilateral occipital face area and right superior temporal sulcus, respectively. Our results also show that the superposition of brain activity in the manifold space reveals the viewpoints of faces as well as directions of gazes as perceived by the subject. The proposed manifold representation model provides a novel opportunity to gain further insight into the processing of information in the human brain.

EEG-Informed fMRI: A Review of Data Analysis Methods

The simultaneous acquisition of electroencephalography (EEG) with functional magnetic resonance imaging (fMRI) is a very promising non-invasive technique for the study of human brain function. Despite continuous improvements, it remains a challenging technique, and a standard methodology for data analysis is yet to be established. Here we review the methodologies that are currently available to address the challenges at each step of the data analysis pipeline. We start by surveying methods for pre-processing both EEG and fMRI data. On the EEG side, we focus on the correction for several MR-induced artifacts, particularly the gradient and pulse artifacts, as well as other sources of EEG artifacts. On the fMRI side, we consider image artifacts induced by the presence of EEG hardware inside the MR scanner, and the contamination of the fMRI signal by physiological noise of non-neuronal origin, including a review of several approaches to model and remove it. We then provide an overview of the approaches specifically employed for the integration of EEG and fMRI when using EEG to predict the blood oxygenation level dependent (BOLD) fMRI signal, the so-called EEG-informed fMRI integration strategy, the most commonly used strategy in EEG-fMRI research. Finally, we systematically review methods used for the extraction of EEG features reflecting neuronal phenomena of interest.

The Neural Bases of Event Monitoring across Domains: a Simultaneous ERP-fMRI Study

The ability to check and evaluate the environment over time with the aim to detect the occurrence of target stimuli is supported by sustained/tonic as well as transient/phasic control processes, which overall might be referred to as event monitoring. The neural underpinning of sustained attentional control processes involves a fronto-parietal network. However, it has not been well-defined yet whether this cortical circuit acts irrespective of the specific material to be monitored and whether this mediates sustained as well as transient monitoring processes. In the current study, the functional activity of brain during an event monitoring task was investigated and compared between two cognitive domains, whose processing is mediated by differently lateralized areas. Namely, participants were asked to monitor sequences of either faces (supported by right-hemisphere regions) or tools (left-hemisphere). In order to disentangle sustained from transient components of monitoring, a simultaneous EEG-fMRI technique was adopted within a block design. When contrasting monitoring versus control blocks, the conventional fMRI analysis revealed the sustained involvement of bilateral fronto-parietal regions, in both task domains. Event-related potentials (ERPs) showed a more positive amplitude over frontal sites in monitoring compared to control blocks, providing evidence of a transient monitoring component. The joint ERP-fMRI analysis showed that, in the case of face monitoring, this transient component relies on right-lateralized areas, including the inferior parietal lobule and the middle frontal gyrus. In the case of tools, no fronto-parietal areas correlated with the transient ERP activity, suggesting that in this domain phasic monitoring processes were masked by tonic ones. Overall, the present findings highlight the role of bilateral fronto-parietal regions in sustained monitoring, independently of the specific task requirements, and suggest that right-lateralized areas subtend transient monitoring processes, at least in some task contexts.

A multimodal encoding model applied to imaging decision-related neural cascades in the human brain

Perception and cognition in the brain are naturally characterized as spatiotemporal processes. Decision-making, for example, depends on coordinated patterns of neural activity cascading across the brain, running in time from stimulus to response and in space from primary sensory regions to the frontal lobe. Measuring this cascade is key to developing an understanding of brain function. Here we report on a novel methodology that employs multi-modal imaging for inferring this cascade in humans at unprecedented spatiotemporal resolution. Specifically, we develop an encoding model to link simultaneously measured electroencephalography (EEG) and functional magnetic resonance imaging (fMRI) signals to infer high-resolution spatiotemporal brain dynamics during a perceptual decision. After demonstrating replication of results from the literature, we report previously unobserved sequential reactivation of a substantial fraction of the pre-response network whose magnitude correlates with a proxy for decision confidence. Our encoding model, which temporally tags BOLD activations using time localized EEG variability, identifies a coordinated and spatially distributed neural cascade that is associated with a perceptual decision. In general the methodology illuminates complex brain dynamics that would otherwise be unobservable using fMRI or EEG acquired separately.

Decision ambiguity is mediated by a late positive potential originating from cingulate cortex

People often make decisions in the face of ambiguous information, but it remains unclear how ambiguity is represented in the brain. We used three types of ambiguous stimuli and combined EEG and fMRI to examine the neural representation of perceptual decisions under ambiguity. We identified a late positive potential, the LPP, which differentiated levels of ambiguity, and which was specifically associated with behavioral judgments about choices that were ambiguous, rather than passive perception of ambiguous stimuli. Mediation analyses together with two further control experiments confirmed that the LPP was generated only when decisions are made (not during mere perception of ambiguous stimuli), and only when those decisions involved choices on a dimension that is ambiguous. A further control experiment showed that a stronger LPP arose in the presence of ambiguous stimuli compared to when only unambiguous stimuli were present. Source modeling suggested that the LPP originated from multiple loci in cingulate cortex, a finding we further confirmed using fMRI and fMRI-guided ERP source prediction. Taken together, our findings argue for a role of an LPP originating from cingulate cortex in encoding decisions based on task-relevant perceptual ambiguity, a process that may in turn influence confidence judgment, response conflict, and error correction.

Facial identity and emotional expression as predictors during economic decisions

Two sources of information most relevant to guide social decision making are the cooperative tendencies associated with different people and their facial emotional displays. This electrophysiological experiment aimed to study how the use of personal identity and emotional expressions as cues impacts different stages of face processing and their potential isolated or interactive processing. Participants played a modified trust game with 8 different alleged partners, and in separate blocks either the identity or the emotions carried information regarding potential trial outcomes (win or loss). Behaviorally, participants were faster to make decisions based on identity compared to emotional expressions. Also, ignored (nonpredictive) emotions interfered with decisions based on identity in trials where these sources of information conflicted. Electrophysiological results showed that expectations based on emotions modulated processing earlier in time than those based on identity. Whereas emotion modulated the central N1 and VPP potentials, identity judgments heightened the amplitude of the N2 and P3b. In addition, the conflict that ignored emotions generated was reflected on the N170 and P3b potentials. Overall, our results indicate that using identity or emotional cues to predict cooperation tendencies recruits dissociable neural circuits from an early point in time, and that both sources of information generate early and late interactive patterns.

Stimulation of subgenual cingulate area decreases limbic top-down effect on ventral visual stream: A DBS-EEG pilot study

Deep brain stimulation (DBS) of the subgenual cingulate gyrus (area CG25) is beneficial in treatment resistant depression. Though the mechanisms of action of Cg25 DBS remain largely unknown, it is commonly believed that Cg25 DBS modulates limbic activity of large networks to achieve thymic regulation of patients. To investigate how emotional attention is influenced by Cg25 DBS, we assessed behavioral and electroencephalographic (EEG) responses to an emotional Stroop task in 5 patients during ON and OFF stimulation conditions. Using EEG source localization, we found that the main effect of DBS was a reduction of neuronal responses in limbic regions (temporal pole, medial prefrontal and posterior cingulate cortices) and in ventral visual areas involved in face processing. In the dynamic causal modeling (DCM) approach, the changes of the evoked response amplitudes are assumed to be due to changes of long range connectivity induced by Cg25 DBS. Here, using a simplified neural mass model that did not take explicitly into account the cytoarchitecture of the considered brain regions, we showed that the remote action of Cg25 DBS could be explained by a reduced top-down effective connectivity of the amygdalo-temporo-polar complex. Overall, our results thus indicate that Cg25 DBS during the emotional Stroop task causes a decrease of top-down limbic influence on the ventral visual stream itself, rather than a modulation of prefrontal cognitive processes only. Tuning down limbic excitability in relation to sensory processing might be one of the biological mechanisms through which Cg25 DBS produces positive clinical outcome in the treatment of resistant depression.

The Deceptively Simple N170 Reflects Network Information Processing Mechanisms Involving Visual Feature Coding and Transfer Across Hemispheres

A key to understanding visual cognition is to determine “where”, “when”, and “how” brain responses reflect the processing of the specific visual features that modulate categorization behavior—the “what”. The N170 is the earliest Event-Related Potential (ERP) that preferentially responds to faces. Here, we demonstrate that a paradigmatic shift is necessary to interpret the N170 as the product of an information processing network that dynamically codes and transfers face features across hemispheres, rather than as a local stimulus-driven event. Reverse-correlation methods coupled with information-theoretic analyses revealed that visibility of the eyes influences face detection behavior. The N170 initially reflects coding of the behaviorally relevant eye contralateral to the sensor, followed by a causal communication of the other eye from the other hemisphere. These findings demonstrate that the deceptively simple N170 ERP hides a complex network information processing mechanism involving initial coding and subsequent cross-hemispheric transfer of visual features.

Supervised learning for neural manifold using spatiotemporal brain activity

OBJECTIVE

Determining the means by which perceived stimuli are compactly represented in the human brain is a difficult task. This study aimed to develop techniques for the construction of the neural manifold as a representation of visual stimuli.

APPROACH

We propose a supervised locally linear embedding method to construct the embedded manifold from brain activity, taking into account similarities between corresponding stimuli. In our experiments, photographic portraits were used as visual stimuli and brain activity was calculated from magnetoencephalographic data using a source localization method.

MAIN RESULTS

The results of 10 × 10-fold cross-validation revealed a strong correlation between manifolds of brain activity and the orientation of faces in the presented images, suggesting that high-level information related to image content can be revealed in the brain responses represented in the manifold.

SIGNIFICANCE

Our experiments demonstrate that the proposed method is applicable to investigation into the inherent patterns of brain activity.

Maternal sensitivity, infant limbic structure volume and functional connectivity: a preliminary study

Mechanisms underlying the profound parental effects on cognitive, emotional and social development in humans remain poorly understood. Studies with nonhuman models suggest variations in parental care affect the limbic system, influential to learning, autobiography and emotional regulation. In some research, nonoptimal care relates to decreases in neurogenesis, although other work suggests early-postnatal social adversity accelerates the maturation of limbic structures associated with emotional learning. We explored whether maternal sensitivity predicts human limbic system development and functional connectivity patterns in a small sample of human infants. When infants were 6 months of age, 20 mother-infant dyads attended a laboratory-based observational session and the infants underwent neuroimaging at the same age. After considering age at imaging, household income and postnatal maternal anxiety, regression analyses demonstrated significant indirect associations between maternal sensitivity and bilateral hippocampal volume at six months, with the majority of associations between sensitivity and the amygdala demonstrating similar indirect, but not significant results. Moreover, functional analyses revealed direct associations between maternal sensitivity and connectivity between the hippocampus and areas important for emotional regulation and socio-emotional functioning. Sensitivity additionally predicted indirect associations between limbic structures and regions related to autobiographical memory. Our volumetric results are consistent with research indicating accelerated limbic development in response to early social adversity, and in combination with our functional results, if replicated in a larger sample, may suggest that subtle, but important, variations in maternal care influence neuroanatomical trajectories important to future cognitive and emotional functioning.

Multimodal neuroimaging computing: the workflows, methods, and platforms

The last two decades have witnessed the explosive growth in the development and use of noninvasive neuroimaging technologies that advance the research on human brain under normal and pathological conditions. Multimodal neuroimaging has become a major driver of current neuroimaging research due to the recognition of the clinical benefits of multimodal data, and the better access to hybrid devices. Multimodal neuroimaging computing is very challenging, and requires sophisticated computing to address the variations in spatiotemporal resolution and merge the biophysical/biochemical information. We review the current workflows and methods for multimodal neuroimaging computing, and also demonstrate how to conduct research using the established neuroimaging computing packages and platforms.

Multimodal neuroimaging computing: a review of the applications in neuropsychiatric disorders

Multimodal neuroimaging is increasingly used in neuroscience research, as it overcomes the limitations of individual modalities. One of the most important applications of multimodal neuroimaging is the provision of vital diagnostic data for neuropsychiatric disorders. Multimodal neuroimaging computing enables the visualization and quantitative analysis of the alterations in brain structure and function, and has reshaped how neuroscience research is carried out. Research in this area is growing exponentially, and so it is an appropriate time to review the current and future development of this emerging area. Hence, in this paper, we review the recent advances in multimodal neuroimaging (MRI, PET) and electrophysiological (EEG, MEG) technologies, and their applications to the neuropsychiatric disorders. We also outline some future directions for multimodal neuroimaging where researchers will design more advanced methods and models for neuropsychiatric research.

Brain signatures of perceiving a smile: Time course and source localization

Facial happiness is consistently recognized faster than other expressions of emotion. In this study, to determine when and where in the brain such a recognition advantage develops, EEG activity during an expression categorization task was subjected to temporospatial PCA analysis and LAURA source localizations. Happy, angry, and neutral faces were presented either in whole or bottom-half format (with the mouth region visible). The comparison of part- versus whole-face conditions served to examine the role of the smile. Two neural signatures underlying the happy face advantage emerged. One peaked around 140 ms (left N140) and was source-located at the left IT cortex (MTG), with greater activity for happy versus non-happy faces in both whole and bottom-half face format. This suggests an enhanced perceptual encoding mechanism for salient smiles. The other peaked around 370 ms (P3b and N3) and was located at the right IT (FG) and dorsal cingulate (CC) cortices, with greater activity specifically for bottom-half happy versus non-happy faces. This suggests an enhanced recruitment of face-specific information to categorize (or reconstruct) facial happiness from diagnostic smiling mouths. Additional differential brain responses revealed a specific "anger effect," with greater activity for angry versus non-angry expressions (right N170 and P230; right pSTS and IPL); and a coarse "emotion effect," with greater activity for happy and angry versus neutral expressions (anterior P2 and posterior N170; vmPFC and right IFG).

Brain Signals of Face Processing as Revealed by Event-Related Potentials

We analyze the functional significance of different event-related potentials (ERPs) as electrophysiological indices of face perception and face recognition, according to cognitive and neurofunctional models of face processing. Initially, the processing of faces seems to be supported by early extrastriate occipital cortices and revealed by modulations of the occipital P1. This early response is thought to reflect the detection of certain primary structural aspects indicating the presence grosso modo of a face within the visual field. The posterior-temporal N170 is more sensitive to the detection of faces as complex-structured stimuli and, therefore, to the presence of its distinctive organizational characteristics prior to within-category identification. In turn, the relatively late and probably more rostrally generated N250r and N400-like responses might respectively indicate processes of access and retrieval of face-related information, which is stored in long-term memory (LTM). New methods of analysis of electrophysiological and neuroanatomical data, namely, dynamic causal modeling, single-trial and time-frequency analyses, are highly recommended to advance in the knowledge of those brain mechanisms concerning face processing.