Fearful face scrambles increase early visual sensory processing in the absence of face information

How and when social evaluative feedback is processed in the brain: A systematic review on ERP studies

Social evaluative feedback informs the receiver of the other's views, which may contain judgments of personality-related traits and/or the level of likability. Such kinds of social evaluative feedback are of particular importance to humans. Event-related potentials (ERPs) can directly measure where in the processing stream feedback valence, expectancy, or contextual relevance modulate information processing. This review provides an overview and systematization of studies and early, mid-latency, and late ERP effects. Early effects were inconsistently reported for all factors. Feedback valence effects are more consistently reported for specific mid-latency ERPs (Reward Positivity, RewP, and Early Posterior Negativity, EPN) and late positivities (P3 and Late Positive Potential, LPP). Unexpected feedback consistently increased the Feedback Related Negativity (FRN) and, less consistently, decreased P3 amplitudes. Contextual relevance of the sender (e.g., human vs computer sender) or self-relatedness increased mid-latency to late ERPs. Interactions between valence and other factors were less often found, arising during mid-latency stages, where most consistent interactions showed larger EPN and P3 amplitude differences for valent feedback in a more relevant context. The ERP findings highlight that social evaluative feedback is consistently differentiated during mid-latency processing stages. The review discusses the relevance of findings, possible shortcomings of different experimental designs, and open questions. Furthermore, we suggest concrete venues for future research.

Mass-univariate analysis of scalp ERPs reveals large effects of gaze fixation location during face processing that only weakly interact with face emotional expression

Decoding others' facial expressions is critical for social functioning. To clarify the neural correlates of expression perception depending on where we look on the face, three combined gaze-contingent ERP experiments were analyzed using robust mass-univariate statistics. Regardless of task, fixation location impacted face processing from 50 to 350 ms, maximally around 120 ms, reflecting retinotopic mapping around C2 and P1 components. Fixation location also impacted majorly the N170-P2 interval while weak effects were seen at the face-sensitive N170 peak. Results question the widespread assumption that faces are processed holistically into an indecomposable perceptual whole around the N170. Rather, face processing is a complex and view-dependent process that continues well beyond the N170. Expression and fixation location interacted weakly during the P1-N170 interval, supporting a role for the mouth and left eye in fearful and happy expression decoding. Expression effects were weakest at the N170 peak but strongest around P2, especially for fear, reflecting task-independent affective processing. Results suggest N170 reflects a transition between processes rather than the maximum of a holistic face processing stage. Focus on this peak should be replaced by data-driven analyses of the epoch using robust statistics to fully unravel the early visual processing of faces and their affective content.

Dissociating different temporal stages of emotional word processing by feature-based attention

Negative emotional content is prioritized across different stages of information processing as reflected by different components of the event-related potential (ERP). In this preregistered study (N = 40), we investigated how varying the attentional focus allows us to dissociate the involvement of specific ERP components in the processing of negative and neutral words. Participants had to discriminate the orientation of lines overlaid onto the words, the word type (adjective/noun), or the emotional content (negative/neutral). Thus, attention was either not focused on words (distraction task), non-emotional aspects, or the emotional relevance of words. Regardless of the task, there were no significant differences between negative and neutral words for the P1, N1, or P2 components. In contrast, interactions between emotion and task were observed for the early posterior negativity (EPN) and late positive potential (LPP). EPN differences were absent during the distraction task but were present in the other two tasks. LPP emotion differences were found only when attention was directed to the emotional content of words. Our study adds to the evidence that early ERP components do not reliably separate negative and neutral words. However, results show that mid-latency and late stages of emotion processing are separable by different attention tasks. The EPN represents a stage of attentional enhancement of negative words given sufficient attentional resources. Differential activations during the LPP stage are associated with more elaborative processing of the emotional meaning of words.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Early neural potentiation to centrally and peripherally presented fear-conditioned faces

For humans, it is vitally important to rapidly detect and process threatening signals regardless of whether stimuli occur at fixation or in the periphery. However, it is unknown whether eccentricity affects early neuronal electrophysiological responses to fear-conditioned stimuli. We examined early event-related potentials (ERPs) of the electroencephalogram (EEG) to fear-conditioned faces to address this question. Participants (N = 80) were presented with faces, either paired with an aversive (CS+) or neutral sound (CS-), at central or peripheral positions. We ensured constant central fixation using online eye-tracking but directed attention to either centrally or peripherally presented faces. Manipulation checks showed successful fear-conditioning (i.e., on average lower ratings in valence and higher ratings in arousal and perceived threat) and successful shifts of visuospatial attention indexed by high task performance and pre-stimulus alpha lateralization of the EEG spectra. We observed a generally increased P1 to fear-conditioned faces regardless of presentation location. An N170 difference between fear-conditioned and neutral stimuli was found but was restricted to the central location and depended on the effectivity of fear-conditioning. A similar effect was observed for the early posterior negativity (EPN). Trait anxiety was not related to differential ERP responses to CS+ versus CS- faces for any ERP component. These findings suggest that the P1 indexes early responses to centrally and peripherally presented fear-conditioned faces. Subsequent stages are modulated by the spatial location of the stimuli. This suggests different stages of neural processing of fear-conditioned faces depending on their spatial location. Finally, our results question the hypothesis that trait anxiety in healthy participants is related to altered visual processing of fear-conditioned faces.

Potentiated early neural responses to fearful faces are not driven by specific face parts

Prioritized processing of fearful compared to neutral faces is reflected in increased amplitudes of components of the event-related potential (ERP). It is unknown whether specific face parts drive these modulations. Here, we investigated the contributions of face parts on ERPs to task-irrelevant fearful and neutral faces using an ERP-dependent facial decoding technique and a large sample of participants (N = 83). Classical ERP analyses showed typical and robust increases of N170 and EPN amplitudes by fearful relative to neutral faces. Facial decoding further showed that the absolute amplitude of these components, as well as the P1, was driven by the low-frequency contrast of specific face parts. However, the difference between fearful and neutral faces was not driven by any specific face part, as supported by Bayesian statistics. Furthermore, there were no correlations between trait anxiety and main effects or interactions. These results suggest that increased N170 and EPN amplitudes to task-irrelevant fearful compared to neutral faces are not driven by specific facial regions but represent a holistic face processing effect.

The role of phase and orientation for ERP modulations of spectrum-manipulated fearful and neutral faces

Prioritized processing of fearful compared to neutral faces has been proposed to result from evolutionary adaptation of the contrast sensitivity function (CSF) to the features of emotionally relevant faces and/or vice versa. However, it is unknown whether a stimulus merely has to feature the amplitude spectrum of a fearful face to be prioritized or whether the relevant spatial frequencies have to occur with specific phases and orientations. Prioritized processing is indexed by specific increases of Event-Related Potentials (ERPs) of the EEG and occurs throughout different early processing stages, indexed by emotion-related modulations of the P1, N170, and EPN. In this pre-registered study, we manipulated phase and amplitude properties of the Fourier spectra of neutral and fearful faces to test the effect of phase coherence (PC, face vs. scramble) and orientation coherence (OC, original vs. rotational average) and their interactions with differential emotion processing. We found that differential emotion processing was not present at the level of P1 but strongly affected N170 and EPN. In both cases, intact phase coherence was required for enhanced processing of fearful faces. OC did not interact with emotion. While faces produced the typical N170 effect, we observed a reversed effect for scrambles. Additional exploratory independent component analysis (ICA) suggests that this reversal could signal a mismatch between an early "perceptual hypothesis" and feedback of configural information. In line with our expectations, fearful-neutral differences for the N170 and EPN depend on configural information, i.e., recognizable faces.

Early ERP functions are indexed by lateralized effects to peripherally presented emotional faces and scrambles

A large body of research suggests that early event-related potentials (ERPs), such as the P1 and N1, are potentiated by attention and represent stimulus amplification. However, recent accounts suggest that the P1 is associated with inhibiting the irrelevant visual field evidenced by a pronounced ipsilateral P1 during sustained attention to peripherally presented stimuli. The current EEG study further investigated this issue to reveal how lateralized ERP findings are modulated by face and emotional information. Therefore, participants were asked to fixate the center of the screen and pay sustained attention either to the right or left visual field, where angry or neutral faces or their Fourier phase-scrambled versions were presented. We found a bilateral P1 to all stimuli with relatively increased, but delayed, ipsilateral P1 amplitudes to faces but not to scrambles. Explorative independent component analyses dissociated an earlier lateralized larger contralateral P1 from a later bilateral P1. By contrast, the N170 showed a contralateral enhancement to all stimuli, which was most pronounced for neutral faces attended in the left hemifield. Finally, increased contralateral alpha power was found for both attended hemifields but was not significantly related to poststimulus ERPs. These results provide evidence against a general inhibitory role of the P1 but suggest stimulus-specific relative enhancements of the ipsilateral P1 for the irrelevant visual hemifield. The lateralized N170, however, is associated with stimulus amplification as a function of facial features.

Top-Down Modulation of Early Visual Processing in V1: Dissociable Neurophysiological Effects of Spatial Attention, Attentional Load and Task-Relevance

Until today, there is an ongoing discussion if attention processes interact with the information processing stream already at the level of the C1, the earliest visual electrophysiological response of the cortex. We used two highly powered experiments (each N = 52) and examined the effects of task relevance, spatial attention, and attentional load on individual C1 amplitudes for the upper or lower visual hemifield. Bayesian models revealed evidence for the absence of load effects but substantial modulations by task-relevance and spatial attention. When the C1-eliciting stimulus was a task-irrelevant, interfering distracter, we observed increased C1 amplitudes for spatially unattended stimuli. For spatially attended stimuli, different effects of task-relevance for the two experiments were found. Follow-up exploratory single-trial analyses revealed that subtle but systematic deviations from the eye-gaze position at stimulus onset between conditions substantially influenced the effects of attention and task relevance on C1 amplitudes, especially for the upper visual field. For the subsequent P1 component, attentional modulations were clearly expressed and remained unaffected by these deviations. Collectively, these results suggest that spatial attention, unlike load or task relevance, can exert dissociable top-down modulatory effects at the C1 and P1 levels.

Electrophysiological responses to negative evaluative person-knowledge: Effects of individual differences

Faces transmit rich information about a unique personal identity. Recent studies examined how negative evaluative information affects event-related potentials (ERPs), the relevance of individual differences, such as trait anxiety, neuroticism, or agreeableness, for these effects is unclear. In this preregistered study, participants (N = 80) were presented with neutral faces, either associated with highly negative or neutral biographical information. Faces were shown under three different task conditions that varied the attentional focus on face-unrelated features, perceptual face information, or emotional information. Results showed a task-independent increase of the N170 component for faces associated with negative information, while interactions occurred for the Early Posterior Negativity (EPN) and the Late Positive Potential (LPP), showing ERP differences only when paying attention to the evaluative information. Trait anxiety and neuroticism did not influence ERP differences. Low agreeableness increased EPN differences during perceptual distraction. Thus, we observed that low agreeableness leads to early increased processing of potentially hostile faces, although participants were required to attend to a face-unrelated feature.

Face and emotional expression processing under continuous perceptual load tasks: An ERP study

High perceptual load is thought to impair already the early stages of visual processing of task-irrelevant visual stimuli. However, recent studies showed no effects of perceptual load on early ERPs in response to task-irrelevant emotional faces. In this preregistered EEG study (N = 40), we investigated the effects of continuous perceptual load on ERPs to fearful and neutral task-irrelevant faces and their phase-scrambled versions. Perceptual load did not modulate face or emotion effects for the P1 or N170. In contrast, larger face-scramble and fearful-neutral differentiation were found during low as compared to high load for the Early Posterior Negativity (EPN). Further, face-independent P1, but face-dependent N170 emotional modulations were observed. Taken together, our findings show that P1 and N170 face and emotional modulations are highly resistant to load manipulations, indicating a high degree of automaticity during this processing stage, whereas the EPN might represent a bottleneck in visual information processing.