Modulation of face- and emotion-selective ERPs by the three most common types of face image manipulations

Is processing superiority a universal trait for all threats? Divergent impacts of fearful, angry, and disgusted faces on attentional capture

Fearful, angry, and disgusted facial expressions are evolutionarily salient and convey different types of threat signals. However, it remains unclear whether these three expressions impact sensory perception and attention in the same way. The present ERP study investigated the temporal dynamics underlying the processing of different types of threatening faces and the impact of attentional resources employed during a perceptual load task. Participants were asked to judge the length of bars superimposed over faces presented in the center of the screen. A mass univariate statistical approach was used to analyze the EEG data. Behaviorally, task accuracy was significantly reduced following exposure to fearful faces relative to neutral distractors, independent of perceptual load. The ERP results revealed that the P1 amplitude over the right hemisphere was found to be enhanced for fearful relative to disgusted faces, reflecting the rapid and coarse detection of fearful cues. The N170 responses elicited by fearful, angry, and disgusted faces were larger than those elicited by neutral faces, suggesting the largely automatic and preferential processing of threats. Furthermore, the early posterior negativity (EPN) component yielded increased responses to fearful and angry faces, indicating prioritized attention to stimuli representing acute threats. Additionally, perceptual load exerted a pronounced influence on the EPN and late positive potential (LPP), with larger responses observed in the low perceptual load condition, indicating goal-directed cognitive processing. Overall, the early sensory processing of fearful, angry, and disgusted faces is characterized by differential sensitivity in capturing attention automatically, despite the importance of these facial signals for survival. Fearful faces produce a strong interference effect and are processed with higher priority than angry and disgusted ones.

Measurement of event-related potentials from electroencephalography to evaluate emotional processing in Fibromyalgia Syndrome: A systematic review and meta-analysis

OBJECTIVE

The present systematic review and meta-analysis intended to: 1) determine the extent of abnormalities in emotional processing linked to emotional event-related potentials (ERPs) in Fibromyalgia Syndrome (FMS) and 2) integrate data from similar emotional tasks into a meta-analysis to clearly demonstrate the scientific and clinical value of measuring emotional ERPs by electroencephalography (EEG) in FMS.

METHODS

A systematic review and meta-analysis of studies comparing emotional processing indicated by ERPs in FMS patients and healthy controls was conducted. Fifteen articles were included in the systematic review after applying the eligibility criteria.

RESULTS

Nine articles demonstrated disturbances in emotional processing in FMS. These emotional disturbances were distributed over the whole range of ERP latencies, mainly over central, parietal, temporal and occipital areas. Despite of this, quantitative analysis revealed only significant differences in N250 and LPP/LPC between FMS patients and healthy controls, with smaller LPP/LPC and greater N250 seen in FMS.

DISCUSSION

N250 and LPP/LPC seem to be the ERPs with the greatest potential to determine emotional alterations in FMS. These ERPs are related to complex cognitive processes such as decoding features relevant to affect recognition (N250) as well differentiation between emotions, persistent engagement, conflict resolution or evaluation of emotional intensity (LPC/LPP). However, differences in task setup had an important impact on the variation of ERP outcomes. Systematization of protocols and tasks is indispensable for future studies.

An EPR study of the cognitive processes underlying the impact of self-relevant information on emotional word processing

Using the event-related potentials (ERPs) technique, this study successively presented names (in either a supra- or subthreshold manner) and emotional words to examine how self-relevant cue (self-name) affects emotional word processing in word class judgment task (to determine whether an emotional word is a noun or adjective) and valence judgment task (to determine whether an emotional word is positive or negative). At the suprathreshold condition, self-relevant positive words elicited a more significant Early posterior negativity (EPN) than negative words only in the valence judgment task. In contrast, at the subthreshold condition, self-relevant negative words elicited an enhanced Late positive potential (LPP) than positive words only in the word class judgment task. These results indicate that self-relevant cue affects emotional word processing at both suprathreshold and subthreshold conditions; nevertheless, the effect manifests as self-positive bias at the suprathreshold condition and self-negative bias at the subthreshold condition. The experimental task modulates these dynamics.

Emotional Prototypicality Ratings for 636 Chinese Words: A Database of Chinese Words with Affective Information

Exemplars of concepts vary in their degree of prototypicality. This is also true for emotion concepts. This study presents prototypicality ratings for a large set of Chinese words. The database contains 636 potential Chinese emotion words (i.e., words that directly express particular emotions, like " happy" and " sad"), from different grammatical categories. Native Chinese speakers rated the words in terms of emotional prototypicality. The database also contains values for valence, arousal, and emotionality. The analyses of the ratings revealed that 502 out of 636 words had a high prototypicality value (value equal to or above three on a 1-to-5 scale), the most prototypical words being negative and high-arousal words. The analyses also indicated that the emotional prototypicality of a word was positively related to both arousal and emotionality, and negatively related to valence. Among these variables, arousal was the most important contributor. Similar results have been found in studies conducted in other languages. This will be a useful resource for researchers interested in studying emotion words in the Chinese language and for those interested in cross-linguistic comparisons.

Mass-univariate analysis of scalp ERPs reveals large effects of gaze fixation location during face processing that only weakly interact with face emotional expression

Decoding others' facial expressions is critical for social functioning. To clarify the neural correlates of expression perception depending on where we look on the face, three combined gaze-contingent ERP experiments were analyzed using robust mass-univariate statistics. Regardless of task, fixation location impacted face processing from 50 to 350 ms, maximally around 120 ms, reflecting retinotopic mapping around C2 and P1 components. Fixation location also impacted majorly the N170-P2 interval while weak effects were seen at the face-sensitive N170 peak. Results question the widespread assumption that faces are processed holistically into an indecomposable perceptual whole around the N170. Rather, face processing is a complex and view-dependent process that continues well beyond the N170. Expression and fixation location interacted weakly during the P1-N170 interval, supporting a role for the mouth and left eye in fearful and happy expression decoding. Expression effects were weakest at the N170 peak but strongest around P2, especially for fear, reflecting task-independent affective processing. Results suggest N170 reflects a transition between processes rather than the maximum of a holistic face processing stage. Focus on this peak should be replaced by data-driven analyses of the epoch using robust statistics to fully unravel the early visual processing of faces and their affective content.

Beyond facial expressions: A systematic review on effects of emotional relevance of faces on the N170

The N170 is the most prominent electrophysiological signature of face processing. While facial expressions reliably modulate the N170, there is considerable variance in N170 modulations by other sources of emotional relevance. Therefore, we systematically review and discuss this research area using different methods to manipulate the emotional relevance of inherently neutral faces. These methods were categorized into (1) existing pre-experimental affective person knowledge (e.g., negative attitudes towards outgroup faces), (2) experimentally instructed affective person knowledge (e.g., negative person information), (3) contingency-based affective learning (e.g., fear-conditioning), or (4) the immediate affective context (e.g., emotional information directly preceding the face presentation). For all categories except the immediate affective context category, the majority of studies reported significantly increased N170 amplitudes depending on the emotional relevance of faces. Furthermore, the potentiated N170 was observed across different attention conditions, supporting the role of the emotional relevance of faces on the early prioritized processing of configural facial information, regardless of low-level differences. However, we identified several open research questions and suggest venues for further research.

Deepfake smiles matter less-the psychological and neural impact of presumed AI-generated faces

High-quality AI-generated portraits ("deepfakes") are becoming increasingly prevalent. Understanding the responses they evoke in perceivers is crucial in assessing their societal implications. Here we investigate the impact of the belief that depicted persons are real or deepfakes on psychological and neural measures of human face perception. Using EEG, we tracked participants' (N = 30) brain responses to real faces showing positive, neutral, and negative expressions, after being informed that they are either real or fake. Smiling faces marked as fake appeared less positive, as reflected in expression ratings, and induced slower evaluations. Whereas presumed real smiles elicited canonical emotion effects with differences relative to neutral faces in the P1 and N170 components (markers of early visual perception) and in the EPN component (indicative of reflexive emotional processing), presumed deepfake smiles showed none of these effects. Additionally, only smiles presumed as fake showed enhanced LPP activity compared to neutral faces, suggesting more effortful evaluation. Negative expressions induced typical emotion effects, whether considered real or fake. Our findings demonstrate a dampening effect on perceptual, emotional, and evaluative processing of presumed deepfake smiles, but not angry expressions, adding new specificity to the debate on the societal impact of AI-generated content.

Early neural potentiation to centrally and peripherally presented fear-conditioned faces

For humans, it is vitally important to rapidly detect and process threatening signals regardless of whether stimuli occur at fixation or in the periphery. However, it is unknown whether eccentricity affects early neuronal electrophysiological responses to fear-conditioned stimuli. We examined early event-related potentials (ERPs) of the electroencephalogram (EEG) to fear-conditioned faces to address this question. Participants (N = 80) were presented with faces, either paired with an aversive (CS+) or neutral sound (CS-), at central or peripheral positions. We ensured constant central fixation using online eye-tracking but directed attention to either centrally or peripherally presented faces. Manipulation checks showed successful fear-conditioning (i.e., on average lower ratings in valence and higher ratings in arousal and perceived threat) and successful shifts of visuospatial attention indexed by high task performance and pre-stimulus alpha lateralization of the EEG spectra. We observed a generally increased P1 to fear-conditioned faces regardless of presentation location. An N170 difference between fear-conditioned and neutral stimuli was found but was restricted to the central location and depended on the effectivity of fear-conditioning. A similar effect was observed for the early posterior negativity (EPN). Trait anxiety was not related to differential ERP responses to CS+ versus CS- faces for any ERP component. These findings suggest that the P1 indexes early responses to centrally and peripherally presented fear-conditioned faces. Subsequent stages are modulated by the spatial location of the stimuli. This suggests different stages of neural processing of fear-conditioned faces depending on their spatial location. Finally, our results question the hypothesis that trait anxiety in healthy participants is related to altered visual processing of fear-conditioned faces.

Potentiated early neural responses to fearful faces are not driven by specific face parts

Prioritized processing of fearful compared to neutral faces is reflected in increased amplitudes of components of the event-related potential (ERP). It is unknown whether specific face parts drive these modulations. Here, we investigated the contributions of face parts on ERPs to task-irrelevant fearful and neutral faces using an ERP-dependent facial decoding technique and a large sample of participants (N = 83). Classical ERP analyses showed typical and robust increases of N170 and EPN amplitudes by fearful relative to neutral faces. Facial decoding further showed that the absolute amplitude of these components, as well as the P1, was driven by the low-frequency contrast of specific face parts. However, the difference between fearful and neutral faces was not driven by any specific face part, as supported by Bayesian statistics. Furthermore, there were no correlations between trait anxiety and main effects or interactions. These results suggest that increased N170 and EPN amplitudes to task-irrelevant fearful compared to neutral faces are not driven by specific facial regions but represent a holistic face processing effect.

Testing stimulus exposure time as the critical factor of increased EPN and LPP amplitudes for fearful faces during perceptual distraction tasks

Fearful facial expressions are prioritized across different information processing stages, as evident in early, intermediate, and late components of event-related brain potentials (ERPs). Recent studies showed that, in contrast to early N170 modulations, mid-latency (Early Posterior Negativity, EPN) and late (Late Positive Potential, LPP) emotional modulations depend on the attended perceptual feature. Nevertheless, several studies reported significant differences between emotional and neutral faces for the EPN or LPP components during distraction tasks. One cause for these conflicting findings might be that when faces are presented sufficiently long, participants attend to task-irrelevant features of the faces. In this registered report, we tested whether the presentation duration of faces is the critical factor for differences between reported emotional modulations during perceptual distraction tasks. To this end, 48 participants were required to discriminate the orientation of lines overlaid onto fearful or neutral faces, while face presentation varied (100 msec, 300 msec, 1,000 msec, 2,000 msec). While participants did not need to pay attention to the faces, we observed main effects of emotion for the EPN and LPP, but no interaction between emotion and presentation duration. Of note, unregistered exploratory tests per presentation duration showed no significant EPN and LPP emotion differences during short durations (100 and 300 msec) but significant differences with longer durations. While the presentation duration seems not to be a critical factor for EPN and LPP emotion effects, future studies are needed to investigate the role of threshold effects and the applied analytic designs to explain conflicting findings in the literature.

Estimation Strategy Utilization Is Modulated by Implicit Emotion Regulation: Evidence from Behavioral and Event-Related Potentials Studies

A large number of studies have studied the influence of emotional experience on an individual's estimation performance, but the influence of implicit emotion regulation is still unknown. Participants were asked to complete the following tasks in order: idiom matching task, multiplication computational estimation task (MCE task), gender judgment task (GJ task), and emotional experience intensity assessment task. The words matching task was adopted to achieve the purpose of implicit emotion regulation (implicit reappraisal and implicit suppression). Behavioral results showed that implicit reappraisal and implicit suppression equally contributed to improving an individual's estimation speed (but not ACC (accuracy)). The MCE task related ERP (event-related potential) results showed that the influence of implicit emotion regulation on estimation consisted of two phases. In the first phase (encoding phase), implicit reappraisal both enhanced (larger P1 amplitudes) and weakened (smaller N170 amplitudes) an individual's encoding sensitivity, while implicit suppression enhanced an individual's encoding sensitivity (larger P1 amplitudes). In the second phase (estimation strategies retrieval phase), implicit reappraisal (but not implicit suppression) cost more attention resources (larger LPC2 and LPC3 amplitudes). The present study suggested that both implicit reappraisal and implicit suppression contributed to improving an individual's estimation performance, and the regulation effect of implicit suppression (vs. implicit reappraisal) was better.

The time course of categorical perception of facial expressions

Decoding emotions on others' faces is one of the most important functions of the human brain, which has been widely studied in cognitive neuroscience. However, the precise time course of facial expression categorization in the human brain is still a matter of debate. Here we used an original paradigm to measure categorical perception of facial expression changes during event-related potentials (ERPs) recording, in which a face stimulus dynamically switched either to a different expression (between-category condition) or to the same expression (within-category condition), the physical distance between the two successive faces being equal across conditions. The switch between faces generated a negative differential potential peaking at around 160 ms over occipito-temporal regions, similar in term of latency and topography to the well-known face-selective N170 component. This response was larger in the condition where the switch occurred between faces that were perceived as having different facial expressions compared to the same expression. In addition, happy expressions were categorized around 20 ms faster than fearful expressions (respectively, 135 and 156 ms). These findings provide evidence that changes of facial expressions are categorically perceived as early as 160 ms following stimulus onset over the occipito-temporal cortex.

Are you for real? Decoding realistic AI-generated faces from neural activity

Can we trust our eyes? Until recently, we rarely had to question whether what we see is indeed what exists, but this is changing. Artificial neural networks can now generate realistic images that challenge our perception of what is real. This new reality can have significant implications for cybersecurity, counterfeiting, fake news, and border security. We investigated how the human brain encodes and interprets realistic artificially generated images using behaviour and brain imaging. We found that we could reliably decode AI generated faces using people's neural activity. However, while at a group level people performed near chance classifying real and realistic fakes, participants tended to interchange the labels, classifying real faces as realistic fakes and vice versa. Understanding this difference between brain and behavioural responses may be key in determining the 'real' in our new reality. Stimuli, code, and data for this study can be found at https://osf.io/n2z73/.

The ERP and psychophysical changes related to facial emotion perception by expertise in Japanese hospitality, "OMOTENASHI"

We investigated the emotion perception process based on hospitality expertise. Forty subjects were divided into the OMOTENASHI group working at inns considered to represent the spirit of hospitality, OMOTENASHI in Japan, and CONTROL group without experience in the hospitality industry. We presented neutral, happy, and angry faces to investigate P100 and N170 by these faces, and psychophysical changes by the favor rating test to evaluate emotional perception. In the favor rating test, the score was significantly smaller (less favorable) in OMOTENASHI than in CONTROL. Regarding event-related potential components, the maximum amplitude of P100 was significantly larger for a neutral face at the right occipital electrode in OMOTENASHI than in CONTROL, and it was significantly larger for an angry face at both occipital electrodes in OMOTENASHI than in CONTROL. However, the peak latency and maximum amplitude of N170 were not significantly different between OMOTENASHI and CONTROL at both temporal electrodes for each emotion condition. Differences on the favor rating test and P100 in OMOTENASHI suggested that workers at inns may more quickly notice and be more sensitive to the facial emotion of guests due to hospitality training, and/or that hospitality expertise may increase attention to emotion by top-down and/or bottom-up processing.

Effects of task load, spatial attention, and trait anxiety on neuronal responses to fearful and neutral faces

There is an ongoing debate on how different components of the event-related potential (ERP) to threat-related facial expressions are modulated by attentional conditions and interindividual differences in trait anxiety. In the current study (N = 80), we examined ERPs to centrally presented, task-irrelevant fearful and neutral faces, while participants had to solve a face-unrelated visual task, which differed in difficulty and spatial position. Critically, we used a fixation-controlled experimental design and ensured the spatial attention manipulation by spectral analysis of the EEG. Besides the factors emotion, spatial attention, and perceptual load, we also investigated correlations between trait anxiety and ERPs. While P1 emotion effects were insignificant, the N170 was increased to fearful faces regardless of load and spatial attention conditions. During the EPN time window, a significantly increased negativity for fearful faces was observed only during low load and spatial attention to the face. We found no significant relationship between ERPs and trait anxiety, questioning the hypothesis of a general hypersensitivity toward fearful expressions in anxious individuals. These results show a high resistance of the N170 amplitude increase for fearful faces to spatial attention and task load manipulations. By contrast, the EPN modulation by fearful faces index a resource-dependent stage of the ERP, requiring both spatial attention at the location of faces and low load of the face-irrelevant task.

Central nervous activity during an emotional Stroop task in fibromyalgia syndrome

Fibromyalgia syndrome (FMS) is a chronic condition of widespread pain accompanied by symptoms like depression, fatigue and cognitive impairments. In addition to central nervous pain sensitization, emotional dysregulation may be involved in FMS pathogenesis. This study investigated emotional influences on cognitive processing in FMS. Event-related potentials and theta oscillations were recorded during an emotional Stroop task including positive, negative, and neutral adjectives in 36 FMS patients and 35 controls. Patients had larger P3 amplitudes and greater theta power than controls, independent of the emotional word content. In patients, but not controls, negative words were associated with a larger late positive component (LPC) amplitude than positive words. No group difference was seen for P1, early posterior negativity or N4. Reaction times (RTs) were longer in patients than controls, independent of emotional word content. The P3 and theta oscillation findings suggest greater cognitive effort and attentional mobilization in FMS, which is needed to overcome the reduction of attentional resources resulting from central nervous pain sensitization. Although RTs do not support attentional bias in FMS, emotional modulation of the LPC amplitude may reflect preferential central nervous processing of negative information, which could contribute to pain and affective symptoms characterizing FMS. ACCESS TO RESEARCH DATA: The research data of the study are available to the public via the Open Science Framework repository (OSF: https://osf.io/tsyre/).

The mere sight of loved ones does not inhibit psychophysiological defense mechanisms when threatened

Looking at pictures of loved ones, such as one's romantic partner or good friends, has been shown to alleviate the experience of pain and reduce defensive reactions. However, little is known about such modulatory effects on threat and safety learning and the psychophysiological processes involved. Here, we explored the hypothesis that beloved faces serve as implicit safety cues and attenuate the expression of fear responses and/or accelerate extinction learning in a threatening context. Thirty-two participants viewed pictures of their loved ones (romantic partner, parents, and best friend) as well as of unknown individuals within contextual background colors indicating threat-of-shock or safety. Focusing on the extinction of non-reinforced threat associations (no shocks were given), the experiment was repeated on two more test days while the defensive startle-EMG, SCR, and threat ratings were obtained. Results confirmed pronounced defensive responding to instructed threat-of-shock relative to safety context (e.g., threat-enhanced startle reflex and SCR). Moreover, threat-potentiated startle response slowly declined across test days indicating passive extinction learning in the absence of shocks. Importantly, neither a main effect of face category (loved vs. unknown) nor a significant interaction with threat/safety instructions was observed. Thus, a long-term learning history of beneficial relations (e.g., with supportive parents) did not interfere with verbal threat learning and aversive apprehensions. These findings reflect the effects of worries and apprehensions that persist despite the repeated experience of safety and the pictorial presence of loved ones. How to counter such aversive expectations is key to changing mal-adaptive behaviors (e.g., avoidance or stockpiling), biased risk perceptions, and stereotypes.

Differences in cortical processing of facial emotions in broader autism phenotype

Autism Spectrum Disorder (ASD) is a heterogeneous condition that affects face perception. Evidence shows that there are differences in face perception associated with the processing of low spatial frequency (LSF) and high spatial frequency (HSF) of visual stimuli between non-symptomatic relatives of individuals with autism (broader autism phenotype, BAP) and typically developing individuals. However, the neural mechanisms involved in these differences are not fully understood. Here we tested whether face-sensitive event related potentials could serve as neuronal markers of differential spatial frequency processing, and whether these potentials could differentiate non-symptomatic parents of children with autism (pASD) from parents of typically developing children (pTD). To this end, we performed electroencephalographic recordings of both groups of parents while they had to recognize emotions of face pictures composed of the same or different emotions (happiness or anger) presented in different spatial frequencies. We found no significant differences in the accuracy between groups but lower amplitude modulation in the Late Positive Potential activity in pASD. Source analysis showed a difference in the right posterior part of the superior temporal region that correlated with ASD symptomatology of the child. These results reveal differences in brain processing of recognition of facial emotion in BAP that could be a precursor of ASD.

Effect of Cognitive Control on Age-Related Positivity Effects in Attentional Processing - Evidence From an Event-Related Brain Potential Study

Studies investigating age-related positivity effects during facial emotion processing have yielded contradictory results. The present study aimed to elucidate the mechanisms of cognitive control during attentional processing of emotional faces among older adults. We used go/no-go detection tasks combined with event-related potentials and source localization to examine the effects of response inhibition on age-related positivity effects. Data were obtained from 23 older and 23 younger healthy participants. Behavioral results showed that the discriminability index (d') of older adults on fear trials was significantly greater than that of younger adults [t(44)=2.37, p=0.024, Cohen's d=0.70], whereas an opposite pattern was found in happy trials [t(44)=2.56, p=0.014, Cohen's d=0.75]. The electroencephalography results on the amplitude of the N170 at the left electrode positions showed that the fear-neutral face pairs were larger than the happy-neutral ones for the younger adults [t(22)=2.32, p=0.030, Cohen's d=0.48]; the older group's right hemisphere presented similar tendency, although the results were not statistically significant [t(22)=1.97, p=0.061, Cohen's d=0.41]. Further, the brain activity of the two hemispheres in older adults showed asymmetrical decrement. Our study demonstrated that the age-related "positivity effect" was not observed owing to the depletion of available cognitive resources at the early attentional stage. Moreover, bilateral activation of the two hemispheres may be important signals of normal aging.

The role of phase and orientation for ERP modulations of spectrum-manipulated fearful and neutral faces

Prioritized processing of fearful compared to neutral faces has been proposed to result from evolutionary adaptation of the contrast sensitivity function (CSF) to the features of emotionally relevant faces and/or vice versa. However, it is unknown whether a stimulus merely has to feature the amplitude spectrum of a fearful face to be prioritized or whether the relevant spatial frequencies have to occur with specific phases and orientations. Prioritized processing is indexed by specific increases of Event-Related Potentials (ERPs) of the EEG and occurs throughout different early processing stages, indexed by emotion-related modulations of the P1, N170, and EPN. In this pre-registered study, we manipulated phase and amplitude properties of the Fourier spectra of neutral and fearful faces to test the effect of phase coherence (PC, face vs. scramble) and orientation coherence (OC, original vs. rotational average) and their interactions with differential emotion processing. We found that differential emotion processing was not present at the level of P1 but strongly affected N170 and EPN. In both cases, intact phase coherence was required for enhanced processing of fearful faces. OC did not interact with emotion. While faces produced the typical N170 effect, we observed a reversed effect for scrambles. Additional exploratory independent component analysis (ICA) suggests that this reversal could signal a mismatch between an early "perceptual hypothesis" and feedback of configural information. In line with our expectations, fearful-neutral differences for the N170 and EPN depend on configural information, i.e., recognizable faces.

Arithmetic performance is modulated by cognitive reappraisal and expression suppression: Evidence from behavioral and ERP findings

Previous studies have shown that negative emotional experiences are detrimental to individual's arithmetic performance, and no study has investigated whether such negative influence can be improved through emotional regulation. This study aimed to explore the relationship between emotion regulation and individual's performance in completing arithmetic problem verification task. Participants were asked to complete arithmetic problem verification task using the down-up strategy (e.g., doing 30 × 70 = 2100 for 34 × 67), under neutral, happy, and fear priming conditions, during which they were asked to regulate their emotional experience by using cognitive reappraisal or expressive suppression. Behavioral results showed that, under happy priming condition, cognitive reappraisal (but not expression suppression) contributed to improving individual's estimation speed. Additionally, under happy and fear priming conditions, cognitive reappraisal (vs. expression suppression) reduced individuals' emotional experience intensity. The arithmetic problem verification task-related ERP results showed that the P1 amplitudes elicited by using cognitive reappraisal (vs. freely view) were larger under happy and fear priming conditions, but the P1 amplitudes elicited by using expression suppression were larger only under happy condition. Meanwhile, the corresponding N170 amplitudes were smaller when using cognitive reappraisal and expression suppression (vs. freely view). Additionally, using cognitive reappraisal (vs. expression suppression) cost less cognitive resource (smaller LPC amplitudes). The present study indicated that both cognitive reappraisal and expression suppression contributed to improving individual's arithmetic performance, and the regulation effect of cognitive reappraisal was better than that of expression suppression.

Implicit happy and fear experience contributes to computational estimation strategy execution: Behavioral and neurophysiological evidence

Previous study have explored the influence of explicit emotion priming on computational estimation strategy execution, but the corresponding influence of implicit emotion priming still remains unknown. The present study aimed to solve this problem. Participants were asked to complete two-digit multiplication computational estimation task, under different implicit emotion priming conditions (gender judgment task). In the two-digit multiplication computational estimation task, the computational estimation question was presented in the middle of the screen, meanwhile, two alternative answers were presented side by side at the bottom of the screen, participants were required to select which answer is correct, by using the down-up strategy (e.g., doing 30 × 50 = 1500 for 34 × 46). Behavioral results showed that the response speed under implicit happy and fear (vs. neutral and angry) priming conditions was quicker, and the accuracy under different priming conditions showed no significant difference. The ERP results showed that the influence of implicit emotion priming on computational estimation strategy execution consisted of two phases: in the first phase, the N1 amplitudes elicited by completing the multiplication computational estimation task were smaller under implicit fear (vs. angry) priming condition; in the second phase, the corresponding P2 amplitudes under implicit happy (vs. fear) priming condition were smaller. The present study indicated that implicit happy and fear experience contributed to complete computational estimation tasks, suggesting that implicit negative emotional (e.g., fear) experience was not always detrimental to computational estimation strategy execution.

Data-point-wise spatiotemporal mapping of human ventral visual areas: Use of spatial frequency/luminance-modulated chromatic faces

Visual information involving facial identity and expression is crucial for social communication. Although the influence of facial features such as spatial frequency (SF) and luminance on face processing in visual areas has been studied extensively using grayscale stimuli, the combined effects of other features in this process have not been characterized. To determine the combined effects of different SFs and color, we created chromatic stimuli with low, high or no SF components, which bring distinct SF and color information into the ventral stream simultaneously. To obtain neural activity data with high spatiotemporal resolution we recorded face-selective responses (M170) using magnetoencephalography. We used a permutation test procedure with threshold-free cluster enhancement to assess statistical significance while resolving problems related to multiple comparisons and arbitrariness found in traditional statistical methods. We found that time windows with statistically significant threshold levels were distributed differently among the stimulus conditions. Face stimuli containing any SF components evoked M170 in the fusiform gyrus (FG), whereas a significant emotional effect on M170 was only observed with the original images. Low SF faces elicited larger activation of the FG and the inferior occipital gyrus than the original images, suggesting an interaction between low and high SF information processing. Interestingly, chromatic face stimuli without SF first activated color-selective regions and then the FG, indicating that facial color was processed according to a hierarchy in the ventral stream. These findings suggest complex effects of SFs in the presence of color information, reflected in M170, and unveil the detailed spatiotemporal dynamics of face processing in the human brain.

The early processing of fearful and happy facial expressions is independent of task demands - Support from mass univariate analyses

Most ERP studies on facial expressions of emotion have yielded inconsistent results regarding the time course of emotion effects and their possible modulation by task demands. Most studies have used classical statistical methods with a high likelihood of type I and type II errors, which can be limited with Mass Univariate statistics. FMUT and LIMO are currently the only two available toolboxes for Mass Univariate analysis of ERP data and use different fundamental statistics. Yet, no direct comparison of their output has been performed on the same dataset. Given the current push to transition to robust statistics to increase results replicability, here we compared the output of these toolboxes on data previously analyzed using classic approaches (Itier & Neath-Tavares, 2017). The early (0-352 ms) processing of fearful, happy, and neutral faces was investigated under three tasks in a within-subject design that also controlled gaze fixation location. Both toolboxes revealed main effects of emotion and task but neither yielded an interaction between the two, confirming the early processing of fear and happy expressions is largely independent of task demands. Both toolboxes found virtually no difference between neutral and happy expressions, while fearful (compared to neutral and happy) expressions modulated the N170 and EPN but elicited maximum effects after the N170 peak, around 190 ms. Similarities and differences in the spatial and temporal extent of these effects are discussed in comparison to the published classical analysis and the rest of the ERP literature.

Affective Face Processing Modified by Different Tastes

Facial emotional recognition is something used often in our daily lives. How does the brain process the face search? Can taste modify such a process? This study employed two tastes (sweet and acidic) to investigate the cross-modal interaction between taste and emotional face recognition. The behavior responses (reaction time and correct response ratios) and the event-related potential (ERP) were applied to analyze the interaction between taste and face processing. Behavior data showed that when detecting a negative target face with a positive face as a distractor, the participants perform the task faster with an acidic taste than with sweet. No interaction effect was observed with correct response ratio analysis. The early (P1, N170) and mid-stage [early posterior negativity (EPN)] components have shown that sweet and acidic tastes modified the ERP components with the affective face search process in the ERP results. No interaction effect was observed in the late-stage (LPP) component. Our data have extended the understanding of the cross-modal mechanism and provided electrophysiological evidence that affective facial processing could be influenced by sweet and acidic tastes.

Gender differences in subliminal affective face priming: A high-density ERP study

INTRODUCTION

Subliminal affective priming effects (SAPEs) refer to the phenomenon by which the presentation of an affective prime stimulus influences the subsequent affective evaluation of a target stimulus. Previous studies have reported that unconsciously processed stimuli affect behavioral performance more than consciously processed stimuli. However, the impact of SAPEs on the face-specific N170 component is unclear. We studied how SAPEs for fearful faces affected the N170 for subsequent supraliminal target faces using event-related potentials (ERPs).

METHODS

Japanese adults (n = 44, 20 females) participated in this study. Subliminal prime faces (neutral or fearful) were presented for 17 ms, followed by a backward mask for 283 ms and 800 ms target faces (neutral, emotionally ambiguous, or fearful). 128-channel ERPs were recorded while participants judged the expression of target faces as neutral or fearful. Response rates and response times were also measured for assessing behavioral alterations.

RESULTS

Although the behavioral results revealed no evidence of SAPEs, we found gender-related SAPEs in right N170 amplitude. Specifically, female participants exhibited enhanced right N170 amplitude for emotionally neutral faces primed by fearful faces, while male participants exhibited decreased N170 amplitude in fearful prime trials with fearful target faces. Male participants exhibited significant correlations between N170 amplitude and behavioral response time in the fearful prime-neutral target condition.

CONCLUSIONS

Our ERP results suggest the existence of a gender difference in target-face processing preceded by subliminally presented face stimuli in the right occipito-temporal region.

"She finds you abhorrent" - The impact of emotional context information on the cortical processing of neutral faces in depression

Depression is associated with abnormalities in patterns of information processing, particularly in the context of processing of interpersonal information. The present study was designed to investigate the differences in depressive individuals in cortical processing of facial stimuli when neutral faces were presented in a context that involved information about emotional valence as well as self-reference. In 21 depressive patients and 20 healthy controls, event-related potentials (ERPs) were recorded during the presentation of neutral facial expressions, which were accompanied by affective context information that was either self- or other-related. Across conditions, depressive patients showed larger mean P100 amplitudes than healthy controls. Furthermore, mean late positive potential (LPP) amplitudes of depressive patients were larger in response to faces in self-related than in other-related context. In addition, irrespective of self-reference, mean LPP responses of depressive patients to faces presented after socially threatening sentences were larger compared with faces presented after neutral sentences. Results regarding self-reference supported results of previous studies indicating larger mean amplitudes in self-related conditions. Findings suggest a general heightened initial responsiveness to emotional cues and a sustained emotion processing of socially threatening information in depressive patients.

Reduced early fearful face processing during perceptual distraction in high trait anxious participants

Fearful facial expressions are prioritized across different stages of information processing as reflected by early, mid-latency, and late components of event-related brain potentials (ERP). Trait anxiety has been proposed to modulate these responses, but it is yet unclear how such modulations depend on feature-based attention. In this preregistered study (N = 80), we investigated the effects of trait anxiety on ERP differences between fearful and neutral faces across three different tasks. Participants had to discriminate either the orientation of lines overlaid onto the faces, the gender of the face, or the emotional expression, thus increasing attention to emotionally relevant facial features across the tasks. Fearful versus neutral faces elicited increased P1 and N170 amplitudes across tasks and potentiated amplitudes when attention was directed to faces (early posterior negativity [EPN]) or the expression (EPN and late positive potential). Higher trait anxiety was related to smaller EPN differences between fearful and neutral faces during the perceptual discrimination task. This early relationship suggests reduced instead of amplified processing of fearful faces for high trait anxious participants under perceptual distraction.

Central nervous activity during implicit processing of emotional face expressions in fibromyalgia syndrome

OBJECTIVE

Fibromyalgia syndrome (FMS) is characterized by chronic widespread pain accompanied by symptoms like fatigue, insomnia, depression, anxiety and cognitive impairments. In addition to central nervous pain sensitization, emotional dysregulation may be involved in FMS pathogenesis. This study investigated central nervous correlates of affective and attentional processing in FMS using an implicit task.

METHODS

Event-related potentials (ERPs) of the EEG were recorded in 25 FMS patients and 37 healthy controls while they had to name the frame color of pictures displaying emotional expressions (angry, painful, happy, neutral). The actual picture had to be ingored. Symptoms of pain, depression and anxiety were also assessed.

RESULTS

Patients exhibited smaller P2 and late positive potential (LPP) amplitudes, and a greater N250 amplitude, than controls. The N250 amplitude varied according to the emotional expressions displayed in patients, but not in controls. No group differences arose for the P1 or N170 amplitudes. Patients had longer reaction times and made more errors on the task; task performance was more closely related to pain severity than to other symptoms.

CONCLUSION

The reduced P2 and LPP amplitudes indicate deficient short-term mobilization of attentional resources and sustained attention in FMS; the greater N250 amplitude may reflect greater engagement in the decoding of complex facial features, which is necessary to compensate for attentional impairments. Affective modulation of the N250 suggests that the neural mechanisms underlying complex visual processes are particularly susceptible to emotional influences in FMS. The behavioral data confirm attentional deficits in the disorder and implicate clinical pain therein.

Learning dynamics of electrophysiological brain signals during human fear conditioning

Electrophysiological studies in rodents allow recording neural activity during threats with high temporal and spatial precision. Although fMRI has helped translate insights about the anatomy of underlying brain circuits to humans, the temporal dynamics of neural fear processes remain opaque and require EEG. To date, studies on electrophysiological brain signals in humans have helped to elucidate underlying perceptual and attentional processes, but have widely ignored how fear memory traces evolve over time. The low signal-to-noise ratio of EEG demands aggregations across high numbers of trials, which will wash out transient neurobiological processes that are induced by learning and prone to habituation. Here, our goal was to unravel the plasticity and temporal emergence of EEG responses during fear conditioning. To this end, we developed a new sequential-set fear conditioning paradigm that comprises three successive acquisition and extinction phases, each with a novel CS+/CS- set. Each set consists of two different neutral faces on different background colors which serve as CS+ and CS-, respectively. Thereby, this design provides sufficient trials for EEG analyses while tripling the relative amount of trials that tap into more transient neurobiological processes. Consistent with prior studies on ERP components, data-driven topographic EEG analyses revealed that ERP amplitudes were potentiated during time periods from 33-60 ms, 108-200 ms, and 468-820 ms indicating that fear conditioning prioritizes early sensory processing in the brain, but also facilitates neural responding during later attentional and evaluative stages. Importantly, averaging across the three CS+/CS- sets allowed us to probe the temporal evolution of neural processes: Responses during each of the three time windows gradually increased from early to late fear conditioning, while long-latency (460-730 ms) electrocortical responses diminished throughout fear extinction. Our novel paradigm demonstrates how short-, mid-, and long-latency EEG responses change during fear conditioning and extinction, findings that enlighten the learning curve of neurophysiological responses to threat in humans.

Attentional conditions differentially affect early, intermediate and late neural responses to fearful and neutral faces

The processing of fearful facial expressions is prioritized by the human brain. This priority is maintained across various information processing stages as evident in early, intermediate and late components of event-related potentials (ERPs). However, emotional modulations are inconsistently reported for these different processing stages. In this pre-registered study, we investigated how feature-based attention differentially affects ERPs to fearful and neutral faces in 40 participants. The tasks required the participants to discriminate either the orientation of lines overlaid onto the face, the sex of the face or the face's emotional expression, increasing attention to emotion-related features. We found main effects of emotion for the N170, early posterior negativity (EPN) and late positive potential (LPP). While N170 emotional modulations were task-independent, interactions of emotion and task were observed for the EPN and LPP. While EPN emotion effects were found in the sex and emotion tasks, the LPP emotion effect was mainly driven by the emotion task. This study shows that early responses to fearful faces are task-independent (N170) and likely based on low-level and configural information while during later processing stages, attention to the face (EPN) or-more specifically-to the face's emotional expression (LPP) is crucial for reliable amplified processing of emotional faces.

Dual-Task Interference on Early and Late Stages of Facial Emotion Detection Is Revealed by Human Electrophysiology

Rapid and accurate processing of potential social threats is paramount to social thriving, and provides a clear evolutionary advantage. Though automatic processing of facial expressions has been assumed for some time, some researchers now question the extent to which this is the case. Here, we provide electrophysiological data from a psychological refractory period (PRP) dual-task paradigm in which participants had to decide whether a target face exhibited a neutral or fearful expression, as overlap with a concurrent auditory tone categorization task was experimentally manipulated. Specifically, we focused on four event-related potentials (ERP) linked to emotional face processing, covering distinct processing stages and topography: the early posterior negativity (EPN), early frontal positivity (EFP), late positive potential (LPP), and also the face-sensitive N170. As expected, there was an emotion modulation of each ERP. Most importantly, there was a significant attenuation of this emotional response proportional to the degree of task overlap for each component, except the N170. In fact, when the central overlap was greatest, this emotion-specific amplitude was statistically null for the EFP and LPP, and only marginally different from zero for the EPN. N170 emotion modulation was, on the other hand, unaffected by central overlap. Thus, our results show that emotion-specific ERPs for three out of four processing stages—i.e., perceptual encoding (EPN), emotion detection (EFP), or content evaluation (LPP)—are attenuated and even eliminated by central resource scarcity. Models assuming automatic processing should be revised to account for these results.

Task Demands Modulate Effects of Threatening Faces on Early Perceptual Encoding

The threat capture hypothesis states that threatening stimuli are automatically processed with higher priority than non-threatening stimuli, irrespective of observer intentions or focus of attention. We evaluated the threat capture hypothesis with respect to the early perceptual stages of face processing. We focused on an electrophysiological marker of face processing (the lateralized N170) in response to neutral, happy, and angry facial expressions displayed in competition with a non-face stimulus (a house). We evaluated how effects of facial expression on the lateralized N170 were modulated by task demands. In the pixel task, participants were required to identify the gender of the face, which made the face task-relevant and entailed structural encoding of the face stimulus. In the pixel task, participants identified the location of a missing pixel in the fixation cross, which made the face task-irrelevant and placed it outside the focus of attention. When faces were relevant, the lateralized N170 to angry faces was enhanced compared to happy and neutral faces. When faces were irrelevant, facial expression had no effect. These results reveal the critical role of task demands on the preference for threatening faces, indicating that top-down, voluntary processing modulates the prioritization of threat.

Reversing Threat to Safety: Incongruence of Facial Emotions and Instructed Threat Modulates Conscious Perception but Not Physiological Responding

Facial expressions inform about other peoples’ emotion and motivation and thus are central for social communication. However, the meaning of facial expressions may change depending on what we have learned about the related consequences. For instance, a smile might easily become threatening when displayed by a person who is known to be dangerous. The present study examined the malleability of emotional facial valence by means of social learning. To this end, facial expressions served as cues for verbally instructed threat-of-shock or safety (e.g., “happy faces cue shocks”). Moreover, reversal instructions tested the flexibility of threat/safety associations (e.g., “now happy faces cue safety”). Throughout the experiment, happy, neutral, and angry facial expressions were presented and auditory startle probes elicited defensive reflex activity. Results show that self-reported ratings and physiological reactions to threat/safety cues dissociate. Regarding threat and valence ratings, happy facial expressions tended to be more resistant becoming a threat cue, and angry faces remain threatening even when instructed as safety cue. For physiological response systems, however, we observed threat-potentiated startle reflex and enhanced skin conductance responses for threat compared to safety cues regardless of whether threat was cued by happy or angry faces. Thus, the incongruity of visual and verbal threat/safety information modulates conscious perception, but not the activation of physiological response systems. These results show that verbal instructions can readily overwrite the intrinsic meaning of facial emotions, with clear benefits for social communication as learning and anticipation of threat and safety readjusted to accurately track environmental changes.